-- Logs begin at Fri 2022-10-28 18:24:58 UTC, end at Fri 2022-10-28 20:52:42 UTC. -- Oct 28 18:56:44.633049 n-d-862769-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 18:56:44.640610 n-d-862769-3 devstack@n-api.service[104761]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 18:56:44 2022] *** Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: nodename: n-d-862769-3 Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: machine: x86_64 Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: clock source: unix Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: pcre jit disabled Oct 28 18:56:44.642598 n-d-862769-3 devstack@n-api.service[104761]: detected number of CPU cores: 4 Oct 28 18:56:44.643110 n-d-862769-3 devstack@n-api.service[104761]: current working directory: / Oct 28 18:56:44.643110 n-d-862769-3 devstack@n-api.service[104761]: detected binary path: /usr/bin/uwsgi-core Oct 28 18:56:44.643110 n-d-862769-3 devstack@n-api.service[104761]: your processes number limit is 47680 Oct 28 18:56:44.643110 n-d-862769-3 devstack@n-api.service[104761]: your memory page size is 4096 bytes Oct 28 18:56:44.643110 n-d-862769-3 devstack@n-api.service[104761]: detected max file descriptor number: 2048 Oct 28 18:56:44.643110 n-d-862769-3 devstack@n-api.service[104761]: lock engine: pthread robust mutexes Oct 28 18:56:44.644283 n-d-862769-3 devstack@n-api.service[104761]: thunder lock: enabled Oct 28 18:56:44.644283 n-d-862769-3 devstack@n-api.service[104761]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 18:56:44.644283 n-d-862769-3 devstack@n-api.service[104761]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 18:56:44.682928 n-d-862769-3 devstack@n-api.service[104761]: Python main interpreter initialized at 0x55987659b9c0 Oct 28 18:56:44.682928 n-d-862769-3 devstack@n-api.service[104761]: python threads support enabled Oct 28 18:56:44.682928 n-d-862769-3 devstack@n-api.service[104761]: your server socket listen backlog is limited to 100 connections Oct 28 18:56:44.682928 n-d-862769-3 devstack@n-api.service[104761]: your mercy for graceful operations on workers is 90 seconds Oct 28 18:56:44.683298 n-d-862769-3 devstack@n-api.service[104761]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 18:56:44.683298 n-d-862769-3 devstack@n-api.service[104761]: *** Operational MODE: preforking *** Oct 28 18:56:44.683579 n-d-862769-3 devstack@n-api.service[104761]: *** uWSGI is running in multiple interpreter mode *** Oct 28 18:56:44.683579 n-d-862769-3 devstack@n-api.service[104761]: spawned uWSGI master process (pid: 104761) Oct 28 18:56:44.683814 n-d-862769-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 18:56:44.684356 n-d-862769-3 devstack@n-api.service[104761]: spawned uWSGI worker 1 (pid: 104762, cores: 1) Oct 28 18:56:44.684650 n-d-862769-3 devstack@n-api.service[104761]: spawned uWSGI worker 2 (pid: 104763, cores: 1) Oct 28 18:56:44.684795 n-d-862769-3 devstack@n-api.service[104761]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 18:56:45.326945 n-d-862769-3 devstack@n-api.service[104763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 18:56:45.327567 n-d-862769-3 devstack@n-api.service[104762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 18:56:46.384018 n-d-862769-3 devstack@n-api.service[104762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:56:46.384018 n-d-862769-3 devstack@n-api.service[104762]: from cryptography.utils import int_from_bytes Oct 28 18:56:46.385751 n-d-862769-3 devstack@n-api.service[104762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:56:46.385751 n-d-862769-3 devstack@n-api.service[104762]: from cryptography.utils import int_from_bytes Oct 28 18:56:46.386899 n-d-862769-3 devstack@n-api.service[104763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:56:46.386899 n-d-862769-3 devstack@n-api.service[104763]: from cryptography.utils import int_from_bytes Oct 28 18:56:46.387359 n-d-862769-3 devstack@n-api.service[104763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:56:46.387359 n-d-862769-3 devstack@n-api.service[104763]: from cryptography.utils import int_from_bytes Oct 28 18:56:48.849076 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 18:56:48.849672 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 18:56:48.849767 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 18:56:48.850125 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 18:56:48.850201 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 18:56:48.850272 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 18:56:48.850424 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 18:56:48.850525 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 18:56:48.850806 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.850954 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 18:56:48.851088 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 18:56:48.851175 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.851417 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.851559 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.851701 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.851791 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852043 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852187 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852318 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852405 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852646 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852788 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.852955 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853104 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853238 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853332 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853525 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853666 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853839 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.853969 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.854104 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.854199 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.854432 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.854561 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.854756 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.854885 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855005 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855124 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855324 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855522 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855674 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855812 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.855934 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.856052 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.856172 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.856299 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.856543 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.856716 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.856853 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.857858 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858012 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858151 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858270 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858395 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858516 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858635 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858805 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.858935 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859064 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859194 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859323 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859443 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859574 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859695 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859821 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.859940 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860058 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860175 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860302 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860430 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860541 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860667 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860799 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.860919 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861041 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861166 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861295 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861426 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861545 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861758 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.861939 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.862067 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.862270 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.862469 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.862603 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.862771 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.862897 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863018 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863144 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863264 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863488 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863681 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863822 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.863947 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864066 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864185 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864377 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864569 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864718 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864843 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.864963 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865082 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865210 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865332 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865534 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865722 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865864 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.865995 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866133 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866253 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866382 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866515 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866637 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866797 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.866939 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867068 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867214 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867341 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867465 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867597 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867719 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867858 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.867982 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.868101 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.868303 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.868571 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.868715 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.868841 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.868962 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869088 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869222 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869351 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869472 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869589 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869706 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869833 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.869987 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.870129 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.870285 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.870416 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.870604 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.870831 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.870989 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871114 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871235 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871353 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871482 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871613 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871830 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.871963 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.872130 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.872251 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.872370 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.872496 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.872701 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.872878 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873021 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873147 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873275 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873411 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873608 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873786 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.873928 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.874067 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.874191 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.874326 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.874449 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.874567 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.874805 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875004 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875151 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875278 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875398 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875524 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875652 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.875773 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876070 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876244 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876387 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876511 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876632 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876750 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.876889 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877011 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877132 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877250 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877469 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877661 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877806 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.877931 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878051 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878173 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878291 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878423 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878580 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878769 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.878893 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879011 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879206 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879403 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879536 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879666 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879789 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.879908 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880034 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880159 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880352 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880527 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880674 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880799 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.880919 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.881049 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.881181 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.881345 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.881470 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.881590 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.881784 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882078 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882078 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882327 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882327 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882608 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882783 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.882910 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883038 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883159 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883285 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883407 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883535 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883668 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883797 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.883918 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884079 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884211 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884413 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884605 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884739 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884860 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.884971 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885097 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885252 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885391 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885567 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885692 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885842 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.885973 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.886160 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.886286 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.886457 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.886590 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.886762 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.886899 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887060 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887186 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887362 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887486 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887661 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887798 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.887928 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888052 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888228 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888356 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888525 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888651 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888779 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.888899 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889090 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889228 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889360 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889491 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889651 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889789 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.889940 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890066 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890246 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890381 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890532 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890655 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890866 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.890992 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.891159 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.891299 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.891471 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.891661 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.891785 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.891913 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.892130 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:56:48.892273 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.892408 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.892533 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.892726 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.892854 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893041 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893175 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893357 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893488 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893662 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893785 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.893985 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894107 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894226 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894351 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894551 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894677 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894859 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.894982 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.895167 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.895293 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.895476 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.895617 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.895747 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.895867 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896069 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896216 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896346 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896465 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896674 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896801 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.896978 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.897105 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.897281 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.897417 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.897577 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.897704 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.897892 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898016 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898196 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898332 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898503 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898627 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898830 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.898957 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.899144 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.899287 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.899438 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.899564 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.899770 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.899895 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900086 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900222 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900397 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900524 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900704 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900836 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.900992 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.901127 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.901295 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.901430 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.901596 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.901725 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.901899 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902023 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902236 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902375 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902496 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902614 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902837 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.902962 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.903143 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.903266 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.903450 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.903571 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.903750 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.903875 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904053 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904174 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904356 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904479 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904657 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904780 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.904960 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.905081 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.905263 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.905400 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.905574 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.905695 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.905885 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906005 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906186 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906316 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906495 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906623 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906821 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.906952 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.907185 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.907315 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.907499 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.907623 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.907796 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.907916 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908092 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908228 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908386 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908509 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908681 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908804 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.908975 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.909112 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.909273 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.909406 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.909574 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.909708 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.909878 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910000 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910193 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910322 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910488 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910609 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910818 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.910944 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.911123 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.911248 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.911422 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.911544 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.911720 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.911845 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912017 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912139 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912345 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912485 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912616 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912735 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.912902 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913029 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913198 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913331 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913498 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913619 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913803 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.913924 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.914097 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.914231 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.914395 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.914517 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.914788 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.914916 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915035 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915172 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915301 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915420 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915595 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915718 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.915914 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916038 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916190 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916320 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916490 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916610 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916788 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.916920 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.917092 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.917222 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.917399 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.917521 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.917703 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.917824 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.918021 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.918143 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.918324 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.918832 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919023 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919146 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919320 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919441 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919620 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919757 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.919915 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920037 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920210 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920332 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920503 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920642 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920800 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.920921 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921092 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921213 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921388 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921518 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921681 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921810 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.921973 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.922101 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.922266 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.922414 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.922601 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.922771 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.922893 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923011 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923192 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923316 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923491 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923613 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923787 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.923907 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.924086 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.924211 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.924386 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.924507 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.924713 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.924834 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925010 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925132 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925329 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925450 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925641 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925763 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.925945 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926069 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926249 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926370 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926549 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926680 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926873 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.926996 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.927174 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.927295 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.927473 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.927609 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.927774 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.927895 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928074 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928203 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928381 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928514 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928682 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928805 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.928988 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.929121 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.929285 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.929418 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.929593 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.929716 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.929887 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930009 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930193 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930328 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930494 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930616 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930827 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.930951 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.931141 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.931264 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.931451 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.931573 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.931749 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.931873 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932051 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932177 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932348 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932470 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932666 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932796 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.932925 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933045 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933224 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933346 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933523 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933645 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933821 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.933944 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.934127 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.934258 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.934423 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.934544 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.934753 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.934881 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935053 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935177 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935358 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935483 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935652 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935785 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.935956 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936078 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936249 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936378 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936555 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936679 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936866 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.936987 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.937167 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.937300 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.937480 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.937600 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.937779 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.937904 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.938075 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.938206 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.938426 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.938553 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.938752 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.938877 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939052 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939178 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939351 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939470 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939650 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939782 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.939948 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940071 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940247 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940368 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940542 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940663 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940847 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.940969 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.941144 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.941264 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.941442 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.941571 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.941736 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.941867 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942034 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942156 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942331 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942462 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942630 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942836 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.942960 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943078 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943268 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943401 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943569 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943704 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943864 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.943986 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.944177 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.944377 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.944507 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.944627 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.944752 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.944873 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945041 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945177 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945336 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945458 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945668 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945792 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.945962 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946095 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946253 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946386 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946560 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946737 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946874 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.946995 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.947185 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.947314 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.947488 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.947610 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.947791 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.947914 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948091 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948211 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948394 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948516 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948697 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948819 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.948996 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.949125 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.949303 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.949434 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.949603 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.949726 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.949903 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950024 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950203 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950332 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950510 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950632 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950832 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.950953 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.951135 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.951270 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.951437 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.951559 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.951730 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.951850 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.952028 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.952192 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.952314 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.952432 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.952613 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.952881 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.953023 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.953198 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.953465 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.953588 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.953794 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.953917 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.954132 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.954256 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.954446 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.954583 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.954788 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.954920 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.955105 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.955237 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.955405 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.955536 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.955704 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.955827 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956005 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956129 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956301 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956425 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956596 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956718 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.956892 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957012 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957187 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957308 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957481 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957611 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957775 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.957899 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.958072 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.958204 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.958365 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.958486 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.958662 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959013 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959132 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959237 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959339 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959441 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959560 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959687 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959835 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.959958 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.960137 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.960260 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.960431 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.960566 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.960733 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.960854 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961030 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961152 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961325 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961462 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961617 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961740 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.961910 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.962035 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.962205 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.962341 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.962503 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.962633 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.962862 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963062 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963204 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963331 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963475 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963606 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963789 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.963910 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964085 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964210 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964396 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964518 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964689 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964823 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.964982 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965106 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965275 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965397 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965572 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965693 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965866 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.965997 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.966159 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.966291 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.966460 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.966591 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.966779 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.966912 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967080 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967202 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967379 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967581 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967717 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967837 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.967955 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968081 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968230 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968363 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968536 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968666 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968831 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.968953 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.969120 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.969249 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.969410 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.969532 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.969785 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.969907 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970085 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970209 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970376 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970498 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970677 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970835 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.970992 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.971123 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.971297 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.971418 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.971589 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.971710 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.971883 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972007 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972163 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972284 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972460 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972583 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972755 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.972877 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973122 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973260 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973384 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973512 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973634 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973762 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.973925 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974046 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974219 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974350 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974515 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974645 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974833 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.974955 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.975129 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.975266 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.975426 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.975547 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.975725 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.975840 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976029 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976160 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976321 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976442 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976623 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976747 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.976919 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977046 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977214 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977336 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977509 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977632 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977806 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.977929 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978096 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978216 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978390 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978512 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978684 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978856 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.978999 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.979120 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.979294 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.979415 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.979594 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.979720 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.979890 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980011 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980184 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980316 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980481 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980611 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980773 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.980897 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981069 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981199 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981359 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981480 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981689 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981812 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.981987 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.982123 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.982299 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.982450 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.982609 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.982747 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.982937 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983076 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983275 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983415 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983537 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983655 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983831 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.983953 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.984157 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.984283 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.984436 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.984566 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.984739 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.984860 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985033 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985156 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985355 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985486 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985673 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985805 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.985971 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.986092 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.986271 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.986391 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.986581 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.986734 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.986913 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987047 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987225 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987354 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987521 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987645 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987821 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.987945 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.988119 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.988281 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.988403 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.988520 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.988704 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.988827 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989004 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989139 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989301 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989430 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989601 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989732 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.989903 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990035 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990204 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990326 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990508 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990629 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990827 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.990960 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.991130 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.991252 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.991428 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.991550 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.991723 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.991899 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992019 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992136 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992308 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992431 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992609 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992731 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.992909 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993030 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993203 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993338 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993537 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993670 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993797 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.993924 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.994081 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.994204 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.994382 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.994506 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.994790 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.994928 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995092 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995295 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995426 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995546 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995672 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995792 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.995969 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.996094 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.996270 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.996392 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.996561 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.996682 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.996876 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997010 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997174 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997299 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997536 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997657 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997834 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.997966 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.998131 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.998254 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.998423 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.998547 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.998741 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.998869 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999043 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999164 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999339 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999459 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999635 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999759 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:48.999925 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000048 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000220 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000341 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000520 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000650 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000850 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.000976 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.001175 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.001302 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.001492 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.001616 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.001886 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.002007 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.002190 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.002320 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.002489 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.002612 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.002886 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003011 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003200 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003351 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003575 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003715 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003837 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.003954 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.004106 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.004237 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.004411 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.004542 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.004711 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.004833 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005019 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005141 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005323 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005528 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005661 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005781 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.005900 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006019 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006192 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006324 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006500 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006630 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006835 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.006958 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.007145 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.007277 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.007459 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.007579 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.007769 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.007892 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.008087 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.008213 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.008443 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.008563 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.008756 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.008884 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009069 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009193 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009364 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009486 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009657 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009779 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.009957 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010081 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010252 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010374 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010546 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010682 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010868 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.010990 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.011169 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.011290 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.011468 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.011604 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.011767 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.011892 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012067 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012188 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012361 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012493 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012657 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012787 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.012953 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.013074 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.013252 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.013384 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.013568 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.013773 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.013899 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014017 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014147 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014269 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014457 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014580 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014771 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.014894 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015084 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015216 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015382 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015511 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015676 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015799 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.015971 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.016095 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.016266 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.016389 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.016586 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.016710 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.016883 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017019 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017203 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017351 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017539 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017686 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017855 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.017980 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.018154 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.018276 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.018478 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.018611 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.018806 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.018923 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.019116 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.019237 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.019418 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.019550 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.019728 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.019854 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020035 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020157 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020328 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020452 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020623 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020754 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.020923 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021045 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021219 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021343 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021512 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021648 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021807 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.021931 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.022106 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.022229 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.022399 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.022528 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.022724 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.022854 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023011 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023150 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023310 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023432 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023608 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023753 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.023943 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024074 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024196 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024315 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024486 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024619 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024780 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.024903 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025073 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025196 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025369 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025499 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025668 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025799 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.025988 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.026110 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.026288 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.026420 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.026601 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.026741 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.026928 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027052 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027234 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027357 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027541 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027672 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027845 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.027975 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.028149 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.028274 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.028454 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.028578 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.028758 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.028880 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029056 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029181 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029360 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029480 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029661 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029783 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.029964 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.030094 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.030275 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.030480 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.030602 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.030825 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.031116 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.031242 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.031426 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.031549 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.031729 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.031860 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.032032 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.032200 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.032388 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.032509 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.032699 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.032831 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033109 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033250 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033383 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033505 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033625 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033820 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.033965 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034127 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034250 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034369 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034497 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034618 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034819 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.034943 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.035130 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.035251 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.035440 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.035566 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.035745 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.035867 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036051 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036185 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036359 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036477 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036668 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036792 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.036969 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.037098 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.037272 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.037395 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.037579 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.037695 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.037885 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038009 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038185 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038307 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038482 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038605 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038808 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.038937 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.039116 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.039239 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.039418 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.039540 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.039719 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.039847 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040022 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040143 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040321 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040451 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040627 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040749 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.040936 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041060 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041249 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041379 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041552 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041675 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041858 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.041979 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.042166 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.042297 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.042472 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.042673 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.042825 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.043001 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.043332 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.043829 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044003 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044125 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044314 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044435 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044620 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044745 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.044926 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045049 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045240 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045361 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045536 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045666 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045833 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.045959 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.046135 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.046257 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.046436 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.046563 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.046754 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.046880 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047059 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047195 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047357 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047478 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047654 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047789 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.047987 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.048120 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.048286 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.048409 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.048602 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.048801 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.048925 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.049138 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.049415 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.049538 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.049748 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.049869 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050056 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050191 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050364 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050484 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050661 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050801 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.050998 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.051132 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.051297 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.051421 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.051591 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.051715 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.051896 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052021 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052193 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052323 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052485 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052607 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052780 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.052904 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053077 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053199 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053393 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053524 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053665 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053792 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.053945 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054069 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054237 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054369 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054537 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054659 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054859 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.054980 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.055153 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.055288 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.055445 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.055568 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.055745 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.055874 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056037 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056168 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056331 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056456 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056625 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056754 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.056918 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057049 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057214 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057335 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057504 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057634 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057802 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.057919 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.058094 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.058216 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.058394 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.058516 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.058709 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.058835 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059016 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059138 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059319 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059439 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059630 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059763 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.059924 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060047 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060215 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060338 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060520 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060645 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060815 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.060936 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.061123 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.061256 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.061422 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.061536 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.061721 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.061844 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.062023 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.062221 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.062346 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.062465 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.062653 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.062892 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.063016 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.063209 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.063554 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.063687 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.063881 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064004 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064197 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064331 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064516 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064647 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064814 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.064939 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.065111 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.065235 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.065409 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.065541 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.065709 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.065833 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066010 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066140 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066310 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066433 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066610 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066749 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.066937 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067063 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067239 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067362 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067541 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067662 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067841 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.067965 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.068140 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.068262 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.068437 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.068574 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.068736 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.068861 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069036 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069157 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069334 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069464 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069633 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069756 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.069934 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.070065 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.070242 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.070375 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.070552 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.070674 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.070898 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071021 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071208 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071332 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071515 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071638 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071820 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.071942 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.072147 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.072308 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.072450 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.072573 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.072752 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.072874 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073055 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073180 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073359 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073481 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073678 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073809 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.073937 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.074058 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.074271 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.074570 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.074716 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.074920 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.075232 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.075363 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.075546 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.075675 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.075848 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.075984 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.076164 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.076287 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.076467 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.076588 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.076772 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.076888 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.077085 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.077221 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.077389 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.077511 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.077705 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.077830 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078014 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078130 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078335 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078457 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078651 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078822 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.078999 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.079123 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.079297 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.079433 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.079594 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.079716 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.079895 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080017 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080195 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080327 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080494 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080618 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080789 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.080911 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081084 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081215 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081378 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081532 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081653 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081772 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.081948 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082086 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082242 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082374 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082530 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082659 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082848 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.082973 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.083141 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.083263 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.083440 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.083560 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.083772 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.083902 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084023 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084142 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084288 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084409 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084580 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084706 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084873 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.084995 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.085164 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.085286 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.085457 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.085582 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.085749 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.085873 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086043 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086182 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086335 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086459 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086629 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086796 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.086950 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.087086 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.087276 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.087400 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.087588 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.087710 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.087888 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088025 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088199 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088321 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088497 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088617 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088808 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.088938 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.089109 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.089232 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.089411 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.089532 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.089713 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.089838 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090018 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090139 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090316 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090445 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090641 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090830 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.090934 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.091023 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.091229 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.091340 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.091527 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.091649 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.091838 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.092084 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.092175 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.092407 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.092497 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.092726 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.092813 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093027 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093119 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093327 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093416 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093649 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093737 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.093958 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.094045 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.094264 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.094354 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.094585 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.094752 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.094950 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095052 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095276 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095374 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095582 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095670 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095887 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.095983 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.096190 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.096278 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.096492 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.096586 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.096796 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.096896 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.097101 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.097208 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.097400 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.097490 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.097704 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.097794 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098011 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098098 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098321 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098428 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098630 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098751 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.098957 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.099045 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.099324 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.099429 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.099590 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.099696 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.099908 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100018 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100213 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100308 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100542 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100630 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100856 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.100951 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101161 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101258 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101465 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101561 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101774 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101863 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.101998 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 18:56:49.102096 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:56:49.102281 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 18:56:49.257646 n-d-862769-3 devstack@n-api.service[104762]: INFO dbcounter [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Registered counter for database nova_api Oct 28 18:56:49.257840 n-d-862769-3 devstack@n-api.service[104763]: INFO dbcounter [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Registered counter for database nova_api Oct 28 18:56:49.279068 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.282270 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_db.sqlalchemy.engines [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.286481 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writer thread running {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.289325 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writer thread running {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.342437 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.context [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=104763) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 18:56:49.345926 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.context [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=104762) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 18:56:49.346354 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:49.346856 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:49.348434 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:49.349135 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:49.349644 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:49.349783 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_concurrency.lockutils [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:49.350272 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_concurrency.lockutils [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:49.351583 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:49.351949 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_concurrency.lockutils [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:49.352658 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_concurrency.lockutils [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:49.353103 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_concurrency.lockutils [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:49.353568 n-d-862769-3 devstack@n-api.service[104763]: INFO dbcounter [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Registered counter for database nova_cell0 Oct 28 18:56:49.355080 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_concurrency.lockutils [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:49.357172 n-d-862769-3 devstack@n-api.service[104762]: INFO dbcounter [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Registered counter for database nova_cell0 Oct 28 18:56:49.357648 n-d-862769-3 devstack@n-api.service[104763]: INFO dbcounter [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Registered counter for database nova_cell1 Oct 28 18:56:49.364695 n-d-862769-3 devstack@n-api.service[104762]: INFO dbcounter [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Registered counter for database nova_cell1 Oct 28 18:56:49.366466 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.367279 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.368922 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_db.sqlalchemy.engines [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.372002 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writer thread running {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.372515 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_db.sqlalchemy.engines [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.374546 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writer thread running {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.509406 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writer thread running {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.513134 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writer thread running {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.518248 n-d-862769-3 devstack@n-api.service[104763]: INFO dbcounter [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Registered counter for database nova_cell0 Oct 28 18:56:49.522223 n-d-862769-3 devstack@n-api.service[104762]: INFO dbcounter [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Registered counter for database nova_cell0 Oct 28 18:56:49.525708 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.530732 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writer thread running {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.531361 n-d-862769-3 devstack@n-api.service[104762]: DEBUG oslo_db.sqlalchemy.engines [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:56:49.536667 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writer thread running {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:56:49.861445 n-d-862769-3 devstack@n-api.service[104763]: WARNING keystonemiddleware.auth_token [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:56:49.864502 n-d-862769-3 devstack@n-api.service[104762]: WARNING keystonemiddleware.auth_token [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:56:49.868677 n-d-862769-3 devstack@n-api.service[104763]: WARNING keystonemiddleware.auth_token [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:56:49.871717 n-d-862769-3 devstack@n-api.service[104762]: WARNING keystonemiddleware.auth_token [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:56:50.212483 n-d-862769-3 devstack@n-api.service[104763]: WARNING keystonemiddleware.auth_token [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:56:50.218413 n-d-862769-3 devstack@n-api.service[104763]: WARNING keystonemiddleware.auth_token [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:56:50.223800 n-d-862769-3 devstack@n-api.service[104763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55987659b9c0 pid: 104763 (default app) Oct 28 18:56:50.225162 n-d-862769-3 devstack@n-api.service[104762]: WARNING keystonemiddleware.auth_token [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:56:50.225884 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:50.227118 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Oct 28 18:56:50.227516 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Fri Oct 28 18:56:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:50.230587 n-d-862769-3 devstack@n-api.service[104762]: WARNING keystonemiddleware.auth_token [None req-7b65ba90-8087-42fc-a31c-c403c38ee4c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:56:50.236032 n-d-862769-3 devstack@n-api.service[104762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55987659b9c0 pid: 104762 (default app) Oct 28 18:58:11.695856 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:11.696825 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 28 18:58:11.697414 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:11.709463 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_api:SELECT=3 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:11.710583 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_cell0:SELECT=3 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:11.711405 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_cell1:SELECT=3 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:11.712377 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:12.596403 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-6649f27f-a1d4-4d41-8331-47bd11c61931 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:12.629580 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-6649f27f-a1d4-4d41-8331-47bd11c61931 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925272 Oct 28 18:58:12.630344 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 18:58:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:15.204453 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:15.205478 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-0cc966df-8785-4a3a-ba6b-a07a27c054ac None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 28 18:58:15.206983 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:15.655887 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e87528d4-6d56-42bb-b86f-198fa243c064 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:15.704415 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-e87528d4-6d56-42bb-b86f-198fa243c064 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492500 Oct 28 18:58:15.704990 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:15.719014 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_api:SELECT=3 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:15.719801 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_cell1:SELECT=3 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:15.722168 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_cell0:SELECT=3 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:15.722415 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:15.931341 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-694c82a1-28f4-42aa-abd9-803e84ea27b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:16.001862 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-694c82a1-28f4-42aa-abd9-803e84ea27b8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287527 Oct 28 18:58:16.001862 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1336 bytes} [Fri Oct 28 18:58:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:18.620325 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e87528d4-6d56-42bb-b86f-198fa243c064 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:18.621389 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-e87528d4-6d56-42bb-b86f-198fa243c064 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Oct 28 18:58:18.622007 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:19.421747 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-5e354884-7120-4a18-9dc9-92d22e7796aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:19.470270 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-5e354884-7120-4a18-9dc9-92d22e7796aa admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.841581 Oct 28 18:58:19.471568 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:19.487122 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-6a974780-1db8-49b1-9dfa-87dfe3943959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:19.543864 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-6a974780-1db8-49b1-9dfa-87dfe3943959 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060297 Oct 28 18:58:19.545039 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1336 bytes} [Fri Oct 28 18:58:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:22.418361 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-5e354884-7120-4a18-9dc9-92d22e7796aa admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:22.419429 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-5e354884-7120-4a18-9dc9-92d22e7796aa admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Oct 28 18:58:22.430569 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:22 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:22.895801 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e124182b-bb90-4fe5-9992-d41a32c4dc3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:22.916049 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-e124182b-bb90-4fe5-9992-d41a32c4dc3a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489798 Oct 28 18:58:22.917225 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:22.930072 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-87c06441-eb62-4bd6-9352-ee1b9e7729ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:22.960423 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-87c06441-eb62-4bd6-9352-ee1b9e7729ce admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034290 Oct 28 18:58:22.961014 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1336 bytes} [Fri Oct 28 18:58:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:25.545119 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e124182b-bb90-4fe5-9992-d41a32c4dc3a admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:25.546141 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-e124182b-bb90-4fe5-9992-d41a32c4dc3a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 28 18:58:25.546544 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:26.017644 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-236a3e8d-b639-4a1b-8aeb-3b63930f088c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:26.043494 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-236a3e8d-b639-4a1b-8aeb-3b63930f088c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490665 Oct 28 18:58:26.044717 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:26.056547 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-a5206a62-7f07-4f81-8c50-37101ccbd4c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:26.097388 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-a5206a62-7f07-4f81-8c50-37101ccbd4c2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044577 Oct 28 18:58:26.098431 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1336 bytes} [Fri Oct 28 18:58:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:28.756928 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-236a3e8d-b639-4a1b-8aeb-3b63930f088c admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:28.758600 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-236a3e8d-b639-4a1b-8aeb-3b63930f088c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 Oct 28 18:58:28.764159 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:29.185105 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-885c5b83-8b57-44de-9525-75e603c16aac admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "disk": 20, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:29.206381 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-885c5b83-8b57-44de-9525-75e603c16aac admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441229 Oct 28 18:58:29.210994 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:58:29.223575 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-801dd951-aef1-47ba-8f8d-5fda002f336e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:29.254138 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-801dd951-aef1-47ba-8f8d-5fda002f336e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038366 Oct 28 18:58:29.255209 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1336 bytes} [Fri Oct 28 18:58:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:31.915683 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-885c5b83-8b57-44de-9525-75e603c16aac admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:31.917104 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-885c5b83-8b57-44de-9525-75e603c16aac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Oct 28 18:58:31.917497 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:32.353713 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-a83004a8-d0a1-4a09-81db-9c6d7428b305 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:32.379896 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-a83004a8-d0a1-4a09-81db-9c6d7428b305 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454794 Oct 28 18:58:32.380455 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 18:58:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:58:35.304769 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-885c5b83-8b57-44de-9525-75e603c16aac admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:35.305905 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-885c5b83-8b57-44de-9525-75e603c16aac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Oct 28 18:58:35.306376 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:35.781553 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-01788d46-1849-42d1-bc82-eb37ca9497a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "disk": 1, "id": "1"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:35.805380 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-01788d46-1849-42d1-bc82-eb37ca9497a9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.492111 Oct 28 18:58:35.805975 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:35.819582 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-71431ed0-ff52-4573-887c-235527b99a4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:35.849750 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-71431ed0-ff52-4573-887c-235527b99a4e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034096 Oct 28 18:58:35.850367 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1333 bytes} [Fri Oct 28 18:58:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:38.689750 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-01788d46-1849-42d1-bc82-eb37ca9497a9 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:38.690786 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-01788d46-1849-42d1-bc82-eb37ca9497a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 28 18:58:38.691189 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:39.095137 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-fbcc0a4b-847e-4bba-ae1d-53d5e5128889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "swap": 0, "id": "2", "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:39.114229 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-fbcc0a4b-847e-4bba-ae1d-53d5e5128889 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416990 Oct 28 18:58:39.114835 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:39.127959 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-47245d09-6a1c-4d97-926e-a6e9e6f3dc30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:39.153062 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-47245d09-6a1c-4d97-926e-a6e9e6f3dc30 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029615 Oct 28 18:58:39.153654 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1333 bytes} [Fri Oct 28 18:58:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:41.735499 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-fbcc0a4b-847e-4bba-ae1d-53d5e5128889 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:41.736538 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-fbcc0a4b-847e-4bba-ae1d-53d5e5128889 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 28 18:58:41.737491 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:42.151510 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-d536807b-a84f-49dc-abfe-b54fa2f7be47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "swap": 0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:42.175533 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-d536807b-a84f-49dc-abfe-b54fa2f7be47 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431538 Oct 28 18:58:42.176005 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:58:42.188215 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-b8f243f1-5090-463d-910c-e8d293bb5208 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:42.193131 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:42.220631 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-b8f243f1-5090-463d-910c-e8d293bb5208 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036188 Oct 28 18:58:42.235160 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1333 bytes} [Fri Oct 28 18:58:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:44.827906 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-d536807b-a84f-49dc-abfe-b54fa2f7be47 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:44.828929 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-d536807b-a84f-49dc-abfe-b54fa2f7be47 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 28 18:58:44.829319 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:45.261266 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-89caa070-af1a-4086-8216-182f0834b724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "ram": 8192}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:45.285451 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-89caa070-af1a-4086-8216-182f0834b724 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449482 Oct 28 18:58:45.286386 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:45.299258 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-0d7c36b2-44d4-4946-bafd-d35e6efac3bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:45.324731 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-0d7c36b2-44d4-4946-bafd-d35e6efac3bd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029354 Oct 28 18:58:45.325314 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1333 bytes} [Fri Oct 28 18:58:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:47.895555 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-89caa070-af1a-4086-8216-182f0834b724 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:47.896583 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-89caa070-af1a-4086-8216-182f0834b724 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 28 18:58:47.902377 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:48.330150 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-2c7d5625-ff3c-4225-98f7-f0edc54b677f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:48.339998 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:48.352197 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-2c7d5625-ff3c-4225-98f7-f0edc54b677f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448413 Oct 28 18:58:48.353283 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1283 bytes} [Fri Oct 28 18:58:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:48.365426 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-411dde76-2d54-45fe-a0ab-4aaa7d4e7238 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:48.391427 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-411dde76-2d54-45fe-a0ab-4aaa7d4e7238 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029761 Oct 28 18:58:48.392171 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1333 bytes} [Fri Oct 28 18:58:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:59:09.027463 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-2c7d5625-ff3c-4225-98f7-f0edc54b677f admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:09.029095 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-2c7d5625-ff3c-4225-98f7-f0edc54b677f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Oct 28 18:59:09.029753 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 18:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:09.041895 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:09.445329 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-f37d0914-9d89-4a0d-ad2a-384af485b93f admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:09.463882 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-f37d0914-9d89-4a0d-ad2a-384af485b93f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428036 Oct 28 18:59:09.464419 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 18:59:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:10.781685 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-2c7d5625-ff3c-4225-98f7-f0edc54b677f admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:10.782715 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-2c7d5625-ff3c-4225-98f7-f0edc54b677f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 28 18:59:10.783133 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:11.362854 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-f1c64efa-f2c3-45ec-88a8-34791462727c admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:11.368229 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.wsgi [None req-f1c64efa-f2c3-45ec-88a8-34791462727c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-f1c64efa-f2c3-45ec-88a8-34791462727c admin admin] Request method failure captured: Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Accept: application/json Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Accept-Encoding: gzip, deflate Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Connection: keep-alive Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Content-Length: 0 Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Host: 10.222.0.44 Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: Openstack-System-Scope: None Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: User-Agent: python-novaclient Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Auth-Token: gAAAAABjXCZ-T7RnVzqs2_3Mn13-zNSDhLh8XF8yXMjp8lTqZ07ZEho0RIcYgIW7Pz0NlQ7AeYB-37g40unCtg0kk16MMH7fT8Uh5K2pxfNuo0lU2vWEOpx_m2RR6F26E0mLHrCRkUXiIQOejhcRBtd1diUOjmt1uaMrjTwPX8KkVx0zHjNYC0Y Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Domain-Id: None Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Domain-Name: None Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Identity-Status: Confirmed Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Is-Admin-Project: True Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Domain-Id: default Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Domain-Name: Default Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Name: admin Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Role: reader,member,admin Oct 28 18:59:11.371510 n-d-862769-3 devstack@n-api.service[104762]: X-Roles: reader,member,admin Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_352d1fe47d604c008bd565ec6893b0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant: admin Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant-Name: admin Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-User: admin Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-User-Domain-Id: default Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-User-Domain-Name: Default Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-User-Id: 49a99d8cabc34bb1b29e770a0ea5cce2 Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: X-User-Name: admin Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: method: > Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: exception: Flavor 42 could not be found. Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: action_args: {'id': '42'} Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:11.373243 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:11.374376 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.376026 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-f1c64efa-f2c3-45ec-88a8-34791462727c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:11.377404 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-f1c64efa-f2c3-45ec-88a8-34791462727c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.424716 Oct 28 18:59:11.377404 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:11.383262 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-7ee4f378-11d1-4673-8ddd-6ee3bf55a0a2 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:11.406662 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-7ee4f378-11d1-4673-8ddd-6ee3bf55a0a2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027383 Oct 28 18:59:11.407172 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:11.420099 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-211d411f-18ec-4951-aa65-169221a7989f admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:11.442221 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-211d411f-18ec-4951-aa65-169221a7989f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027068 Oct 28 18:59:11.442728 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:11.453323 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-ed92ecd3-61db-472a-aa47-63576b5ce561 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:11.459231 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.wsgi [None req-ed92ecd3-61db-472a-aa47-63576b5ce561 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-ed92ecd3-61db-472a-aa47-63576b5ce561 admin admin] Request method failure captured: Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Accept: application/json Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Accept-Encoding: gzip, deflate Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Connection: keep-alive Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Content-Length: 0 Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Host: 10.222.0.44 Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: Openstack-System-Scope: None Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: User-Agent: python-novaclient Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Auth-Token: gAAAAABjXCZ-T7RnVzqs2_3Mn13-zNSDhLh8XF8yXMjp8lTqZ07ZEho0RIcYgIW7Pz0NlQ7AeYB-37g40unCtg0kk16MMH7fT8Uh5K2pxfNuo0lU2vWEOpx_m2RR6F26E0mLHrCRkUXiIQOejhcRBtd1diUOjmt1uaMrjTwPX8KkVx0zHjNYC0Y Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Domain-Id: None Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Domain-Name: None Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Identity-Status: Confirmed Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Is-Admin-Project: True Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Domain-Id: default Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Domain-Name: Default Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Name: admin Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Role: reader,member,admin Oct 28 18:59:11.462514 n-d-862769-3 devstack@n-api.service[104763]: X-Roles: reader,member,admin Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_352d1fe47d604c008bd565ec6893b0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant: admin Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant-Name: admin Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-User: admin Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-User-Domain-Id: default Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-User-Domain-Name: Default Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-User-Id: 49a99d8cabc34bb1b29e770a0ea5cce2 Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: X-User-Name: admin Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: method: > Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: exception: Flavor 42 could not be found. Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: action_args: {'id': '42'} Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:11.464230 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:11.465208 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:11.466348 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-ed92ecd3-61db-472a-aa47-63576b5ce561 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:11.467674 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-ed92ecd3-61db-472a-aa47-63576b5ce561 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015305 Oct 28 18:59:11.467674 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:12.672639 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-211d411f-18ec-4951-aa65-169221a7989f admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:12.673758 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-211d411f-18ec-4951-aa65-169221a7989f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 28 18:59:12.674156 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:13.274789 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-fcd58c67-8a23-43e5-948f-48057f227264 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:13.279879 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.wsgi [None req-fcd58c67-8a23-43e5-948f-48057f227264 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-fcd58c67-8a23-43e5-948f-48057f227264 admin admin] Request method failure captured: Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Accept: application/json Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Accept-Encoding: gzip, deflate Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Connection: keep-alive Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Content-Length: 0 Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Host: 10.222.0.44 Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: Openstack-System-Scope: None Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: User-Agent: python-novaclient Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Auth-Token: gAAAAABjXCaAXK5Kdc06z9I-uVtI9hYweL3OUzaGUH7IeN8BuNn69LpzpiMdDFiwHc16d2kb3KXhTfGt-h5ircxQ93YpDon1TBuKhpHl8JMmDCrLiRd-Pqv4rnOMYwNTrAbtktODEw4ts_qHU9MOzwcxO7xXCeLQ-wyiRTxzObH0ow_3PfT1YyM Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Domain-Id: None Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Domain-Name: None Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Identity-Status: Confirmed Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Is-Admin-Project: True Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Domain-Id: default Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Domain-Name: Default Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Name: admin Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Role: reader,member,admin Oct 28 18:59:13.281386 n-d-862769-3 devstack@n-api.service[104763]: X-Roles: reader,member,admin Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_352d1fe47d604c008bd565ec6893b0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant: admin Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant-Name: admin Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-User: admin Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-User-Domain-Id: default Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-User-Domain-Name: Default Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-User-Id: 49a99d8cabc34bb1b29e770a0ea5cce2 Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: X-User-Name: admin Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: method: > Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: exception: Flavor 84 could not be found. Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: action_args: {'id': '84'} Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:13.282804 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:13.283617 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.284921 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-fcd58c67-8a23-43e5-948f-48057f227264 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:13.286148 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-fcd58c67-8a23-43e5-948f-48057f227264 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.464762 Oct 28 18:59:13.286148 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:13.293099 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-643a7271-9425-486e-961e-f473977e7085 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:13.308138 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-643a7271-9425-486e-961e-f473977e7085 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019093 Oct 28 18:59:13.308628 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:13.317984 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-77618409-a150-42be-b74d-9866a3783402 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:13.333756 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-77618409-a150-42be-b74d-9866a3783402 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019274 Oct 28 18:59:13.334306 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:13.346185 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e02a2032-cb77-40e3-a8e3-bf71142934e1 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:13.354012 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.wsgi [None req-e02a2032-cb77-40e3-a8e3-bf71142934e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e02a2032-cb77-40e3-a8e3-bf71142934e1 admin admin] Request method failure captured: Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Accept: application/json Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Accept-Encoding: gzip, deflate Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Connection: keep-alive Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Content-Length: 0 Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Host: 10.222.0.44 Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: Openstack-System-Scope: None Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: User-Agent: python-novaclient Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Auth-Token: gAAAAABjXCaAXK5Kdc06z9I-uVtI9hYweL3OUzaGUH7IeN8BuNn69LpzpiMdDFiwHc16d2kb3KXhTfGt-h5ircxQ93YpDon1TBuKhpHl8JMmDCrLiRd-Pqv4rnOMYwNTrAbtktODEw4ts_qHU9MOzwcxO7xXCeLQ-wyiRTxzObH0ow_3PfT1YyM Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Domain-Id: None Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Domain-Name: None Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Identity-Status: Confirmed Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Is-Admin-Project: True Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Domain-Id: default Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Domain-Name: Default Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Name: admin Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Role: reader,member,admin Oct 28 18:59:13.356450 n-d-862769-3 devstack@n-api.service[104762]: X-Roles: reader,member,admin Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_352d1fe47d604c008bd565ec6893b0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant: admin Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant-Name: admin Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-User: admin Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-User-Domain-Id: default Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-User-Domain-Name: Default Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-User-Id: 49a99d8cabc34bb1b29e770a0ea5cce2 Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: X-User-Name: admin Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: method: > Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: exception: Flavor 84 could not be found. Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: action_args: {'id': '84'} Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:13.357954 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:13.358852 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:13.360070 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-e02a2032-cb77-40e3-a8e3-bf71142934e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:13.361289 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-e02a2032-cb77-40e3-a8e3-bf71142934e1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.017474 Oct 28 18:59:13.361289 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Fri Oct 28 18:59:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:14.576616 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-77618409-a150-42be-b74d-9866a3783402 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:14.577837 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-77618409-a150-42be-b74d-9866a3783402 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Oct 28 18:59:14.578227 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:15.137477 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-21ca83dd-44e7-415a-8fd1-25d805c9f26a admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:15.143666 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.wsgi [None req-21ca83dd-44e7-415a-8fd1-25d805c9f26a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-21ca83dd-44e7-415a-8fd1-25d805c9f26a admin admin] Request method failure captured: Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Accept: application/json Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Accept-Encoding: gzip, deflate Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Connection: keep-alive Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Content-Length: 0 Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Host: 10.222.0.44 Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: Openstack-System-Scope: None Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: User-Agent: python-novaclient Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Auth-Token: gAAAAABjXCaCYKYRnzaYeVgSjx3cEIeasyIdN1z9CJanKbf0Dn70FUpTbdh_-Lr3Z36pZotq4HI71NKNHDthLReIrOpxSSzxUuPw2vluiVW9BQSdKew9jxLoXFmEApqSBUx5lPMptFoGUZMsc4XaBY9m5UHwpYcfxH8pcOPiwhzQjIVYMI-TBMk Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Domain-Id: None Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Domain-Name: None Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Identity-Status: Confirmed Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Is-Admin-Project: True Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Domain-Id: default Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Domain-Name: Default Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Project-Name: admin Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Role: reader,member,admin Oct 28 18:59:15.145207 n-d-862769-3 devstack@n-api.service[104762]: X-Roles: reader,member,admin Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_352d1fe47d604c008bd565ec6893b0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant: admin Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-Tenant-Name: admin Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-User: admin Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-User-Domain-Id: default Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-User-Domain-Name: Default Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-User-Id: 49a99d8cabc34bb1b29e770a0ea5cce2 Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: X-User-Name: admin Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: method: > Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: exception: Flavor 451 could not be found. Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: action_args: {'id': '451'} Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:15.146623 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:15.147570 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.148757 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-21ca83dd-44e7-415a-8fd1-25d805c9f26a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:15.150107 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-21ca83dd-44e7-415a-8fd1-25d805c9f26a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.434433 Oct 28 18:59:15.150107 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 18:59:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:15.156436 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-96395fc9-9542-46a4-83e1-9ae47e3a10fa admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:15.171664 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-96395fc9-9542-46a4-83e1-9ae47e3a10fa admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018934 Oct 28 18:59:15.172189 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:15.181741 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:15.196972 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018818 Oct 28 18:59:15.197496 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Fri Oct 28 18:59:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:59:15.206725 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-f28daa44-8518-45bc-bf1a-748d48561370 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:15.211637 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.wsgi [None req-f28daa44-8518-45bc-bf1a-748d48561370 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-f28daa44-8518-45bc-bf1a-748d48561370 admin admin] Request method failure captured: Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Accept: application/json Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Accept-Encoding: gzip, deflate Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Connection: keep-alive Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Content-Length: 0 Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Host: 10.222.0.44 Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Openstack-Api-Version: compute 2.92 Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: Openstack-System-Scope: None Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: User-Agent: python-novaclient Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Auth-Token: gAAAAABjXCaCYKYRnzaYeVgSjx3cEIeasyIdN1z9CJanKbf0Dn70FUpTbdh_-Lr3Z36pZotq4HI71NKNHDthLReIrOpxSSzxUuPw2vluiVW9BQSdKew9jxLoXFmEApqSBUx5lPMptFoGUZMsc4XaBY9m5UHwpYcfxH8pcOPiwhzQjIVYMI-TBMk Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Domain-Id: None Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Domain-Name: None Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Identity-Status: Confirmed Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Is-Admin-Project: True Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Domain-Id: default Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Domain-Name: Default Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Project-Name: admin Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Role: reader,member,admin Oct 28 18:59:15.213131 n-d-862769-3 devstack@n-api.service[104763]: X-Roles: reader,member,admin Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_352d1fe47d604c008bd565ec6893b0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/352d1fe47d604c008bd565ec6893b0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant: admin Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant-Id: 352d1fe47d604c008bd565ec6893b0df Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-Tenant-Name: admin Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-User: admin Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-User-Domain-Id: default Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-User-Domain-Name: Default Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-User-Id: 49a99d8cabc34bb1b29e770a0ea5cce2 Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: X-User-Name: admin Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: method: > Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: exception: Flavor 451 could not be found. Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: action_args: {'id': '451'} Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:59:15.214654 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:15.215562 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: ERROR nova.api.openstack.wsgi Oct 28 18:59:15.216619 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-f28daa44-8518-45bc-bf1a-748d48561370 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:59:15.217705 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-f28daa44-8518-45bc-bf1a-748d48561370 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011229 Oct 28 18:59:15.217705 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 18:59:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:59:16.419589 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:16.420713 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Oct 28 18:59:16.421108 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:16.988983 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-5d0335ea-3ad0-4ebb-8850-b79d652d177a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:17.011700 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-5d0335ea-3ad0-4ebb-8850-b79d652d177a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.453650 Oct 28 18:59:17.012280 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Fri Oct 28 18:59:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:18.224582 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:18.225585 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 28 18:59:18.226116 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:18.783008 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-80483e26-afd1-4ef5-81c2-e49b0d4bc0b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:18.805174 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-80483e26-afd1-4ef5-81c2-e49b0d4bc0b5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.442157 Oct 28 18:59:18.805703 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Fri Oct 28 18:59:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:20.018726 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:20.019781 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 18:59:20.020221 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:20.557754 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-34dcf273-489a-487b-8478-775dea889283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:20.578900 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-34dcf273-489a-487b-8478-775dea889283 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.424757 Oct 28 18:59:20.579504 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Fri Oct 28 18:59:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:21.797920 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:21.798980 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 28 18:59:21.799374 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:22.344235 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-ab44ea35-f6c3-4c72-a56f-a07ce9f472e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:22.365144 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-ab44ea35-f6c3-4c72-a56f-a07ce9f472e1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.429715 Oct 28 18:59:22.365700 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Fri Oct 28 18:59:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:59:23.578061 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:23.579170 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Oct 28 18:59:23.579590 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 18:59:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:24.127325 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-c229ba76-64cb-4df7-808d-bcd72cfce5ba admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:24.147672 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-c229ba76-64cb-4df7-808d-bcd72cfce5ba admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.431196 Oct 28 18:59:24.148126 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Fri Oct 28 18:59:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:00:20.720536 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:20.721625 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-08b1c48e-14cf-494a-9abb-526e32609ba3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 28 19:00:20.722034 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 931 bytes} [Fri Oct 28 19:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:20.736371 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.151133 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-14ea8eb4-cbe7-4a7d-b363-229ea6e6d897 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:21.172202 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-14ea8eb4-cbe7-4a7d-b363-229ea6e6d897 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.443370 Oct 28 19:00:21.172761 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 19:00:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:00:21.195570 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_api:SELECT=14 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:21.200627 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-744663ba-f638-41f5-bf4f-adeca2e1bf50 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:21.209937 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-744663ba-f638-41f5-bf4f-adeca2e1bf50 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016928 Oct 28 19:00:21.210492 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1283 bytes} [Fri Oct 28 19:00:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:00:21.222214 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-e00f466e-5695-41d2-9906-8d872265bfb1 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:21.229803 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-e00f466e-5695-41d2-9906-8d872265bfb1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011121 Oct 28 19:00:21.230261 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1286 bytes} [Fri Oct 28 19:00:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:21.242418 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-4b2a93dc-b2ad-4575-aef9-a70bbaf8f7b1 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:21.249894 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-4b2a93dc-b2ad-4575-aef9-a70bbaf8f7b1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011122 Oct 28 19:00:21.250415 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1286 bytes} [Fri Oct 28 19:00:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:21.264512 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-d091a1c4-5296-49f7-b5d3-4606848f6f2e admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:21.275084 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-d091a1c4-5296-49f7-b5d3-4606848f6f2e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015849 Oct 28 19:00:21.275683 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1283 bytes} [Fri Oct 28 19:00:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:45.654065 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-4b2a93dc-b2ad-4575-aef9-a70bbaf8f7b1 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:45.655123 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-4b2a93dc-b2ad-4575-aef9-a70bbaf8f7b1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 28 19:05:45.655511 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 19:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:45.794022 n-d-862769-3 devstack@n-api.service[104763]: DEBUG dbcounter [-] [104763] Writing DB stats nova_api:SELECT=6 {{(pid=104763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:45.950148 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:45.955337 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:45.955821 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:45.956249 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:45.956961 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:45.957407 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:45.957825 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:45.996707 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-a1adeca9-ed91-4d47-be7d-b6754961a789 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.203881 Oct 28 19:05:45.997264 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 19:05:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:05:47.057598 n-d-862769-3 devstack@n-api.service[104762]: DEBUG nova.api.openstack.wsgi [None req-4b2a93dc-b2ad-4575-aef9-a70bbaf8f7b1 admin admin] Calling method '>' {{(pid=104762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:47.058638 n-d-862769-3 devstack@n-api.service[104762]: INFO nova.api.openstack.requestlog [None req-4b2a93dc-b2ad-4575-aef9-a70bbaf8f7b1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 28 19:05:47.059105 n-d-862769-3 devstack@n-api.service[104762]: [pid: 104762|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Fri Oct 28 19:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:47.258040 n-d-862769-3 devstack@n-api.service[104763]: DEBUG nova.api.openstack.wsgi [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Calling method '>' {{(pid=104763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:47.261457 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:47.262028 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:47.262453 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:47.263185 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:47.263630 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:47.264046 n-d-862769-3 devstack@n-api.service[104763]: DEBUG oslo_concurrency.lockutils [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:47.286600 n-d-862769-3 devstack@n-api.service[104763]: INFO nova.api.openstack.requestlog [None req-ed058055-ebc0-46cd-97e0-78456e72a18d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.088036 Oct 28 19:05:47.287174 n-d-862769-3 devstack@n-api.service[104763]: [pid: 104763|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 19:05:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:06:32.160437 n-d-862769-3 devstack@n-api.service[104761]: Fri Oct 28 19:06:32 2022 - graceful shutdown triggered... Oct 28 19:06:32.160992 n-d-862769-3 devstack@n-api.service[104762]: Gracefully killing worker 1 (pid: 104762)... Oct 28 19:06:32.160568 n-d-862769-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 19:06:32.161835 n-d-862769-3 devstack@n-api.service[104763]: Gracefully killing worker 2 (pid: 104763)... Oct 28 19:06:32.293561 n-d-862769-3 devstack@n-api.service[104762]: DEBUG dbcounter [-] [104762] Writing DB stats nova_api:SELECT=4 {{(pid=104762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:33.161710 n-d-862769-3 devstack@n-api.service[104761]: worker 1 buried after 1 seconds Oct 28 19:06:33.161710 n-d-862769-3 devstack@n-api.service[104761]: worker 2 buried after 1 seconds Oct 28 19:06:33.161710 n-d-862769-3 devstack@n-api.service[104761]: goodbye to uWSGI. Oct 28 19:06:33.164782 n-d-862769-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 28 19:06:33.165857 n-d-862769-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 19:06:33.170816 n-d-862769-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 19:06:33.195349 n-d-862769-3 devstack@n-api.service[120615]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 19:06:33 2022] *** Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: nodename: n-d-862769-3 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: machine: x86_64 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: clock source: unix Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: pcre jit disabled Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: detected number of CPU cores: 4 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: current working directory: / Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: detected binary path: /usr/bin/uwsgi-core Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: your processes number limit is 47680 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: your memory page size is 4096 bytes Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: detected max file descriptor number: 2048 Oct 28 19:06:33.208021 n-d-862769-3 devstack@n-api.service[120615]: lock engine: pthread robust mutexes Oct 28 19:06:33.209079 n-d-862769-3 devstack@n-api.service[120615]: thunder lock: enabled Oct 28 19:06:33.209079 n-d-862769-3 devstack@n-api.service[120615]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 19:06:33.209079 n-d-862769-3 devstack@n-api.service[120615]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 19:06:33.249124 n-d-862769-3 devstack@n-api.service[120615]: Python main interpreter initialized at 0x5559c20009c0 Oct 28 19:06:33.249124 n-d-862769-3 devstack@n-api.service[120615]: python threads support enabled Oct 28 19:06:33.249124 n-d-862769-3 devstack@n-api.service[120615]: your server socket listen backlog is limited to 100 connections Oct 28 19:06:33.249124 n-d-862769-3 devstack@n-api.service[120615]: your mercy for graceful operations on workers is 90 seconds Oct 28 19:06:33.249615 n-d-862769-3 devstack@n-api.service[120615]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 19:06:33.249615 n-d-862769-3 devstack@n-api.service[120615]: *** Operational MODE: preforking *** Oct 28 19:06:33.249844 n-d-862769-3 devstack@n-api.service[120615]: *** uWSGI is running in multiple interpreter mode *** Oct 28 19:06:33.249844 n-d-862769-3 devstack@n-api.service[120615]: spawned uWSGI master process (pid: 120615) Oct 28 19:06:33.250063 n-d-862769-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 19:06:33.250896 n-d-862769-3 devstack@n-api.service[120615]: spawned uWSGI worker 1 (pid: 120628, cores: 1) Oct 28 19:06:33.251428 n-d-862769-3 devstack@n-api.service[120615]: spawned uWSGI worker 2 (pid: 120629, cores: 1) Oct 28 19:06:33.251709 n-d-862769-3 devstack@n-api.service[120615]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 19:06:33.896205 n-d-862769-3 devstack@n-api.service[120628]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 19:06:33.909432 n-d-862769-3 devstack@n-api.service[120629]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 19:06:35.119223 n-d-862769-3 devstack@n-api.service[120628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:06:35.119223 n-d-862769-3 devstack@n-api.service[120628]: from cryptography.utils import int_from_bytes Oct 28 19:06:35.119973 n-d-862769-3 devstack@n-api.service[120628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:06:35.119973 n-d-862769-3 devstack@n-api.service[120628]: from cryptography.utils import int_from_bytes Oct 28 19:06:35.121580 n-d-862769-3 devstack@n-api.service[120629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:06:35.121580 n-d-862769-3 devstack@n-api.service[120629]: from cryptography.utils import int_from_bytes Oct 28 19:06:35.122041 n-d-862769-3 devstack@n-api.service[120629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:06:35.122041 n-d-862769-3 devstack@n-api.service[120629]: from cryptography.utils import int_from_bytes Oct 28 19:06:37.514826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:06:37.515411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:06:37.515506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:06:37.515845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:06:37.516076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:06:37.516483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.516812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.517118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.517432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.517758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.518061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.518355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.518667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.519046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.519273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.519582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.519901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.520214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.520523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.520822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.521132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.521461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.521800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.522096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.522571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.523040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.523346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.523653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.523984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.524313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.524485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:06:37.524898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.524994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:06:37.525088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.525204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.525291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:06:37.525499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.525614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:06:37.525803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.525927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:06:37.526192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.526296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.526505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.526606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.526833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.526944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.527139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.527269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.527497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.527596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.527807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.527909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.528123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.528227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.528438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.528538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.528766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.528869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.529978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.530090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.530288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.530395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.530587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.530711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.530918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.531995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.532118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.532330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.532447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.532642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.532734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.532950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.533087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.533259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.533375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.533571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.533675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.533818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.534997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.535148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.535291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.535442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.535606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.535795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.535909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.536110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.536205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.536423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.536520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.536720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.536813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.537043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.537241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.537379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.537473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.537688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.537784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.538002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.538105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.538309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.538403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.538620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.538812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.539906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.540014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.540220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.540343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.540524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.540626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.540836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.541301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.541513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.541615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.541815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.541915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.542111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.542203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.542356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.542448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.542666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.542810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.543887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.544839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.545938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.546965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.547162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.547258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.547465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.547570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.547760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.547854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.548968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.549982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.550175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.550280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.550473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.550606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.550794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.550936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.551097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.551231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.551396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.551540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.551709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.551849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.552920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.553999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.554128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.554263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.554400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.554538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.554676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.554844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.555891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.556940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.557986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.558124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.558263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.558427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.558563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.558759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.558910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.559074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.559208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.559420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.559619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.559773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.559926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.560058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.560195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.560328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.560463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.560593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.560721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.560856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.561074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.561206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.561335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.561471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.561600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.561735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.561873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.562089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.562286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.562461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.562595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.562765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.562898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.563026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.563162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.563291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.563421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.563722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.563860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.563987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.564125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.564262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.564448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.564598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.564729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.564869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.564999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.565208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.565338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.565475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.565616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.565755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.565893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.566022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.566164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.566293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.566420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.566548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.566683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.566829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.566976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.567107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.567281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.567413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.567601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.567727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.567907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.568040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.568236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:06:37.568411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.568573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.568714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.568907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.569984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.570147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.570279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.570468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.570607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.570802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.570935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.571108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.571241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.571418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.571550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.571728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.571861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.572971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.573102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.573285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.573417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.573593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.573885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.573885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.574973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.575108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.575271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.575469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.575600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.575738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.575877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.576874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.577948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.578123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.578265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.578437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.578570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.578769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.578902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.579963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.580103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.580285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.580429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.580576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.580706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.580878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.581931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.582099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.582245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.582411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.582550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.582737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.582884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.583048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.583191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.583352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.583493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.583669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.583826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.584925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.585986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.586143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.586244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.586444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.586544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.586772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.586913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.587977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.588067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.588284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.588394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.588584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.588679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.588883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.589890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.590100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.590219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.590399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.590490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.590713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.590830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.591953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.592998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.593199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.593307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.593511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.593617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.593821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.593926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.594126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.594220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.594433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.594526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.594761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.594860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.595079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.595172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.595389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.595482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.595706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.595807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.596929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.597941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.598146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.598248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.598450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.598551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.598777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.598883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.599088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.599192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.599410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.599597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.599763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.599854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.600985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.601098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.601289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.601383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.601603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.601703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.601909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.602995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.603171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.603264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.603479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.603573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.603801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.603896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.604111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.604206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.604424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.604526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.604729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.604820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.605964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.606990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.607207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.607309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.607515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.607616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.607824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.607923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.608128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.608221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.608444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.608538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.608749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.608849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.609976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.610071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.610282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.610375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.610599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.610717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.610938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.611685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.611790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.611889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.611984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.612975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.613074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.613309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.613412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.613617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.613709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.613918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.614970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.615208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.615304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.615516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.615616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.615820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.615976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.616136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.616230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.616445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.616544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.616748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.616846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.617970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.618063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.618274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.618365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.618580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.618681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.618907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.619906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.620128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.620242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.620445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.620697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.620802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.621953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.622054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.622257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.622358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.622560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.622652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.622927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.623944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.624142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.624243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.624442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.624534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.624748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.624848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.625953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.626971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.627171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.627258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.627481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.627583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.627777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.627876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.628996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.629100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.629294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.629394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.629592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.629683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.629890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.630238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.630354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.630499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.630600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.630888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.631949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.632151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.632243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.632470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.632572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.632771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.632864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.633986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.634090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.634284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.634403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.634611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.634730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.634907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.635906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.636114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.636206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.636412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.636505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.636711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.636802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.637995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.638217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.638335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.638514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.638635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.638843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.638945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.639142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.639243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.639445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.639552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.639752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.639864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.640957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.641101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.641254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.641351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.641571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.641663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.641875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.642906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.643094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.643189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.643391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.643493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.643692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.643799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.644924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.645915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.646121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.646223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.646444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.646551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.646836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.646945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.647142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.647243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.647441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.647548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.647741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.647841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.648954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.649993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.650175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.650269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.650485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.650586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.650811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.650909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.651126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.651220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.651433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.651534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.651736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.651837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.652939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.653932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.654154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.654246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.654463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.654570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.654788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.654941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.655096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.655192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.655400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.655498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.655708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.655811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.656910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.657011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.657209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.657301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.657513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.657613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.657819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.658856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.659962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.660981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.661177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.661279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.661479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.661573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.661779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.661872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.662134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.662227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.662438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.662532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.662792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.663099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.663202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.663405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.663500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.663724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.663815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.664958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.665058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.665269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.665363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.665570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.665662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.665877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.666345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.666544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.666645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.666883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.666981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.667197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.667305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.667508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.667614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.667818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.667921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.668129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.668240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.668438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.668540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.668748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.668847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.669957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.670064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.670259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.670350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.670579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.670730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.670922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.671975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.672134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.672277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.672440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.672594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.672908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.673103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.673228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.673422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.673515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.673738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.673846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.674046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.674139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.674360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.674461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.674676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.674836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.675952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.676984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.677248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.677349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.677552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.677641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.677922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.678116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.678245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.678448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.678565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.678779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.678963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.679091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.679267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.679395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.679575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.679718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.679876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.680027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.680178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.680350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.680494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.680768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.680870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.681987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.682101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.682286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.682410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.682601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.682759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.682922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.683082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.683236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.683407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.683545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.683712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.683861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.684981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.685096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.685294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.685387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.685609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.685710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.685913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.686005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.686236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.686330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.686557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.686651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.686899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.687961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.688199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.688307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.688527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.688628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.688844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.688944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.689153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.689264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.689454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.689545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.689767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.689860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.690993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.691998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.692194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.692288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.692494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.692631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.692790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.692884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.693101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.693192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.693473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.693583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.693787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.693884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.694088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.694192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.694389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.694493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.694703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.694802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.695934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.696966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.697180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.697285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.697489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.697590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.697800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.697899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.698109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.698218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.698420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.698512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.698753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.698862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.699995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.700089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.700317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.700518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.700620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.700844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.700952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.701153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.701260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.701461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.701556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.701769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.701874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.702078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.702181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.702378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.702469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.702679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.702816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.703931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.704950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.705150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.705258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.705469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.705573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.705777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.705880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.706083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.706191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.706397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.706490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.706742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.706849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.707982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.708091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.708295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.708398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.708602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.708695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.708936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.709955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.710159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.710253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.710467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.710709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.710821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.711984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.712079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.712301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.712403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.712612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.712826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.712928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.713136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.713231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.713462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.713564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.713783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.713877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.714101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.714236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.714413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.714517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.714749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.714848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.715979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.716137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.716282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.716377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.716580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.716681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.716895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.717959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.718125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.718228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.718435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.718653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.718776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.719970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.720071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.720283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.720376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.720587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.720694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.720907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.721958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.722125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.722218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.722426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.722529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.722748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.722979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.723085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.723296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.723404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.723629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.723723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.723930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.724021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.724230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.724379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.724614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.724712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.724925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.725923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.726128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.726221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.726425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.726527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.726745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.726853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.727958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.728122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.728262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.728366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.728575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.728793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.728916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.729143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.729245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.729461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.729556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.729791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.729887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.730099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.730195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.730398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.730498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.730748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.730849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.731957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.732038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.732265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.732367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.732569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.732671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.732873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.733110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.733212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.733440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.733547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.733758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.733852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.734065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.734166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.734367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.734462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.734698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.734791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.735923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.736932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.737133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.737227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.737439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.737542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.737740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.737841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.738971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.739976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.740217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.740322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.740526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.740621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.740840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.740942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.741150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.741243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.741457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.741587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.741768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.741905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.742995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.743270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.743379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.743607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.743701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.743911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.744009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.744211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.744318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.744572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.744673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.744881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.745908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.746120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.746215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.746431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.746525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.746777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.746884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.747988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.748071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.748299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.748401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.748608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.748705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.748917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.749898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.750122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.750205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.750424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.750514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.750741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.750829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.751044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.751211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.751347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.751432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.751795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.752114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.752389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.752711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.752806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.752984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.753144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.753280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.753473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.753608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.753797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.753905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.754115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.754217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.754430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.754541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.754745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.754847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.755052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.755155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.755351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.755457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.755650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.755777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.756958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.757143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.757285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.757460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.757597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.757789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.757916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.758117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.758220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.758432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.758539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.758786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.758896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.759104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.759203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.759440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.759534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.759760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.759860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.760066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.760160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.760392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.760484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.760698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.760791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.761906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.762952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.763156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.763248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.763458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.763562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.763765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.763866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.764069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.764191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.764372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.764495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.764676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.764769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.765984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.766187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.766281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.766489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.766581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.766817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.766916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.767121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.767218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.767423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.767516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.767721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.767823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.768955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.769048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.769276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.769370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.769597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.769699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.769907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.770000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.770226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.770321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.770534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.770637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.770898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.771006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.771209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.771304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.771573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.771669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.771886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.772025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.772120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:06:37.772204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.772512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.772823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.773135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.773443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.773752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.774059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.774385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.774727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.775038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.775364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.775681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.776002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.776317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.776629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.776956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.777269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.777578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.777886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.778197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.778505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.778842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.779154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.779465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.779787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.780101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.780429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.780754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.781201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.781384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.781709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.782056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.782370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.782732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.783065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.783380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.783693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.784000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:06:37.784243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:06:37.834584 n-d-862769-3 devstack@n-api.service[120628]: INFO dbcounter [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Registered counter for database nova_api Oct 28 19:06:37.845407 n-d-862769-3 devstack@n-api.service[120629]: INFO dbcounter [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Registered counter for database nova_api Oct 28 19:06:37.854935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_db.sqlalchemy.engines [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:37.862257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writer thread running {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:37.867828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_db.sqlalchemy.engines [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:37.875421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writer thread running {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:37.921457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.context [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=120628) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 19:06:37.926235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.926945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.928662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.929400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.929840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.931903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.933983 n-d-862769-3 devstack@n-api.service[120628]: INFO dbcounter [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Registered counter for database nova_cell0 Oct 28 19:06:37.935014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.context [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=120629) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 19:06:37.938228 n-d-862769-3 devstack@n-api.service[120628]: INFO dbcounter [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Registered counter for database nova_cell1 Oct 28 19:06:37.939106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.939570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.941180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.941936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:37.942358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:37.944469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:37.945388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_db.sqlalchemy.engines [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:37.946571 n-d-862769-3 devstack@n-api.service[120629]: INFO dbcounter [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Registered counter for database nova_cell0 Oct 28 19:06:37.950929 n-d-862769-3 devstack@n-api.service[120629]: INFO dbcounter [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Registered counter for database nova_cell1 Oct 28 19:06:37.951110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writer thread running {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:37.951573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_db.sqlalchemy.engines [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:37.960615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_db.sqlalchemy.engines [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:37.962316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_db.sqlalchemy.engines [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:37.967965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writer thread running {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:38.091770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writer thread running {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:38.101952 n-d-862769-3 devstack@n-api.service[120628]: INFO dbcounter [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Registered counter for database nova_cell0 Oct 28 19:06:38.104182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writer thread running {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:38.109212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_db.sqlalchemy.engines [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:38.113644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writer thread running {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:38.115089 n-d-862769-3 devstack@n-api.service[120629]: INFO dbcounter [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Registered counter for database nova_cell0 Oct 28 19:06:38.121908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_db.sqlalchemy.engines [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:06:38.126581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writer thread running {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:06:38.425360 n-d-862769-3 devstack@n-api.service[120628]: WARNING keystonemiddleware.auth_token [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:06:38.432729 n-d-862769-3 devstack@n-api.service[120628]: WARNING keystonemiddleware.auth_token [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:06:38.440553 n-d-862769-3 devstack@n-api.service[120629]: WARNING keystonemiddleware.auth_token [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:06:38.448052 n-d-862769-3 devstack@n-api.service[120629]: WARNING keystonemiddleware.auth_token [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:06:38.774317 n-d-862769-3 devstack@n-api.service[120628]: WARNING keystonemiddleware.auth_token [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:06:38.780311 n-d-862769-3 devstack@n-api.service[120628]: WARNING keystonemiddleware.auth_token [None req-7946c6c6-ccaf-4a9d-a79b-b17a14f378e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:06:38.785589 n-d-862769-3 devstack@n-api.service[120628]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5559c20009c0 pid: 120628 (default app) Oct 28 19:06:38.791680 n-d-862769-3 devstack@n-api.service[120629]: WARNING keystonemiddleware.auth_token [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 19:06:38.797743 n-d-862769-3 devstack@n-api.service[120629]: WARNING keystonemiddleware.auth_token [None req-43b89d15-5cb4-4701-9297-e21697b8545e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 19:06:38.803175 n-d-862769-3 devstack@n-api.service[120629]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5559c20009c0 pid: 120629 (default app) Oct 28 19:07:18.488543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:18.489375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:18.490126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:18.496006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:19.585504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:19.586921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:19.587900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:19.588773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:20.007629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.012534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.012939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.013362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.014084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.014520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.014956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.057713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5632bda4-f877-42cb-a8c6-620fe5244147 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.575130 Oct 28 19:07:20.058623 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1/1] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:07:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:20.404159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1524275c-f512-45c8-af79-cb013e911179 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.407964 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1524275c-f512-45c8-af79-cb013e911179 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1524275c-f512-45c8-af79-cb013e911179 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin] Request method failure captured: Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChnybjwr8cICGURzQWFSYRu51pT77y4H-Rg7GEL5Tf3rFSvhQyjJEb91cAwYe6hqktPYSW-Kz75MNwiXCoDdDEjrW4wTbDNTAqa-1HGoTegAV36mI02GDeWKbHXjs330Khm5Jya_dFhxjsQuHEsGiUH84Q4jd7yB0Gn3mMxw1KuFKg Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ed89b679ad344d40a3efaf33f2aa33c4 Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:20.415959 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed89b679ad344d40a3efaf33f2aa33c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed89b679ad344d40a3efaf33f2aa33c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed89b679ad344d40a3efaf33f2aa33c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed89b679ad344d40a3efaf33f2aa33c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ed89b679ad344d40a3efaf33f2aa33c4 Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c8078a3b19c64b808ef8c4ef5ee26228 Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:20.417632 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid timestamp for date invalid_time Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'invalid_time'} Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:20.418521 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:20.420056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1524275c-f512-45c8-af79-cb013e911179 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:20.421377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1524275c-f512-45c8-af79-cb013e911179 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679 tempest-InstanceUsageAuditLogNegativeTestJSON-628928679-project-admin] 10.222.0.44 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.361557 Oct 28 19:07:20.445031 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2/2] 10.222.0.44 () {58 vars in 1224 bytes} [Fri Oct 28 19:07:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:07:20.703032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '.version_select at 0x7f1d7e053550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.710029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=120628) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 19:07:20.711023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.711727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.712331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.739302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.740099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.740950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.751151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Calling method '.version_select at 0x7f1d7d7e6f70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:20.755536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.756246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.756858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.758024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=120629) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 19:07:20.758791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.759271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.759714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.764153 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d3d66e8-8f4a-4392-b4af-3b0bd90045ed tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.335665 Oct 28 19:07:20.765217 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3/3] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:07:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:20.770040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed71ad0b-e6e3-4bae-8509-c5a473873eb7 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1060133536"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:20.789066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.789557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.789985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.792161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-ed71ad0b-e6e3-4bae-8509-c5a473873eb7 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid e2de8fd0-a7f5-4592-9c92-e272a7e3b3de for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:20.803031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:20.803511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:20.804153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:20.811707 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18cf280e-edf8-4c39-8649-030afd987247 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.238985 Oct 28 19:07:20.812279 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1/4] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:20.861774 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed71ad0b-e6e3-4bae-8509-c5a473873eb7 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095129 Oct 28 19:07:20.862433 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 4/5] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:21.001315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Calling method '.version_select at 0x7f1d7d80b430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:21.005313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.005794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.006493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.022940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.023636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.024215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.037101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.037668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.038094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.044803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3557aed1-7032-4f31-bf93-394e04c93859 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.231496 Oct 28 19:07:21.045521 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2/6] 10.222.0.44 () {60 vars in 1208 bytes} [Fri Oct 28 19:07:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:21.052751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f5b64de-f9fb-4596-9e91-e8122ea9ff45 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:21.054447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f5b64de-f9fb-4596-9e91-e8122ea9ff45 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3ebee4d8249545adae4e09c846568dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad5bc2aad24df4b221c780152e4fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f5b64de-f9fb-4596-9e91-e8122ea9ff45 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Request method failure captured: Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChlVvnkt_KvJRU4Yxzqn--cVGihIS0CAQHtsvtlDFO-3Tikooji0A-LpugyHNSaDlpsBFaMgKwg0Z6McPoXEuDW5dg7UudF_08Y7iDKE5zlaWPUxAY2jL6ySnprf2YUaAc1b9To0sMqlplzgctzD27Ah8BpdmfIl0yUQzeRtscFWC0 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d0ad5bc2aad24df4b221c780152e4fd6 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:21.057486 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d0ad5bc2aad24df4b221c780152e4fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d0ad5bc2aad24df4b221c780152e4fd6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d0ad5bc2aad24df4b221c780152e4fd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d0ad5bc2aad24df4b221c780152e4fd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d0ad5bc2aad24df4b221c780152e4fd6 Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3ebee4d8249545adae4e09c846568dbf Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project Oct 28 19:07:21.059137 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:21.059685 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 19:07:21.060767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.061778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f5b64de-f9fb-4596-9e91-e8122ea9ff45 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:21.061778 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f5b64de-f9fb-4596-9e91-e8122ea9ff45 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] 10.222.0.44 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.195431 Oct 28 19:07:21.062813 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 5/7] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:07:20 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:21.162820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf2bff21-b4c9-4291-a68a-3cfdad3051c7 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1084176240", "ram": 512, "vcpus": 1, "disk": 10, "id": 227726756, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:21.178488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79dd487c-c958-42de-947d-dadb7266231c tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1503738376", "id": 1425572904, "os-flavor-access:is_public": "False"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:21.213196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79dd487c-c958-42de-947d-dadb7266231c tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.149265 Oct 28 19:07:21.223016 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 6/8] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:21 2022] POST /compute/v2.1/flavors => generated 439 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:21.223092 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf2bff21-b4c9-4291-a68a-3cfdad3051c7 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.154713 Oct 28 19:07:21.223092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3/9] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:21 2022] POST /compute/v2.1/flavors => generated 413 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:21.235230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-58217154-cf51-4775-98d5-4b949e4eacac tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:21.268856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58217154-cf51-4775-98d5-4b949e4eacac tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.269477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58217154-cf51-4775-98d5-4b949e4eacac tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.269921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58217154-cf51-4775-98d5-4b949e4eacac tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.398199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c2b2247-9c63-4ac4-bb07-b6341979624c tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Calling method '.version_select at 0x7f1d7d694790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:21.400352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1c2b2247-9c63-4ac4-bb07-b6341979624c tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '17510b7279e04872a0394c5e3bbe5f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b96292162a646fca7f5a054de344f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c2b2247-9c63-4ac4-bb07-b6341979624c tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Request method failure captured: Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/n-h2-862769-3/search HTTP/1.1 Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChlkKrsAwZ8w6Wz_cq6pQvmWjd7tQvU1f5TxOyJmg9eHHu5cWy7X3ToPo7uQYrBSa9XeaSJsN6P7NSmRlyGEOvQte0x3kuPkgBaqx4Kb4JdtMOLp1WGwa22eoxjOQ6mqU3HO9j1mASdkLYzFvISjHW0hUTvUfi7pFVy5fEfOR7EYvY Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2b96292162a646fca7f5a054de344f28 Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-5967775 Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:21.402265 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b96292162a646fca7f5a054de344f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b96292162a646fca7f5a054de344f28", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b96292162a646fca7f5a054de344f28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b96292162a646fca7f5a054de344f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-5967775 Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2b96292162a646fca7f5a054de344f28 Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-5967775 Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-5967775-project Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 17510b7279e04872a0394c5e3bbe5f54 Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-5967775-project Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 19:07:21.403219 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'n-h2-862769-3'} Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:21.403833 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 19:07:21.404691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.406222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c2b2247-9c63-4ac4-bb07-b6341979624c tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:21.406222 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c2b2247-9c63-4ac4-bb07-b6341979624c tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/n-h2-862769-3/search" status: 403 len: 117 microversion: 2.1 time: 0.188947 Oct 28 19:07:21.406222 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 7/10] 10.222.0.44 () {58 vars in 1209 bytes} [Fri Oct 28 19:07:21 2022] GET /compute/v2.1/os-hypervisors/n-h2-862769-3/search => generated 117 bytes in 190 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:21.410217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cecaff8b-ad86-4144-8553-1ddb52a75db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:21.412405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cecaff8b-ad86-4144-8553-1ddb52a75db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3ebee4d8249545adae4e09c846568dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad5bc2aad24df4b221c780152e4fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cecaff8b-ad86-4144-8553-1ddb52a75db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Request method failure captured: Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2019:07:21 HTTP/1.1 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChlVvnkt_KvJRU4Yxzqn--cVGihIS0CAQHtsvtlDFO-3Tikooji0A-LpugyHNSaDlpsBFaMgKwg0Z6McPoXEuDW5dg7UudF_08Y7iDKE5zlaWPUxAY2jL6ySnprf2YUaAc1b9To0sMqlplzgctzD27Ah8BpdmfIl0yUQzeRtscFWC0 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d0ad5bc2aad24df4b221c780152e4fd6 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:21.415478 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d0ad5bc2aad24df4b221c780152e4fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d0ad5bc2aad24df4b221c780152e4fd6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d0ad5bc2aad24df4b221c780152e4fd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d0ad5bc2aad24df4b221c780152e4fd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d0ad5bc2aad24df4b221c780152e4fd6 Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3ebee4d8249545adae4e09c846568dbf Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project Oct 28 19:07:21.416810 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '2022-10-28 19:07:21'} Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:21.417266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 19:07:21.418335 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.419437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cecaff8b-ad86-4144-8553-1ddb52a75db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:21.419437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cecaff8b-ad86-4144-8553-1ddb52a75db8 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555 tempest-InstanceUsageAuditLogNegativeTestJSON-1945432555-project] 10.222.0.44 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 19:07:21" status: 403 len: 128 microversion: 2.1 time: 0.012159 Oct 28 19:07:21.419437 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 8/11] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:07:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2019%3A07%3A21 => generated 128 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:21.422254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df512975-e2b0-4fcc-b851-04cb1eeca9e7 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:21.476184 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df512975-e2b0-4fcc-b851-04cb1eeca9e7 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056947 Oct 28 19:07:21.477762 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 9/12] 10.222.0.44 () {60 vars in 1221 bytes} [Fri Oct 28 19:07:21 2022] POST /compute/v2.1/flavors/227726756/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:21.483116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-097d708e-cd90-4258-b74d-c28f23258086 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:21.750379 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-097d708e-cd90-4258-b74d-c28f23258086 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1425572904/action" status: 200 len: 97 microversion: 2.1 time: 0.270655 Oct 28 19:07:21.751211 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 10/13] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:21 2022] POST /compute/v2.1/flavors/1425572904/action => generated 97 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:21.756368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Calling method '.version_select at 0x7f1d7cd7fa60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:21.759184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:21.759833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:21.760266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:21.776465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Request method failure captured: Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChnk-FgkbVrOrZdJVBUo1XJEsRAvbftwyDXIA8zeuAfw1tzshTxUBZ4pvo2EKboGd6hl_yDUHqpRaQokdSzWu5H2rC6bv2fAatyP0Hr3woJkQ9ZY36bgpOG2XEwEOCl5ZBZlsEjlm4XWqh83ANi8SPtNnfUATU_aJx0D6SPn-FJGgY Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8bb7a12ce3eb4497b73e909cc7183c3f Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1925713906 Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:21.778367 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8bb7a12ce3eb4497b73e909cc7183c3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8bb7a12ce3eb4497b73e909cc7183c3f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8bb7a12ce3eb4497b73e909cc7183c3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8bb7a12ce3eb4497b73e909cc7183c3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1925713906 Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8bb7a12ce3eb4497b73e909cc7183c3f Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1925713906 Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2acbf8c024d5401d9b6b8ed5f901bfa2 Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 19:07:21.779578 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:21.780285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8c0a474c-383c-43f2-919e-4c7060ac20a9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027750 Oct 28 19:07:21.781397 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 11/14] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:07:21 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:21.813998 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-58217154-cf51-4775-98d5-4b949e4eacac tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.597467 Oct 28 19:07:21.814598 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 4/15] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:07:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:21.828484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31c205e4-c962-41bc-b227-cc8c83a3f0f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.052081 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-31c205e4-c962-41bc-b227-cc8c83a3f0f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project f26882aa11ab4e398c04bcc883fb7fff combination. Oct 28 19:07:22.062013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f96a1fd2-a4fc-4825-b361-4f6d9e00f4aa tempest-FlavorsExtraSpecsTestJSON-2090125042 tempest-FlavorsExtraSpecsTestJSON-2090125042-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31c205e4-c962-41bc-b227-cc8c83a3f0f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Request method failure captured: Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/flavors/1425572904/action HTTP/1.1 Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 67 Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChmEgdRHRYlkwPwXsg_q2sPAWZefDm5C69KHAjx5Z1-JGS3qK7RYYM7gGBtupFU2J6v1JjF_rlWO7SfHeH6wUnlbVhHTLa5NdiIGKRM8vhRv45CiW-CbgSyEJjm26BVJ5KJbgzAg2P-CEmZtAuztj2lEyts26Y3WJYARS6M-jB2u_o Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: eaa843873f3a4a319a21e2c315dc7f3a Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:07:22.071950 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_eaa843873f3a4a319a21e2c315dc7f3a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: eaa843873f3a4a319a21e2c315dc7f3a Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 360fe7f6c52d478b8c5c1fb65ff9f727 Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: {"addTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} Oct 28 19:07:22.073216 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: exception: Flavor access already exists for flavor 15 and project f26882aa11ab4e398c04bcc883fb7fff combination. Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1425572904', 'body': {'addTenantAccess': {'tenant': 'f26882aa11ab4e398c04bcc883fb7fff'}}} Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result.read() Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:07:22.073923 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-f26882aa11ab4e398c04bcc883fb7fff' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:07:22.075022 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:07:22.076104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:07:22.077104 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result.read() Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-f26882aa11ab4e398c04bcc883fb7fff' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 19, 7, 22, 46056), 'updated_at': None, 'flavor_id': 15, 'project_id': 'f26882aa11ab4e398c04bcc883fb7fff'}] Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.078083 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project f26882aa11ab4e398c04bcc883fb7fff combination. Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.079078 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project f26882aa11ab4e398c04bcc883fb7fff combination. Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:22.080128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:22.081213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project f26882aa11ab4e398c04bcc883fb7fff combination. Oct 28 19:07:22.081213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.083011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31c205e4-c962-41bc-b227-cc8c83a3f0f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project f26882aa11ab4e398c04bcc883fb7fff combination. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:22.083572 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-31c205e4-c962-41bc-b227-cc8c83a3f0f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1425572904/action" status: 409 len: 152 microversion: 2.1 time: 0.259495 Oct 28 19:07:22.084892 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 5/16] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:21 2022] POST /compute/v2.1/flavors/1425572904/action => generated 152 bytes in 270 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:07:22.090779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Calling method '.version_select at 0x7f1d7d8a9d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.093236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.093873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.094462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.098726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f96a1fd2-a4fc-4825-b361-4f6d9e00f4aa tempest-FlavorsExtraSpecsTestJSON-2090125042 tempest-FlavorsExtraSpecsTestJSON-2090125042-project] 10.222.0.44 "GET /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.316797 Oct 28 19:07:22.099877 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 12/17] 10.222.0.44 () {58 vars in 1200 bytes} [Fri Oct 28 19:07:21 2022] GET /compute/v2.1/flavors/227726756/os-extra_specs => generated 66 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.105412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.118356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.119335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.120051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.126482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.127156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.127765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.132609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.133098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.133534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.140091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0fca66f0-d72f-413a-b7e3-5105a82dc4b9 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053856 Oct 28 19:07:22.141261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 6/18] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:22.153753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e4aba48-149b-4424-a1b2-c719c3cad9ce tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.206121 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-862769-3. Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 39 Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:22.238202 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: {"add_host": {"host": "n-h2-862769-3"}} Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:22.239293 n-d-862769-3 devstack@n-api.service[120628]: exception: Aggregate 1 already has host n-h2-862769-3. Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-862769-3'}}} Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result.read() Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:07:22.239951 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-862769-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:07:22.240947 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:07:22.241824 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:07:22.242644 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result.read() Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-862769-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 19, 7, 22, 185723), 'updated_at': None, 'host': 'n-h2-862769-3', 'aggregate_id': 1}] Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.243509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-862769-3. Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.244392 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-862769-3. Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:22.245415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:22.250668 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-862769-3. Oct 28 19:07:22.250668 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.250668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-862769-3. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:22.250668 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b76a6cd0-916f-4e8e-a158-36e57e4cafcd tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.141091 Oct 28 19:07:22.250668 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 13/19] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 28 19:07:22.252913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc398502-35df-46e8-9bee-c6a9cf4e4169 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.262095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e4aba48-149b-4424-a1b2-c719c3cad9ce tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1425572904/action" status: 200 len: 21 microversion: 2.1 time: 0.119595 Oct 28 19:07:22.263109 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 7/20] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/flavors/1425572904/action => generated 21 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.272620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a884bf3-edc2-4ee5-a757-2173ed575109 tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Calling method '.version_select at 0x7f1d7cb5fdc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.275289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1a884bf3-edc2-4ee5-a757-2173ed575109 tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '17510b7279e04872a0394c5e3bbe5f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b96292162a646fca7f5a054de344f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a884bf3-edc2-4ee5-a757-2173ed575109 tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Request method failure captured: Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChlkKrsAwZ8w6Wz_cq6pQvmWjd7tQvU1f5TxOyJmg9eHHu5cWy7X3ToPo7uQYrBSa9XeaSJsN6P7NSmRlyGEOvQte0x3kuPkgBaqx4Kb4JdtMOLp1WGwa22eoxjOQ6mqU3HO9j1mASdkLYzFvISjHW0hUTvUfi7pFVy5fEfOR7EYvY Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2b96292162a646fca7f5a054de344f28 Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-5967775 Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:22.278442 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b96292162a646fca7f5a054de344f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b96292162a646fca7f5a054de344f28", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b96292162a646fca7f5a054de344f28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b96292162a646fca7f5a054de344f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-5967775 Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2b96292162a646fca7f5a054de344f28 Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-5967775 Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-5967775-project Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 17510b7279e04872a0394c5e3bbe5f54 Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-5967775-project Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1'} Oct 28 19:07:22.279515 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:22.280138 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 19:07:22.281128 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.281918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a884bf3-edc2-4ee5-a757-2173ed575109 tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:22.281918 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a884bf3-edc2-4ee5-a757-2173ed575109 tempest-HypervisorAdminNegativeUnderV252Test-5967775 tempest-HypervisorAdminNegativeUnderV252Test-5967775-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015667 Oct 28 19:07:22.281918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 8/21] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:22.292663 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc398502-35df-46e8-9bee-c6a9cf4e4169 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045588 Oct 28 19:07:22.297498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 14/22] 10.222.0.44 () {60 vars in 1221 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/flavors/227726756/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.298399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db5ce45c-381d-4b70-ba85-a35df7ea8403 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.307794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-756bda79-0432-46dc-9298-2ac10174aee5 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.320911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db5ce45c-381d-4b70-ba85-a35df7ea8403 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.320911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db5ce45c-381d-4b70-ba85-a35df7ea8403 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.321233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db5ce45c-381d-4b70-ba85-a35df7ea8403 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.349969 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-756bda79-0432-46dc-9298-2ac10174aee5 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1425572904" status: 202 len: 0 microversion: 2.1 time: 0.050745 Oct 28 19:07:22.377907 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 15/23] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:07:22 2022] DELETE /compute/v2.1/flavors/1425572904 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:22.386548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Calling method '.version_select at 0x7f1d7cdc1b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.388930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:22.389478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:22.389965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:22.400266 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] HTTP exception thrown: No hypervisor matching 'a944d7be-fda5-4be0-ae3a-f25f6f6edef8' could be found. Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Request method failure captured: Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/a944d7be-fda5-4be0-ae3a-f25f6f6edef8/servers HTTP/1.1 Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChnk-FgkbVrOrZdJVBUo1XJEsRAvbftwyDXIA8zeuAfw1tzshTxUBZ4pvo2EKboGd6hl_yDUHqpRaQokdSzWu5H2rC6bv2fAatyP0Hr3woJkQ9ZY36bgpOG2XEwEOCl5ZBZlsEjlm4XWqh83ANi8SPtNnfUATU_aJx0D6SPn-FJGgY Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8bb7a12ce3eb4497b73e909cc7183c3f Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1925713906 Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:22.402118 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8bb7a12ce3eb4497b73e909cc7183c3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8bb7a12ce3eb4497b73e909cc7183c3f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8bb7a12ce3eb4497b73e909cc7183c3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8bb7a12ce3eb4497b73e909cc7183c3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1925713906 Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8bb7a12ce3eb4497b73e909cc7183c3f Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1925713906 Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2acbf8c024d5401d9b6b8ed5f901bfa2 Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: exception: No hypervisor matching 'a944d7be-fda5-4be0-ae3a-f25f6f6edef8' could be found. Oct 28 19:07:22.403275 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a944d7be-fda5-4be0-ae3a-f25f6f6edef8'} Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a944d7be-fda5-4be0-ae3a-f25f6f6edef8' could be found. Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.403919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.404946 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.404946 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.404946 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:22.404946 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:22.404946 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a944d7be-fda5-4be0-ae3a-f25f6f6edef8' could be found. Oct 28 19:07:22.404946 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.406087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] Returning 404 to user: No hypervisor matching 'a944d7be-fda5-4be0-ae3a-f25f6f6edef8' could be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:22.407242 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b2a04ba-48a1-4337-901c-38f8cca3a663 tempest-HypervisorAdminNegativeUnderV252Test-1925713906 tempest-HypervisorAdminNegativeUnderV252Test-1925713906-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/a944d7be-fda5-4be0-ae3a-f25f6f6edef8/servers" status: 404 len: 123 microversion: 2.1 time: 0.027611 Oct 28 19:07:22.408212 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 16/24] 10.222.0.44 () {58 vars in 1281 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/os-hypervisors/a944d7be-fda5-4be0-ae3a-f25f6f6edef8/servers => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:22.413692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc067c43-e9a3-4bce-a30b-91e03d235eb1 tempest-FlavorsExtraSpecsTestJSON-2090125042 tempest-FlavorsExtraSpecsTestJSON-2090125042-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.430132 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc067c43-e9a3-4bce-a30b-91e03d235eb1 tempest-FlavorsExtraSpecsTestJSON-2090125042 tempest-FlavorsExtraSpecsTestJSON-2090125042-project] 10.222.0.44 "GET /compute/v2.1/flavors/227726756/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.020603 Oct 28 19:07:22.430764 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 17/25] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/flavors/227726756/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.436102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5298706d-4d1a-4e3a-b8b8-9dab9f6e6a1f tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.488176 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5298706d-4d1a-4e3a-b8b8-9dab9f6e6a1f tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.056127 Oct 28 19:07:22.500162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 18/26] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:22.511376 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db5ce45c-381d-4b70-ba85-a35df7ea8403 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.229820 Oct 28 19:07:22.512592 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 9/27] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:22.517279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce975c9a-14d6-48ca-87d2-71ac2d86cf04 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2095534249", "id": 811962057, "os-flavor-access:is_public": "True"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.519423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70feb856-6786-4c5b-b8f8-b1b828881ff4 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.554952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce975c9a-14d6-48ca-87d2-71ac2d86cf04 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041013 Oct 28 19:07:22.555960 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 10/28] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/flavors => generated 435 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:22.563923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c784e610-e59b-4027-ad15-f07eac50259a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.571025 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70feb856-6786-4c5b-b8f8-b1b828881ff4 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069191 Oct 28 19:07:22.572305 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 19/29] 10.222.0.44 () {60 vars in 1221 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/flavors/227726756/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.586876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44eef5f1-580d-4273-9b7e-9fb765be621e tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.599105 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c784e610-e59b-4027-ad15-f07eac50259a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.041446 Oct 28 19:07:22.601956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 11/30] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:22 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:22.614986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4497ad36-7c1e-468a-9bec-519d614749ed tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.620150 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-44eef5f1-580d-4273-9b7e-9fb765be621e tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44eef5f1-580d-4273-9b7e-9fb765be621e tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Request method failure captured: Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/flavors/811962057/os-flavor-access HTTP/1.1 Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChmEgdRHRYlkwPwXsg_q2sPAWZefDm5C69KHAjx5Z1-JGS3qK7RYYM7gGBtupFU2J6v1JjF_rlWO7SfHeH6wUnlbVhHTLa5NdiIGKRM8vhRv45CiW-CbgSyEJjm26BVJ5KJbgzAg2P-CEmZtAuztj2lEyts26Y3WJYARS6M-jB2u_o Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: eaa843873f3a4a319a21e2c315dc7f3a Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:22.622149 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_eaa843873f3a4a319a21e2c315dc7f3a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: eaa843873f3a4a319a21e2c315dc7f3a Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 360fe7f6c52d478b8c5c1fb65ff9f727 Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: exception: Access list not available for public flavors. Oct 28 19:07:22.623610 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'flavor_id': '811962057'} Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 28 19:07:22.624393 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:22.627783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44eef5f1-580d-4273-9b7e-9fb765be621e tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:22.630061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44eef5f1-580d-4273-9b7e-9fb765be621e tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/811962057/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.055439 Oct 28 19:07:22.630933 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 20/31] 10.222.0.44 () {58 vars in 1206 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/flavors/811962057/os-flavor-access => generated 91 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:07:22.634601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4497ad36-7c1e-468a-9bec-519d614749ed tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028484 Oct 28 19:07:22.636396 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 12/32] 10.222.0.44 () {58 vars in 1200 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/flavors/227726756/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.648579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6b78284-9c6a-4358-81dc-aa65114652f0 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1011957611"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.653507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bfb6d0f1-8f0b-4006-8cbd-7fa814cee1fe tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-515885570"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.659486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-bfb6d0f1-8f0b-4006-8cbd-7fa814cee1fe tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid b407c201-3cd1-492c-aba1-c3e255ce19dc for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:22.660208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-b6b78284-9c6a-4358-81dc-aa65114652f0 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Generated uuid 29b31e77-4582-4952-bc75-fba65ae56844 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:22.716795 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6b78284-9c6a-4358-81dc-aa65114652f0 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.076744 Oct 28 19:07:22.718208 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 13/33] 10.222.0.44 () {62 vars in 1205 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:22.725383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-496f2d28-6933-4272-8447-427369907d03 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.737147 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bfb6d0f1-8f0b-4006-8cbd-7fa814cee1fe tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.077886 Oct 28 19:07:22.746341 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 21/34] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:22.752277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3193d53b-ad09-4adc-be83-c31f74bf0310 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.792267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-496f2d28-6933-4272-8447-427369907d03 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/811962057" status: 202 len: 0 microversion: 2.1 time: 0.072601 Oct 28 19:07:22.793582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 14/35] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:07:22 2022] DELETE /compute/v2.1/flavors/811962057 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:22.799075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-524a5e53-8962-4766-8506-6d8fcdb5e0ef tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1510286138"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:22.799412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3193d53b-ad09-4adc-be83-c31f74bf0310 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "PUT /compute/v2.1/flavors/227726756/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.051591 Oct 28 19:07:22.802074 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 22/36] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:07:22 2022] PUT /compute/v2.1/flavors/227726756/os-extra_specs/hw:numa_nodes => generated 22 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:22.936659 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-524a5e53-8962-4766-8506-6d8fcdb5e0ef tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.141357 Oct 28 19:07:22.937354 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 15/37] 10.222.0.44 () {62 vars in 1210 bytes} [Fri Oct 28 19:07:22 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:22.943691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55e5dfe0-4846-420e-a68a-ffdf56369469 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:22.994886 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55e5dfe0-4846-420e-a68a-ffdf56369469 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.056223 Oct 28 19:07:22.999925 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 16/38] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:22 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:23.006947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5981a80-82df-4520-85fb-0e740d2c3edb tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.028653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5981a80-82df-4520-85fb-0e740d2c3edb tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024399 Oct 28 19:07:23.029561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 17/39] 10.222.0.44 () {58 vars in 1200 bytes} [Fri Oct 28 19:07:23 2022] GET /compute/v2.1/flavors/227726756/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:23.038532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-efe78203-1ac4-451b-9213-5ac66188dd73 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.048716 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-efe78203-1ac4-451b-9213-5ac66188dd73 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.017973 Oct 28 19:07:23.058637 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 18/40] 10.222.0.44 () {60 vars in 1190 bytes} [Fri Oct 28 19:07:23 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:23.064092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50147639-de21-4737-9f4e-9e3bd50889d7 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1153130244", "id": 980064329, "os-flavor-access:is_public": "False"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:23.105278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2f50bb-1ba7-4884-bca3-20c77f5245c6 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:23.109175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc2f50bb-1ba7-4884-bca3-20c77f5245c6 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '10f651bd96d04cbd92f5eb5f292d0073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52939de27b4db1a34684ab6cadf5ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:23.109289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50147639-de21-4737-9f4e-9e3bd50889d7 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.044551 Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2f50bb-1ba7-4884-bca3-20c77f5245c6 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Request method failure captured: Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 39 Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChkU-_qYA-d7rALxIaLW0CuXXug0HaSSjfzLfQ2XAqddSzAyDzwadhRgFLjUqBW9E1mENBvIp1gBZLV0irUM81qN88tmtIz4gSrSuSsNZWPINYHEP5ImhBf6cxrVLRCko7FhqivUMYO89abi1gkO7pclBITNo-D4jm8ladYzg0TYRM Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:23.111238 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1b52939de27b4db1a34684ab6cadf5ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 10f651bd96d04cbd92f5eb5f292d0073 Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: {"add_host": {"host": "n-h2-862769-3"}} Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:23.112394 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-862769-3'}}} Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:23.113087 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 19:07:23.114089 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.116854 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 19/41] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:23 2022] POST /compute/v2.1/flavors => generated 436 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:23.117681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2f50bb-1ba7-4884-bca3-20c77f5245c6 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:23.121228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc2f50bb-1ba7-4884-bca3-20c77f5245c6 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] 10.222.0.44 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.315366 Oct 28 19:07:23.121889 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 23/42] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:07:22 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 319 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:23.123780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-deda8329-99e1-4a93-acc0-8bf42e7010ae tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.129030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74cb976e-549a-432d-93d5-2a2beb9cf545 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:23.155400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74cb976e-549a-432d-93d5-2a2beb9cf545 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.158929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74cb976e-549a-432d-93d5-2a2beb9cf545 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.159596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74cb976e-549a-432d-93d5-2a2beb9cf545 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.172236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-deda8329-99e1-4a93-acc0-8bf42e7010ae tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/227726756/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.051836 Oct 28 19:07:23.178321 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:07:23 2022] DELETE /compute/v2.1/flavors/227726756/os-extra_specs/hw:numa_nodes => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:23.200923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:23.495291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b09dd8af-bfe3-4dd5-8700-77708f21b2ca tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:23.498499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b09dd8af-bfe3-4dd5-8700-77708f21b2ca tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '2cb6547d3c1d4254b778a5598b403afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26882aa11ab4e398c04bcc883fb7fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b09dd8af-bfe3-4dd5-8700-77708f21b2ca tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Request method failure captured: Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/flavors/980064329/action HTTP/1.1 Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 67 Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChk0HITvs6tVqsbEyH0jhRLKPI9DPnyL_rr_F7eiMIv40UcM1UVKAEore5wq7JFqDXFa2B67czxDbP39SBZrexHNrLVSTg26VZExsI03tyqN75Vi4WL2B-u8KPRehMbVvUGMlfeMp4tzKP2eTZU5MaH4vlg-vdfGI5Ztvkz3pWVCDA Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f26882aa11ab4e398c04bcc883fb7fff Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-439498664 Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:23.500111 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26882aa11ab4e398c04bcc883fb7fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26882aa11ab4e398c04bcc883fb7fff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26882aa11ab4e398c04bcc883fb7fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26882aa11ab4e398c04bcc883fb7fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-439498664 Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f26882aa11ab4e398c04bcc883fb7fff Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-439498664 Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FlavorsAccessNegativeTestJSON-439498664-project Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2cb6547d3c1d4254b778a5598b403afc Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-439498664-project Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: {"addTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} Oct 28 19:07:23.501156 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '980064329', 'body': {'addTenantAccess': {'tenant': 'f26882aa11ab4e398c04bcc883fb7fff'}}} Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:23.501784 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 19:07:23.502670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.503631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b09dd8af-bfe3-4dd5-8700-77708f21b2ca tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:23.503631 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b09dd8af-bfe3-4dd5-8700-77708f21b2ca tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] 10.222.0.44 "POST /compute/v2.1/flavors/980064329/action" status: 403 len: 130 microversion: 2.1 time: 0.321973 Oct 28 19:07:23.515102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 21/44] 10.222.0.44 () {60 vars in 1197 bytes} [Fri Oct 28 19:07:23 2022] POST /compute/v2.1/flavors/980064329/action => generated 130 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:23.519814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd2b2863-1648-4c17-a8ce-659d8c327ee3 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.575665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd2b2863-1648-4c17-a8ce-659d8c327ee3 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.058581 Oct 28 19:07:23.577452 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 22/45] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:23 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:23.591312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a62ba305-df10-40b8-a695-05fa2c1bef07 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.614442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=11,nova_api:UPDATE=1,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:23.632029 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a62ba305-df10-40b8-a695-05fa2c1bef07 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/227726756/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.053138 Oct 28 19:07:23.633039 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 23/46] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:07:23 2022] DELETE /compute/v2.1/flavors/227726756/os-extra_specs/hw:cpu_policy => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:23.646853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7c458a8-c411-4f09-ad1c-97f2ff591f04 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.687404 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7c458a8-c411-4f09-ad1c-97f2ff591f04 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/980064329" status: 202 len: 0 microversion: 2.1 time: 0.052142 Oct 28 19:07:23.693774 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 24/47] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:07:23 2022] DELETE /compute/v2.1/flavors/980064329 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:23.710212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fa66802-b33a-49d3-8596-d58921236397 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1336188403"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:23.725355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-1fa66802-b33a-49d3-8596-d58921236397 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid 7770e509-a1ce-4a5d-b1e4-289990633210 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:23.750271 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fa66802-b33a-49d3-8596-d58921236397 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054623 Oct 28 19:07:23.763250 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 25/48] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:23.770407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28a2c8c5-34d7-4a16-86ef-b6ffc50f1e80 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.782386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28a2c8c5-34d7-4a16-86ef-b6ffc50f1e80 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/227726756/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016860 Oct 28 19:07:23.783436 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 26/49] 10.222.0.44 () {58 vars in 1200 bytes} [Fri Oct 28 19:07:23 2022] GET /compute/v2.1/flavors/227726756/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:23.788548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a338c0a3-b2aa-4727-953e-58e60ab03f6f tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.814621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a338c0a3-b2aa-4727-953e-58e60ab03f6f tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.029581 Oct 28 19:07:23.815854 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 27/50] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:23 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:23.824791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2039813102"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:23.835817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.836314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.836743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.850782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:23.851482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:23.852117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:23.900657 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2039813102 could not be found. Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 58 Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:07:23.908682 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: {"add_host": {"host": "tempest-nonexist_host-2039813102"}} Oct 28 19:07:23.909842 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: exception: Compute host tempest-nonexist_host-2039813102 could not be found. Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2039813102'}}} Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2039813102' is not mapped to any cell Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.910443 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 28 19:07:23.912114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2039813102 could not be found. Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2039813102 could not be found. Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:23.913474 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2039813102 could not be found. Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2039813102 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:23.915824 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d07b9f7-1af0-425b-ad9e-a555f374b46a tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.098121 Oct 28 19:07:23.926474 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 28/51] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:07:23 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:23.937045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc9627e3-de4f-444b-a804-fc6e34822f91 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.982918 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74cb976e-549a-432d-93d5-2a2beb9cf545 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.859505 Oct 28 19:07:23.983546 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 24/52] 10.222.0.44 () {62 vars in 1232 bytes} [Fri Oct 28 19:07:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:23.988814 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc9627e3-de4f-444b-a804-fc6e34822f91 tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/227726756" status: 202 len: 0 microversion: 2.1 time: 0.059026 Oct 28 19:07:23.991124 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 29/53] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:07:23 2022] DELETE /compute/v2.1/flavors/227726756 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:23.997491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc50201f-2453-4417-b4b5-c7667a676e95 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:23.998351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e0da044-8ef5-463a-9ca0-ba713a8587ab tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1745039798", "id": 1122766540, "os-flavor-access:is_public": "False"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.028177 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc50201f-2453-4417-b4b5-c7667a676e95 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.034342 Oct 28 19:07:24.029372 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 30/54] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:23 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:24.039212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c0a0b71f-781c-446d-b6bd-de5117ac664d tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.053242 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e0da044-8ef5-463a-9ca0-ba713a8587ab tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.064670 Oct 28 19:07:24.054466 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 25/55] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:23 2022] POST /compute/v2.1/flavors => generated 439 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:24.057149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0a0b71f-781c-446d-b6bd-de5117ac664d tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:24.057853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0a0b71f-781c-446d-b6bd-de5117ac664d tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:24.058440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0a0b71f-781c-446d-b6bd-de5117ac664d tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:24.059388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46c120af-e0e5-4530-9eb4-70dd1c2e815d tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:24.103908 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46c120af-e0e5-4530-9eb4-70dd1c2e815d tempest-FlavorsExtraSpecsTestJSON-434150455 tempest-FlavorsExtraSpecsTestJSON-434150455-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048225 Oct 28 19:07:24.117946 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 26/56] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:24.138281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3271da8-5eed-4464-8ce5-477136fcef92 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3271da8-5eed-4464-8ce5-477136fcef92 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 283 Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:24.144404 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:24.145678 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:07:24.146343 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:24.146894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.147837 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.148548 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:07:24.148548 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:07:24.148548 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:07:24.148548 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.148548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3271da8-5eed-4464-8ce5-477136fcef92 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:24.148846 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3271da8-5eed-4464-8ce5-477136fcef92 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.027454 Oct 28 19:07:24.148846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 27/57] 10.222.0.44 () {60 vars in 1165 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:07:24.155988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-598f5270-af20-419e-bd02-e9c751fb98f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.297169 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c0a0b71f-781c-446d-b6bd-de5117ac664d tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.266224 Oct 28 19:07:24.298179 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 31/58] 10.222.0.44 () {62 vars in 1232 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:24.304613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ea28059-4e39-4ced-9eff-d7d026388722 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ea28059-4e39-4ced-9eff-d7d026388722 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 27 Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:07:24.314302 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: {"aggregate": {"name": ""}} Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:24.315681 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi '' Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:24.316433 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:07:24.317693 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.319956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ea28059-4e39-4ced-9eff-d7d026388722 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:24.319956 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ea28059-4e39-4ced-9eff-d7d026388722 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016762 Oct 28 19:07:24.319956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 32/59] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:07:24.328666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-603b2f36-ffa1-4f9d-9786-533be04354a1 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:24.379414 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-603b2f36-ffa1-4f9d-9786-533be04354a1 tempest-AggregatesAdminTestV241-638132108 tempest-AggregatesAdminTestV241-638132108-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.058718 Oct 28 19:07:24.381449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 33/60] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 19:07:24 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:24.393301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-adc9a6a7-a9ae-4563-acd9-1a5cbf337611 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-336907933"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.407039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-adc9a6a7-a9ae-4563-acd9-1a5cbf337611 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '10f651bd96d04cbd92f5eb5f292d0073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52939de27b4db1a34684ab6cadf5ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-adc9a6a7-a9ae-4563-acd9-1a5cbf337611 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Request method failure captured: Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 59 Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChkU-_qYA-d7rALxIaLW0CuXXug0HaSSjfzLfQ2XAqddSzAyDzwadhRgFLjUqBW9E1mENBvIp1gBZLV0irUM81qN88tmtIz4gSrSuSsNZWPINYHEP5ImhBf6cxrVLRCko7FhqivUMYO89abi1gkO7pclBITNo-D4jm8ladYzg0TYRM Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:24.410212 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1b52939de27b4db1a34684ab6cadf5ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 10f651bd96d04cbd92f5eb5f292d0073 Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: {"aggregate": {"name": "tempest-test_aggregate-336907933"}} Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:24.411559 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-336907933'}}} Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:24.412249 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:24.413121 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 19:07:24.414026 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.418658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-adc9a6a7-a9ae-4563-acd9-1a5cbf337611 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:24.419708 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-adc9a6a7-a9ae-4563-acd9-1a5cbf337611 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.035226 Oct 28 19:07:24.420438 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 34/61] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:24.431161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9fc2619d-1014-476e-bf5e-1dc914d5d128 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1424438511"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.443631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-9fc2619d-1014-476e-bf5e-1dc914d5d128 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid da3bf5db-433b-4849-a87a-1030736184e7 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:24.485555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9fc2619d-1014-476e-bf5e-1dc914d5d128 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059135 Oct 28 19:07:24.486519 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 35/62] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:07:24.498112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b65dbb0-d3e5-4ca3-bba8-8666f833a454 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2005175548", "name": "tempest-test_aggregate-1136082781"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.533951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-6b65dbb0-d3e5-4ca3-bba8-8666f833a454 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid ea00dd33-e854-4015-98eb-e6b96943c76b for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:24.596612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b65dbb0-d3e5-4ca3-bba8-8666f833a454 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.108021 Oct 28 19:07:24.597574 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 36/63] 10.222.0.44 () {60 vars in 1165 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:24.602286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02609f3b-c140-448b-a86a-19a23a4a85a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1424438511"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.606928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-02609f3b-c140-448b-a86a-19a23a4a85a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid 7f256bf4-1524-4c12-9390-93d121b9afba for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:24.632790 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-02609f3b-c140-448b-a86a-19a23a4a85a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1424438511 already exists. Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02609f3b-c140-448b-a86a-19a23a4a85a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 60 Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:07:24.635363 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: {"aggregate": {"name": "tempest-test_aggregate-1424438511"}} Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:24.636745 n-d-862769-3 devstack@n-api.service[120629]: exception: Aggregate tempest-test_aggregate-1424438511 already exists. Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1424438511'}}} Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 28 19:07:24.637405 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1424438511 already exists. Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:24.638323 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1424438511 already exists. Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1424438511 already exists. Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02609f3b-c140-448b-a86a-19a23a4a85a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1424438511 already exists. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:24.639351 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02609f3b-c140-448b-a86a-19a23a4a85a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.037647 Oct 28 19:07:24.647400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 37/64] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:07:24.663033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5820388d-3d44-40fc-93c1-2da45317b01d tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:24.685696 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5820388d-3d44-40fc-93c1-2da45317b01d tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.035565 Oct 28 19:07:24.686733 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 38/65] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:07:24 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:24.692503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-835f10f4-91c0-4a63-bf8f-0a86be5b3b8b tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:24.736928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-835f10f4-91c0-4a63-bf8f-0a86be5b3b8b tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.048723 Oct 28 19:07:24.740826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 39/66] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:24 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:24.748114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e52bcbf-865e-4418-803d-95f8d9c42b57 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:24.764401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e52bcbf-865e-4418-803d-95f8d9c42b57 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:24.765918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e52bcbf-865e-4418-803d-95f8d9c42b57 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:24.766503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e52bcbf-865e-4418-803d-95f8d9c42b57 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:25.001597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e52bcbf-865e-4418-803d-95f8d9c42b57 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.1 time: 0.259294 Oct 28 19:07:25.002241 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 40/67] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:25.012380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-be6633e1-e1e5-404e-9dc0-24e782555d17 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-214873201"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:25.025818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-be6633e1-e1e5-404e-9dc0-24e782555d17 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid 8aa80120-03b5-4380-9986-d70a216eaf60 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:25.104630 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-be6633e1-e1e5-404e-9dc0-24e782555d17 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.098289 Oct 28 19:07:25.111850 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 41/68] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:25.118515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5e16dd8-56e7-47d1-adf3-53ca96adb472 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:25.121258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5e16dd8-56e7-47d1-adf3-53ca96adb472 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '10f651bd96d04cbd92f5eb5f292d0073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52939de27b4db1a34684ab6cadf5ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5e16dd8-56e7-47d1-adf3-53ca96adb472 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Request method failure captured: Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChkU-_qYA-d7rALxIaLW0CuXXug0HaSSjfzLfQ2XAqddSzAyDzwadhRgFLjUqBW9E1mENBvIp1gBZLV0irUM81qN88tmtIz4gSrSuSsNZWPINYHEP5ImhBf6cxrVLRCko7FhqivUMYO89abi1gkO7pclBITNo-D4jm8ladYzg0TYRM Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:25.124814 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1b52939de27b4db1a34684ab6cadf5ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 10f651bd96d04cbd92f5eb5f292d0073 Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 19:07:25.126006 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7'} Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:25.126587 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.127622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5e16dd8-56e7-47d1-adf3-53ca96adb472 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:25.128442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5e16dd8-56e7-47d1-adf3-53ca96adb472 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.013457 Oct 28 19:07:25.130373 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 42/69] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:25 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:07:25.140456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f2ae7fe-f33a-4e68-98be-54a33e44dd18 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:25.145382 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-598f5270-af20-419e-bd02-e9c751fb98f9 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1122766540/action" status: 200 len: 97 microversion: 2.1 time: 0.997792 Oct 28 19:07:25.146022 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 28/70] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:24 2022] POST /compute/v2.1/flavors/1122766540/action => generated 97 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:25.162132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9033cce7-4369-4c87-aca8-e4acbbed44bc tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:25.181191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9033cce7-4369-4c87-aca8-e4acbbed44bc tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '2cb6547d3c1d4254b778a5598b403afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26882aa11ab4e398c04bcc883fb7fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9033cce7-4369-4c87-aca8-e4acbbed44bc tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Request method failure captured: Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/flavors/1122766540/action HTTP/1.1 Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 70 Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChk0HITvs6tVqsbEyH0jhRLKPI9DPnyL_rr_F7eiMIv40UcM1UVKAEore5wq7JFqDXFa2B67czxDbP39SBZrexHNrLVSTg26VZExsI03tyqN75Vi4WL2B-u8KPRehMbVvUGMlfeMp4tzKP2eTZU5MaH4vlg-vdfGI5Ztvkz3pWVCDA Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f26882aa11ab4e398c04bcc883fb7fff Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-439498664 Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:25.182858 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26882aa11ab4e398c04bcc883fb7fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26882aa11ab4e398c04bcc883fb7fff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26882aa11ab4e398c04bcc883fb7fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26882aa11ab4e398c04bcc883fb7fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-439498664 Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f26882aa11ab4e398c04bcc883fb7fff Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-439498664 Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsAccessNegativeTestJSON-439498664-project Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2cb6547d3c1d4254b778a5598b403afc Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-439498664-project Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: {"removeTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} Oct 28 19:07:25.184121 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1122766540', 'body': {'removeTenantAccess': {'tenant': 'f26882aa11ab4e398c04bcc883fb7fff'}}} Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can( Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:25.184890 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 19:07:25.185846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.186752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9033cce7-4369-4c87-aca8-e4acbbed44bc tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:25.186752 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9033cce7-4369-4c87-aca8-e4acbbed44bc tempest-FlavorsAccessNegativeTestJSON-439498664 tempest-FlavorsAccessNegativeTestJSON-439498664-project] 10.222.0.44 "POST /compute/v2.1/flavors/1122766540/action" status: 403 len: 133 microversion: 2.1 time: 0.026147 Oct 28 19:07:25.188596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f2ae7fe-f33a-4e68-98be-54a33e44dd18 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.056786 Oct 28 19:07:25.190496 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 43/71] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:25 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:25.197015 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 29/72] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:25 2022] POST /compute/v2.1/flavors/1122766540/action => generated 133 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:07:25.202016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-049d447f-92de-42c7-9947-7a0a12c68522 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:25.206558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a0c65da-c113-475b-b8b7-7b819bc7f438 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f26882aa11ab4e398c04bcc883fb7fff"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:25.251832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-049d447f-92de-42c7-9947-7a0a12c68522 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-049d447f-92de-42c7-9947-7a0a12c68522 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:25.256987 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: exception: Aggregate -1 could not be found. Oct 28 19:07:25.258012 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '-1'} Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 19:07:25.258773 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.259651 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.260962 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.260962 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.260962 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:25.260962 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:25.260962 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 19:07:25.260962 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.263082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-049d447f-92de-42c7-9947-7a0a12c68522 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:25.266369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-049d447f-92de-42c7-9947-7a0a12c68522 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.068274 Oct 28 19:07:25.268119 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 30/73] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:07:25 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:07:25.280801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8607653d-0e61-44f9-a4e3-38464682be28 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-50267821"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:25.294759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-8607653d-0e61-44f9-a4e3-38464682be28 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid 2fe23e98-6dcc-41e8-ba96-4863d14d4cd9 for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:07:25.347601 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8607653d-0e61-44f9-a4e3-38464682be28 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.072730 Oct 28 19:07:25.348982 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 31/74] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:07:25 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:25.364954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27632a8f-1766-4e81-b628-7fa9406585da tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:25.370369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27632a8f-1766-4e81-b628-7fa9406585da tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '10f651bd96d04cbd92f5eb5f292d0073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52939de27b4db1a34684ab6cadf5ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27632a8f-1766-4e81-b628-7fa9406585da tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Request method failure captured: Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChkU-_qYA-d7rALxIaLW0CuXXug0HaSSjfzLfQ2XAqddSzAyDzwadhRgFLjUqBW9E1mENBvIp1gBZLV0irUM81qN88tmtIz4gSrSuSsNZWPINYHEP5ImhBf6cxrVLRCko7FhqivUMYO89abi1gkO7pclBITNo-D4jm8ladYzg0TYRM Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:25.377869 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1b52939de27b4db1a34684ab6cadf5ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 10f651bd96d04cbd92f5eb5f292d0073 Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 19:07:25.379046 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '8'} Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:25.379632 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 19:07:25.380508 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:25.383903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27632a8f-1766-4e81-b628-7fa9406585da tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:25.384925 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-27632a8f-1766-4e81-b628-7fa9406585da tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] 10.222.0.44 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.028703 Oct 28 19:07:25.385684 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 32/75] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:07:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:07:26.030648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-517246490", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "availability_zone": "tempest-test_az-2005175548"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:26.059366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:26.060120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:26.060731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:26.063035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:26.063818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:26.065854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:26.067084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a0c65da-c113-475b-b8b7-7b819bc7f438 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1122766540/action" status: 200 len: 21 microversion: 2.1 time: 0.867387 Oct 28 19:07:26.075871 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 44/76] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:25 2022] POST /compute/v2.1/flavors/1122766540/action => generated 21 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:26.091409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ecb473a5-5847-4da5-9789-8e638a905442 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:26.172524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ecb473a5-5847-4da5-9789-8e638a905442 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.095358 Oct 28 19:07:26.173122 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 45/77] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:26 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:07:26.187161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-23ab7f17-d4b4-46dc-9330-37381107c762 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:26.205241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=18,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:26.252666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-23ab7f17-d4b4-46dc-9330-37381107c762 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1122766540" status: 202 len: 0 microversion: 2.1 time: 0.066910 Oct 28 19:07:26.253934 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 46/78] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:07:26 2022] DELETE /compute/v2.1/flavors/1122766540 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:26.262238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a3715cb-8c9f-4963-aa7a-86e61f663b43 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:26.280761 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2a3715cb-8c9f-4963-aa7a-86e61f663b43 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a3715cb-8c9f-4963-aa7a-86e61f663b43 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:07:26.283911 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: exception: Aggregate -1 could not be found. Oct 28 19:07:26.284988 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '-1'} Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:26.285649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 19:07:26.286579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.290024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a3715cb-8c9f-4963-aa7a-86e61f663b43 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:26.291662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2a3715cb-8c9f-4963-aa7a-86e61f663b43 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035017 Oct 28 19:07:26.301669 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 47/79] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:07:26 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:07:26.309065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-407881cf-08b7-45d4-bdda-a88d972f7e36 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:26.352596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-407881cf-08b7-45d4-bdda-a88d972f7e36 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049352 Oct 28 19:07:26.358582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 48/80] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:26.365178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25b04d92-1465-4ccf-b671-69cbc626b27f tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:26.367060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25b04d92-1465-4ccf-b671-69cbc626b27f tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '10f651bd96d04cbd92f5eb5f292d0073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52939de27b4db1a34684ab6cadf5ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25b04d92-1465-4ccf-b671-69cbc626b27f tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Request method failure captured: Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChkU-_qYA-d7rALxIaLW0CuXXug0HaSSjfzLfQ2XAqddSzAyDzwadhRgFLjUqBW9E1mENBvIp1gBZLV0irUM81qN88tmtIz4gSrSuSsNZWPINYHEP5ImhBf6cxrVLRCko7FhqivUMYO89abi1gkO7pclBITNo-D4jm8ladYzg0TYRM Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:26.368878 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1b52939de27b4db1a34684ab6cadf5ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 10f651bd96d04cbd92f5eb5f292d0073 Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 19:07:26.369917 n-d-862769-3 devstack@n-api.service[120629]: action_args: {} Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:26.370514 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 19:07:26.371466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:26.377247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25b04d92-1465-4ccf-b671-69cbc626b27f tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:26.380484 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25b04d92-1465-4ccf-b671-69cbc626b27f tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] 10.222.0.44 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020613 Oct 28 19:07:26.386985 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 49/81] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:07:26 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:26.401829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aa041db-8004-4afa-a512-c78e22cb0db0 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1584766681", "id": 1402171355, "os-flavor-access:is_public": "False"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:26.440084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7aa041db-8004-4afa-a512-c78e22cb0db0 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.049272 Oct 28 19:07:26.445168 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 50/82] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:26 2022] POST /compute/v2.1/flavors => generated 439 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:26.456758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf848836-9ded-4e8a-ae4a-34f4f02d6f88 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "94eaa5eeee7e4a50b4435a4fbecb4bcf"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:27.117465 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-cf848836-9ded-4e8a-ae4a-34f4f02d6f88 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] HTTP exception thrown: Flavor access not found for 20 / 94eaa5eeee7e4a50b4435a4fbecb4bcf combination. Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf848836-9ded-4e8a-ae4a-34f4f02d6f88 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Request method failure captured: Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/flavors/1402171355/action HTTP/1.1 Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 70 Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChmEgdRHRYlkwPwXsg_q2sPAWZefDm5C69KHAjx5Z1-JGS3qK7RYYM7gGBtupFU2J6v1JjF_rlWO7SfHeH6wUnlbVhHTLa5NdiIGKRM8vhRv45CiW-CbgSyEJjm26BVJ5KJbgzAg2P-CEmZtAuztj2lEyts26Y3WJYARS6M-jB2u_o Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: eaa843873f3a4a319a21e2c315dc7f3a Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:07:27.119097 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_eaa843873f3a4a319a21e2c315dc7f3a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eaa843873f3a4a319a21e2c315dc7f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: eaa843873f3a4a319a21e2c315dc7f3a Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878 Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 360fe7f6c52d478b8c5c1fb65ff9f727 Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: {"removeTenantAccess": {"tenant": "94eaa5eeee7e4a50b4435a4fbecb4bcf"}} Oct 28 19:07:27.120193 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: exception: Flavor access not found for 20 / 94eaa5eeee7e4a50b4435a4fbecb4bcf combination. Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1402171355', 'body': {'removeTenantAccess': {'tenant': '94eaa5eeee7e4a50b4435a4fbecb4bcf'}}} Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 28 19:07:27.120809 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 94eaa5eeee7e4a50b4435a4fbecb4bcf combination. Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 94eaa5eeee7e4a50b4435a4fbecb4bcf combination. Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.121748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 94eaa5eeee7e4a50b4435a4fbecb4bcf combination. Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf848836-9ded-4e8a-ae4a-34f4f02d6f88 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Returning 404 to user: Flavor access not found for 20 / 94eaa5eeee7e4a50b4435a4fbecb4bcf combination. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:27.122733 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf848836-9ded-4e8a-ae4a-34f4f02d6f88 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1402171355/action" status: 404 len: 124 microversion: 2.1 time: 0.667666 Oct 28 19:07:27.131484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 51/83] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:07:26 2022] POST /compute/v2.1/flavors/1402171355/action => generated 124 bytes in 679 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:27.141341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe768304-5ba6-4af9-b295-6d235e482ce0 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:27.184571 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe768304-5ba6-4af9-b295-6d235e482ce0 tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1402171355" status: 202 len: 0 microversion: 2.1 time: 0.051855 Oct 28 19:07:27.189669 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 52/84] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:07:27 2022] DELETE /compute/v2.1/flavors/1402171355 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:27.195157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3f6d4d5-95c2-4b29-89a1-858bbf39e5be tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:27.235661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3f6d4d5-95c2-4b29-89a1-858bbf39e5be tempest-FlavorsAccessNegativeTestJSON-1076216878 tempest-FlavorsAccessNegativeTestJSON-1076216878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044673 Oct 28 19:07:27.245442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 53/85] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:27.429498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:07:27.792407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:07:27.792827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:07:27.793288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:07:27.793696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:07:27.794101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:07:27.824879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:27.828347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:27.829389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.832601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:27.834630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:27.836333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:27.903624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Getting quotas for project 333e061960044691927569fa82f30543. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:27.913226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Getting quotas for user 79df33be7e064907b35d252e38522ca1 and project 333e061960044691927569fa82f30543. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:27.959365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:07:27.964436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:07:28.131701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4b257ff-8e95-4d0f-92e0-e6b8716808a2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.738253 Oct 28 19:07:28.133399 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 33/86] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:07:28.144468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4469bb0b-c8c7-48bb-9021-39e4a8bc73cc tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:28.146212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4469bb0b-c8c7-48bb-9021-39e4a8bc73cc tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:29.712410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4469bb0b-c8c7-48bb-9021-39e4a8bc73cc tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:29.734404 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4469bb0b-c8c7-48bb-9021-39e4a8bc73cc tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1242 microversion: 2.1 time: 1.593776 Oct 28 19:07:29.753661 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 54/87] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:28 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1242 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:30.764415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:30.765036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:30.804529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:30.805243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:30.805883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:30.808184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:30.808982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:30.809850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:31.101775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:31.145463 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-780f63e1-ef00-494f-a6b4-caffa56d322d tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1308 microversion: 2.1 time: 0.387922 Oct 28 19:07:31.147473 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 34/88] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:30 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:31.626196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-703309985", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:31.788158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:07:32.173933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:32.175363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:32.188262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:32.188930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:32.192191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:32.193341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:32.193953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:32.194379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:32.322771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:07:32.324647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:07:32.324647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:07:32.324647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:07:32.324964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:07:32.363220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:32.366290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:32.367615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:32.369613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:32.372413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:32.375356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e9f43d9-e5d6-44c5-b9e1-2e1fc891d583 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1296 microversion: 2.1 time: 0.208450 Oct 28 19:07:32.376359 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 35/89] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:32 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1296 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:32.379420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:32.380279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:32.440935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:32.452601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for user 3142fd0059aa4b658c2cea015b1f3d93 and project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:32.472922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:07:32.477394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:07:32.556031 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e57cd457-dc0c-46ea-af31-16b4e6be5557 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.683551 Oct 28 19:07:32.559434 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 55/90] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:07:32.571932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4c46f095-5836-42ff-9097-2e94be021dd8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:32.572682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4c46f095-5836-42ff-9097-2e94be021dd8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:32.690735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4c46f095-5836-42ff-9097-2e94be021dd8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:32.731008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4c46f095-5836-42ff-9097-2e94be021dd8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1212 microversion: 2.1 time: 0.162623 Oct 28 19:07:32.732761 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 36/91] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:32 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1212 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:33.405392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:33.406597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:33.424683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:33.439587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:33.444773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:33.446580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:33.448343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:33.450242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:33.756341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8fd3d4e6-c893-49a5-a2f3-be769c2dca53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:33.756943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8fd3d4e6-c893-49a5-a2f3-be769c2dca53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:34.044223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8fd3d4e6-c893-49a5-a2f3-be769c2dca53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:34.061485 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8fd3d4e6-c893-49a5-a2f3-be769c2dca53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1212 microversion: 2.1 time: 0.301576 Oct 28 19:07:34.087155 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 37/92] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:33 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1212 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:34.206918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:34.251361 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f505ca89-cd61-4744-bb3f-0a796b5d6d15 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1296 microversion: 2.1 time: 0.851444 Oct 28 19:07:34.272696 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 56/93] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:33 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1296 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:35.099599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:35.100514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:35.118337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:35.119638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:35.121825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:35.126093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:35.128110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:35.128764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:35.360015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:35.372313 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f22f09f-e071-4d95-a7f9-f3c581db87ad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1216 microversion: 2.1 time: 0.276863 Oct 28 19:07:35.383210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 57/94] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:35 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1216 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:35.406391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:35.407237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:35.444060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:35.447755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:35.449460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:35.455351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:35.458603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:35.461698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:35.979984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-890486ca-1163-4cc1-aa1f-61ffb8cc5ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1116649957", "ram": 512, "vcpus": 1, "disk": 10, "id": 2093414431, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:36.077141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-890486ca-1163-4cc1-aa1f-61ffb8cc5ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.066644 Oct 28 19:07:36.085617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 38/95] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:35 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:36.228498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:36.240205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e562825f-24c1-41fb-96ae-6cce90c77019 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.855498 Oct 28 19:07:36.246994 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 58/96] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:35 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:36.624895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:36.626563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:36.627105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:36.627541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:36.628304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:36.631026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:36.631479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:36.747455 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8094a4a-aae4-4d6b-9d3a-58da63df8506 tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] 10.222.0.44 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.654721 Oct 28 19:07:36.750294 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 39/97] 10.222.0.44 () {58 vars in 1164 bytes} [Fri Oct 28 19:07:36 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:36.768564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:36.773918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:36.795330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:36.798538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:36.801370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:36.803812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:36.804990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:36.806952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.050714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2969b332-3074-48fe-ad5e-01e62b42daf9 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.076603 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2969b332-3074-48fe-ad5e-01e62b42daf9 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] HTTP exception thrown: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2969b332-3074-48fe-ad5e-01e62b42daf9 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Request method failure captured: Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/flavors/2093414431/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCh04up21JDqvUq7cl3-KQiDZJ0vejscapMeOVgeKjgiVqgxdomwS7o_-_6AekP0-FtJIBldLSuOQ1cgvm3o3bLmZ0Vv3pmV09q3JMnChGlamjn5AordU7RYAQGrxlMppY5rjrBo_5Med-venkUlalzj9p8m7SpGFngRpYqyquaez-c Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:37.085956 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf5ee75dbe3a42e3b130174c5ce28603", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: d8fb6e9490504217bca65877ad75c50d Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:37.087557 n-d-862769-3 devstack@n-api.service[120629]: exception: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'flavor_id': '2093414431', 'id': 'hw:cpu_thread_policy'} Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.088420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.089780 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.095439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2969b332-3074-48fe-ad5e-01e62b42daf9 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Returning 404 to user: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.097004 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2969b332-3074-48fe-ad5e-01e62b42daf9 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] 10.222.0.44 "GET /compute/v2.1/flavors/2093414431/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.848310 Oct 28 19:07:37.106487 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 59/98] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:07:36 2022] GET /compute/v2.1/flavors/2093414431/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 859 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:37.123159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.129677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:37.132692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:37.134500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.138188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:37.140384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:37.144179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.247818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-95ec5b35-e242-4045-88b5-f1441c10d27d tempest-AZAdminV2TestJSON-1033159743 tempest-AZAdminV2TestJSON-1033159743-project-admin] 10.222.0.44 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.138809 Oct 28 19:07:37.250208 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 60/99] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:07:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:37.268359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2df6539b-0c99-4cb2-ac36-2f873824e874 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:37.284449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2df6539b-0c99-4cb2-ac36-2f873824e874 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'd8fb6e9490504217bca65877ad75c50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5ee75dbe3a42e3b130174c5ce28603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2df6539b-0c99-4cb2-ac36-2f873824e874 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Request method failure captured: Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/flavors/2093414431/os-extra_specs HTTP/1.1 Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 66 Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCh04up21JDqvUq7cl3-KQiDZJ0vejscapMeOVgeKjgiVqgxdomwS7o_-_6AekP0-FtJIBldLSuOQ1cgvm3o3bLmZ0Vv3pmV09q3JMnChGlamjn5AordU7RYAQGrxlMppY5rjrBo_5Med-venkUlalzj9p8m7SpGFngRpYqyquaez-c Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:07:37.286180 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf5ee75dbe3a42e3b130174c5ce28603", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: d8fb6e9490504217bca65877ad75c50d Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 28 19:07:37.287590 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'flavor_id': '2093414431', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:37.288326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 19:07:37.289316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.290307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2df6539b-0c99-4cb2-ac36-2f873824e874 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.290307 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2df6539b-0c99-4cb2-ac36-2f873824e874 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] 10.222.0.44 "POST /compute/v2.1/flavors/2093414431/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.036493 Oct 28 19:07:37.290307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 61/100] 10.222.0.44 () {60 vars in 1224 bytes} [Fri Oct 28 19:07:37 2022] POST /compute/v2.1/flavors/2093414431/os-extra_specs => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:37.312289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.315214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:37.337747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:37.343613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:37.344119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:37.344557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.345274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:37.356389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:37.357086 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ef2402b7-9676-4f31-a0f7-fb925065eb7b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1270 microversion: 2.1 time: 0.601540 Oct 28 19:07:37.358155 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 40/101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:36 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1270 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:37.361226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:37.369337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04109eac-5bf9-4f19-a14a-21c44994a888 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:37.462983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04109eac-5bf9-4f19-a14a-21c44994a888 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/2093414431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.103405 Oct 28 19:07:37.471562 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 41/102] 10.222.0.44 () {60 vars in 1224 bytes} [Fri Oct 28 19:07:37 2022] POST /compute/v2.1/flavors/2093414431/os-extra_specs => generated 66 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:37.485599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c052f83-c9bf-40a9-a6fa-5c51d8581e05 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.488088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8c052f83-c9bf-40a9-a6fa-5c51d8581e05 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'd8fb6e9490504217bca65877ad75c50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5ee75dbe3a42e3b130174c5ce28603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c052f83-c9bf-40a9-a6fa-5c51d8581e05 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Request method failure captured: Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCh04up21JDqvUq7cl3-KQiDZJ0vejscapMeOVgeKjgiVqgxdomwS7o_-_6AekP0-FtJIBldLSuOQ1cgvm3o3bLmZ0Vv3pmV09q3JMnChGlamjn5AordU7RYAQGrxlMppY5rjrBo_5Med-venkUlalzj9p8m7SpGFngRpYqyquaez-c Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:37.493570 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf5ee75dbe3a42e3b130174c5ce28603", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d8fb6e9490504217bca65877ad75c50d Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:37.494737 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'flavor_id': '2093414431', 'id': 'hw:numa_nodes'} Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:37.495295 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 19:07:37.496331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.501603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c052f83-c9bf-40a9-a6fa-5c51d8581e05 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.519894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8c052f83-c9bf-40a9-a6fa-5c51d8581e05 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] 10.222.0.44 "DELETE /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.046799 Oct 28 19:07:37.526077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 42/103] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:07:37 2022] DELETE /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes => generated 124 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:37.550213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e022793c-5ea7-4d9c-9ad9-c05f933c645f tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:37.646991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e022793c-5ea7-4d9c-9ad9-c05f933c645f tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/2093414431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115336 Oct 28 19:07:37.649611 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 43/104] 10.222.0.44 () {60 vars in 1224 bytes} [Fri Oct 28 19:07:37 2022] POST /compute/v2.1/flavors/2093414431/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:37.667714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-768a714b-b183-474a-b40b-ede77e1774b6 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:37.681102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-768a714b-b183-474a-b40b-ede77e1774b6 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'd8fb6e9490504217bca65877ad75c50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5ee75dbe3a42e3b130174c5ce28603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-768a714b-b183-474a-b40b-ede77e1774b6 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Request method failure captured: Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 22 Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCh04up21JDqvUq7cl3-KQiDZJ0vejscapMeOVgeKjgiVqgxdomwS7o_-_6AekP0-FtJIBldLSuOQ1cgvm3o3bLmZ0Vv3pmV09q3JMnChGlamjn5AordU7RYAQGrxlMppY5rjrBo_5Med-venkUlalzj9p8m7SpGFngRpYqyquaez-c Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:07:37.683637 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf5ee75dbe3a42e3b130174c5ce28603", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf5ee75dbe3a42e3b130174c5ce28603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: bf5ee75dbe3a42e3b130174c5ce28603 Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d8fb6e9490504217bca65877ad75c50d Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: {"hw:numa_nodes": "1"} Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:37.684845 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'flavor_id': '2093414431', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:07:37.685516 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 19:07:37.686658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.688691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-768a714b-b183-474a-b40b-ede77e1774b6 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.691058 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-768a714b-b183-474a-b40b-ede77e1774b6 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245 tempest-FlavorsExtraSpecsNegativeTestJSON-866774245-project] 10.222.0.44 "PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034001 Oct 28 19:07:37.712029 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 44/105] 10.222.0.44 () {60 vars in 1265 bytes} [Fri Oct 28 19:07:37 2022] PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes => generated 124 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:37.732571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0789a9df-e3ef-4427-9e90-810c91b220a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.761082 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0789a9df-e3ef-4427-9e90-810c91b220a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] HTTP exception thrown: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0789a9df-e3ef-4427-9e90-810c91b220a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Request method failure captured: Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/flavors/2093414431/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCh2VKwerk8ZcnCeHW7RpHbazKN2a1h7QfnTr-rQJVBsQqy31XyZv3NjL-YLX4JtyEzMbTwD8Fr4ywkTi6AhemXLd3coI6yllXD8YxmyBPNe4ly8w9JEEE0PKKG1t9oOBk-Y5C7mF8bGnIjMKv5SQ0nbTnCvAkwbBMpEWtlMN6Nlbzs Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c9918269e8b497eb6877df0b450f53e Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:37.765116 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c9918269e8b497eb6877df0b450f53e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c9918269e8b497eb6877df0b450f53e Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: db93d79e29f74a90ac1df7aac4b96fea Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:37.766454 n-d-862769-3 devstack@n-api.service[120628]: exception: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'flavor_id': '2093414431', 'id': 'hw:cpu_thread_policy'} Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.767194 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. Oct 28 19:07:37.768486 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.771200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0789a9df-e3ef-4427-9e90-810c91b220a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Returning 404 to user: Flavor 2093414431 has no extra specs with key hw:cpu_thread_policy. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.774027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0789a9df-e3ef-4427-9e90-810c91b220a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/2093414431/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.060393 Oct 28 19:07:37.777781 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 45/106] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:07:37 2022] DELETE /compute/v2.1/flavors/2093414431/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:37.797744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09da7e66-4714-49ae-9600-b6c468b50a99 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:37.805476 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-09da7e66-4714-49ae-9600-b6c468b50a99 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09da7e66-4714-49ae-9600-b6c468b50a99 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Request method failure captured: Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 27 Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCh2VKwerk8ZcnCeHW7RpHbazKN2a1h7QfnTr-rQJVBsQqy31XyZv3NjL-YLX4JtyEzMbTwD8Fr4ywkTi6AhemXLd3coI6yllXD8YxmyBPNe4ly8w9JEEE0PKKG1t9oOBk-Y5C7mF8bGnIjMKv5SQ0nbTnCvAkwbBMpEWtlMN6Nlbzs Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c9918269e8b497eb6877df0b450f53e Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:37.811141 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c9918269e8b497eb6877df0b450f53e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c9918269e8b497eb6877df0b450f53e Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: db93d79e29f74a90ac1df7aac4b96fea Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: {"hw:cpu_policy": "shared"} Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:37.812623 n-d-862769-3 devstack@n-api.service[120628]: exception: Request body and URI mismatch Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'flavor_id': '2093414431', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.813417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.814633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:37.814633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:37.814633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 28 19:07:37.814633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.816106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09da7e66-4714-49ae-9600-b6c468b50a99 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.817114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09da7e66-4714-49ae-9600-b6c468b50a99 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.031865 Oct 28 19:07:37.825745 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 46/107] 10.222.0.44 () {60 vars in 1265 bytes} [Fri Oct 28 19:07:37 2022] PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:07:37.836514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0f34150-2ec8-463d-af83-20be70fa99ce tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0f34150-2ec8-463d-af83-20be70fa99ce tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Request method failure captured: Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 49 Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCh2VKwerk8ZcnCeHW7RpHbazKN2a1h7QfnTr-rQJVBsQqy31XyZv3NjL-YLX4JtyEzMbTwD8Fr4ywkTi6AhemXLd3coI6yllXD8YxmyBPNe4ly8w9JEEE0PKKG1t9oOBk-Y5C7mF8bGnIjMKv5SQ0nbTnCvAkwbBMpEWtlMN6Nlbzs Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c9918269e8b497eb6877df0b450f53e Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:07:37.849102 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c9918269e8b497eb6877df0b450f53e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c9918269e8b497eb6877df0b450f53e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c9918269e8b497eb6877df0b450f53e Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: db93d79e29f74a90ac1df7aac4b96fea Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 28 19:07:37.851034 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'flavor_id': '2093414431', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance: Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 28 19:07:37.851754 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.853189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:37.855103 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:37.855103 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:37.855103 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:07:37.855103 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:07:37.855103 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 19:07:37.855103 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:07:37.859417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0f34150-2ec8-463d-af83-20be70fa99ce tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:37.860596 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0f34150-2ec8-463d-af83-20be70fa99ce tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.033597 Oct 28 19:07:37.868058 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 47/108] 10.222.0.44 () {60 vars in 1265 bytes} [Fri Oct 28 19:07:37 2022] PUT /compute/v2.1/flavors/2093414431/os-extra_specs/hw:numa_nodes => generated 117 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:07:37.881369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93c36968-69f8-4bb1-a4b2-151a195ac73a tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:37.952333 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-93c36968-69f8-4bb1-a4b2-151a195ac73a tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/2093414431" status: 202 len: 0 microversion: 2.1 time: 0.079847 Oct 28 19:07:37.955754 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 48/109] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:07:37 2022] DELETE /compute/v2.1/flavors/2093414431 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:07:37.969993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-86696251-d5cf-4203-847a-8f3c58031c41 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:38.036101 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-86696251-d5cf-4203-847a-8f3c58031c41 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709 tempest-FlavorsExtraSpecsNegativeTestJSON-1644580709-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077983 Oct 28 19:07:38.044358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 49/110] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:07:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:38.388238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:38.391824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:38.425618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:38.427359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:38.430124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:38.431484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:38.434270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:38.435635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:39.008979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:39.026838 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23360b2e-49da-474d-bffe-1c2bb50de460 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1270 microversion: 2.1 time: 0.644155 Oct 28 19:07:39.029219 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 50/111] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:38 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1270 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:39.331573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:39.352527 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-982069a8-14d0-4ef6-bb14-ff053508189f tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 2.048253 Oct 28 19:07:39.363989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 62/112] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:37 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:39.684573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5cfe8000-b8b2-4a75-94a4-11dc74df4caa tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-766292924", "id": 1312055857, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:39.698571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=11,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:39.727700 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5cfe8000-b8b2-4a75-94a4-11dc74df4caa tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.383276 Oct 28 19:07:39.728798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 51/113] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:07:39 2022] POST /compute/v2.1/flavors => generated 470 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:07:39.743523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0bc07515-bff5-487c-ae5f-075d1437b291 tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:40.062139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:40.068268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:40.082400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.083413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.084386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.085638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.086836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.088933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.097225 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0bc07515-bff5-487c-ae5f-075d1437b291 tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1312055857/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.350790 Oct 28 19:07:40.100771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 63/114] 10.222.0.44 () {62 vars in 1265 bytes} [Fri Oct 28 19:07:39 2022] POST /compute/v2.1/flavors/1312055857/os-extra_specs => generated 62 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:40.130399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-888c22d7-73e7-4791-85cf-44f3afeafa75 tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:40.227340 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-888c22d7-73e7-4791-85cf-44f3afeafa75 tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1312055857" status: 202 len: 0 microversion: 2.86 time: 0.118772 Oct 28 19:07:40.234140 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 64/115] 10.222.0.44 () {60 vars in 1202 bytes} [Fri Oct 28 19:07:40 2022] DELETE /compute/v2.1/flavors/1312055857 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:07:40.240359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d6083c26-a354-4d71-ab09-2422cf9de14b tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:40.291968 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d6083c26-a354-4d71-ab09-2422cf9de14b tempest-FlavorMetadataValidation-1653038456 tempest-FlavorMetadataValidation-1653038456-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.056030 Oct 28 19:07:40.308090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 65/116] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:07:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:40.472284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b8a61a7-c39b-405b-a51b-70f6a99c1b50", "tag": "5c6cf80e-bae3-4fab-a325-445725261ef3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:40.503560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.504036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.504461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.585732 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Creating event network-changed:5c6cf80e-bae3-4fab-a325-445725261ef3 for instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 on n-h2-862769-3 Oct 28 19:07:40.586301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:07:40.588760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44916603-9f38-48d8-a721-389b2d0626c6 req-97c1e08d-57d1-4b65-87cb-04fdf13a20f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:07:40.590091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.594352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.595089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.596328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.597059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.597660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.619760 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.rpcapi [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 19:07:40.621482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] Releasing lock "compute-rpcapi-router" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:07:40.664320 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1cb5b741-82d9-42f3-b296-9a4d34ba3fce None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325458 Oct 28 19:07:40.666000 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 66/117] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:07:40.681512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:40.684437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:40.712074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.715132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.715791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:40.716662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:40.719041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:40.720138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:41.090925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:41.114665 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6ef24f5-8a85-498a-9157-41bc11ca0c12 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1270 microversion: 2.1 time: 1.062026 Oct 28 19:07:41.119352 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 52/118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:40 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1270 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:42.140348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:42.141082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:42.150248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:42.152895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:42.153398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:42.159368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:42.160491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:42.161139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:42.241178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:42.255013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4176db70-044a-47b2-a410-262c09d50fed tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 1.586442 Oct 28 19:07:42.256899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 67/119] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:40 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:43.121696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:43.131247 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87f2e4f4-b88e-4af1-b4b8-b5a02b124093 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.995190 Oct 28 19:07:43.151446 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 53/120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:42 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:43.284743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:43.286274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:43.312505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:43.326966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:43.330615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:43.334562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:43.342987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:43.343727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:43.348537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:43.689664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:43.705528 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3dec4999-f327-4018-a69e-a324126cd4b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.427786 Oct 28 19:07:43.710012 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 68/121] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:43 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:44.167263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:44.167978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:44.171282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:44.176147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:44.189760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:44.192167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:44.194586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:44.195353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:44.199023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:44.733236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:44.733852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:44.744174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:44.751651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:44.752173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:44.752946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:44.753396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:44.753811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:45.265224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:45.280479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-86aeb11a-ea91-405e-8283-4514ab245075 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 1.119477 Oct 28 19:07:45.283997 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 54/122] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:44 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:45.578725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:45.592290 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44670dce-354b-42bc-8a29-e3a36f6bce65 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.863723 Oct 28 19:07:45.595820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 69/123] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:44 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:46.307492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:46.308103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:46.322526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.323051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.323485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.324198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.324673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.325048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.623225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:46.624485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:46.651062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.656375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.659067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.660932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.664330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.665908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:46.666256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:47.357084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:47.368738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-66a5af4d-3148-4e58-90c5-1920a3cca750 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 1.065162 Oct 28 19:07:47.371587 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 55/124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:46 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:47.527036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:47.557057 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d9635f59-088d-481e-8166-80ad52125cc6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.938472 Oct 28 19:07:47.561016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 70/125] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:46 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:48.397595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:48.398440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:48.406491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:48.416130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:48.420601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.422371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:48.422993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:48.424520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.088490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ce333101-4cd3-40f0-9047-ed2b6c616aad req-b75b3da0-1d94-457f-9b00-ab81eecdb76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495986a-5fdf-462a-8a27-4cae25051f67", "tag": "7a6fb0d8-3d62-43fe-ba26-7f441e053865"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:49.118013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ce333101-4cd3-40f0-9047-ed2b6c616aad req-b75b3da0-1d94-457f-9b00-ab81eecdb76d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.125261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ce333101-4cd3-40f0-9047-ed2b6c616aad req-b75b3da0-1d94-457f-9b00-ab81eecdb76d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.140742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ce333101-4cd3-40f0-9047-ed2b6c616aad req-b75b3da0-1d94-457f-9b00-ab81eecdb76d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.189481 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ce333101-4cd3-40f0-9047-ed2b6c616aad req-b75b3da0-1d94-457f-9b00-ab81eecdb76d service nova] Creating event network-changed:7a6fb0d8-3d62-43fe-ba26-7f441e053865 for instance b495986a-5fdf-462a-8a27-4cae25051f67 on n-h1-862769-3 Oct 28 19:07:49.233705 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ce333101-4cd3-40f0-9047-ed2b6c616aad req-b75b3da0-1d94-457f-9b00-ab81eecdb76d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.719280 Oct 28 19:07:49.243613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 71/126] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:07:49.263202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:49.264031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:49.288438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.289501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.290136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.293554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.294081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.294832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.295455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.306060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=77 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:49.316683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba44a01c-eca0-4c6a-9b14-108b5293c33c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.922588 Oct 28 19:07:49.321138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 56/127] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:48 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:49.745058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.749127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=99 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:49.775429 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43a6855e-964d-4ccc-8732-b57afe1ab7ec tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.523168 Oct 28 19:07:49.811804 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 72/128] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:49 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:50.346087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:50.347534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:50.363947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.368787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.368787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.370068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.373809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.374917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.620217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:51.065891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Calling method '.version_select at 0x7f1d7c7b0040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:51.076242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.076744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.077242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.137225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.137741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.138186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.261574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.262548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.263160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.303469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=80,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:51.319989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.323403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.324875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.391319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.397164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.397947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.426300 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56b8f6d8-cbe5-4f18-83e5-17d170426f66 tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.900452 Oct 28 19:07:51.450082 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 73/129] 10.222.0.44 () {60 vars in 1243 bytes} [Fri Oct 28 19:07:50 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:51.471386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:51.475096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:51.497420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.507879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.509145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.511905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.512604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7174f458-cfb1-4124-9c04-5ab5b395bacb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 1.171848 Oct 28 19:07:51.515842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.516652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.517540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.520039 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 57/130] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:50 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:52.033407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.056748 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-00f373a0-23ad-42dd-9c76-68c3fec6df50 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.603144 Oct 28 19:07:52.060448 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 74/131] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:51 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:52.068603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Calling method '.version_select at 0x7f1d7c8dedc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.084146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.095594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.096512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.143924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.144825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.154074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.168111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da3f52ec-666e-4e92-852f-3cfecaed90ca tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-969494311", "id": 449155207, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:52.205429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.208230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.209134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.243723 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da3f52ec-666e-4e92-852f-3cfecaed90ca tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.720385 Oct 28 19:07:52.249422 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 58/132] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:07:51 2022] POST /compute/v2.1/flavors => generated 445 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:52.251023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.251964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.252601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.362437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.366554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.367617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.396848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-16230184-1dd0-4578-a0bf-3a457287b9cb tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.334585 Oct 28 19:07:52.400005 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 75/133] 10.222.0.44 () {60 vars in 1222 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:52.424103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Calling method '.version_select at 0x7f1d7c8deee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.435111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.438432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.438801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.511000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.513475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.514129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.548120 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed5e7ef9-068d-448a-91e5-c40a323f4c4b tempest-HypervisorAdminV253TestBase-486812686 tempest-HypervisorAdminV253TestBase-486812686-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/2e386374-775b-4012-b05f-d85cafab4a45" status: 200 len: 792 microversion: 2.53 time: 0.139619 Oct 28 19:07:52.565252 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 76/134] 10.222.0.44 () {60 vars in 1298 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/os-hypervisors/2e386374-775b-4012-b05f-d85cafab4a45 => generated 792 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:52.577177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.577581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:52.601410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.601910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.602337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.609426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.613763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.615167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.939788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bd7731f-e084-4cd9-989a-d94c2450f4c2 tempest-FlavorsV255TestJSON-271868167 tempest-FlavorsV255TestJSON-271868167-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.956746 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bd7731f-e084-4cd9-989a-d94c2450f4c2 tempest-FlavorsV255TestJSON-271868167 tempest-FlavorsV255TestJSON-271868167-project] 10.222.0.44 "GET /compute/v2.1/flavors/449155207" status: 200 len: 445 microversion: 2.55 time: 0.689028 Oct 28 19:07:52.965049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 59/135] 10.222.0.44 () {60 vars in 1196 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/flavors/449155207 => generated 445 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:52.984276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1fac9d3-0e55-4629-83b8-a2eb72554e67 tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7dbb9b80>, body: {"flavor": {"description": "new"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:53.087330 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1fac9d3-0e55-4629-83b8-a2eb72554e67 tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] 10.222.0.44 "PUT /compute/v2.1/flavors/449155207" status: 200 len: 446 microversion: 2.55 time: 0.114372 Oct 28 19:07:53.088443 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 60/136] 10.222.0.44 () {62 vars in 1216 bytes} [Fri Oct 28 19:07:52 2022] PUT /compute/v2.1/flavors/449155207 => generated 446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:07:53.098377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.099501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:53.118032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.118638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.119553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.120485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.121151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.121753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.578802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:53.593627 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4152197c-f224-480c-8a30-a67acec8cec6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.503771 Oct 28 19:07:53.597629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 61/137] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.606586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-916bba0b-7d0d-4a1c-8923-e7d51ad2cf0b tempest-FlavorsV255TestJSON-271868167 tempest-FlavorsV255TestJSON-271868167-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.683514 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-916bba0b-7d0d-4a1c-8923-e7d51ad2cf0b tempest-FlavorsV255TestJSON-271868167 tempest-FlavorsV255TestJSON-271868167-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.082497 Oct 28 19:07:53.686434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:53.696872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7e4d6d4-1262-4036-b0d0-0d4a48d0a195 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 1.130443 Oct 28 19:07:53.697630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 77/138] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.708713 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 62/139] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:53.725241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b22f34f-7f41-4449-b14f-88c4c91a5b5f tempest-FlavorsV255TestJSON-271868167 tempest-FlavorsV255TestJSON-271868167-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.785490 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b22f34f-7f41-4449-b14f-88c4c91a5b5f tempest-FlavorsV255TestJSON-271868167 tempest-FlavorsV255TestJSON-271868167-project] 10.222.0.44 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.069709 Oct 28 19:07:53.792849 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 78/140] 10.222.0.44 () {60 vars in 1166 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:53.819891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f360ddf-739a-4f67-b549-5855758069f8 tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.877398 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f360ddf-739a-4f67-b549-5855758069f8 tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/449155207" status: 202 len: 0 microversion: 2.55 time: 0.067903 Oct 28 19:07:53.879961 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 79/141] 10.222.0.44 () {60 vars in 1199 bytes} [Fri Oct 28 19:07:53 2022] DELETE /compute/v2.1/flavors/449155207 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:07:53.906512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ff317e3-16b7-421e-a708-a1d0599c1b75 tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.984744 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ff317e3-16b7-421e-a708-a1d0599c1b75 tempest-FlavorsV255TestJSON-235776628 tempest-FlavorsV255TestJSON-235776628-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.099729 Oct 28 19:07:53.990427 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 80/142] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:07:54.196465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f5e2eec-1786-481e-9f3d-5d26ada0d00d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.225428 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f5e2eec-1786-481e-9f3d-5d26ada0d00d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.522007 Oct 28 19:07:54.235861 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 63/143] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:54.382296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3acbd450-f978-4676-91fb-f01800469738 tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-97208205", "id": 2082668900, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:54.471887 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3acbd450-f978-4676-91fb-f01800469738 tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.222646 Oct 28 19:07:54.485808 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 81/144] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:54 2022] POST /compute/v2.1/flavors => generated 423 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:54.496623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cef7eb36-cde5-49b5-95f5-e82d467f7dc2 tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.519604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cef7eb36-cde5-49b5-95f5-e82d467f7dc2 tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034988 Oct 28 19:07:54.530922 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 64/145] 10.222.0.44 () {58 vars in 1182 bytes} [Fri Oct 28 19:07:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:54.532426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94b60355-d85c-4111-830e-1861aebc4956 tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-895109705", "id": 2007963952, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:54.591018 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94b60355-d85c-4111-830e-1861aebc4956 tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.062340 Oct 28 19:07:54.599773 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 82/146] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:54 2022] POST /compute/v2.1/flavors => generated 424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:07:54.605539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc9f9a73-21a1-4f47-b6c6-de0fe4818fae tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.623499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc9f9a73-21a1-4f47-b6c6-de0fe4818fae tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022047 Oct 28 19:07:54.623919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.624586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:54.629109 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 65/147] 10.222.0.44 () {58 vars in 1182 bytes} [Fri Oct 28 19:07:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:07:54.644430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1e499a4-bd24-43e4-82ef-a626e49a52cf tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Action: 'create', calling method: .version_select at 0x7f1d7c8025e0>, body: {"keypair": {"name": "tempest-keypair-275537579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAVT6IPe+trY/MrcisMfduUOCmeSlzQU7Hm4paZZ5kN3MMjoCw7i036ox0jqJuxzonHdg58lx5QHnknAQxAorb0NnsD6UR1tEP4orG/jSEmrjFjh8eCJ31c5qQ8j8RmxA=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:54.654668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.661690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.662364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.664322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.665046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.666004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.745922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e1e499a4-bd24-43e4-82ef-a626e49a52cf tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Getting quotas for project 2cabf5bc7f864f11b150f8b15825922c. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:54.750784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e1e499a4-bd24-43e4-82ef-a626e49a52cf tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Getting quotas for user 8468bb4493eb4cf5951029cda891cec9 and project 2cabf5bc7f864f11b150f8b15825922c. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:54.816680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1e499a4-bd24-43e4-82ef-a626e49a52cf tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178105 Oct 28 19:07:54.831974 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 66/148] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:07:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:54.849719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.851319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:54.865611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.876286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.877103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.878030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.883110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.883899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:55.533790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.544713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-786e4fca-ce00-4577-a722-8f2da56427a6 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.925045 Oct 28 19:07:55.550769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 83/149] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:54 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:55.631509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.648431 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-598c6bb9-24b2-4f0f-a27e-aea71585f9cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.813893 Oct 28 19:07:55.649126 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 67/150] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:54 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:56.578976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.581800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:56.594878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.599527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.600202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.603664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.604292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.605329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.675161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.675774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:56.687919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.690984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.691851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.694926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.695972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.697659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:57.432552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:57.470298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-200ec42a-ad69-47e7-a465-fdf3b6cd5250 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.891959 Oct 28 19:07:57.497193 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 84/151] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:57.579948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:57.591825 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c07cb46d-7c18-4ffd-8914-867eb6a79924 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.922024 Oct 28 19:07:57.600329 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 68/152] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:58.501615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:58.502198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:58.517231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.520057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.530033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.531324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.532264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.535051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.624993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:58.626478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:07:58.635939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.638419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.640044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.644628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.647342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.648800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:59.332859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.344202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:59.358902 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f5fab8d6-ac06-43c6-bfee-43938075565e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.739187 Oct 28 19:07:59.372343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 69/153] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:58 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:59.390040 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c70d4483-6ecc-4e97-ac9e-cc31ec6aa6cf tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.890271 Oct 28 19:07:59.393048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 85/154] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:58 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:00.397260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:00.398845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:00.416832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:00.418225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:00.433938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.435766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.436417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.437090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.437676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.438287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.439262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.440664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:00.441481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.442425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:00.443054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.445394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:00.977040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:00.984453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-12d9aa38-be96-45cf-b549-740dfa3770b1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.572312 Oct 28 19:08:00.985046 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 86/155] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:00 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:01.000417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1130823088", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "2007963952", "adminPass": "***", "networks": [{"uuid": "15f7d709-b4f7-4184-88b9-170199bcabd3"}], "security_groups": [{"name": "tempest-securitygroup--1073179599"}], "key_name": "tempest-keypair-275537579", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:01.320379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] validate_networks() for [('15f7d709-b4f7-4184-88b9-170199bcabd3', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:01.363385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:01.380772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7e961bc-be30-4f30-bf61-bb6c5f543ce3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.987253 Oct 28 19:08:01.406128 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 70/156] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:00 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:01.650235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4879372f-b290-411b-9760-6d160b083ac0 tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1929486279", "id": 1338861987, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:01.687205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4879372f-b290-411b-9760-6d160b083ac0 tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.270437 Oct 28 19:08:01.689540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 71/157] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:08:01 2022] POST /compute/v2.1/flavors => generated 468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:01.872167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35d52e69-4977-479a-a9ba-59e092f924ce tempest-FlavorsV261TestJSON-1695635926 tempest-FlavorsV261TestJSON-1695635926-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:01.906987 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35d52e69-4977-479a-a9ba-59e092f924ce tempest-FlavorsV261TestJSON-1695635926 tempest-FlavorsV261TestJSON-1695635926-project] 10.222.0.44 "GET /compute/v2.1/flavors/1338861987" status: 200 len: 468 microversion: 2.61 time: 0.202057 Oct 28 19:08:01.906987 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 72/158] 10.222.0.44 () {60 vars in 1199 bytes} [Fri Oct 28 19:08:01 2022] GET /compute/v2.1/flavors/1338861987 => generated 468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:08:01.938477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d83dd60c-6295-43cb-a3a2-d2b5081cc13c tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:01.986320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d83dd60c-6295-43cb-a3a2-d2b5081cc13c tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] 10.222.0.44 "PUT /compute/v2.1/flavors/1338861987" status: 200 len: 469 microversion: 2.61 time: 0.055427 Oct 28 19:08:01.987472 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 73/159] 10.222.0.44 () {62 vars in 1219 bytes} [Fri Oct 28 19:08:01 2022] PUT /compute/v2.1/flavors/1338861987 => generated 469 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:02.002957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bbf4958-74e5-463c-b564-bdfa7192e9e9 tempest-FlavorsV261TestJSON-1695635926 tempest-FlavorsV261TestJSON-1695635926-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:02.075700 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bbf4958-74e5-463c-b564-bdfa7192e9e9 tempest-FlavorsV261TestJSON-1695635926 tempest-FlavorsV261TestJSON-1695635926-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 7157 microversion: 2.61 time: 0.078481 Oct 28 19:08:02.076511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 74/160] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:08:01 2022] GET /compute/v2.1/flavors/detail => generated 7157 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:02.081616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:02.084368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:02.097265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:02.099719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:02.100404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:02.115447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:02.121068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:02.126559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:02.573514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:02.582204 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2e859f8-cac0-40d1-a6e0-1190836dee7a tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.504381 Oct 28 19:08:02.589569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 75/161] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:02 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:02.598481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-33ba54eb-02eb-4732-9976-734285dece23 tempest-FlavorsV261TestJSON-1695635926 tempest-FlavorsV261TestJSON-1695635926-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:02.654241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-33ba54eb-02eb-4732-9976-734285dece23 tempest-FlavorsV261TestJSON-1695635926 tempest-FlavorsV261TestJSON-1695635926-project] 10.222.0.44 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.61 time: 0.062696 Oct 28 19:08:02.658363 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 76/162] 10.222.0.44 () {60 vars in 1166 bytes} [Fri Oct 28 19:08:02 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:02.798657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-390404850", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e506fab6-553b-4be6-8b83-6b486040fd9f"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:02.890717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] validate_networks() for [('e506fab6-553b-4be6-8b83-6b486040fd9f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:03.687681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:03.688335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:03.688565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:03.688976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:03.689378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:03.700519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.701326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.702015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.703074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.703699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.704269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.748836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Getting quotas for project 2cabf5bc7f864f11b150f8b15825922c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:03.756137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Getting quotas for user 8468bb4493eb4cf5951029cda891cec9 and project 2cabf5bc7f864f11b150f8b15825922c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:03.783854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:03.793348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:03.904641 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2605ba45-daa3-4aca-b6d5-f7c387b8118c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.918212 Oct 28 19:08:03.911090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 87/163] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:03.923049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:03.923682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:03.938183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.939317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.942022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:03.946568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:03.948420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:03.948772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.686717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:04.694977 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca494fce-544f-488a-9e78-1394ce7765d3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.782248 Oct 28 19:08:04.713493 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 88/164] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:03 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:04.722648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1edd4444-1242-4949-ad45-9aeead852377 tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:04.758753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:04.764732 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1edd4444-1242-4949-ad45-9aeead852377 tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1338861987" status: 202 len: 0 microversion: 2.61 time: 0.049866 Oct 28 19:08:04.765690 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 89/165] 10.222.0.44 () {60 vars in 1202 bytes} [Fri Oct 28 19:08:04 2022] DELETE /compute/v2.1/flavors/1338861987 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:04.775831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:04.776762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:04.791877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:04.792377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:04.792802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:04.794855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:04.796115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:04.798938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.084713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:05.085225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:05.085587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:05.085988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:05.086392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:05.101670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.102170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.107271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.108233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.108836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.109910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.141993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.151566 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f479904-e903-431a-b745-aad41b4c27a1 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.380549 Oct 28 19:08:05.158543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:05.178090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for user 6e2ff64ca72649d3ac2e8912da76c9af and project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:05.182055 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 90/166] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:04 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:05.202568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.211782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:05.227812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.229815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:05.234349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.236505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:05.239165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.240111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.256077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.258272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.427058 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c35afa1a-8141-45ef-addb-ce43192ca99b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.767366 Oct 28 19:08:05.428010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 77/167] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:05.588223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8a61a7-c39b-405b-a51b-70f6a99c1b50", "name": "network-vif-plugged", "status": "completed", "tag": "5c6cf80e-bae3-4fab-a325-445725261ef3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:05.623836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.624335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.624767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.682804 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Creating event network-vif-plugged:5c6cf80e-bae3-4fab-a325-445725261ef3 for instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 on n-h2-862769-3 Oct 28 19:08:05.685304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:08:05.685990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c0377fc1-31a0-4295-8c96-6d78fac970b3 req-32fdc321-d306-4c9b-96dd-40f0f1ce013f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:08:05.688015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.690082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.692136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.693088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.695310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:05.695905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:05.731120 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.compute.rpcapi [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 19:08:05.733326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] Releasing lock "compute-rpcapi-router" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:08:05.768515 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cdd8a3f-4f09-4690-9a60-700d9c790840 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338851 Oct 28 19:08:05.775895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 78/168] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:05.783066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-34947d56-3d5f-440f-b255-a1f3dd43c56f tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.874100 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-34947d56-3d5f-440f-b255-a1f3dd43c56f tempest-FlavorsV261TestJSON-1058957427 tempest-FlavorsV261TestJSON-1058957427-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 6698 microversion: 2.61 time: 0.096446 Oct 28 19:08:05.876163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 79/169] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/flavors/detail => generated 6698 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:05.887870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b71d9790-9160-4074-8b89-df01aa4f7121 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.888607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b71d9790-9160-4074-8b89-df01aa4f7121 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:05.916867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:05.930075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:05.943793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56b5230c-fdf4-4b5c-b8fa-06a64e24d107 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1316 microversion: 2.1 time: 0.755167 Oct 28 19:08:05.944434 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 91/170] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:05.960216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:05.960782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:05.994161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:05.994653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.002019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.003049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.003663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.004253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.497675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b71d9790-9160-4074-8b89-df01aa4f7121 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:06.506485 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b71d9790-9160-4074-8b89-df01aa4f7121 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1210 microversion: 2.1 time: 0.624619 Oct 28 19:08:06.508165 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 80/171] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1210 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:06.537840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:06.538907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:06.563465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.565597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.566274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.567301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.573429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:06.574220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:06.871295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:06.893095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f56de46b-31d3-4983-b027-64d469ee1eeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.934679 Oct 28 19:08:06.893775 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 92/172] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:05 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:06.969063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:06.969717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:06.990225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:06.999265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.000198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.000999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.001537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.014714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.797687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.804137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:07.814590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0cda6351-767e-4d7a-a275-7a145b104301 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1322 microversion: 2.1 time: 0.849288 Oct 28 19:08:07.815594 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 93/173] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:06 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:07.822422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:07.832644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:07.850232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.850727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.851158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.851879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.852298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.852709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.946348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:07.958878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a9e1138-41e9-465f-b9fd-888a12578747 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 1.443413 Oct 28 19:08:07.959542 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 81/174] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:06 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:07.967632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:07.968818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:07.979784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.984910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.990995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:07.992009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:07.995951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:07.996557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:08.116384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:08.138088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e239a51-3b0f-4131-b777-7a795b1f0f96 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1284 microversion: 2.1 time: 0.321255 Oct 28 19:08:08.143030 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 94/175] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:07 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:08.450366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:08.465728 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-931fc7a7-e6b7-4aff-bc69-3136fef06bb9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.500529 Oct 28 19:08:08.474824 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 82/176] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:07 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:08.839611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:08.840585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:08.847852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:08.848644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:08.849304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:08.850202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:08.853126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:08.853770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:08.984861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:08.986504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:08.994337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.001113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.002110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.007751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.009924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.011349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.241357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.250467 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f85f265-7b0b-4a4f-80e1-dbef87ea6f90 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1322 microversion: 2.1 time: 0.415653 Oct 28 19:08:09.266683 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 95/177] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:08 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:09.271590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:09.273894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:09.287728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.289869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.296067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.297506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.302285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.302974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.619815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.637263 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-961b891d-bb4a-417f-a5bd-a5e75a6ec632 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1290 microversion: 2.1 time: 0.377195 Oct 28 19:08:09.638291 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 96/178] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:09 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1290 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:09.647906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:09.653296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:09.668680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.669245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.669789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.670561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.671189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.671609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.960270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:09.969638 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e832d76f-13ab-4d93-9475-211d07b1f58e tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1338 microversion: 2.1 time: 0.988634 Oct 28 19:08:09.976090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 83/179] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:08 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1338 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:10.163763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.180392 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ac78c1b-e62e-4070-9819-4d6e6593af9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.533349 Oct 28 19:08:10.182869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 97/180] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:09 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:10.285211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:10.285872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:10.294078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.300210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.300729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.301707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.323660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.324566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.661665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:10.662274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:10.674245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.675913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.676603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.679515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.680857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.682107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.894104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.908072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35a4c5a6-7d76-48c3-a6ad-8fdc36d89080 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.627857 Oct 28 19:08:10.911708 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 84/181] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:10.920550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:10.937620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1e0a64e-5659-4f40-928f-2625c4e16558 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1290 microversion: 2.1 time: 0.279808 Oct 28 19:08:10.940930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 98/182] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1290 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:11.001090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.001976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:11.014104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.016334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.016798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.023333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.024276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.024853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.216155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.217448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:11.230714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.242295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.244266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.245125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.246860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.247712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.077521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.093280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4426212e-da5c-4010-89b6-9b1a2b8dd92f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 0.885408 Oct 28 19:08:12.108605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:12.109741 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 99/183] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:11 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:12.115594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3807513b-a671-4e73-8e1b-a0465e29acf2 req-dc268486-3275-4fbb-a2ff-eb9a1a2b4176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495986a-5fdf-462a-8a27-4cae25051f67", "name": "network-vif-plugged", "status": "completed", "tag": "7a6fb0d8-3d62-43fe-ba26-7f441e053865"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:12.131844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3807513b-a671-4e73-8e1b-a0465e29acf2 req-dc268486-3275-4fbb-a2ff-eb9a1a2b4176 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.132430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3807513b-a671-4e73-8e1b-a0465e29acf2 req-dc268486-3275-4fbb-a2ff-eb9a1a2b4176 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.133673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3807513b-a671-4e73-8e1b-a0465e29acf2 req-dc268486-3275-4fbb-a2ff-eb9a1a2b4176 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.144324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0d406f4-2afb-4acc-94a7-ab452ab4f2cb tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1486 microversion: 2.1 time: 1.148498 Oct 28 19:08:12.157678 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3807513b-a671-4e73-8e1b-a0465e29acf2 req-dc268486-3275-4fbb-a2ff-eb9a1a2b4176 service nova] Creating event network-vif-plugged:7a6fb0d8-3d62-43fe-ba26-7f441e053865 for instance b495986a-5fdf-462a-8a27-4cae25051f67 on n-h1-862769-3 Oct 28 19:08:12.161995 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 85/184] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1486 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:12.171151 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3807513b-a671-4e73-8e1b-a0465e29acf2 req-dc268486-3275-4fbb-a2ff-eb9a1a2b4176 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059289 Oct 28 19:08:12.172338 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 100/185] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:12.177832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:12.178522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:12.184799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:12.199841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:12.215588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.217791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.218257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.234674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.235567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.236011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.260119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.261032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.261678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.262574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.263311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.264493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.583228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:13.595066 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-acb8b88d-cdf8-44e5-bbb6-c275521d9c17 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1332 microversion: 2.1 time: 1.420847 Oct 28 19:08:13.598964 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 101/186] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:12 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1332 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:13.608814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:13.611937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:13.631366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.632078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.632882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.633741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.634548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.635393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.683740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:13.700199 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb63ca27-4b87-4cda-9c72-54d8b05dc5d9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 1.522424 Oct 28 19:08:13.701072 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 86/187] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:12 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:13.719878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:13.722741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:13.748944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.756449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.759125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:13.760925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.762057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.762540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.763044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.794163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:14.769859 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b0c7343-425c-46bb-a5ec-7a015058462c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1637 microversion: 2.1 time: 1.168876 Oct 28 19:08:14.776448 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 102/188] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:13 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1637 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:14.787050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2fa57059-0b6c-4559-b7ea-ca1784a32f43 req-dbf163dd-6b53-4b5c-8952-650dc6f97778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a6353c-9ddc-4f2d-9fb4-c487c851cdc6", "tag": "0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:14.855310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2fa57059-0b6c-4559-b7ea-ca1784a32f43 req-dbf163dd-6b53-4b5c-8952-650dc6f97778 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.858081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2fa57059-0b6c-4559-b7ea-ca1784a32f43 req-dbf163dd-6b53-4b5c-8952-650dc6f97778 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.869426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2fa57059-0b6c-4559-b7ea-ca1784a32f43 req-dbf163dd-6b53-4b5c-8952-650dc6f97778 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.885624 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2fa57059-0b6c-4559-b7ea-ca1784a32f43 req-dbf163dd-6b53-4b5c-8952-650dc6f97778 service nova] Creating event network-changed:0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb for instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 on n-h2-862769-3 Oct 28 19:08:14.891928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2fa57059-0b6c-4559-b7ea-ca1784a32f43 req-dbf163dd-6b53-4b5c-8952-650dc6f97778 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113493 Oct 28 19:08:14.892738 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 103/189] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:14.986316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:15.002009 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-73feca8b-a4f0-487b-9020-444a3ed033e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1312 microversion: 2.1 time: 1.287603 Oct 28 19:08:15.002670 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 87/190] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:13 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1312 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:15.020892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-47871b55-2d78-48df-b463-fc79c3bad69c req-6080b0de-6c28-45c3-96f1-079f9bc765f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831d5ec9-b916-4990-84b9-8750b7b09827", "tag": "d197f992-5d98-43d0-bd9c-b28888bacc66"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:15.043960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-47871b55-2d78-48df-b463-fc79c3bad69c req-6080b0de-6c28-45c3-96f1-079f9bc765f2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.044958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-47871b55-2d78-48df-b463-fc79c3bad69c req-6080b0de-6c28-45c3-96f1-079f9bc765f2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.045911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-47871b55-2d78-48df-b463-fc79c3bad69c req-6080b0de-6c28-45c3-96f1-079f9bc765f2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.070092 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-47871b55-2d78-48df-b463-fc79c3bad69c req-6080b0de-6c28-45c3-96f1-079f9bc765f2 service nova] Creating event network-changed:d197f992-5d98-43d0-bd9c-b28888bacc66 for instance 831d5ec9-b916-4990-84b9-8750b7b09827 on n-h1-862769-3 Oct 28 19:08:15.089811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-47871b55-2d78-48df-b463-fc79c3bad69c req-6080b0de-6c28-45c3-96f1-079f9bc765f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084318 Oct 28 19:08:15.092020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 88/191] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:15.106631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.107806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.130328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.144201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.146761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.149251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.151984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.155718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.213664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c7b00d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.215688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.216352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.216918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.232298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:15.234028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.234655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.235244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.252278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.253124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.253550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.260695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b01a35b2-2440-471c-b913-fec291b4c858 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.366536 Oct 28 19:08:15.261757 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 104/192] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:08:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:15.267119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.268205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.278077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.280206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.281960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.282924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.283948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.284522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.713224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:15.722214 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95e68bee-f97e-4db0-9626-cf53df4ed69f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1332 microversion: 2.1 time: 0.627606 Oct 28 19:08:15.725230 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 89/193] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1332 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:15.731687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.737731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:15.748545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:15.751152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.755646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.756464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.757496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.758172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.758949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.765376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:15.769826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:15.779855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7bc2ce08-f6ff-465a-a2dd-1870458cbe22 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.516734 Oct 28 19:08:15.789279 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 105/194] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:15.799037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c69b670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.801002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.801476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.801899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.812012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:08:15.822974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.823735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.825031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.838917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.839689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.840285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.867403 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdfa491d-18b0-4206-b74c-15b6f31f30b8 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.076724 Oct 28 19:08:15.883053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 106/195] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:15.895047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c69bee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.897208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.897877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.898486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.937291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.938088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.938909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.952238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.953446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.954351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:15.966259 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9bbeabd8-d22c-4498-97eb-583c8946ffce tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081715 Oct 28 19:08:15.967855 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 107/196] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:15.983965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c69b430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:15.986179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:15.987063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:15.987664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.009178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.010498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.011779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.022121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a053bb2c-0dbb-4429-a5ca-79d578480efc tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.048037 Oct 28 19:08:16.023778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 108/197] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:16.054444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.060319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:16.077186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.078061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.078872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.087020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-876927ff-efb1-42e4-b7e7-200a479a27b2 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 204 len: 0 microversion: 2.1 time: 0.350467 Oct 28 19:08:16.088726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 90/198] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:08:15 2022] DELETE /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:16.095415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0d797a9-293c-4762-8b00-351012e1402e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c8a0e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.096242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.098145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.099951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.104247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d797a9-293c-4762-8b00-351012e1402e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.104824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d797a9-293c-4762-8b00-351012e1402e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.105617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d797a9-293c-4762-8b00-351012e1402e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.168947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0d797a9-293c-4762-8b00-351012e1402e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.078604 Oct 28 19:08:16.181508 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 91/199] 10.222.0.44 () {58 vars in 1179 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:16.194511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.199800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:16.207002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.207843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.208484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.209375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.209998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.210588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.504776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:16.598098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.607440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ebe52142-0780-4008-b5bc-9da7f3e8c5a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1461 microversion: 2.1 time: 0.582378 Oct 28 19:08:16.608024 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 109/200] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1461 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:16.615414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c731280>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.616929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:16.617177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.617648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.618079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.639029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eec5eb3d-fe54-4c84-b65b-045b44cc28ae tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1492 microversion: 2.1 time: 0.456043 Oct 28 19:08:16.640569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 92/201] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1492 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:16.682269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.682269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.689078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.716897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.717382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.717807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.739928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2a81c658-4a5f-4e24-8726-9f29fe974908 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.130719 Oct 28 19:08:16.749009 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 110/202] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:16.763114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.763811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:16.772287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.773224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.773743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.774512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.775523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.776009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.922310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:16.923303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:16.934679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.938197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.938827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:16.940284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:16.942457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:16.943249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.618163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:17.631936 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f4f0aa2-2ffa-4576-a132-8da31c1594d7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1332 microversion: 2.1 time: 0.879844 Oct 28 19:08:17.632875 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 111/203] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1332 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:17.638531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c81a310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:17.648079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.648562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.650296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.659822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:17.685592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.686151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.686578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.704312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f27bdb5-d844-4c95-b252-75e69c0b6532 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.069838 Oct 28 19:08:17.705119 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 112/204] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:17.726716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:17.727244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:17.737533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.738006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.739143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:17.739286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:17.739659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:17.740075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.122155 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78843f20-9fcc-4975-bf8d-6140a5d9c280 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1612 microversion: 2.1 time: 1.480463 Oct 28 19:08:18.139270 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 93/205] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:16 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1612 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:18.146038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.146925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:18.153502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.154274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.155006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.155874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.156486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.157052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.250581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.268584 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-663c59f1-2a4d-4660-b659-e20a68de2d37 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.553619 Oct 28 19:08:18.270918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 113/206] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:17 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:18.278518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c6c7820>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.280724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.281324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.281873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.304287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.304962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.305527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.324945 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f54c3a6-1895-40cc-b9b3-671f52171b1e tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.050317 Oct 28 19:08:18.335734 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 114/207] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:18.343845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:18.344785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:18.362194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.364496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.365034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.367136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.367982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.372716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.429494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.443461 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df2df1a1-c015-4174-80be-6071ba372288 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1492 microversion: 2.1 time: 0.302671 Oct 28 19:08:18.444072 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 94/208] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1492 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:18.499940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Calling method '.version_select at 0x7f1d7c75c790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.507769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.509021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.509481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.549082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b48bee39ca514665aeb90007ffb30733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f359020e3bb4db2bda3dd618ea63d58', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.552404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.552905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.553341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.554253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] flavor_id is None. Assuming migration. {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 19:08:18.554853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:08:18.582547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.583252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.583502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.634231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-92e554d3-e12e-4cc7-b100-2b4abfb376e3 tempest-HypervisorAdminTestJSON-1623765042 tempest-HypervisorAdminTestJSON-1623765042-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.166408 Oct 28 19:08:18.637120 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 95/209] 10.222.0.44 () {58 vars in 1173 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:18.659945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.660970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:18.676014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.676511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.676943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.686563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.687275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.687909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.017276 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e5084fb-af78-4e2c-966f-c1a12fda889b tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67/action" status: 202 len: 0 microversion: 2.1 time: 0.680124 Oct 28 19:08:19.021305 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 115/210] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:18 2022] POST /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:19.036165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:19.037054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:19.051981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.053210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.053880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.054633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.055431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.055519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.695238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:19.712739 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3e040a18-4e7b-41ef-87d7-f0b99002983d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1332 microversion: 2.1 time: 1.057901 Oct 28 19:08:19.715414 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 96/211] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1332 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:19.762285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:19.767004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:19.786550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.792206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.792673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.793433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.793901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.794317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.821988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:19.835178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9b0212b-0fa3-4495-bc16-938ac084d661 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1470 microversion: 2.1 time: 0.809509 Oct 28 19:08:19.836369 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 116/212] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:19 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1470 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:19.842855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-367bfa12-280b-44f7-8c9d-a757fdb02870 req-c672410c-8773-4db4-bcb9-c5d3d84be6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8a61a7-c39b-405b-a51b-70f6a99c1b50", "name": "network-vif-deleted", "tag": "5c6cf80e-bae3-4fab-a325-445725261ef3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:19.855588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-367bfa12-280b-44f7-8c9d-a757fdb02870 req-c672410c-8773-4db4-bcb9-c5d3d84be6f3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.856397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-367bfa12-280b-44f7-8c9d-a757fdb02870 req-c672410c-8773-4db4-bcb9-c5d3d84be6f3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.857053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-367bfa12-280b-44f7-8c9d-a757fdb02870 req-c672410c-8773-4db4-bcb9-c5d3d84be6f3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.870837 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-367bfa12-280b-44f7-8c9d-a757fdb02870 req-c672410c-8773-4db4-bcb9-c5d3d84be6f3 service nova] Creating event network-vif-deleted:5c6cf80e-bae3-4fab-a325-445725261ef3 for instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 on n-h2-862769-3 Oct 28 19:08:19.882427 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-367bfa12-280b-44f7-8c9d-a757fdb02870 req-c672410c-8773-4db4-bcb9-c5d3d84be6f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044490 Oct 28 19:08:19.883747 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 117/213] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:19.895736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:19.908089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:19.918591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.920022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.921031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.922840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.923731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.924784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.969599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.970369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.971045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.971764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lazy-loading 'fault' on Instance uuid 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:20.069836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79df33be7e064907b35d252e38522ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333e061960044691927569fa82f30543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.083615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ebe98ab-4f71-49c8-b5f6-d354f74fce88 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 200 len: 1328 microversion: 2.1 time: 0.198347 Oct 28 19:08:20.084879 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 118/214] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:19 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 1328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:20.332417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.342101 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7b07d17e-0c53-4ed7-a900-f13ffa1fc99b tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.623909 Oct 28 19:08:20.344122 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 97/215] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:19 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:20.742562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.744566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:20.766575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.769780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.770491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.772789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.773368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.775235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.861732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.863070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:20.878194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.879385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.880158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.881435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.883228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.885518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.541929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.553060 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1521858-1b74-4369-af0e-f59812431bf1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1470 microversion: 2.1 time: 0.697691 Oct 28 19:08:21.574606 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 98/216] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1470 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.580523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.581474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.588787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.589613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.590364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.591332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.592136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.592868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.607781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:21.610750 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] HTTP exception thrown: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Request method failure captured: Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 HTTP/1.1 Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChlpnNvuLMd3uKA1qgLvTk02QKuIe4saGVZ4fpiTw3t_ppo5yT46VzSylxe3Ss8vrwSYNoS3WgTbiAlS7uVarmtiAfv86-LZdu_lK8JyXhMaTQYL3te0Exv_wi0y7KLEsUo3dXtkCW5VHXn4gEKinEWcJYeFm_ZRVZK8J48B7bNYMU Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 333e061960044691927569fa82f30543 Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:08:21.616188 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/333e061960044691927569fa82f30543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_333e061960044691927569fa82f30543", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/333e061960044691927569fa82f30543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/333e061960044691927569fa82f30543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 333e061960044691927569fa82f30543 Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminTestJSON-77776135-project Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 79df33be7e064907b35d252e38522ca1 Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminTestJSON-77776135-project Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:21.617369 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1b8a61a7-c39b-405b-a51b-70f6a99c1b50'} Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:21.618054 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:21.619237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.620210 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-409e6935-cced-4baa-bf24-b7a00c3d48ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1332 microversion: 2.1 time: 0.882906 Oct 28 19:08:21.623793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Returning 404 to user: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:21.624792 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 119/217] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1332 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.625289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e16bd46-7cf4-4067-aee3-500d4ffec7a7 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 404 len: 111 microversion: 2.1 time: 0.048595 Oct 28 19:08:21.629883 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 99/218] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:21.635086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5083bfc-0c43-4dab-9e55-b44fa4aa7580 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:21.642306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.647207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5083bfc-0c43-4dab-9e55-b44fa4aa7580 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.647755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:21.648159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5083bfc-0c43-4dab-9e55-b44fa4aa7580 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.648740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5083bfc-0c43-4dab-9e55-b44fa4aa7580 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.676241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.676627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.679107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.681081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.684230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.687195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.946111 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5083bfc-0c43-4dab-9e55-b44fa4aa7580 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 300 microversion: 2.1 time: 0.314698 Oct 28 19:08:21.957751 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 100/219] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:08:21 2022] POST /compute/v2.1/os-aggregates/6/action => generated 300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:21.976890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e6d5a8e-af42-4e09-93f3-dca3193e9838 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.057278 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e6d5a8e-af42-4e09-93f3-dca3193e9838 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.095509 Oct 28 19:08:22.076118 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 101/220] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:21 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:22.089461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1d3fabc-0aba-4406-90a6-507cd4162c81 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2112932934"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:22.102341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-d1d3fabc-0aba-4406-90a6-507cd4162c81 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid a25d530d-fc87-4e7e-9c0e-987a6af46b38 for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:22.159417 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1d3fabc-0aba-4406-90a6-507cd4162c81 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080347 Oct 28 19:08:22.163003 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 102/221] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:22.176826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14192100-1f03-4f6a-90cf-4d29bfbcac26 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:22.200184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14192100-1f03-4f6a-90cf-4d29bfbcac26 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.201063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14192100-1f03-4f6a-90cf-4d29bfbcac26 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.202140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14192100-1f03-4f6a-90cf-4d29bfbcac26 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.403514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:22.418071 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-acf4725f-92b7-4e6f-92f1-09a04e4fb4cb tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.789244 Oct 28 19:08:22.421297 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 120/222] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:22.526935 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14192100-1f03-4f6a-90cf-4d29bfbcac26 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.354567 Oct 28 19:08:22.528085 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 103/223] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:08:22 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:22.568298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44499231-92c2-4353-91a9-773b75c5362f tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.584030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.584689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:22.599987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44499231-92c2-4353-91a9-773b75c5362f tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.063053 Oct 28 19:08:22.600199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.600483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.600917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.605462 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 121/224] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:08:22 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:22.606470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.608427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.608870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.631637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8055c265-59b5-47ee-ab2d-e732e68767f9 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:22.661914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8055c265-59b5-47ee-ab2d-e732e68767f9 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.663809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8055c265-59b5-47ee-ab2d-e732e68767f9 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.664387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8055c265-59b5-47ee-ab2d-e732e68767f9 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.847357 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8055c265-59b5-47ee-ab2d-e732e68767f9 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.232353 Oct 28 19:08:22.849164 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 122/225] 10.222.0.44 () {60 vars in 1191 bytes} [Fri Oct 28 19:08:22 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:22.864289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:22.866429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:22.886462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.887599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.889536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:22.891396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:22.892218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:22.893886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.127096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.142115 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-47d66587-9bdb-4dfa-999f-ade44d72ce4d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1470 microversion: 2.1 time: 0.564167 Oct 28 19:08:23.142715 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 104/226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:22 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1470 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:23.153516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-475b75b0-88c3-4750-abc1-17df0e4a7914 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.193506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-475b75b0-88c3-4750-abc1-17df0e4a7914 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.049618 Oct 28 19:08:23.194343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 105/227] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:23 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:23.210721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d9c99754-ec14-4147-a82b-33d449064cff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1271560480"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:23.214272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-d9c99754-ec14-4147-a82b-33d449064cff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid 2703c9af-f769-493b-a9cc-de7bff8c2b4d for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:23.257179 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d9c99754-ec14-4147-a82b-33d449064cff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055132 Oct 28 19:08:23.258790 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 106/228] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:23.274177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88947dd9-f10f-43d1-ba58-c399fc7f7333 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:23.303848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88947dd9-f10f-43d1-ba58-c399fc7f7333 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.304781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88947dd9-f10f-43d1-ba58-c399fc7f7333 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.306933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88947dd9-f10f-43d1-ba58-c399fc7f7333 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.356379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.368114 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a41d75b5-f90d-4c01-901f-c4e4edac8b22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1310 microversion: 2.1 time: 0.514440 Oct 28 19:08:23.370400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 123/229] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:22 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1310 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:23.448276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.448983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:23.470741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.474884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.475686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.480063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.480830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.482458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.574074 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88947dd9-f10f-43d1-ba58-c399fc7f7333 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.307587 Oct 28 19:08:23.574705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 107/230] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:23 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:23.587269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc1ce703-4a91-4cb5-88a0-a2b68743e81c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.602091 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc1ce703-4a91-4cb5-88a0-a2b68743e81c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.019818 Oct 28 19:08:23.602660 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 108/231] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:08:23 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:23.614991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-374ae121-62b4-4009-9a17-e1c8653e9d59 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:23.656806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-374ae121-62b4-4009-9a17-e1c8653e9d59 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.657549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-374ae121-62b4-4009-9a17-e1c8653e9d59 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.658781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-374ae121-62b4-4009-9a17-e1c8653e9d59 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.839191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:23.856559 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-374ae121-62b4-4009-9a17-e1c8653e9d59 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.245728 Oct 28 19:08:23.857761 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 109/232] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:23 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:23.878446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6402a410-4d30-4b06-98ca-c37cba19678c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.936623 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6402a410-4d30-4b06-98ca-c37cba19678c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.070901 Oct 28 19:08:23.939404 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 110/233] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:23 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:23.955479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3b8ddef-284a-491c-89d6-a058269f1ad8 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-411969904"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:23.965316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-d3b8ddef-284a-491c-89d6-a058269f1ad8 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid 94fd815d-1696-42ba-8c79-500aeacce765 for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:24.034682 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3b8ddef-284a-491c-89d6-a058269f1ad8 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085204 Oct 28 19:08:24.042233 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 111/234] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:24.052188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-425a4ff0-28fa-434d-b6d1-211dc703e293 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:24.083874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-425a4ff0-28fa-434d-b6d1-211dc703e293 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.084954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-425a4ff0-28fa-434d-b6d1-211dc703e293 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.085798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-425a4ff0-28fa-434d-b6d1-211dc703e293 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.156692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:24.170336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-faa4e1db-1f09-4c3e-b2db-d24d4a260d25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.726538 Oct 28 19:08:24.175832 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 124/235] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:23 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:24.187078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:24.188046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:24.203639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.204421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.205012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.205882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.206487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.207172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.347216 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-425a4ff0-28fa-434d-b6d1-211dc703e293 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.303494 Oct 28 19:08:24.347747 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 112/236] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:24.362891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71350026-00fe-4661-9df2-0f09987623ff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:24.391194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71350026-00fe-4661-9df2-0f09987623ff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.394804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71350026-00fe-4661-9df2-0f09987623ff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.395550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71350026-00fe-4661-9df2-0f09987623ff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.651595 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71350026-00fe-4661-9df2-0f09987623ff tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.293047 Oct 28 19:08:24.654336 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 113/237] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:24.680303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:24.681147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:24.692048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.693351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.693977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.695048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.697073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.697732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.027549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.039032 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a56198f7-fb53-44dd-ba76-e856bd8d089d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1470 microversion: 2.1 time: 0.861346 Oct 28 19:08:25.042332 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 125/238] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:24 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1470 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:25.047200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f86a72d7-7936-4f34-8606-38889bb3b415 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.081689 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f86a72d7-7936-4f34-8606-38889bb3b415 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.037767 Oct 28 19:08:25.088021 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 126/239] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:25 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:25.097654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72147085-6a2a-40a2-aa47-16dc5c103cea tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1586062338"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.101905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-72147085-6a2a-40a2-aa47-16dc5c103cea tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid d11178ab-d29b-4f7c-87e2-a3ff6ece3653 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:25.146746 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72147085-6a2a-40a2-aa47-16dc5c103cea tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055111 Oct 28 19:08:25.154855 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 127/240] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:25.170954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-be6df7a6-ef44-43c1-9797-004e7dbaf25c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.237486 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-be6df7a6-ef44-43c1-9797-004e7dbaf25c tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.078624 Oct 28 19:08:25.238149 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 128/241] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:25.248670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0953526-bbae-4af4-b631-26f28af40d6c tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1468989282"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.259260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-a0953526-bbae-4af4-b631-26f28af40d6c tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid 17b22e97-7d9b-48cc-a680-d2eb3ca12074 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:25.285227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.296074 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed46ed5b-82f3-4812-956e-941c6a972c04 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1310 microversion: 2.1 time: 0.640109 Oct 28 19:08:25.317866 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 114/242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:24 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1310 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:25.339358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.339921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:25.364355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.365033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.365264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.365966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.366743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.376597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0953526-bbae-4af4-b631-26f28af40d6c tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.133552 Oct 28 19:08:25.377225 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 129/243] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:25.385754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.413947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f5433e7-abc5-4e7d-94d0-b9490d3e3da0 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.442446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2f5433e7-abc5-4e7d-94d0-b9490d3e3da0 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f5433e7-abc5-4e7d-94d0-b9490d3e3da0 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Request method failure captured: Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChnHmMIARoVyCRDLx_h0_x3Xcr5pk7WzDScMbdKpZQy5LK8LqcA65NVURogfeYqFmoigyTrNSMhWWFgdqjK1jgbv_RqcypsDVPnyxjn32gqJlAxQ9nht1UeE7HlcVKhV5WiHeYXSm7uKR70w2d1u1KI9BfyefyrneHjdokIIPggRJc Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:08:25.446212 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb76e6c252854c13bae7d56cb6c7346f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9261ca8c2e6640b0b50be94adf4a2bdf Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: exception: Aggregate 12 could not be found. Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '12'} Oct 28 19:08:25.447712 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.448503 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 28 19:08:25.450534 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.454022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f5433e7-abc5-4e7d-94d0-b9490d3e3da0 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:25.454022 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f5433e7-abc5-4e7d-94d0-b9490d3e3da0 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.069572 Oct 28 19:08:25.454022 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 130/244] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:25 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:08:25.473006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ee864aa-b45a-4315-990e-db32090be9a1 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.483515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:25.527726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee864aa-b45a-4315-990e-db32090be9a1 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.529247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee864aa-b45a-4315-990e-db32090be9a1 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.532584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee864aa-b45a-4315-990e-db32090be9a1 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.778468 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ee864aa-b45a-4315-990e-db32090be9a1 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.329052 Oct 28 19:08:25.785774 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 131/245] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:25.788444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a8f6a78-ab4c-43e4-97a3-adcfb43b7816 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.795988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.807434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56dc568d-7ccc-41e8-9e1c-f293d53a3805 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.487960 Oct 28 19:08:25.810233 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 115/246] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:25 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:25.848352 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2a8f6a78-ab4c-43e4-97a3-adcfb43b7816 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a8f6a78-ab4c-43e4-97a3-adcfb43b7816 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Request method failure captured: Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChnHmMIARoVyCRDLx_h0_x3Xcr5pk7WzDScMbdKpZQy5LK8LqcA65NVURogfeYqFmoigyTrNSMhWWFgdqjK1jgbv_RqcypsDVPnyxjn32gqJlAxQ9nht1UeE7HlcVKhV5WiHeYXSm7uKR70w2d1u1KI9BfyefyrneHjdokIIPggRJc Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:08:25.850820 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb76e6c252854c13bae7d56cb6c7346f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9261ca8c2e6640b0b50be94adf4a2bdf Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: exception: Aggregate 12 could not be found. Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '12'} Oct 28 19:08:25.852010 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:08:25.852721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.853748 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:25.854868 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:25.854868 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:25.854868 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:25.854868 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 28 19:08:25.854868 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.857390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a8f6a78-ab4c-43e4-97a3-adcfb43b7816 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:25.858761 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2a8f6a78-ab4c-43e4-97a3-adcfb43b7816 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.078124 Oct 28 19:08:25.860081 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 132/247] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:08:25.872837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e395fec-94bd-4e58-a4c4-6420529f7893 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.878592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1e395fec-94bd-4e58-a4c4-6420529f7893 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '10f651bd96d04cbd92f5eb5f292d0073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52939de27b4db1a34684ab6cadf5ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e395fec-94bd-4e58-a4c4-6420529f7893 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Request method failure captured: Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 42 Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChkU-_qYA-d7rALxIaLW0CuXXug0HaSSjfzLfQ2XAqddSzAyDzwadhRgFLjUqBW9E1mENBvIp1gBZLV0irUM81qN88tmtIz4gSrSuSsNZWPINYHEP5ImhBf6cxrVLRCko7FhqivUMYO89abi1gkO7pclBITNo-D4jm8ladYzg0TYRM Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:08:25.881006 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1b52939de27b4db1a34684ab6cadf5ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1b52939de27b4db1a34684ab6cadf5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1b52939de27b4db1a34684ab6cadf5ca Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-566273794 Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 10f651bd96d04cbd92f5eb5f292d0073 Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-566273794-project Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: {"remove_host": {"host": "n-h2-862769-3"}} Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:25.882231 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-862769-3'}}} Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:25.882980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 19:08:25.884036 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:25.886959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e395fec-94bd-4e58-a4c4-6420529f7893 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:25.888406 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e395fec-94bd-4e58-a4c4-6420529f7893 tempest-AggregatesAdminNegativeTestJSON-566273794 tempest-AggregatesAdminNegativeTestJSON-566273794-project] 10.222.0.44 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.026866 Oct 28 19:08:25.889240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 133/248] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:25.896906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-edeeb048-b53c-47fc-8ba1-8766745a3633 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1891096949", "name": "tempest-test_aggregate-937220427"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.925217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-edeeb048-b53c-47fc-8ba1-8766745a3633 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid b2f2aeef-dbc6-437c-8339-ebdc54240fa9 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:25.940363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:25.970894 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-edeeb048-b53c-47fc-8ba1-8766745a3633 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.079907 Oct 28 19:08:25.972842 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 134/249] 10.222.0.44 () {60 vars in 1165 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:25.979799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff4e7e8e-97c7-4532-9faa-8f950da211bb tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.996240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff4e7e8e-97c7-4532-9faa-8f950da211bb tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.997469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff4e7e8e-97c7-4532-9faa-8f950da211bb tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.998382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff4e7e8e-97c7-4532-9faa-8f950da211bb tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.172629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff4e7e8e-97c7-4532-9faa-8f950da211bb tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.198014 Oct 28 19:08:26.192948 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 135/250] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:26.199191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28f03250-1c77-4de0-85b5-5a432a760cae tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.247859 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28f03250-1c77-4de0-85b5-5a432a760cae tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.053113 Oct 28 19:08:26.254361 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 136/251] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:26 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:26.285176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.287330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:26.318667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.323170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.324525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.328104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.329186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.334496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.571682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2139639041", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "aa325377-9337-4f1f-b1f3-a267b86ca8bc"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:26.638052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:26.656038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] validate_networks() for [('aa325377-9337-4f1f-b1f3-a267b86ca8bc', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:26.664547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-950e616a-26c1-4f9a-b652-f4c1abc882dd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.407997 Oct 28 19:08:26.665488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 137/252] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:26.697588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55e84645-24fc-43fa-84bc-108d93d0339b tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.728254 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55e84645-24fc-43fa-84bc-108d93d0339b tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.036039 Oct 28 19:08:26.735118 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 138/253] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:26 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:26.746894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53a05a3b-13a9-4d3b-8110-cf4417fb6f9b tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.772278 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-53a05a3b-13a9-4d3b-8110-cf4417fb6f9b tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53a05a3b-13a9-4d3b-8110-cf4417fb6f9b tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Request method failure captured: Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChnHmMIARoVyCRDLx_h0_x3Xcr5pk7WzDScMbdKpZQy5LK8LqcA65NVURogfeYqFmoigyTrNSMhWWFgdqjK1jgbv_RqcypsDVPnyxjn32gqJlAxQ9nht1UeE7HlcVKhV5WiHeYXSm7uKR70w2d1u1KI9BfyefyrneHjdokIIPggRJc Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:08:26.774118 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb76e6c252854c13bae7d56cb6c7346f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9261ca8c2e6640b0b50be94adf4a2bdf Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: exception: Aggregate 14 could not be found. Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '14'} Oct 28 19:08:26.775450 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:26.776220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 28 19:08:26.777307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:26.778295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53a05a3b-13a9-4d3b-8110-cf4417fb6f9b tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:26.778295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53a05a3b-13a9-4d3b-8110-cf4417fb6f9b tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.039319 Oct 28 19:08:26.778295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 139/254] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:08:26.793971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.794599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:26.815447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.815966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.816445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.817175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.817618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.818057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.115091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:27.123461 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-602c5192-dd6b-422c-913c-e251e1268282 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1310 microversion: 2.1 time: 0.346303 Oct 28 19:08:27.124300 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 140/255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1310 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:27.269689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Calling method '.version_select at 0x7f1d7c5669d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.272562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.273406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.274028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.282550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:27.323231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.324654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.325309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.365544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.366065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.366508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.378632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:27.379436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:27.380824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:27.381481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:27.382263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:27.385967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd241ca8-a37a-47c6-a82a-bd1750d32a48 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.260209 Oct 28 19:08:27.386871 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 141/256] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:27.396430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.397141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.397754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.399256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.400098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.400790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.407564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b20946be-accd-4061-a395-dde1b5d49eb5 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-976783004"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:27.418098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-b20946be-accd-4061-a395-dde1b5d49eb5 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Generated uuid d793aaa6-c13b-4058-a930-03db46733d35 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:27.422541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:27.428128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for user 1b1defe0b46f45fc8ff3d354bb4d361e and project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:27.448586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:27.457200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:27.459116 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b20946be-accd-4061-a395-dde1b5d49eb5 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061689 Oct 28 19:08:27.459724 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 142/257] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:27.469790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-030d6b1e-eae3-4b7d-b331-4885abe2a10a tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.494712 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-030d6b1e-eae3-4b7d-b331-4885abe2a10a tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-030d6b1e-eae3-4b7d-b331-4885abe2a10a tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Request method failure captured: Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChnHmMIARoVyCRDLx_h0_x3Xcr5pk7WzDScMbdKpZQy5LK8LqcA65NVURogfeYqFmoigyTrNSMhWWFgdqjK1jgbv_RqcypsDVPnyxjn32gqJlAxQ9nht1UeE7HlcVKhV5WiHeYXSm7uKR70w2d1u1KI9BfyefyrneHjdokIIPggRJc Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:08:27.496814 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb76e6c252854c13bae7d56cb6c7346f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb76e6c252854c13bae7d56cb6c7346f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fb76e6c252854c13bae7d56cb6c7346f Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-924481641 Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9261ca8c2e6640b0b50be94adf4a2bdf Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminTestJSON-924481641-project-admin Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: exception: Aggregate 14 could not be found. Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '14'} Oct 28 19:08:27.498262 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:08:27.499107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.501486 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:27.502897 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:27.502897 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:27.502897 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:27.502897 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 28 19:08:27.502897 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.506013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-030d6b1e-eae3-4b7d-b331-4885abe2a10a tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:27.508580 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-030d6b1e-eae3-4b7d-b331-4885abe2a10a tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.047664 Oct 28 19:08:27.510187 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 143/258] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:08:27.517969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b1deb9b7-4a45-4890-8b07-5b82374c479d req-2815ec41-555a-4ea2-be5f-fb9fb7689ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831d5ec9-b916-4990-84b9-8750b7b09827", "name": "network-vif-plugged", "status": "completed", "tag": "d197f992-5d98-43d0-bd9c-b28888bacc66"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:27.531139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b1deb9b7-4a45-4890-8b07-5b82374c479d req-2815ec41-555a-4ea2-be5f-fb9fb7689ee8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.531879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b1deb9b7-4a45-4890-8b07-5b82374c479d req-2815ec41-555a-4ea2-be5f-fb9fb7689ee8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.532447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b1deb9b7-4a45-4890-8b07-5b82374c479d req-2815ec41-555a-4ea2-be5f-fb9fb7689ee8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.557224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b1deb9b7-4a45-4890-8b07-5b82374c479d req-2815ec41-555a-4ea2-be5f-fb9fb7689ee8 service nova] Creating event network-vif-plugged:d197f992-5d98-43d0-bd9c-b28888bacc66 for instance 831d5ec9-b916-4990-84b9-8750b7b09827 on n-h1-862769-3 Oct 28 19:08:27.566521 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b1deb9b7-4a45-4890-8b07-5b82374c479d req-2815ec41-555a-4ea2-be5f-fb9fb7689ee8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053789 Oct 28 19:08:27.567681 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 144/259] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:27.582715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2ad638b-065d-48f7-9d9c-7b94817dccbf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.770974 Oct 28 19:08:27.584712 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 116/260] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:08:27.589240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.591531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:27.600714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Calling method '.version_select at 0x7f1d7c8a0e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.603142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.608108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.628788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.631376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.631727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.632303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.633112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.636091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.637146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.673899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.678949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.679580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.688620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f83a59c-5284-45c1-802c-c90e81e07eb7 tempest-HypervisorAdminV228Test-634368378 tempest-HypervisorAdminV228Test-634368378-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.099921 Oct 28 19:08:27.695831 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 117/261] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:27.705241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:27.730380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.734239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.734938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.752911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:27.754195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:27.756124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.780123 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.compute.aggregates [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 19:08:27.781064 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Request method failure captured: Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 42 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChm4-xbaGN-HGvBsWhetlwT3H7ahHffJa_fSYGM9dEminJKFo9DEZ6hKChQqQx__-JzQznambh98rz1nQXFAOHsEUcyhFFD4A8A8h4YYCzJ-uKz5UGzWh5NFkRkJGsliPVU-rqdGemZrwqQ_WZnNXdovI7mL7N3vWj4lgHl1g3OCZk Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:08:27.784930 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ada06946d67647c78a9c33db4884b0f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ada06946d67647c78a9c33db4884b0f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ada06946d67647c78a9c33db4884b0f0 Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585 Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7d34a8f126864c6ea6a063a601432153 Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: {"remove_host": {"host": "nonexist_host"}} Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:08:27.786267 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 19:08:27.787154 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 28 19:08:27.788379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.789614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:27.791244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:27.791244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:27.791244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:27.791244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:27.791244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 28 19:08:27.791244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:27.794327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:27.796901 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37652a83-5eb6-4a98-be17-6385607d91a6 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.099810 Oct 28 19:08:27.801448 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 118/262] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:27 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:08:27.812282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c85cd48-1983-420e-b574-d123390297de tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1302274589"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:27.818211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-1c85cd48-1983-420e-b574-d123390297de tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid 201eccba-1b65-4739-8b48-a5d317e84073 for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:27.867360 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c85cd48-1983-420e-b574-d123390297de tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062945 Oct 28 19:08:27.876647 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 119/263] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:27.891456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c31dd7b5-d7f3-4eff-b79c-374c2626fd1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:27.892408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c31dd7b5-d7f3-4eff-b79c-374c2626fd1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:28.054555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c31dd7b5-d7f3-4eff-b79c-374c2626fd1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.063209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c31dd7b5-d7f3-4eff-b79c-374c2626fd1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.065360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c31dd7b5-d7f3-4eff-b79c-374c2626fd1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.067406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c31dd7b5-d7f3-4eff-b79c-374c2626fd1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1262 microversion: 2.25 time: 0.187813 Oct 28 19:08:28.068174 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 120/264] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1262 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:28.073357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.074476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:28.081706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.082579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.083257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.084149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.084819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.085539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.107958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.152184 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65789f44-24c7-4042-a3fd-d9550ff160a4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.574778 Oct 28 19:08:28.159409 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 145/265] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:27 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:28.180110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c3e22db-d266-4998-9a69-23861ac0e0b7 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.257378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7c3e22db-d266-4998-9a69-23861ac0e0b7 tempest-AggregatesAdminNegativeTestJSON-2119678585 tempest-AggregatesAdminNegativeTestJSON-2119678585-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.096544 Oct 28 19:08:28.259767 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 146/266] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:28 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:28.273157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a37552c8-c42e-4ac9-8b67-e9f9a6e75c09 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.285103 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a37552c8-c42e-4ac9-8b67-e9f9a6e75c09 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.020369 Oct 28 19:08:28.297767 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 147/267] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:28.306775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.308551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:28.315872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.316789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.317480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.318594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.319999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.320701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.635223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.643170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.653747 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc23f2cf-b943-44a7-ab25-49b11ac9dadb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.584065 Oct 28 19:08:28.659732 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e112662-fd17-4b11-b48c-71a4dbb42b94 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1310 microversion: 2.1 time: 0.359980 Oct 28 19:08:28.661001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 121/268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:28.675930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 148/269] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1310 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:28.685417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ca7e4a6-cd36-4d39-a745-b7d01fef0611 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:28.743546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ca7e4a6-cd36-4d39-a745-b7d01fef0611 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.080715 Oct 28 19:08:28.757882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-36071482-4964-4615-ab26-1206c1cf1659 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.763409 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 122/270] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:08:28 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:28.772416 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-36071482-4964-4615-ab26-1206c1cf1659 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.019891 Oct 28 19:08:28.787168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1056d02-5561-4c7e-b172-2a92ede4b620 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.790376 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 149/271] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:28.832724 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1056d02-5561-4c7e-b172-2a92ede4b620 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.049718 Oct 28 19:08:28.844736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28f32040-98ed-45d3-b422-7b28ff4ebdda tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1395043642", "availability_zone": "tempest-test_az-920298377"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:28.851367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-28f32040-98ed-45d3-b422-7b28ff4ebdda tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid 7f2178dd-668d-4d1a-89ff-e3ffa9c0cfa0 for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:28.851634 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 123/272] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:28 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:28.909303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28f32040-98ed-45d3-b422-7b28ff4ebdda tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.067555 Oct 28 19:08:28.924459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f3c294fa-bdd8-4fe9-afc9-45c0cf4555d3 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1395043642_new", "availability_zone": "tempest-test_az-920298377_new"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:28.930090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 150/273] 10.222.0.44 () {60 vars in 1165 bytes} [Fri Oct 28 19:08:28 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:29.094493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.095770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:29.148477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.153741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.156065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.169004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.172424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.188374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.310349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c294fa-bdd8-4fe9-afc9-45c0cf4555d3 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.310969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c294fa-bdd8-4fe9-afc9-45c0cf4555d3 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.311417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c294fa-bdd8-4fe9-afc9-45c0cf4555d3 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.374366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f3c294fa-bdd8-4fe9-afc9-45c0cf4555d3 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.453989 Oct 28 19:08:29.376137 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 124/274] 10.222.0.44 () {60 vars in 1173 bytes} [Fri Oct 28 19:08:28 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:29.386908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.387734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:29.402381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.404086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.405372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.409908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.410732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.411727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.688524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:29.705547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:29.708210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:29.711965 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65789ce9-23d7-436f-a15d-85aee9e36e85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1258 microversion: 2.25 time: 0.621320 Oct 28 19:08:29.728263 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 151/275] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1258 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:29.738560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3bf1283-f737-45b7-8a53-d600b96f7fb7 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.771480 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3bf1283-f737-45b7-8a53-d600b96f7fb7 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.041166 Oct 28 19:08:29.778385 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 152/276] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:29.786842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-fa8de20c-2b8e-4f43-a571-450d36fccfdc req-c26e7ec0-f082-4640-8902-b409e765a2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6353c-9ddc-4f2d-9fb4-c487c851cdc6", "name": "network-vif-plugged", "status": "completed", "tag": "0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:29.813786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fa8de20c-2b8e-4f43-a571-450d36fccfdc req-c26e7ec0-f082-4640-8902-b409e765a2a9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.814516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fa8de20c-2b8e-4f43-a571-450d36fccfdc req-c26e7ec0-f082-4640-8902-b409e765a2a9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.815192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fa8de20c-2b8e-4f43-a571-450d36fccfdc req-c26e7ec0-f082-4640-8902-b409e765a2a9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.835054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-fa8de20c-2b8e-4f43-a571-450d36fccfdc req-c26e7ec0-f082-4640-8902-b409e765a2a9 service nova] Creating event network-vif-plugged:0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb for instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 on n-h2-862769-3 Oct 28 19:08:29.842737 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-fa8de20c-2b8e-4f43-a571-450d36fccfdc req-c26e7ec0-f082-4640-8902-b409e765a2a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060231 Oct 28 19:08:29.848018 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 153/277] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:29.858527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.860108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:29.881936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.882620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.884506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.888428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.889143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.889962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.350556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.381327 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57dd96e6-8c63-41f1-91bf-197c37992e13 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1390 microversion: 2.1 time: 0.997873 Oct 28 19:08:30.382204 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 125/278] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1390 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:30.418898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:30.419822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:30.436389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.439725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.440556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.442974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.443919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.446058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.784434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.799705 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f86da0df-c8c8-4a8e-ba6b-d9f130055f50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.950077 Oct 28 19:08:30.800293 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 154/279] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:30.804853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24d20b81-7297-4883-9bfd-523e87dd6045 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:30.855232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24d20b81-7297-4883-9bfd-523e87dd6045 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.052798 Oct 28 19:08:30.856546 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 155/280] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:30 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:08:30.864615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:30.865830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:30.875789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.876583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.877360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.878363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.879149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.879776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.148814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.158589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.160241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.168036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe83e7fa-7eef-4e69-8c34-46ee9c3e31ec tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1320 microversion: 2.25 time: 0.309869 Oct 28 19:08:31.170559 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 156/281] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:30 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:31.196186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccf7c8b4-3a06-4581-af16-f5cd08aa3f15 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-932919720"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:31.200683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.aggregate [None req-ccf7c8b4-3a06-4581-af16-f5cd08aa3f15 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Generated uuid d7f4b8ba-c560-4731-ab83-7ecc5f31586f for aggregate {{(pid=120629) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:08:31.237272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.244281 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ccf7c8b4-3a06-4581-af16-f5cd08aa3f15 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059617 Oct 28 19:08:31.247418 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 157/282] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:08:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:31.255725 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6061bb39-cf32-45e6-bb01-4a5fb646502b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1310 microversion: 2.1 time: 0.868554 Oct 28 19:08:31.258928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-670506e7-bc72-4be9-bb87-ad611ad94c61 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.260151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 126/283] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:30 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1310 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:31.279859 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-670506e7-bc72-4be9-bb87-ad611ad94c61 tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.025066 Oct 28 19:08:31.280596 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 158/284] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:31.294131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15033259-dffa-4be6-bab5-ce4bfeeaddde tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.341905 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15033259-dffa-4be6-bab5-ce4bfeeaddde tempest-AggregatesAdminTestJSON-924481641 tempest-AggregatesAdminTestJSON-924481641-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.052732 Oct 28 19:08:31.344829 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 127/285] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 19:08:31.354119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.354834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.366445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.375448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.375448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.380144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.381011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.381463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.409296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.410022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.410098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] HTTP exception thrown: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Request method failure captured: Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 HTTP/1.1 Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChlpnNvuLMd3uKA1qgLvTk02QKuIe4saGVZ4fpiTw3t_ppo5yT46VzSylxe3Ss8vrwSYNoS3WgTbiAlS7uVarmtiAfv86-LZdu_lK8JyXhMaTQYL3te0Exv_wi0y7KLEsUo3dXtkCW5VHXn4gEKinEWcJYeFm_ZRVZK8J48B7bNYMU Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 333e061960044691927569fa82f30543 Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:08:31.412693 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/333e061960044691927569fa82f30543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_333e061960044691927569fa82f30543", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/333e061960044691927569fa82f30543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/333e061960044691927569fa82f30543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 333e061960044691927569fa82f30543 Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminTestJSON-77776135-project Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 79df33be7e064907b35d252e38522ca1 Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminTestJSON-77776135-project Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.413857 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1b8a61a7-c39b-405b-a51b-70f6a99c1b50'} Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:31.414588 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.416648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.420962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.421465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.421894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.422601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.423079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.423496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.435706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Returning 404 to user: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:31.438433 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4ebd8ffe-1049-4b91-8ff8-9208e0b45897 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 404 len: 111 microversion: 2.1 time: 0.087852 Oct 28 19:08:31.443601 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 159/286] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:08:31 2022] DELETE /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:08:31.455091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.459387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] [instance: 1b8a61a7-c39b-405b-a51b-70f6a99c1b50] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.474898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.475527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.476939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.478355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.492679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.493533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.509621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] HTTP exception thrown: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Request method failure captured: Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 HTTP/1.1 Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChlpnNvuLMd3uKA1qgLvTk02QKuIe4saGVZ4fpiTw3t_ppo5yT46VzSylxe3Ss8vrwSYNoS3WgTbiAlS7uVarmtiAfv86-LZdu_lK8JyXhMaTQYL3te0Exv_wi0y7KLEsUo3dXtkCW5VHXn4gEKinEWcJYeFm_ZRVZK8J48B7bNYMU Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 333e061960044691927569fa82f30543 Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:08:31.516641 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/333e061960044691927569fa82f30543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_333e061960044691927569fa82f30543", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/333e061960044691927569fa82f30543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/333e061960044691927569fa82f30543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 333e061960044691927569fa82f30543 Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-77776135 Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AggregatesAdminTestJSON-77776135-project Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 79df33be7e064907b35d252e38522ca1 Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AggregatesAdminTestJSON-77776135-project Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.518213 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1b8a61a7-c39b-405b-a51b-70f6a99c1b50'} Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:31.518931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. Oct 28 19:08:31.520082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:31.523318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] Returning 404 to user: Instance 1b8a61a7-c39b-405b-a51b-70f6a99c1b50 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:31.524673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-439117f1-2bfb-42e8-b545-73e887ff0822 tempest-AggregatesAdminTestJSON-77776135 tempest-AggregatesAdminTestJSON-77776135-project] 10.222.0.44 "GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50" status: 404 len: 111 microversion: 2.1 time: 0.075578 Oct 28 19:08:31.527153 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 160/287] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/1b8a61a7-c39b-405b-a51b-70f6a99c1b50 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:31.760064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.777766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8f72fb6-9092-41e3-b9c8-14efac3cb4dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1589 microversion: 2.1 time: 0.372752 Oct 28 19:08:31.780026 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 128/288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1589 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:31.810671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.811305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.825409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.826302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:31.840396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.846387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.847126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.847757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.848603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.849115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.849563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.850165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.851306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.852108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.852590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.853021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.902391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=7,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:32.387601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-843f3819-268f-4ea5-b2aa-23e799d8d7ba tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.583802 Oct 28 19:08:32.388410 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 161/289] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827/os-interface => generated 285 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:32.399817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.405022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.415135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.417323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.418569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.419327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.419752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.427615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.828906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.838461 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9684297e-618b-4326-9273-3362d6e2c6aa tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 1.018802 Oct 28 19:08:32.855059 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 129/290] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:32.860485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.861279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:32.867631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.868323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.872389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.873324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.873939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.874508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.178778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.192843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.194387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.195590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2165d627-02ac-40d8-a702-0a0b62241f9d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1362 microversion: 2.25 time: 0.806105 Oct 28 19:08:33.196152 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 162/291] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1362 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:33.256042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.266650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d63c0f47-affc-48ed-8d7b-199d9ac5a9da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1493 microversion: 2.1 time: 0.410111 Oct 28 19:08:33.272288 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 130/292] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1493 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:33.740330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:33.741490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:33.745093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:33.756856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.760195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.760868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.762034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.764654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.765326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.862458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:33.864326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:33.875370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.876236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.876863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.883098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.884276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.885200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.400837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:34.413960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7b8429fa-099c-4bdd-b746-986d1245de53 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.555818 Oct 28 19:08:34.415905 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 131/293] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:33 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:34.417386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4459d476-206d-42e3-9e43-ad9474bd98e6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1644 microversion: 2.1 time: 1.120393 Oct 28 19:08:34.423692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:34.427624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:34.431635 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 163/294] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:33 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1644 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:34.443329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.447696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.448375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.451051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:34.451357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.452229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:34.453242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.457855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.468644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.469115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.469490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.470187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.470631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.481156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.880753 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7cc4d487-8a00-4da9-9819-df3250aaa050 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1644 microversion: 2.1 time: 0.441398 Oct 28 19:08:34.881763 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 164/295] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:34 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1644 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:34.906165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:34.911238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.912074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.919410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.920563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.921858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.922493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.987201 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee4d0f6f-5704-405a-bd16-45a723d48694 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085016 Oct 28 19:08:34.990054 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 165/296] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:08:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:35.008739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-3", "block_migration": true, "disk_over_commit": false}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:35.011639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:35.026447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.029068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.029749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.032505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.035338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.035999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.201126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lazy-loading 'flavor' on Instance uuid 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:35.308175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Going to try to live migrate instance to n-h1-862769-3 {{(pid=120629) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:08:35.411806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.463744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.466276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.470407 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-198f09c1-5641-46ac-8eba-cea6b707d249 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1362 microversion: 2.25 time: 1.052178 Oct 28 19:08:35.471424 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 132/297] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:34 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1362 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:35.492124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:35.496527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:35.521048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.522045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.523041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.524887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:35.525852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:35.529010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:35.983089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:35.996979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca644855-64b5-467b-824f-e91898f4af74 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.519317 Oct 28 19:08:35.997918 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 133/298] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:35 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:36.021232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0efbbac0-ab9e-4b30-963e-a5d29dfe03e2 req-edb2a0cf-0696-4532-afd2-78cfb5bc9d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56da196-1ce9-4bb4-948b-785ea839bff8", "tag": "aa11e10c-a6e1-475a-84a9-49088e29ced3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:36.048122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0efbbac0-ab9e-4b30-963e-a5d29dfe03e2 req-edb2a0cf-0696-4532-afd2-78cfb5bc9d6a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.049449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0efbbac0-ab9e-4b30-963e-a5d29dfe03e2 req-edb2a0cf-0696-4532-afd2-78cfb5bc9d6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.055717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0efbbac0-ab9e-4b30-963e-a5d29dfe03e2 req-edb2a0cf-0696-4532-afd2-78cfb5bc9d6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.096986 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0efbbac0-ab9e-4b30-963e-a5d29dfe03e2 req-edb2a0cf-0696-4532-afd2-78cfb5bc9d6a service nova] Creating event network-changed:aa11e10c-a6e1-475a-84a9-49088e29ced3 for instance e56da196-1ce9-4bb4-948b-785ea839bff8 on n-h2-862769-3 Oct 28 19:08:36.111108 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0efbbac0-ab9e-4b30-963e-a5d29dfe03e2 req-edb2a0cf-0696-4532-afd2-78cfb5bc9d6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111231 Oct 28 19:08:36.113472 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 134/299] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:36.504119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:36.504810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:36.525298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.531246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.531921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:36.544766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:36.545485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:36.546092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.129279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:37.137639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:37.139143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:37.145149 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9ff5048-5cc4-4a50-ab62-48b7286a68d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1362 microversion: 2.25 time: 0.646303 Oct 28 19:08:37.147698 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 135/300] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:36 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:08:37.155343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:37.156159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:37.177720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.178279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.178739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.179452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.180083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.180540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.410461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:37.420366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e7518eb-98f2-4d5f-b14a-8db5cb066b53 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 200 len: 1589 microversion: 2.1 time: 0.269696 Oct 28 19:08:37.421509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 136/301] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:37 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 1589 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:37.748519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:37.959035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1adc3675-b948-40ec-9a5e-b6d96fbec7c2 tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] Action: 'create', calling method: .version_select at 0x7f1d7c554550>, body: {"security_group": {"name": "tempest-securitygroup-645294841", "description": "tempest-description-1229429314"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:38.061575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:39.037609 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1adc3675-b948-40ec-9a5e-b6d96fbec7c2 tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.614864 Oct 28 19:08:39.043195 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 137/302] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:08:37 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:39.048337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:39.052323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:39.079172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.079730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.080178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.080914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.081394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.083883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.455010 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35330f7b-7826-4036-8b96-29e55b510c6c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6/action" status: 202 len: 0 microversion: 2.1 time: 4.454320 Oct 28 19:08:39.456881 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 166/303] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:34 2022] POST /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6/action => generated 0 bytes in 4458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:08:39.484531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-592c5121-45bc-46d8-829b-60191f1c96b3 req-69569b82-44fd-4caf-aa7f-e3c6703d29d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831d5ec9-b916-4990-84b9-8750b7b09827", "tag": "d197f992-5d98-43d0-bd9c-b28888bacc66"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:39.521810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:39.538577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-592c5121-45bc-46d8-829b-60191f1c96b3 req-69569b82-44fd-4caf-aa7f-e3c6703d29d7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.538577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-592c5121-45bc-46d8-829b-60191f1c96b3 req-69569b82-44fd-4caf-aa7f-e3c6703d29d7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.538577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-592c5121-45bc-46d8-829b-60191f1c96b3 req-69569b82-44fd-4caf-aa7f-e3c6703d29d7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.543008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a219b53a-1359-4563-badb-04ca7ddefa05 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.485782 Oct 28 19:08:39.557605 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 138/304] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:39.557945 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-592c5121-45bc-46d8-829b-60191f1c96b3 req-69569b82-44fd-4caf-aa7f-e3c6703d29d7 service nova] Creating event network-changed:d197f992-5d98-43d0-bd9c-b28888bacc66 for instance 831d5ec9-b916-4990-84b9-8750b7b09827 on n-h1-862769-3 Oct 28 19:08:39.558036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:39.558036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:39.558164 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-592c5121-45bc-46d8-829b-60191f1c96b3 req-69569b82-44fd-4caf-aa7f-e3c6703d29d7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084912 Oct 28 19:08:39.558164 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 167/305] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:39.575713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.576844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.577498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.585304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.598981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.602229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.885846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-648dac6e-a524-4af3-b7a5-1e30d796f6da tempest-AZAdminNegativeTestJSON-815011274 tempest-AZAdminNegativeTestJSON-815011274-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:39.887670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-648dac6e-a524-4af3-b7a5-1e30d796f6da tempest-AZAdminNegativeTestJSON-815011274 tempest-AZAdminNegativeTestJSON-815011274-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '553dba006f234c58ab90777d7c74a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf3406ea492468fbd45b278408f9c76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-648dac6e-a524-4af3-b7a5-1e30d796f6da tempest-AZAdminNegativeTestJSON-815011274 tempest-AZAdminNegativeTestJSON-815011274-project] Request method failure captured: Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCi1i82WnflC_y_IbpHBwCXZZHfunChh2zOjAZXSJD5mdE-0XamTOi_0VTQbG6U_-vrFC6JZeNuJiWM7WqsGVqep9ZZRG-bmaXOEIO9BEx688OI-n49n96fMufQNZOPiXJTX6y0uOZx22GZoTp3JLQ1Ps1gTaHTEDzByHirikXss7eI Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0cf3406ea492468fbd45b278408f9c76 Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AZAdminNegativeTestJSON-815011274 Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:08:39.889977 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0cf3406ea492468fbd45b278408f9c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0cf3406ea492468fbd45b278408f9c76", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0cf3406ea492468fbd45b278408f9c76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0cf3406ea492468fbd45b278408f9c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AZAdminNegativeTestJSON-815011274 Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0cf3406ea492468fbd45b278408f9c76 Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-815011274 Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AZAdminNegativeTestJSON-815011274-project Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 553dba006f234c58ab90777d7c74a809 Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AZAdminNegativeTestJSON-815011274-project Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 19:08:39.891358 n-d-862769-3 devstack@n-api.service[120629]: action_args: {} Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:39.892098 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 19:08:39.893130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:39.895601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-648dac6e-a524-4af3-b7a5-1e30d796f6da tempest-AZAdminNegativeTestJSON-815011274 tempest-AZAdminNegativeTestJSON-815011274-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:39.897813 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-648dac6e-a524-4af3-b7a5-1e30d796f6da tempest-AZAdminNegativeTestJSON-815011274 tempest-AZAdminNegativeTestJSON-815011274-project] 10.222.0.44 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.340158 Oct 28 19:08:39.898485 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 168/306] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 341 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:39.997277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.012767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.018190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.019708 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8914e78c-3382-412b-b568-244d81075215 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1362 microversion: 2.25 time: 0.473416 Oct 28 19:08:40.023161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 139/307] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:40.033340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54b8aba0-2545-4b8d-9a5c-2b0188669d8c tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] Action: 'create', calling method: .version_select at 0x7f1d7c6d85e0>, body: {"security_group": {"name": "tempest-securitygroup-137546567", "description": "tempest-description-1369670143"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:40.059685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c909940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:40.063324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.063807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.064237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.073104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.073900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.075140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.139517 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-be765df8-c2e8-4877-8144-b780830ca005 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.239158 Oct 28 19:08:40.143084 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 169/308] 10.222.0.44 () {58 vars in 1128 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:40.149416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:40.150142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:40.168359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.178993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.182243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.183101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.192512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.193564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.930517 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54b8aba0-2545-4b8d-9a5c-2b0188669d8c tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.906195 Oct 28 19:08:40.939531 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 140/309] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:08:40 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:40.939531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c528a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:40.939931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.940356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.940814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.941754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.942360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.942981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.948569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.967590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e0ea814-fb96-42c1-8b9c-a38fec85b720 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.823122 Oct 28 19:08:40.978980 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 170/310] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:40 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:40.988297 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b35cf17-9a43-49d1-90fc-f5b123f9a94c tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.053343 Oct 28 19:08:40.988455 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 141/311] 10.222.0.44 () {58 vars in 1139 bytes} [Fri Oct 28 19:08:40 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:41.000308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:41.000949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:41.008784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.009269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.009688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.010385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.013738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.014218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.240534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a0eedb09-340b-4e6b-9d40-ba45e2c6cb5b tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Action: 'create', calling method: .version_select at 0x7f1d7c622ca0>, body: {"security_group": {"name": "tempest-securitygroup-1484749289", "description": "tempest-description-2052654531"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:41.333568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.335983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:41.344407 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-12b363b2-f390-4be1-a120-eb9da5815790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.366840 Oct 28 19:08:41.345579 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 171/312] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:40 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:41.363275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7ca111f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:41.367118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.367600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.368202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.369246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.369892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.370486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.397566 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fa8c244-8f63-43d4-8874-41d1c0569c55 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.050207 Oct 28 19:08:41.398629 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 172/313] 10.222.0.44 () {58 vars in 1145 bytes} [Fri Oct 28 19:08:41 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:08:41.408963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:41.411934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:41.425977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.426481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.427173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.431792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.432325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.432767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.864474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.868583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a0eedb09-340b-4e6b-9d40-ba45e2c6cb5b tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.878905 Oct 28 19:08:41.869876 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 142/314] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:08:40 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:41.891990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c58daf0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:41.899761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.901207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.901847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.902274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.904758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.906677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.907204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.908198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.909450 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a024a29b-040b-4a71-bc27-82d44d932bd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1362 microversion: 2.25 time: 0.506191 Oct 28 19:08:41.910211 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 173/315] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:41 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:41.919809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3c733f1f-1b16-432f-91eb-176a775efebf req-66b47e49-fea8-4d9c-b645-b5270036d87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6353c-9ddc-4f2d-9fb4-c487c851cdc6", "name": "network-vif-unplugged", "status": "completed", "tag": "0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:41.938911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3c733f1f-1b16-432f-91eb-176a775efebf req-66b47e49-fea8-4d9c-b645-b5270036d87c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.939728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3c733f1f-1b16-432f-91eb-176a775efebf req-66b47e49-fea8-4d9c-b645-b5270036d87c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.940330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3c733f1f-1b16-432f-91eb-176a775efebf req-66b47e49-fea8-4d9c-b645-b5270036d87c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.954305 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3c733f1f-1b16-432f-91eb-176a775efebf req-66b47e49-fea8-4d9c-b645-b5270036d87c service nova] Creating event network-vif-unplugged:0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb for instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 on n-h2-862769-3 Oct 28 19:08:41.961406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f81bbf9-18b9-4214-8c5f-75a57c8765be tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.087109 Oct 28 19:08:41.962798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3c733f1f-1b16-432f-91eb-176a775efebf req-66b47e49-fea8-4d9c-b645-b5270036d87c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045737 Oct 28 19:08:41.963035 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 143/316] 10.222.0.44 () {58 vars in 1128 bytes} [Fri Oct 28 19:08:41 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:41.964068 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 174/317] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:41.969239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73fff3f7-b7d7-440c-9980-c2219549f402 tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Action: 'create', calling method: .version_select at 0x7f1d7ca11c10>, body: {"security_group": {"name": "tempest-securitygroup-1007577164", "description": "tempest-description-330511445"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:41.973873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-de1462f1-3c76-421c-8da4-7b2e22dc3cfb req-f0b5d5b7-5d7c-4c05-a601-5e130809941b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56da196-1ce9-4bb4-948b-785ea839bff8", "name": "network-vif-plugged", "status": "completed", "tag": "aa11e10c-a6e1-475a-84a9-49088e29ced3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:41.988976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-de1462f1-3c76-421c-8da4-7b2e22dc3cfb req-f0b5d5b7-5d7c-4c05-a601-5e130809941b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.990079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-de1462f1-3c76-421c-8da4-7b2e22dc3cfb req-f0b5d5b7-5d7c-4c05-a601-5e130809941b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.990659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-de1462f1-3c76-421c-8da4-7b2e22dc3cfb req-f0b5d5b7-5d7c-4c05-a601-5e130809941b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.005509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-de1462f1-3c76-421c-8da4-7b2e22dc3cfb req-f0b5d5b7-5d7c-4c05-a601-5e130809941b service nova] Creating event network-vif-plugged:aa11e10c-a6e1-475a-84a9-49088e29ced3 for instance e56da196-1ce9-4bb4-948b-785ea839bff8 on n-h2-862769-3 Oct 28 19:08:42.013871 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-de1462f1-3c76-421c-8da4-7b2e22dc3cfb req-f0b5d5b7-5d7c-4c05-a601-5e130809941b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048211 Oct 28 19:08:42.015112 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 144/318] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:42.023657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c80a3a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.028671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.029380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.029962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.031028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.031728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.033060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.072669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:42.087584 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-26a683ff-1b2b-47a1-b793-783be3c4d8a6 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.070250 Oct 28 19:08:42.088372 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 145/319] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:42.099425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.100325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.106985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.107551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.108075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.108857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.109401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.109886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.335632 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73fff3f7-b7d7-440c-9980-c2219549f402 tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.367359 Oct 28 19:08:42.339347 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 175/320] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:08:41 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:42.357158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c44b310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.362109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.362963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.363833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.364613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.365209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.366210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.421033 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0fe53bd-332d-42b6-8280-ad8571951fb0 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.075377 Oct 28 19:08:42.422551 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 176/321] 10.222.0.44 () {58 vars in 1128 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:42.434492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.444129 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c8aff7e-b111-4c58-9274-b6eebc60f60d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.353647 Oct 28 19:08:42.447604 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 146/322] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:42.452759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.453633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.460061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.460818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.461462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.462524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.463236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.463849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.464199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Calling method '.version_select at 0x7f1d7c541ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.722586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.731045 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8c075e8-6bfa-4775-a55c-a87657f2b19b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.282141 Oct 28 19:08:42.731963 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 147/323] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:42.738403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c80a8b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.745650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.746373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.747010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.765820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.766315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.766768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.801636 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d7393c6-2ede-42ed-8a05-3b105de1afec tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts/n-h2-862769-3" status: 200 len: 598 microversion: 2.1 time: 0.068404 Oct 28 19:08:42.807570 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 148/324] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/os-hosts/n-h2-862769-3 => generated 598 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:42.813809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Calling method '.version_select at 0x7f1d7c554820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.823662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.824144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.824626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.842444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.843166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.843410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.863539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72aabbdb-7f84-4410-86ba-2f295afa7317 tempest-HostsAdminTestJSON-1497690022 tempest-HostsAdminTestJSON-1497690022-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts/n-h1-862769-3" status: 200 len: 598 microversion: 2.1 time: 0.054749 Oct 28 19:08:42.864954 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 149/325] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/os-hosts/n-h1-862769-3 => generated 598 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:42.937492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.938094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.944571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.945042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.945462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.946137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.946578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.947010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.141242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.158432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.160031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.172219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da7ceceb-c799-4a40-8fe3-3b3fda53118f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1362 microversion: 2.25 time: 0.237373 Oct 28 19:08:43.172687 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 150/326] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:43.473395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.474280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.481796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.482546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.483256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.484187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.484862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.485499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.713889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.723963 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1810b06b-3a8d-4475-9806-41fb8efadef0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.257023 Oct 28 19:08:43.724549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 151/327] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:43.755203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.755868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.763124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.764413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.765286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.767288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.768102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.768933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.878437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6bdd9142-4f05-4002-bd09-67fc584b4ecc does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:08:43.879301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Neutron security group 6bdd9142-4f05-4002-bd09-67fc584b4ecc not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:08:43.879863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.security_groups [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Security Group ID 6bdd9142-4f05-4002-bd09-67fc584b4ecc does not exist {{(pid=120629) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 28 19:08:43.912404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6bdd9142-4f05-4002-bd09-67fc584b4ecc does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:08:43.913186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Neutron security group 6bdd9142-4f05-4002-bd09-67fc584b4ecc not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:08:43.913696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.security_groups [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Security Group ID 6bdd9142-4f05-4002-bd09-67fc584b4ecc does not exist {{(pid=120629) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 28 19:08:44.052392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.062073 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68fa23c2-103e-4676-aa6f-3bc1b189dc72 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.311788 Oct 28 19:08:44.062658 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 152/328] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:44.073122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5bd0b635-8f57-4097-afac-26c677bee42b req-11c5ab30-59cf-4b3c-b391-4e26352248b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a6353c-9ddc-4f2d-9fb4-c487c851cdc6", "tag": "0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:44.100172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5bd0b635-8f57-4097-afac-26c677bee42b req-11c5ab30-59cf-4b3c-b391-4e26352248b9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.101216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5bd0b635-8f57-4097-afac-26c677bee42b req-11c5ab30-59cf-4b3c-b391-4e26352248b9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.101825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5bd0b635-8f57-4097-afac-26c677bee42b req-11c5ab30-59cf-4b3c-b391-4e26352248b9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.133348 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5bd0b635-8f57-4097-afac-26c677bee42b req-11c5ab30-59cf-4b3c-b391-4e26352248b9 service nova] Creating event network-changed:0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb for instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 on n-h2-862769-3 Oct 28 19:08:44.145604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5bd0b635-8f57-4097-afac-26c677bee42b req-11c5ab30-59cf-4b3c-b391-4e26352248b9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078487 Oct 28 19:08:44.147504 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 153/329] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:44.202664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:44.203612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:44.212780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.214089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.214759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.215708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.216883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.233635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.461448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.471231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.473667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:44.475217 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f76429d8-1986-4ee5-a7ee-9c4c5e5d1b53 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1558 microversion: 2.25 time: 0.277950 Oct 28 19:08:44.491696 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 154/330] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:44 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1558 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:44.789402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d7baf88-e935-4818-a925-15900d6430ab tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] 10.222.0.44 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10539 microversion: 2.1 time: 2.365226 Oct 28 19:08:44.790339 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 177/331] 10.222.0.44 () {58 vars in 1191 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10539 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:44.816004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:44.816912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:44.827037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.827835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.828268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.829138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.829730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.830298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.064595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid e56da196-1ce9-4bb4-948b-785ea839bff8 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:45.132566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1447644648", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:45.135292 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-174bed77-46a2-4343-932e-f08d1e8eb655 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 2051 microversion: 2.25 time: 0.636652 Oct 28 19:08:45.136030 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 155/332] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:44 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 2051 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:45.161286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.162621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.170985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.172004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.172634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.173535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.174210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.174932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.201513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:45.444204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.454966 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b87cc769-a17b-408c-9449-71f5b2727740 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.302976 Oct 28 19:08:45.455914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 156/333] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:45.460820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-686cf973-8346-4e64-957e-3ef7f508b440 tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] Calling method '.version_select at 0x7f1d7c802790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.545666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:45.546374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:45.547202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:45.547835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:45.548395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:45.565930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.567561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.568102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.570672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.572067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.573646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.601302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Getting quotas for project 0d394b3626a64b55847ca2da79aeeef1. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:45.613046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Getting quotas for user 3c6c5e19c04148ceb2903f8bbb617550 and project 0d394b3626a64b55847ca2da79aeeef1. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:45.631376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:45.635006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:45.702472 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2a2cffe-5996-4990-ac88-97678e090808 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910775 Oct 28 19:08:45.706897 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 178/334] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:45.715896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.721858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.730306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.731006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.731584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.732983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.733709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.734355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.757220 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-686cf973-8346-4e64-957e-3ef7f508b440 tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.299906 Oct 28 19:08:45.758659 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 157/335] 10.222.0.44 () {58 vars in 1191 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:45.768499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.769385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.781686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.782488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.783124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.795310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.798746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.799953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.944253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.954343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1953e476-a3fc-4215-8af4-41f8f64d87c7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.246059 Oct 28 19:08:45.956477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 179/336] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:45.961728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f690715-23db-4dce-89b0-5a94cbf7d57c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.962632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f690715-23db-4dce-89b0-5a94cbf7d57c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:45.977798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid e56da196-1ce9-4bb4-948b-785ea839bff8 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:45.997090 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-762afa5c-6e1d-4e80-885c-94ec0d49fc3e tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 2051 microversion: 2.25 time: 0.232921 Oct 28 19:08:45.999068 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 158/337] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 2051 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:46.039172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f690715-23db-4dce-89b0-5a94cbf7d57c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:46.047396 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f690715-23db-4dce-89b0-5a94cbf7d57c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1220 microversion: 2.1 time: 0.089673 Oct 28 19:08:46.048288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 180/338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:46.053177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1757b0e9-96bb-48cc-84d8-8d8f1efd8f96 tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Calling method '.version_select at 0x7f1d7c3821f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.240209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-735e79e8-62c3-4307-816f-24bebbf821dd tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] Calling method '.version_select at 0x7f1d7c5323a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.255719 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-735e79e8-62c3-4307-816f-24bebbf821dd tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.255157 Oct 28 19:08:46.256577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 159/339] 10.222.0.44 () {60 vars in 1226 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:46.259460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1757b0e9-96bb-48cc-84d8-8d8f1efd8f96 tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/1c58ff3a-6f8f-43b5-b3cc-aed1282e3575" status: 202 len: 0 microversion: 2.1 time: 0.209975 Oct 28 19:08:46.260756 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 181/340] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:08:46 2022] DELETE /compute/v2.1/os-security-groups/1c58ff3a-6f8f-43b5-b3cc-aed1282e3575 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:46.268198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c3c88fd-9187-4229-97e2-8a4593814f84 tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] Calling method '.version_select at 0x7f1d7c37d5e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.272127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.277167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.277662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.278097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.279062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.279764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.293478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.335870 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b55b08e-29cd-4805-b788-08b22145af02 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.069276 Oct 28 19:08:46.336600 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 160/341] 10.222.0.44 () {60 vars in 1217 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:46.341238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c516bd4e-7c11-400a-8155-194b7551015a tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c5fc3a0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:46.415677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:46.468000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c3c88fd-9187-4229-97e2-8a4593814f84 tempest-SecurityGroupsTestAdminJSON-615754017 tempest-SecurityGroupsTestAdminJSON-615754017-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/d7ee6b74-7eea-4aa3-9388-3e7445702af9" status: 202 len: 0 microversion: 2.1 time: 0.203308 Oct 28 19:08:46.468626 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 182/342] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:08:46 2022] DELETE /compute/v2.1/os-security-groups/d7ee6b74-7eea-4aa3-9388-3e7445702af9 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:08:46.473510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-3", "block_migration": "auto"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:46.476873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.486374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.487084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.487857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.488940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.489566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.490621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.518580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'flavor' on Instance uuid e56da196-1ce9-4bb4-948b-785ea839bff8 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:46.534106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Going to try to live migrate instance to n-h1-862769-3 {{(pid=120629) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:08:46.546968 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c516bd4e-7c11-400a-8155-194b7551015a tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.209075 Oct 28 19:08:46.547559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 161/343] 10.222.0.44 () {62 vars in 1247 bytes} [Fri Oct 28 19:08:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:46.552276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-247c63a3-f78c-42ac-afe5-adbbfc22c32e tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] Calling method '.version_select at 0x7f1d7c528b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.739539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-247c63a3-f78c-42ac-afe5-adbbfc22c32e tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/9d3842dd-9c97-4434-9530-cd6939ac85d1" status: 202 len: 0 microversion: 2.1 time: 0.190616 Oct 28 19:08:46.740036 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 162/344] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:08:46 2022] DELETE /compute/v2.1/os-security-groups/9d3842dd-9c97-4434-9530-cd6939ac85d1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:46.748932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.750379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.758231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.763826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.764274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.764996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.765472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.766045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.918865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:46.922077 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2dd3c91a-a1dd-44c0-bf1c-29d13c77d8d5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.181036 Oct 28 19:08:46.932315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 163/345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:46.932315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-810b3423-f95e-43a6-ada0-0cb07d4101f0 tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] Calling method '.version_select at 0x7f1d7c5900d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.941777 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-810b3423-f95e-43a6-ada0-0cb07d4101f0 tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.017945 Oct 28 19:08:46.942401 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 164/346] 10.222.0.44 () {60 vars in 1226 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:46.953790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1db28b86-f144-4903-b587-0f2893ba1fb9 tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] Calling method '.version_select at 0x7f1d7c590b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.153978 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1db28b86-f144-4903-b587-0f2893ba1fb9 tempest-SecurityGroupsTestAdminJSON-781735261 tempest-SecurityGroupsTestAdminJSON-781735261-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/02227981-7acc-4dc5-8e67-10b56acf89d1" status: 202 len: 0 microversion: 2.1 time: 0.203848 Oct 28 19:08:47.154566 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 165/347] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:08:46 2022] DELETE /compute/v2.1/os-security-groups/02227981-7acc-4dc5-8e67-10b56acf89d1 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:47.160491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb0878e2-0b6a-42e5-b3c2-f11030ed051d tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c590ee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:47.237703 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb0878e2-0b6a-42e5-b3c2-f11030ed051d tempest-QuotaClassesAdmin257Test-608876088 tempest-QuotaClassesAdmin257Test-608876088-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.081763 Oct 28 19:08:47.238303 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 166/348] 10.222.0.44 () {62 vars in 1247 bytes} [Fri Oct 28 19:08:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:08:47.243050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.244298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:47.250670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.251362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.251854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.252696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.253353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.253655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.409027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.419007 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b68f8d4d-27c3-4e04-a2ed-42ecfba28388 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1475 microversion: 2.1 time: 0.179651 Oct 28 19:08:47.419594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 167/349] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1475 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:47.667311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a9ab01e-b341-4b1c-8615-b3c8f0b04539 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Calling method '.version_select at 0x7f1d7c590700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.669356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a9ab01e-b341-4b1c-8615-b3c8f0b04539 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '159389f044894251a87d9efa83a0a3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11165e512b04889a32fc0bc805dd986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a9ab01e-b341-4b1c-8615-b3c8f0b04539 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Request method failure captured: Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-JyT-mSNyWH5-GTb5qB71WN7M7bd0LOC2TDfC9cTWuIYHppGDlqjCqcsaQhYsrZ1zEyRvUhvBJ3ITEGlc3plZX_2YOQgS5o_Yge6oaCJEhdLbz0vmXWqCEqCPcifJRe7HmuFNZy56Qt9bS_Wxz-wCcUti81Pq-RAwGFxFRnXfyaU Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:08:47.671074 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c11165e512b04889a32fc0bc805dd986", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 159389f044894251a87d9efa83a0a3ee Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:08:47.672236 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:47.672973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 19:08:47.674001 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.675082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a9ab01e-b341-4b1c-8615-b3c8f0b04539 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:47.675082 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a9ab01e-b341-4b1c-8615-b3c8f0b04539 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.251673 Oct 28 19:08:47.677169 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 168/350] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:47.682464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.683101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:47.690733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.691531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.692388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.693357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.694121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.695095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.781414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.795744 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b156d2aa-6db1-4279-9bc4-7821d4465d54 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1216 microversion: 2.1 time: 0.117268 Oct 28 19:08:47.797129 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 169/351] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:47.804504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a688ecbc-3f49-44e6-8221-cb2984214c27 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Calling method '.version_select at 0x7f1d7c5281f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.807721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a688ecbc-3f49-44e6-8221-cb2984214c27 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '159389f044894251a87d9efa83a0a3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11165e512b04889a32fc0bc805dd986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a688ecbc-3f49-44e6-8221-cb2984214c27 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Request method failure captured: Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-JyT-mSNyWH5-GTb5qB71WN7M7bd0LOC2TDfC9cTWuIYHppGDlqjCqcsaQhYsrZ1zEyRvUhvBJ3ITEGlc3plZX_2YOQgS5o_Yge6oaCJEhdLbz0vmXWqCEqCPcifJRe7HmuFNZy56Qt9bS_Wxz-wCcUti81Pq-RAwGFxFRnXfyaU Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:08:47.810048 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c11165e512b04889a32fc0bc805dd986", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 159389f044894251a87d9efa83a0a3ee Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:08:47.811565 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:47.812444 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 19:08:47.813903 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.815679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a688ecbc-3f49-44e6-8221-cb2984214c27 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:47.818441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a688ecbc-3f49-44e6-8221-cb2984214c27 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.020216 Oct 28 19:08:47.828488 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 170/352] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:47.844234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30115d39-35b0-4f86-a535-c3a9b14bc9c3 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Calling method '.version_select at 0x7f1d7c590e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.848898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30115d39-35b0-4f86-a535-c3a9b14bc9c3 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '159389f044894251a87d9efa83a0a3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11165e512b04889a32fc0bc805dd986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30115d39-35b0-4f86-a535-c3a9b14bc9c3 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Request method failure captured: Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-JyT-mSNyWH5-GTb5qB71WN7M7bd0LOC2TDfC9cTWuIYHppGDlqjCqcsaQhYsrZ1zEyRvUhvBJ3ITEGlc3plZX_2YOQgS5o_Yge6oaCJEhdLbz0vmXWqCEqCPcifJRe7HmuFNZy56Qt9bS_Wxz-wCcUti81Pq-RAwGFxFRnXfyaU Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:08:47.850646 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c11165e512b04889a32fc0bc805dd986", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 159389f044894251a87d9efa83a0a3ee Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:08:47.852086 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:47.853078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 19:08:47.855234 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:47.859865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30115d39-35b0-4f86-a535-c3a9b14bc9c3 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:47.860938 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30115d39-35b0-4f86-a535-c3a9b14bc9c3 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020981 Oct 28 19:08:47.867473 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 171/353] 10.222.0.44 () {58 vars in 1179 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:48.060493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Calling method '.version_select at 0x7f1d7c8a0e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.062324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.063057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.063556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.103485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.108128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.108789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.124151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.124854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.125593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.132976 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e014cd85-6b72-4718-bebb-dcf2aef3057b tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.262148 Oct 28 19:08:48.140179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 172/354] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:48.172214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.172754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.187588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.188085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.188512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.190240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.190782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.194106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.202927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:48.404421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.414250 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-83f7d457-1d3e-416d-bd93-58cff6547642 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.272651 Oct 28 19:08:48.415596 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 173/355] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:48.425312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f8feebb-3f9b-4fb0-a428-5428e54446dd tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Calling method '.version_select at 0x7f1d7c590700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.428556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f8feebb-3f9b-4fb0-a428-5428e54446dd tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '159389f044894251a87d9efa83a0a3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11165e512b04889a32fc0bc805dd986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f8feebb-3f9b-4fb0-a428-5428e54446dd tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Request method failure captured: Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-JyT-mSNyWH5-GTb5qB71WN7M7bd0LOC2TDfC9cTWuIYHppGDlqjCqcsaQhYsrZ1zEyRvUhvBJ3ITEGlc3plZX_2YOQgS5o_Yge6oaCJEhdLbz0vmXWqCEqCPcifJRe7HmuFNZy56Qt9bS_Wxz-wCcUti81Pq-RAwGFxFRnXfyaU Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:08:48.430453 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c11165e512b04889a32fc0bc805dd986", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 159389f044894251a87d9efa83a0a3ee Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1'} Oct 28 19:08:48.432154 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:48.432911 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 19:08:48.433895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.435501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f8feebb-3f9b-4fb0-a428-5428e54446dd tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:48.438020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f8feebb-3f9b-4fb0-a428-5428e54446dd tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021131 Oct 28 19:08:48.439407 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 174/356] 10.222.0.44 () {58 vars in 1173 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:48.456244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.456871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.466721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.466938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.467535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.468265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.468723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.469156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.756775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.773448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aabfd5c0-6471-4be9-813e-816d43e332a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1474 microversion: 2.1 time: 0.325250 Oct 28 19:08:48.774940 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 175/357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:48.794725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb184483-9de3-4049-be77-a8a33dbe61cc tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Calling method '.version_select at 0x7f1d7c5fc3a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.798533 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-cb184483-9de3-4049-be77-a8a33dbe61cc tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] HTTP exception thrown: Hypervisor with ID '7eb34071-910c-4677-856e-667dcd063a75' could not be found. Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb184483-9de3-4049-be77-a8a33dbe61cc tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Request method failure captured: Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/7eb34071-910c-4677-856e-667dcd063a75/uptime HTTP/1.1 Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-HFa1SFojHtebALSuZhdOgVDKHMv1TgcNtYGXH1yt3QEgGkmYW8hri3dQwHH_l_DT5MKqoXBQ8tUjqEOXjMFw4SxgbKnIbwcn32t0RMQBixzsiivzZfQWwMcHJh_8QPSN41lsnU_68-uYxgLUdYmLRyC2YmckoSlrhEG09I0g4Xk Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 363b07c341314c96abc4c93bd694dd6a Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1569703637 Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:08:48.819990 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/363b07c341314c96abc4c93bd694dd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_363b07c341314c96abc4c93bd694dd6a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/363b07c341314c96abc4c93bd694dd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/363b07c341314c96abc4c93bd694dd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1569703637 Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 363b07c341314c96abc4c93bd694dd6a Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1569703637 Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 70030ecf697a40a3998e7b6c80c78478 Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: exception: Hypervisor with ID '7eb34071-910c-4677-856e-667dcd063a75' could not be found. Oct 28 19:08:48.821492 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7eb34071-910c-4677-856e-667dcd063a75'} Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7eb34071-910c-4677-856e-667dcd063a75' Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 19:08:48.822301 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7eb34071-910c-4677-856e-667dcd063a75' could not be found. Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:48.823745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7eb34071-910c-4677-856e-667dcd063a75' could not be found. Oct 28 19:08:48.824859 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:48.834648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb184483-9de3-4049-be77-a8a33dbe61cc tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Returning 404 to user: Hypervisor with ID '7eb34071-910c-4677-856e-667dcd063a75' could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:48.836608 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb184483-9de3-4049-be77-a8a33dbe61cc tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/7eb34071-910c-4677-856e-667dcd063a75/uptime" status: 404 len: 123 microversion: 2.1 time: 0.049565 Oct 28 19:08:48.841400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 176/358] 10.222.0.44 () {58 vars in 1278 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/os-hypervisors/7eb34071-910c-4677-856e-667dcd063a75/uptime => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:48.853714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.855502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.896261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.897802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.898589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.899510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.900743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.902038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.006834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.023436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-249b0eeb-b9bc-402d-be4b-92337c75bbec tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1278 microversion: 2.1 time: 0.179790 Oct 28 19:08:49.041545 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 177/359] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:49.041545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Calling method '.version_select at 0x7f1d7c5900d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.041545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.041545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.041995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.052523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.053114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.054256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.065516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.066222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.066924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.075431 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-324c535f-a94c-4dfb-9c1f-bb1c92a86b45 tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048910 Oct 28 19:08:49.076551 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 178/360] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:49.088296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ffb1498d-f5cb-4513-928e-7697d2a4ba64 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Calling method '.version_select at 0x7f1d7c5909d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.092810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ffb1498d-f5cb-4513-928e-7697d2a4ba64 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '159389f044894251a87d9efa83a0a3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11165e512b04889a32fc0bc805dd986', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ffb1498d-f5cb-4513-928e-7697d2a4ba64 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Request method failure captured: Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-JyT-mSNyWH5-GTb5qB71WN7M7bd0LOC2TDfC9cTWuIYHppGDlqjCqcsaQhYsrZ1zEyRvUhvBJ3ITEGlc3plZX_2YOQgS5o_Yge6oaCJEhdLbz0vmXWqCEqCPcifJRe7HmuFNZy56Qt9bS_Wxz-wCcUti81Pq-RAwGFxFRnXfyaU Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:08:49.094932 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c11165e512b04889a32fc0bc805dd986", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c11165e512b04889a32fc0bc805dd986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: c11165e512b04889a32fc0bc805dd986 Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696 Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 159389f044894251a87d9efa83a0a3ee Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1124056696-project Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1'} Oct 28 19:08:49.096164 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:49.096919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 19:08:49.097876 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.100254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ffb1498d-f5cb-4513-928e-7697d2a4ba64 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:49.101164 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ffb1498d-f5cb-4513-928e-7697d2a4ba64 tempest-HypervisorAdminNegativeTestJSON-1124056696 tempest-HypervisorAdminNegativeTestJSON-1124056696-project] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.018092 Oct 28 19:08:49.101931 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 179/361] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:49.111544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5e5e0da-a79d-435b-9d37-62d66aac2ffa tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Calling method '.version_select at 0x7f1d7c528e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.113367 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b5e5e0da-a79d-435b-9d37-62d66aac2ffa tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] HTTP exception thrown: Hypervisor with ID '18d84814-b49b-4f60-9a0b-90b4cbc47bcd' could not be found. Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5e5e0da-a79d-435b-9d37-62d66aac2ffa tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Request method failure captured: Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hypervisors/18d84814-b49b-4f60-9a0b-90b4cbc47bcd HTTP/1.1 Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi-HFa1SFojHtebALSuZhdOgVDKHMv1TgcNtYGXH1yt3QEgGkmYW8hri3dQwHH_l_DT5MKqoXBQ8tUjqEOXjMFw4SxgbKnIbwcn32t0RMQBixzsiivzZfQWwMcHJh_8QPSN41lsnU_68-uYxgLUdYmLRyC2YmckoSlrhEG09I0g4Xk Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 363b07c341314c96abc4c93bd694dd6a Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1569703637 Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:08:49.115287 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/363b07c341314c96abc4c93bd694dd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_363b07c341314c96abc4c93bd694dd6a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/363b07c341314c96abc4c93bd694dd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/363b07c341314c96abc4c93bd694dd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1569703637 Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 363b07c341314c96abc4c93bd694dd6a Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1569703637 Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 70030ecf697a40a3998e7b6c80c78478 Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: exception: Hypervisor with ID '18d84814-b49b-4f60-9a0b-90b4cbc47bcd' could not be found. Oct 28 19:08:49.116526 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '18d84814-b49b-4f60-9a0b-90b4cbc47bcd'} Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '18d84814-b49b-4f60-9a0b-90b4cbc47bcd' Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 19:08:49.117163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:08:49.118403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '18d84814-b49b-4f60-9a0b-90b4cbc47bcd' could not be found. Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '18d84814-b49b-4f60-9a0b-90b4cbc47bcd' could not be found. Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5e5e0da-a79d-435b-9d37-62d66aac2ffa tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] Returning 404 to user: Hypervisor with ID '18d84814-b49b-4f60-9a0b-90b4cbc47bcd' could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5e5e0da-a79d-435b-9d37-62d66aac2ffa tempest-HypervisorAdminNegativeTestJSON-1569703637 tempest-HypervisorAdminNegativeTestJSON-1569703637-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/18d84814-b49b-4f60-9a0b-90b4cbc47bcd" status: 404 len: 123 microversion: 2.1 time: 0.009558 Oct 28 19:08:49.121528 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 180/362] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/os-hypervisors/18d84814-b49b-4f60-9a0b-90b4cbc47bcd => generated 123 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:08:49.439275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.442955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.450920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.451583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.452246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.453153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.454244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.454937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.649740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.658774 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1736cc86-68ff-4a34-b0ae-45385bd1eb5c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.223446 Oct 28 19:08:49.659409 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 181/363] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:49.804200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.804857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.811428 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b7a9ec31-1f6e-4d47-b6b1-1973816bb134 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8/action" status: 202 len: 0 microversion: 2.25 time: 3.341685 Oct 28 19:08:49.813539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.813923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.814582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.815700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.816416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.817005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.822398 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 183/364] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:08:46 2022] POST /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8/action => generated 0 bytes in 3352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:49.845631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.846273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.867233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.867988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.869054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.870732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.872351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.873391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.565405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.575185 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e396862d-c9bc-441f-80ef-4b5ef3fc63c0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1474 microversion: 2.1 time: 0.777476 Oct 28 19:08:50.578075 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 182/365] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1474 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:50.583111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495986a-5fdf-462a-8a27-4cae25051f67", "name": "network-vif-unplugged", "status": "completed", "tag": "7a6fb0d8-3d62-43fe-ba26-7f441e053865"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:50.605216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.605689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.606110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.642371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] Creating event network-vif-unplugged:7a6fb0d8-3d62-43fe-ba26-7f441e053865 for instance b495986a-5fdf-462a-8a27-4cae25051f67 on n-h2-862769-3 Oct 28 19:08:50.671157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] Instance b495986a-5fdf-462a-8a27-4cae25051f67 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:08:50.673496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.687706 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9e384d10-f7b5-4864-828d-f21ff84f48b4 req-9c660916-ff10-4402-9ab2-5c5094b35307 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108110 Oct 28 19:08:50.692326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 183/366] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:50.694752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.700297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.701502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3ecf732-9211-413d-bcad-7bb41c035ada tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.874995 Oct 28 19:08:50.701867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.702764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:50.703978 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 184/367] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:50.723792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.726829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.727712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.728875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.729545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.733153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.739413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.740110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:50.758512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.759044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.763684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.764485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.765999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.766443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.840515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.849374 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-228012b7-2d11-488c-b04f-9ed043d9a075 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1278 microversion: 2.1 time: 0.155532 Oct 28 19:08:50.852827 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 184/368] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:51.117580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:51.130090 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdfc4e0a-d61a-4301-a18c-b34dbf02f233 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1503 microversion: 2.1 time: 0.405813 Oct 28 19:08:51.130942 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 185/369] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:51.530310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c6d8e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:51.543190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.545264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.547282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.558833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.559874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.560581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.571658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] HTTP exception thrown: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Request method failure captured: Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7 HTTP/1.1 Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 56 Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCjCFr5srpkBZnwSaO0TmM1oKihpJAFdDJ_cUgQo3JcOsGnvan_l5UEgU9lAKSLgRYveb6jyguUDuAXvOmEYIEF4x2rPfLJ1fsiFO21j_XhEA1EJjCDGFtK-Qh2wvkFyLW-St8ENdwqEHgzZbb3kRSBm0nCatkDoo_0jwwHwY7DlfZc Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fd2d218fb48c42e1baa9d999d6ffe01c Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:08:51.574157 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd2d218fb48c42e1baa9d999d6ffe01c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fd2d218fb48c42e1baa9d999d6ffe01c Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 4178dfbef144435099210de75e7267a4 Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:08:51.575708 n-d-862769-3 devstack@n-api.service[120628]: exception: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9a08106d-21b0-4b76-b0e1-042e742baed7', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.576482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.577618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:51.578744 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:51.578744 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.578744 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.581986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Returning 404 to user: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:51.583310 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ad88305-887b-4374-8aad-e13ba0ce0ff2 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7" status: 404 len: 110 microversion: 2.53 time: 0.482150 Oct 28 19:08:51.585218 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 185/370] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Oct 28 19:08:51 2022] PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7 => generated 110 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:08:51.595157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c2e8040>, body: {"status": "disabled"} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:51.600590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.603769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.605235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.622531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.623056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.623509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.628918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.630227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:51.642022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.642669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.644531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.645506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.646070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.646583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.676427 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] HTTP exception thrown: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Request method failure captured: Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7 HTTP/1.1 Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 22 Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCjCFr5srpkBZnwSaO0TmM1oKihpJAFdDJ_cUgQo3JcOsGnvan_l5UEgU9lAKSLgRYveb6jyguUDuAXvOmEYIEF4x2rPfLJ1fsiFO21j_XhEA1EJjCDGFtK-Qh2wvkFyLW-St8ENdwqEHgzZbb3kRSBm0nCatkDoo_0jwwHwY7DlfZc Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fd2d218fb48c42e1baa9d999d6ffe01c Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:08:51.678551 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd2d218fb48c42e1baa9d999d6ffe01c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fd2d218fb48c42e1baa9d999d6ffe01c Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 4178dfbef144435099210de75e7267a4 Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: {"status": "disabled"} Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: exception: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.679796 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9a08106d-21b0-4b76-b0e1-042e742baed7', 'body': {'status': 'disabled'}} Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.680549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:51.681614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:51.682624 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.682624 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.682624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Returning 404 to user: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:51.682624 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9b77dda-3054-437c-8dc8-fa415d628d36 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7" status: 404 len: 110 microversion: 2.53 time: 0.089851 Oct 28 19:08:51.696207 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 186/371] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Oct 28 19:08:51 2022] PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7 => generated 110 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:08:51.708910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c566310>, body: {"status": "enabled"} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:51.720651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.721206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.721724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.733099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.733586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.734021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.748659 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] HTTP exception thrown: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Request method failure captured: Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7 HTTP/1.1 Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 21 Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCjCFr5srpkBZnwSaO0TmM1oKihpJAFdDJ_cUgQo3JcOsGnvan_l5UEgU9lAKSLgRYveb6jyguUDuAXvOmEYIEF4x2rPfLJ1fsiFO21j_XhEA1EJjCDGFtK-Qh2wvkFyLW-St8ENdwqEHgzZbb3kRSBm0nCatkDoo_0jwwHwY7DlfZc Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fd2d218fb48c42e1baa9d999d6ffe01c Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:08:51.754209 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd2d218fb48c42e1baa9d999d6ffe01c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd2d218fb48c42e1baa9d999d6ffe01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fd2d218fb48c42e1baa9d999d6ffe01c Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709 Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 4178dfbef144435099210de75e7267a4 Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: {"status": "enabled"} Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: exception: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.755689 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9a08106d-21b0-4b76-b0e1-042e742baed7', 'body': {'status': 'enabled'}} Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.756436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:51.757501 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:51.759317 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. Oct 28 19:08:51.759317 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.759317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Returning 404 to user: Service 9a08106d-21b0-4b76-b0e1-042e742baed7 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:51.759317 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-19ec602d-0d3d-4857-8afb-ff961aa71b05 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7" status: 404 len: 110 microversion: 2.53 time: 0.058482 Oct 28 19:08:51.761851 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 187/372] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Oct 28 19:08:51 2022] PUT /compute/v2.1/os-services/9a08106d-21b0-4b76-b0e1-042e742baed7 => generated 110 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:08:51.784660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.787474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:51.802109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.802818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.804526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.805328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.806990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.807432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.075041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.086635 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9921d177-5d8f-4b1a-aad9-e0433379d898 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1474 microversion: 2.1 time: 0.485021 Oct 28 19:08:52.106936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 186/373] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1474 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:52.119492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.127483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.130546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.131449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.133163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.135594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.137158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.189140 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f7ab487-0933-4511-8cf3-4b02b7dde2bd tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.081427 Oct 28 19:08:52.203045 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 187/374] 10.222.0.44 () {60 vars in 1178 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:52.214956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.218715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.227465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.242574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.244198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.245394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cceaeda1-7082-4434-b35b-f9874ea6f5ac tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.482527 Oct 28 19:08:52.248377 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 188/375] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:52.256682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.257293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.263468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.264388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.265188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.266075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.266727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.267329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.276013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.276514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.276946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.277664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.278114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.278533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.580299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.584458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.588772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7c0921e9-f7a3-46e3-906a-6842e6eb2146 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.383292 Oct 28 19:08:52.589608 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 188/376] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:52.593116 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17fb3022-a803-4a81-852b-deab83cd47bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1493 microversion: 2.1 time: 0.343645 Oct 28 19:08:52.594150 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 189/377] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1493 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:52.601981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.620233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.620902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.621341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.622365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.623465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.623901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.650723 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b61663e-612b-432c-82ff-4845b3d7f61c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.059602 Oct 28 19:08:52.652343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 189/378] 10.222.0.44 () {60 vars in 1211 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:52.660134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc8db0bf-6a55-4913-910f-a99e52203242 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '.version_select at 0x7f1d7c438670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.663994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8db0bf-6a55-4913-910f-a99e52203242 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.664798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8db0bf-6a55-4913-910f-a99e52203242 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.665914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8db0bf-6a55-4913-910f-a99e52203242 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.681593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc8db0bf-6a55-4913-910f-a99e52203242 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.025241 Oct 28 19:08:52.691316 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 190/379] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:52.699324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.704489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.704972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.705400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.706749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.707211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.707718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.738864 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fcccccbe-464a-4ef9-845b-ca59a430160a tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045990 Oct 28 19:08:52.749113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 191/380] 10.222.0.44 () {60 vars in 1178 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:52.754527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-838036814", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:52.755514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:52.756125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:52.759202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=11,nova_api:INSERT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:52.763288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.763773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.764203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.765248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:52.765702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:52.766118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.823001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:53.014380 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-899f8ec7-856d-47f3-bc83-8ed659ed7a22 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1644 microversion: 2.1 time: 0.262585 Oct 28 19:08:53.028030 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 192/381] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:52 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1644 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:53.048256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495986a-5fdf-462a-8a27-4cae25051f67", "tag": "7a6fb0d8-3d62-43fe-ba26-7f441e053865"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:53.057913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.058751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.059177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.079541 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] Creating event network-changed:7a6fb0d8-3d62-43fe-ba26-7f441e053865 for instance b495986a-5fdf-462a-8a27-4cae25051f67 on n-h2-862769-3 Oct 28 19:08:53.085523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] Instance b495986a-5fdf-462a-8a27-4cae25051f67 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:08:53.093307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:53.093719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:53.094179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:53.094574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:53.095282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:53.101512 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a2b720f6-e602-4988-8a7b-189657284941 req-7595a802-41cb-4f4c-af53-5cfa7508ef22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071913 Oct 28 19:08:53.103217 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 193/382] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:53.106995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.107670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.108106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.108984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.110023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.110023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.124216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.129320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.129578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Getting quotas for project 48ee36f1887d40efb7a6ee6787c44501. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:53.129814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.130783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.132682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.133318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.133972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.157784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Getting quotas for user 2d0cd2464c6546a5afe23f9231feb95c and project 48ee36f1887d40efb7a6ee6787c44501. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:53.175019 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b9af3f0-c4f3-4851-b0ed-ca43112b3201 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?host=n-d-862769-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.070214 Oct 28 19:08:53.184473 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 194/383] 10.222.0.44 () {60 vars in 1235 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/os-services?host=n-d-862769-3&binary=xxx => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:53.191275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:53.191710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.192679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.201681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:53.205759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.206552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.207229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.208672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.209338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.209987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.306077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1cdf5573-abcd-48da-bb9c-3434acf9b4b0 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708291 Oct 28 19:08:53.307227 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 190/384] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:53.314995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.319003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.319776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.320506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.321501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.322326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.323221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.359027 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2579dc99-0768-496e-9a30-ec6f55593dd1 tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.050664 Oct 28 19:08:53.359650 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 191/385] 10.222.0.44 () {60 vars in 1178 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:53.375014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-161486427", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e506fab6-553b-4be6-8b83-6b486040fd9f"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:53.399134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:53.458315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] validate_networks() for [('e506fab6-553b-4be6-8b83-6b486040fd9f', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:53.568870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.583775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02b50e92-dd1b-4bef-b12c-9a2fb12e3ebe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1472 microversion: 2.1 time: 0.396713 Oct 28 19:08:53.586681 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 195/386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:53.594528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.595217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.601528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.602008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.602434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.603157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.603747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.604772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.854322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.862923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.864358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.865509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff2a9383-d18b-46f5-9b69-f74cd0587413 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.277530 Oct 28 19:08:53.866078 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 196/387] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:53.871011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.871709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.877638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.878328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.878785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.879480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.880019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.880395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.988501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.997575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6077902-b8c4-4f54-bba0-34b98d05965d tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1226 microversion: 2.1 time: 0.130461 Oct 28 19:08:53.998154 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 197/388] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1226 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.002600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.006634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.007135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.007564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.008339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.008790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.009200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.043849 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22901828-372e-4395-8d93-8a0d6a38de0c tempest-ServicesAdminNegativeV253TestJSON-299437709 tempest-ServicesAdminNegativeV253TestJSON-299437709-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.043948 Oct 28 19:08:54.045049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 198/389] 10.222.0.44 () {60 vars in 1239 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.049871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.051027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:54.051533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:54.052073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.052177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:54.052587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:54.053081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:54.060713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.061202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.061926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.062448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.062933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.063808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.065142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.066201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.067455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:54.069556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.070429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.071663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.072343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.133344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:54.138353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for user 6e2ff64ca72649d3ac2e8912da76c9af and project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:54.160588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:54.165638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:54.251445 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a73ca611-2307-4d66-923e-23591111e45d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890708 Oct 28 19:08:54.252573 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 192/390] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:54.298820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.311357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80232bea-49d0-42eb-a5e4-5cf99928ea68 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.265233 Oct 28 19:08:54.315690 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 199/391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.320883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a9949c7b-6778-4d55-a754-56113b2f0fbe tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.324080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a9949c7b-6778-4d55-a754-56113b2f0fbe tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.497836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a9949c7b-6778-4d55-a754-56113b2f0fbe tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.506007 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a9949c7b-6778-4d55-a754-56113b2f0fbe tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1210 microversion: 2.1 time: 0.188821 Oct 28 19:08:54.506579 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 200/392] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.609632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.610248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.616946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.617434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.617889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.618582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.619072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.619486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.700495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef81214b-265e-477f-9cf7-8b0918f793e6 tempest-ServicesAdminNegativeV253TestJSON-1927761943 tempest-ServicesAdminNegativeV253TestJSON-1927761943-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.704133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef81214b-265e-477f-9cf7-8b0918f793e6 tempest-ServicesAdminNegativeV253TestJSON-1927761943 tempest-ServicesAdminNegativeV253TestJSON-1927761943-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5ba4ceb280df41ada3df1bfc8e46e996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50269cffda3342d79c158aec1d9c3086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef81214b-265e-477f-9cf7-8b0918f793e6 tempest-ServicesAdminNegativeV253TestJSON-1927761943 tempest-ServicesAdminNegativeV253TestJSON-1927761943-project] Request method failure captured: Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCjCGlyimMQgW58cWpCRWcBcXaOb5Thz248ignHI1IX5sS_9Ap9kq3q1gBe0xjLG21JoXXMmHJCU18O25xdf3VUqgnUtxUe6tak_Uih4vI6vSTttK9Q-f7SA5b-1vamMsRaS2qALiN1cuNjv4dE27NUrth_iwigL41HbGHSRH6rbn4I Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 50269cffda3342d79c158aec1d9c3086 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1927761943 Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:08:54.705731 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50269cffda3342d79c158aec1d9c3086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50269cffda3342d79c158aec1d9c3086", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50269cffda3342d79c158aec1d9c3086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50269cffda3342d79c158aec1d9c3086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1927761943 Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 50269cffda3342d79c158aec1d9c3086 Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1927761943 Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1927761943-project Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 5ba4ceb280df41ada3df1bfc8e46e996 Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1927761943-project Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 19:08:54.707187 n-d-862769-3 devstack@n-api.service[120629]: action_args: {} Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:08:54.707926 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 19:08:54.709033 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:08:54.710128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef81214b-265e-477f-9cf7-8b0918f793e6 tempest-ServicesAdminNegativeV253TestJSON-1927761943 tempest-ServicesAdminNegativeV253TestJSON-1927761943-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:54.710128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef81214b-265e-477f-9cf7-8b0918f793e6 tempest-ServicesAdminNegativeV253TestJSON-1927761943 tempest-ServicesAdminNegativeV253TestJSON-1927761943-project] 10.222.0.44 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.451758 Oct 28 19:08:54.710128 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 193/393] 10.222.0.44 () {60 vars in 1178 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 453 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:08:54.789090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cee27735-3ac6-4ab2-a394-958ffa444f41 tempest-NetworksTest-1137789524 tempest-NetworksTest-1137789524-project-admin] Calling method '.version_select at 0x7f1d7c65aa60>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.297851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.311460 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b397adb2-d3d6-4551-b461-b906cba9627c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1469 microversion: 2.1 time: 0.703797 Oct 28 19:08:55.313052 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 201/394] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1469 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:55.335926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.336829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.344793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cee27735-3ac6-4ab2-a394-958ffa444f41 tempest-NetworksTest-1137789524 tempest-NetworksTest-1137789524-project-admin] 10.222.0.44 "GET /compute/v2.1/os-networks" status: 200 len: 6066 microversion: 2.1 time: 0.635827 Oct 28 19:08:55.348956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 194/395] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/os-networks => generated 6066 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:55.349472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.349472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.349472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.349472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.349805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.349805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.350299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.350935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.357403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.358088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.358720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.359428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.359875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.360457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.465770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.478894 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9457a3c5-6e43-4712-9de0-6eb4cc949890 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1274 microversion: 2.1 time: 0.131164 Oct 28 19:08:55.481163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 195/396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:55.500881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ffac298d-2657-45fc-b0eb-bd3e6d92c9db req-3aca6e6e-2a9e-4c61-b593-e33345b182d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa484dd-a603-4442-8bcb-adb9eb32932f", "tag": "db3aeb47-3575-47b4-b727-c44aeee26de7"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:55.523192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ffac298d-2657-45fc-b0eb-bd3e6d92c9db req-3aca6e6e-2a9e-4c61-b593-e33345b182d8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.523748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ffac298d-2657-45fc-b0eb-bd3e6d92c9db req-3aca6e6e-2a9e-4c61-b593-e33345b182d8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.524410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ffac298d-2657-45fc-b0eb-bd3e6d92c9db req-3aca6e6e-2a9e-4c61-b593-e33345b182d8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.540022 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ffac298d-2657-45fc-b0eb-bd3e6d92c9db req-3aca6e6e-2a9e-4c61-b593-e33345b182d8 service nova] Creating event network-changed:db3aeb47-3575-47b4-b727-c44aeee26de7 for instance 0fa484dd-a603-4442-8bcb-adb9eb32932f on n-h1-862769-3 Oct 28 19:08:55.547312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ffac298d-2657-45fc-b0eb-bd3e6d92c9db req-3aca6e6e-2a9e-4c61-b593-e33345b182d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062776 Oct 28 19:08:55.548700 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 196/397] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:55.555078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:55.556302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.563577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.564310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.564893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.565897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.566660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.567262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.581349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.593923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.606269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:55.608917 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10e7418a-e30c-4c54-bed5-1ddea1acb43b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.294065 Oct 28 19:08:55.611511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 202/398] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:55.644817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.648426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.665590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.667005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.667629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.668918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.670252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.674556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.720069 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f974961a-9437-4c3c-83ad-10e83e1ed53f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67/action" status: 204 len: 0 microversion: 2.1 time: 0.168641 Oct 28 19:08:55.723107 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 197/399] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:55 2022] POST /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67/action => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:55.731201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ec19847-6747-47ec-9eaa-8f70a2f3f29f tempest-NetworksTest-1137789524 tempest-NetworksTest-1137789524-project-admin] Calling method '.version_select at 0x7f1d7c378ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.981333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4ec19847-6747-47ec-9eaa-8f70a2f3f29f tempest-NetworksTest-1137789524 tempest-NetworksTest-1137789524-project-admin] 10.222.0.44 "GET /compute/v2.1/os-networks/693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f" status: 200 len: 652 microversion: 2.1 time: 0.256496 Oct 28 19:08:55.982723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 198/400] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/os-networks/693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f => generated 652 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:55.998752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.001082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.015619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.017108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.019834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.022520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.023291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.024188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.080550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.089289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53405cfb-8e73-4493-8a2a-0e3ec982599a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.475924 Oct 28 19:08:56.095717 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 203/401] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.100548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.101145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.118731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.119572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.119892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.120601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.121056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.121481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.255009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.259876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:56.270018 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ebab7b28-1553-4d61-8d05-1e1df0fc9d61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1262 microversion: 2.1 time: 0.284278 Oct 28 19:08:56.273606 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 199/402] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1262 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.281996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-57585b28-82bb-4f5a-809b-fd24826be324 tempest-NetworksTest-1137789524 tempest-NetworksTest-1137789524-project-admin] Calling method '.version_select at 0x7f1d7c84ad30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.617937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.627929 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ce68770-50a6-453b-a301-38cac77ff507 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1469 microversion: 2.1 time: 0.531045 Oct 28 19:08:56.644933 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 204/403] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1469 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.650774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.652360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.660261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.660759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.661383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.663066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.664072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.665152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.685482 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-57585b28-82bb-4f5a-809b-fd24826be324 tempest-NetworksTest-1137789524 tempest-NetworksTest-1137789524-project-admin] 10.222.0.44 "GET /compute/v2.1/os-networks" status: 200 len: 6066 microversion: 2.1 time: 0.410724 Oct 28 19:08:56.686319 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 200/404] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/os-networks => generated 6066 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.695656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.696274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:56.706294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.706831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.707251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.707954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.708404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.713449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.792923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.803892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dae772f6-66c0-4a8b-9c02-cd163c41db98 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1280 microversion: 2.1 time: 0.157363 Oct 28 19:08:56.804494 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 205/405] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.052993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.064223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.066257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.068210 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ce996a9-597c-4f74-9219-4fa45d3ea7d0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.380767 Oct 28 19:08:57.069446 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 201/406] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:57.118173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.118959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.128082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.128982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.129535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.130833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.132430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.133077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.300214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.301021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.307138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.307636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.308364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.309149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.309820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.310524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.351580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.359937 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e62b398b-452d-4277-9b3e-a99be18392ad tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.245966 Oct 28 19:08:57.360509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 206/407] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.401714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.411720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed271f3a-9b7d-439f-ab05-8054b0bbfebc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1268 microversion: 2.1 time: 0.115333 Oct 28 19:08:57.412947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 202/408] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1268 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.654324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.654963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.668195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.668712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.669273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.671692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.672201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.672583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.691347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495986a-5fdf-462a-8a27-4cae25051f67", "name": "network-vif-plugged", "status": "completed", "tag": "7a6fb0d8-3d62-43fe-ba26-7f441e053865"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:57.712985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.713465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.713885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.727738 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] Creating event network-vif-plugged:7a6fb0d8-3d62-43fe-ba26-7f441e053865 for instance b495986a-5fdf-462a-8a27-4cae25051f67 on n-h2-862769-3 Oct 28 19:08:57.745449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] Instance b495986a-5fdf-462a-8a27-4cae25051f67 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:08:57.763900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e6966cf6-bdcc-4f98-baed-51d5af15b805 req-7581d94c-3324-45a4-be61-28dff542c9c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076475 Oct 28 19:08:57.764909 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 203/409] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:57.830725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.831429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.852735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.854172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.857156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.858206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.860033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.861414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.861947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.874313 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-245b3f19-275a-45e0-a0a6-71a0b074179a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1469 microversion: 2.1 time: 0.226038 Oct 28 19:08:57.875283 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 207/410] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.941718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.951310 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-396d3a4f-d30c-4928-891a-902fba6cd07a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1280 microversion: 2.1 time: 0.124870 Oct 28 19:08:57.951885 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 204/411] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.086500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-96793704-c33a-4d2e-83c3-2dee04c36f75 req-5f72b704-9525-43f6-a1ba-f2d578a12fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56da196-1ce9-4bb4-948b-785ea839bff8", "name": "network-vif-unplugged", "status": "completed", "tag": "aa11e10c-a6e1-475a-84a9-49088e29ced3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:58.098032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-96793704-c33a-4d2e-83c3-2dee04c36f75 req-5f72b704-9525-43f6-a1ba-f2d578a12fec service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.098500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-96793704-c33a-4d2e-83c3-2dee04c36f75 req-5f72b704-9525-43f6-a1ba-f2d578a12fec service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.098941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-96793704-c33a-4d2e-83c3-2dee04c36f75 req-5f72b704-9525-43f6-a1ba-f2d578a12fec service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.101435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.102048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.110951 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-96793704-c33a-4d2e-83c3-2dee04c36f75 req-5f72b704-9525-43f6-a1ba-f2d578a12fec service nova] Creating event network-vif-unplugged:aa11e10c-a6e1-475a-84a9-49088e29ced3 for instance e56da196-1ce9-4bb4-948b-785ea839bff8 on n-h2-862769-3 Oct 28 19:08:58.116044 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-96793704-c33a-4d2e-83c3-2dee04c36f75 req-5f72b704-9525-43f6-a1ba-f2d578a12fec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036516 Oct 28 19:08:58.116838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 208/412] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:08:58.122777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.123447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.123763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.124850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.125305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.125724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.362151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.373047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.374453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.375634 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2116979-d53e-4ab5-ae21-7fdc453f5046 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.278358 Oct 28 19:08:58.376355 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 205/413] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:58.394089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.395289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.404035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.404603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.405081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.405867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.406661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.407691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.437423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.438400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.444813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.445626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.446288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.447260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.447964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.448585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.546076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.556836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91564f50-f4b2-4bf0-9a6a-de7235b55966 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1268 microversion: 2.1 time: 0.122988 Oct 28 19:08:58.558608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 206/414] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1268 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.679735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.692319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed2053d8-3692-4616-83f8-24b0758b036a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.310676 Oct 28 19:08:58.693417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 209/415] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.898306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.899113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.910321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.910872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.912387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.913107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.913566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.913987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.973577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.974186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.985361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.985721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.986160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.987037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.987438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.987919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.349633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.360319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.361534 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0262e2c5-38ab-4e2c-a39d-aa7365fd8eb7 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.391854 Oct 28 19:08:59.369414 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98ba85c0-f86f-40ff-9651-a19e232796c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1469 microversion: 2.1 time: 0.475453 Oct 28 19:08:59.378962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 210/416] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:59.379059 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 207/417] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1469 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:59.406970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.408004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.414316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.415374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.415957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.416798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.417396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.417962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.580462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.581355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.594307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.595069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.595781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.596716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.600076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.600704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.733977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.743539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.756012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.763383 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-755f49f1-24dc-4bb7-8db0-fa2a9c4b553d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.361715 Oct 28 19:08:59.764236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 211/418] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:08:59.771830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.779523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.790546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.795407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.796146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.797130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.797793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.798434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.045315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.057915 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-479b1515-a775-4b6e-a359-1478805397f4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.481491 Oct 28 19:09:00.058739 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 208/419] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:00.072238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-809a868b-6116-454e-9338-62d4f1a14a2c req-05614012-6f1b-4635-8f24-f60dba366799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa484dd-a603-4442-8bcb-adb9eb32932f", "name": "network-vif-plugged", "status": "completed", "tag": "db3aeb47-3575-47b4-b727-c44aeee26de7"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:00.098976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-809a868b-6116-454e-9338-62d4f1a14a2c req-05614012-6f1b-4635-8f24-f60dba366799 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.099942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-809a868b-6116-454e-9338-62d4f1a14a2c req-05614012-6f1b-4635-8f24-f60dba366799 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.103501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-809a868b-6116-454e-9338-62d4f1a14a2c req-05614012-6f1b-4635-8f24-f60dba366799 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.127044 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-809a868b-6116-454e-9338-62d4f1a14a2c req-05614012-6f1b-4635-8f24-f60dba366799 service nova] Creating event network-vif-plugged:db3aeb47-3575-47b4-b727-c44aeee26de7 for instance 0fa484dd-a603-4442-8bcb-adb9eb32932f on n-h1-862769-3 Oct 28 19:09:00.142357 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-809a868b-6116-454e-9338-62d4f1a14a2c req-05614012-6f1b-4635-8f24-f60dba366799 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079283 Oct 28 19:09:00.145943 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 209/420] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:00.150306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.162157 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ab778aa-4a53-49eb-8ef6-7e00945c71fb tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.394006 Oct 28 19:09:00.163415 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 212/421] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:00.182301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-78f8c7df-0860-46b3-bfa2-7114dab3b9bf req-016d4127-d6b7-4268-9c24-cd7343428c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56da196-1ce9-4bb4-948b-785ea839bff8", "tag": "aa11e10c-a6e1-475a-84a9-49088e29ced3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:00.194138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-78f8c7df-0860-46b3-bfa2-7114dab3b9bf req-016d4127-d6b7-4268-9c24-cd7343428c1c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.194919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-78f8c7df-0860-46b3-bfa2-7114dab3b9bf req-016d4127-d6b7-4268-9c24-cd7343428c1c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.195575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-78f8c7df-0860-46b3-bfa2-7114dab3b9bf req-016d4127-d6b7-4268-9c24-cd7343428c1c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.208578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-78f8c7df-0860-46b3-bfa2-7114dab3b9bf req-016d4127-d6b7-4268-9c24-cd7343428c1c service nova] Creating event network-changed:aa11e10c-a6e1-475a-84a9-49088e29ced3 for instance e56da196-1ce9-4bb4-948b-785ea839bff8 on n-h2-862769-3 Oct 28 19:09:00.213671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-78f8c7df-0860-46b3-bfa2-7114dab3b9bf req-016d4127-d6b7-4268-9c24-cd7343428c1c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039045 Oct 28 19:09:00.214777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 210/422] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:00.387338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.388272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:00.396822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.397604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.398195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.399120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.399730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.400331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.402000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.403765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:00.411366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.412104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.412710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.413582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.414186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.415080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.982918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.991854 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e713a79-d552-4103-a036-e1f872bf5e67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1461 microversion: 2.1 time: 0.596769 Oct 28 19:09:00.993297 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 211/423] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1461 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.000548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.001266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.014533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.019145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.020773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.021627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.023409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.024794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.026031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.030366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e742f22-89df-49ce-98b9-625f5bca1274 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.648012 Oct 28 19:09:01.047557 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 213/424] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.053660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.054467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.062131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.063073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.063822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.065464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.066185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.066815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.567201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.580488 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c922f5d5-1f9a-425a-9909-0acfb50cc587 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1612 microversion: 2.1 time: 0.531206 Oct 28 19:09:01.580877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.581114 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 214/425] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1612 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.583383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.584736 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99f537fa-1448-494f-92c8-76559a829fc1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.588131 Oct 28 19:09:01.594411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.595270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.601148 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 212/426] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:01.605849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.611247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.611432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.611847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.612379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.612579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.613042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.613466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.624267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.624819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.625259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.625990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.626444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.626905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.913888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.918966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.932065 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93842e1a-0430-4983-bdc1-cddde21faace tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1320 microversion: 2.1 time: 0.329722 Oct 28 19:09:01.933029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d7c8a9c-bb20-4fef-8d35-bf2d6ddd3430 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.350866 Oct 28 19:09:01.943162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 215/427] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.953143 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 213/428] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.953327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-41133048-12f5-4b3f-9fd6-71a5cf628ae3 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '.version_select at 0x7f1d7c438b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.958865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41133048-12f5-4b3f-9fd6-71a5cf628ae3 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.959359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41133048-12f5-4b3f-9fd6-71a5cf628ae3 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.959799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41133048-12f5-4b3f-9fd6-71a5cf628ae3 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.970242 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-41133048-12f5-4b3f-9fd6-71a5cf628ae3 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.025926 Oct 28 19:09:01.971135 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 216/429] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:02.055730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.056725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.064721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.065822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.066352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.067498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.068037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.068655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.093498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1929985054", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:02.150494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:02.287396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.300469 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8bdfe2f3-90f1-44e1-a8c7-0f168d3357c4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.250230 Oct 28 19:09:02.317565 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 214/430] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:02.323242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386", "tag": "c73e5aed-f76f-4c24-8d01-4461bf33df76"}, {"name": "network-changed", "server_uuid": "c725ea7f-facb-47c1-94c4-15b43b75fcd5", "tag": "ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:02.335102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.335697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.336127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.349803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] Creating event network-changed:c73e5aed-f76f-4c24-8d01-4461bf33df76 for instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 on n-h2-862769-3 Oct 28 19:09:02.355243 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] Creating event network-changed:ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0 for instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 on n-h2-862769-3 Oct 28 19:09:02.363604 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-57ea4ae2-9989-4894-9a3b-f949533c7773 req-449306e8-6dc8-4169-a2a2-492887c6f71d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044471 Oct 28 19:09:02.365055 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 215/431] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:02.433913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:02.434335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:02.434834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:02.435241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:02.435656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:02.446926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.447988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.448482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.449512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.450004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.450641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.470730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:02.476407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for user 3142fd0059aa4b658c2cea015b1f3d93 and project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:02.490481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:02.493072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:02.542066 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82240c8c-1cfb-477a-b843-5f219e6cb161 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.452237 Oct 28 19:09:02.543081 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 217/432] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:09:02.555789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc6c8015-58f1-4c5a-ace9-cbdbbd5ede25 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.556517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc6c8015-58f1-4c5a-ace9-cbdbbd5ede25 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.616947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.623463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.640144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.642648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.643805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.646968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.647543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.648056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.687423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc6c8015-58f1-4c5a-ace9-cbdbbd5ede25 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.696960 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc6c8015-58f1-4c5a-ace9-cbdbbd5ede25 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1213 microversion: 2.1 time: 0.145558 Oct 28 19:09:02.697535 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 216/433] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:02.908076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.911803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:02.925592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.927255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.928581 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b67d4fe-ba36-43a9-85cc-5e6fbc7193fc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.316197 Oct 28 19:09:02.929838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 218/434] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:02.960975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.963876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.975974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.976589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:02.977990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.982418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.983617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.984884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.985686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.986353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.990613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.991142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.991621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.992338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.992791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.993214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.248033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.259410 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-252995a1-1a63-48e6-b5c7-adae71a50358 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1469 microversion: 2.1 time: 0.285065 Oct 28 19:09:03.261631 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 219/435] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.350723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.361296 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d18cac7-225c-423a-902a-b5d9a46b725c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.404883 Oct 28 19:09:03.362307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 217/436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.367253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.368164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.375230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.376074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.376874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.377821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.378453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.379075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.563266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.564072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.572663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.573451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.574098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.575195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.575809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.576456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.598652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.608615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ca3bd07-ac40-4b0b-bbbd-131ff7ac6f6b tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.244962 Oct 28 19:09:03.609574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:09:03.612989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 218/437] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.720104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.721381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.729106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.730727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.732831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.733788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.734635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.736527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.763975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-650a1faa-3ebd-488a-8c1a-cd9c43c4d4da tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] 10.222.0.44 "DELETE /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 204 len: 0 microversion: 2.1 time: 0.479370 Oct 28 19:09:03.764499 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 220/438] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:03 2022] DELETE /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:03.776899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.778024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.785432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.786244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.786887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.788167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.789870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.790994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.849266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.857098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-596ac1f5-27a1-4919-a64e-6e9555011604 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1265 microversion: 2.1 time: 0.140755 Oct 28 19:09:03.858400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 219/439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:03.959229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.960701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.965266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.968966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.969641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.970247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.971931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.972561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.973131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.978755 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59bd8422-60fa-4e08-8ad7-8a855a467e18 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1475 microversion: 2.1 time: 0.209208 Oct 28 19:09:03.979937 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 221/440] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1475 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:04.086990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=20 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:04.153248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.159970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:04.169328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.172652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.174876 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a9c439da-8032-4911-abe4-485941be6f85 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.220884 Oct 28 19:09:04.179074 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 220/441] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:04.391080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.393032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.403534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.404042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.404783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.405801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.406740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.407448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.635971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.636645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.646083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.646903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.647502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.648774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.649397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.649973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.655116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.664929 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de2e4b46-2afe-42e6-8577-838d422fe5ee tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.283057 Oct 28 19:09:04.668852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 222/442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:04.860349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.881193 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-156139eb-2a99-4114-8f1f-6af3fbce7a5a tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.249344 Oct 28 19:09:04.883234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.883842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.888036 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 221/443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:04.890493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.892502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.892972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.893781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.894451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.895413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.964551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.972427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f72b248-ddf5-46ad-842a-bb5be8bab078 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1273 microversion: 2.1 time: 0.093077 Oct 28 19:09:04.972998 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 223/444] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:05.003140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.003755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.009755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.010275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.010675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.011430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.012009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.012428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.178960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.187581 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-834d76f6-b446-491f-97e2-30d6c6cf78e3 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1475 microversion: 2.1 time: 0.188236 Oct 28 19:09:05.188395 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 222/445] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1475 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:05.202006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.202861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.211077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.211683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.212286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.213337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.222532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.229403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.586159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.596605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.599545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.600983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-673df212-cb0c-49da-abfc-42fe4c9b0363 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.403026 Oct 28 19:09:05.602048 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 224/446] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:05.688139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.688758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.701025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.705918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.706622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.707660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.711551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.712602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.905846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.906474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.914052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:05.927463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.927955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.928913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.929643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.930100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.930522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.380966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.397867 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4f59d327-6178-413d-b00c-5928bb47033c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.714054 Oct 28 19:09:06.398483 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 223/447] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:06.418017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.418740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:06.428686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.429282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.429952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.430933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.432846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.433523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.471630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.480998 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4e29d1e-7836-4015-a0b9-56ece5e08ac3 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.579541 Oct 28 19:09:06.489032 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 225/448] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:06.504208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.505140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:06.519308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.521353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.521978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.525787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.526278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.526737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.631581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.649408 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2bb10e86-0f4c-482d-9454-b2a3b40af588 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1271 microversion: 2.1 time: 0.249669 Oct 28 19:09:06.672822 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 224/449] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:06.679809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a1845650-fee7-4fb8-a413-146219ddd237 req-06528652-e648-49b7-93f1-8ea85bdf79bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386", "name": "network-vif-plugged", "status": "completed", "tag": "c73e5aed-f76f-4c24-8d01-4461bf33df76"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:06.692129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a1845650-fee7-4fb8-a413-146219ddd237 req-06528652-e648-49b7-93f1-8ea85bdf79bd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.693958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a1845650-fee7-4fb8-a413-146219ddd237 req-06528652-e648-49b7-93f1-8ea85bdf79bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.694627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a1845650-fee7-4fb8-a413-146219ddd237 req-06528652-e648-49b7-93f1-8ea85bdf79bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.709516 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a1845650-fee7-4fb8-a413-146219ddd237 req-06528652-e648-49b7-93f1-8ea85bdf79bd service nova] Creating event network-vif-plugged:c73e5aed-f76f-4c24-8d01-4461bf33df76 for instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 on n-h2-862769-3 Oct 28 19:09:06.716188 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a1845650-fee7-4fb8-a413-146219ddd237 req-06528652-e648-49b7-93f1-8ea85bdf79bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041817 Oct 28 19:09:06.717495 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 225/450] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:06.723719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.725048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:06.733643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.734800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.735764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.737858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.738533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.739228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.019171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.037680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-857a6c6a-dc1c-427b-ae75-07d1fc2d2c46 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1475 microversion: 2.1 time: 0.547085 Oct 28 19:09:07.039956 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 226/451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1475 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:07.120066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.132676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.134418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.136544 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07a4c2e0-a59d-47d3-891a-11342a390982 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.417506 Oct 28 19:09:07.137287 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 226/452] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:07.424503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:07.425107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:07.437111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.437537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.437969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.441946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.442442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.442919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.518287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:07.520211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:07.531910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.532417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.532854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.533631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.534087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.534532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.878521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.897362 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b404e35-357f-4be5-a456-ea8dfa2ee98c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.476577 Oct 28 19:09:07.898046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 227/453] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:07 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:07.913151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:07.914059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:07.929028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.929777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.930393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.931291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.931897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.932469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.966962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.985194 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d818860e-f9ce-4059-9670-da90a9a966c9 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1322 microversion: 2.1 time: 0.473506 Oct 28 19:09:07.986189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 227/454] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:07 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:07.997171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-df2e7e9d-efa6-47da-955d-a9b12d513c78 req-621972b6-2556-4e90-8a5f-77bcb5f08dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa484dd-a603-4442-8bcb-adb9eb32932f", "name": "network-vif-deleted", "tag": "db3aeb47-3575-47b4-b727-c44aeee26de7"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:08.042392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-df2e7e9d-efa6-47da-955d-a9b12d513c78 req-621972b6-2556-4e90-8a5f-77bcb5f08dfc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.042913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-df2e7e9d-efa6-47da-955d-a9b12d513c78 req-621972b6-2556-4e90-8a5f-77bcb5f08dfc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.043339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-df2e7e9d-efa6-47da-955d-a9b12d513c78 req-621972b6-2556-4e90-8a5f-77bcb5f08dfc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.081341 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-df2e7e9d-efa6-47da-955d-a9b12d513c78 req-621972b6-2556-4e90-8a5f-77bcb5f08dfc service nova] Creating event network-vif-deleted:db3aeb47-3575-47b4-b727-c44aeee26de7 for instance 0fa484dd-a603-4442-8bcb-adb9eb32932f on n-h1-862769-3 Oct 28 19:09:08.092496 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-df2e7e9d-efa6-47da-955d-a9b12d513c78 req-621972b6-2556-4e90-8a5f-77bcb5f08dfc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103488 Oct 28 19:09:08.093642 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 228/455] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:08.100326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.101224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:08.113051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.114285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.119477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.120594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.121268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.122819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.180079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.191407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.205373 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56cd7cae-aad9-4897-9403-7b4d2951c3e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1313 microversion: 2.1 time: 0.305090 Oct 28 19:09:08.206238 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 228/456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:07 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:08.209198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.211822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.212694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lazy-loading 'fault' on Instance uuid 0fa484dd-a603-4442-8bcb-adb9eb32932f {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:08.215258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.217902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:08.234001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.234930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.236134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.237731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.241229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.242199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.502808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.523317 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c0580a25-5824-4063-8218-a8d3c5da63ae tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 200 len: 1310 microversion: 2.1 time: 0.428155 Oct 28 19:09:08.524874 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 229/457] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 1310 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:08.651312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.660714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.665039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.666934 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a877406-db22-4efd-b9bf-0c14ed92faef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.459494 Oct 28 19:09:08.668326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 229/458] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:08.922680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.923513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:08.937286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.937778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.938211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.938948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.939572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.940196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.012365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.012980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.027033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.029286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.029796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.030594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.033089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.033703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.484702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.501514 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-807e9b67-4f5f-4ab4-bcf6-74b871af555b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.582586 Oct 28 19:09:09.503763 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 230/459] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:09.511210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.520169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.522541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.527347 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-578401bb-521a-440b-a965-38b26be01f7f tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1470 microversion: 2.1 time: 0.518743 Oct 28 19:09:09.532264 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 230/460] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1470 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:09.537243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.539067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.542619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.543670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.544407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.545082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.550387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.551980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.566288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.566820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.568920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.571411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.571934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.572412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.606466 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] HTTP exception thrown: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Request method failure captured: Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f HTTP/1.1 Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi7ebMc8JyJSVagkjJhXLRNODmAOTBRG-IGE4eONHoM-SWweCaW0E_mVz3D3jtls9YsSEsHWz8nqahUnEnJtVrfwJwbCwX-Vbi5DLpwW1HpzHlXNc9Nqcyl89MfYcxypmcbJ_wy45bLpdOf2N_JjgvZpN3Ykmp9VNiNWhwpk7OSXfQ Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:09:09.615142 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d394b3626a64b55847ca2da79aeeef1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3c6c5e19c04148ceb2903f8bbb617550 Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:09.616499 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '0fa484dd-a603-4442-8bcb-adb9eb32932f'} Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:09.617244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:09.618405 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.622991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Returning 404 to user: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:09.624118 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b07d47d-a6a3-4f83-8fe7-82910cc63ead tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 404 len: 111 microversion: 2.1 time: 0.078705 Oct 28 19:09:09.625029 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 231/461] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:09.638866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.639688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.665226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.665880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.666419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.667280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.667852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.671957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.730064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Request method failure captured: Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386/diagnostics HTTP/1.1 Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCjCM8EXurcu_ibqz8-OHX0zXGlFq3vRc5apo5to8PS0GH1ykpW97sv3TSEMojyDMenB8vkaHYzzX4AGGTYsF91yPNUW-LMAw1ozh994x36xDWc2jYQfIPq7a31xPmagKRUd0ka2bQ6evVO2jd5pHmrUfMyXR1MxaKo6FfvSytvRu_A Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48ee36f1887d40efb7a6ee6787c44501 Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-531014292 Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:09:09.733225 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48ee36f1887d40efb7a6ee6787c44501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48ee36f1887d40efb7a6ee6787c44501", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48ee36f1887d40efb7a6ee6787c44501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48ee36f1887d40efb7a6ee6787c44501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-531014292 Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48ee36f1887d40efb7a6ee6787c44501 Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-531014292 Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerDiagnosticsNegativeTest-531014292-project Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2d0cd2464c6546a5afe23f9231feb95c Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-531014292-project Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:09:09.734810 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386'} Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:09:09.735631 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 19:09:09.738189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:09.741127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:09.742203 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1d2e73c-3511-46ef-b0ad-248605203764 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.115640 Oct 28 19:09:09.743138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 232/462] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386/diagnostics => generated 117 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:09.765997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.766959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.775330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.776888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.777627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.778745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.779392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.779998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.507011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.535443 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-862f9ce4-78b1-4c5c-ad93-edbd4e5ca16a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1313 microversion: 2.1 time: 1.029214 Oct 28 19:09:10.536191 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 231/463] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1313 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:10.548609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:10.563579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:10.574623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.579684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.580946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.581922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.583493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.584318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.586883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.599474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.600925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.605862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-836f8163-4b27-4cea-872a-772f1d5d25a6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1568 microversion: 2.25 time: 0.861444 Oct 28 19:09:10.607877 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 233/464] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1568 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:10.621990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1532572411", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:10.642127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:09:10.726472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:10.777563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:10.782970 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b5e0779-cd1f-45ae-9608-177ce628dd46 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 204 len: 0 microversion: 2.1 time: 0.243459 Oct 28 19:09:10.784369 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 232/465] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:10 2022] DELETE /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:10.792782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-13c9d606-254c-4ab1-92dd-33c79a884cd3 req-b50f50b9-d03b-4de1-8c2b-b2c529faad5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b9d8c7-fd45-4793-8005-48a329af61fc", "tag": "acb14376-c9d5-489b-91db-914a95c06be3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:10.808222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-13c9d606-254c-4ab1-92dd-33c79a884cd3 req-b50f50b9-d03b-4de1-8c2b-b2c529faad5c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.808982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-13c9d606-254c-4ab1-92dd-33c79a884cd3 req-b50f50b9-d03b-4de1-8c2b-b2c529faad5c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.809639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-13c9d606-254c-4ab1-92dd-33c79a884cd3 req-b50f50b9-d03b-4de1-8c2b-b2c529faad5c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.828548 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-13c9d606-254c-4ab1-92dd-33c79a884cd3 req-b50f50b9-d03b-4de1-8c2b-b2c529faad5c service nova] Creating event network-changed:acb14376-c9d5-489b-91db-914a95c06be3 for instance 98b9d8c7-fd45-4793-8005-48a329af61fc on n-h2-862769-3 Oct 28 19:09:10.836515 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-13c9d606-254c-4ab1-92dd-33c79a884cd3 req-b50f50b9-d03b-4de1-8c2b-b2c529faad5c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050421 Oct 28 19:09:10.838120 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 233/466] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:10.846622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f92f45b8-c8e4-403f-8599-b5c8242b73f7 req-a9419e4a-1598-44c3-9a22-f0291c3ed928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c725ea7f-facb-47c1-94c4-15b43b75fcd5", "name": "network-vif-plugged", "status": "completed", "tag": "ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:10.860438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f92f45b8-c8e4-403f-8599-b5c8242b73f7 req-a9419e4a-1598-44c3-9a22-f0291c3ed928 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.861726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f92f45b8-c8e4-403f-8599-b5c8242b73f7 req-a9419e4a-1598-44c3-9a22-f0291c3ed928 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.862559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f92f45b8-c8e4-403f-8599-b5c8242b73f7 req-a9419e4a-1598-44c3-9a22-f0291c3ed928 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.878874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f92f45b8-c8e4-403f-8599-b5c8242b73f7 req-a9419e4a-1598-44c3-9a22-f0291c3ed928 service nova] Creating event network-vif-plugged:ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0 for instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 on n-h2-862769-3 Oct 28 19:09:10.885117 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f92f45b8-c8e4-403f-8599-b5c8242b73f7 req-a9419e4a-1598-44c3-9a22-f0291c3ed928 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045410 Oct 28 19:09:10.885880 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 234/467] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:10.896395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:10.897101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:10.904296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.905215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.905828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.906932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.907836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.908590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.170201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:11.170614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:11.171108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:11.171503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:11.171906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:11.190473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=7 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:11.204479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.205069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.205892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.206830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.209235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.211874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.236752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=23 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:11.273334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Getting quotas for project 0d394b3626a64b55847ca2da79aeeef1. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:11.288191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Getting quotas for user 3c6c5e19c04148ceb2903f8bbb617550 and project 0d394b3626a64b55847ca2da79aeeef1. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:11.312535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:11.315664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:11.424921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0725798a-9c0a-40ae-895c-b183c2e30d98 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806769 Oct 28 19:09:11.427685 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 234/468] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:09:11.449058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:11.449995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:11.464363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:11.472870 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29d70a7c-99d5-420f-929e-a8496227abb0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.581310 Oct 28 19:09:11.480830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.481990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.482533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.486794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.489271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.489994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.495088 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 235/469] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:10 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:11.501221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b5f6c69-fcf6-45c5-b394-6f98079a93cd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:11.501826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b5f6c69-fcf6-45c5-b394-6f98079a93cd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:11.509670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:11.630846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b5f6c69-fcf6-45c5-b394-6f98079a93cd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:11.640815 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b5f6c69-fcf6-45c5-b394-6f98079a93cd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1220 microversion: 2.1 time: 0.144522 Oct 28 19:09:11.657269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 236/470] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:11 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:11.669896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:11.670535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:11.688140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.688633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.689169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.692205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.699052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.699601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.881307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:11.898330 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23190d52-a9cc-4f18-83d4-9d97abb6a2f4 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1476 microversion: 2.1 time: 0.468750 Oct 28 19:09:11.904442 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 235/471] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:11 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1476 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:11.911062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:11.911905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:11.950011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.951004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.951649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.952569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.953326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.953911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.221037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.234884 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25696f12-1530-4aab-afd5-e13891a66602 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1313 microversion: 2.1 time: 0.573525 Oct 28 19:09:12.235654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 237/472] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:11 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:12.243727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:12.245446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:12.255443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.256164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.256759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.257621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.258505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.259147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.324709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:09:12.349772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:12.479169 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4181fbc1-582e-4c76-8ef3-7cf011a8e4a7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 204 len: 0 microversion: 2.1 time: 0.241991 Oct 28 19:09:12.480014 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 238/473] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:12 2022] DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:12.502442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:12.503290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:12.503420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.513355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.514210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.514934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.515865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.516556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.517221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.527509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.533860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:12.539226 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bbd0459a-8734-4e5a-879e-e68475d62583 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1558 microversion: 2.25 time: 0.632490 Oct 28 19:09:12.543541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 236/474] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:11 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1558 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:12.577571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b7c1f3f-4fe9-4ede-84a8-9276b19f154d tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '.version_select at 0x7f1d7c359160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:12.587664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b7c1f3f-4fe9-4ede-84a8-9276b19f154d tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.590062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b7c1f3f-4fe9-4ede-84a8-9276b19f154d tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.590862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b7c1f3f-4fe9-4ede-84a8-9276b19f154d tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.606605 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b7c1f3f-4fe9-4ede-84a8-9276b19f154d tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.035097 Oct 28 19:09:12.613882 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 237/475] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Oct 28 19:09:12 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:12.630553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:12.631208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:12.639478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.639971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.640676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.641594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.642048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.642463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.001216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.010213 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4454742-a140-417b-9785-ddba41853544 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1310 microversion: 2.1 time: 0.512421 Oct 28 19:09:13.014759 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 239/476] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:12 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1310 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:13.024556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:13.025333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:13.037208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.038629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.039977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.041936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.042887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.044035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.100555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid e56da196-1ce9-4bb4-948b-785ea839bff8 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:13.146509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4c5d9f25-f06b-4e29-874d-3dabeb16e72b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 2051 microversion: 2.25 time: 0.520472 Oct 28 19:09:13.151276 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 238/477] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:12 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 2051 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:13.167571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-865735920", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "2082668900", "adminPass": "***", "networks": [{"uuid": "15f7d709-b4f7-4184-88b9-170199bcabd3"}], "security_groups": [{"name": "tempest-securitygroup--1073179599"}], "key_name": "tempest-keypair-275537579", "user_data": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:13.201710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.212974 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07ca4c34-1e2b-4e92-bd42-17d119aa3a06 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1272 microversion: 2.1 time: 0.197334 Oct 28 19:09:13.215612 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 240/478] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:13 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:13.262171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:13.264851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:13.289904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.295861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.296641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.297402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.298172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.298595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.572980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] validate_networks() for [('15f7d709-b4f7-4184-88b9-170199bcabd3', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:13.849722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0cd2464c6546a5afe23f9231feb95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ee36f1887d40efb7a6ee6787c44501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.860280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8dd9e0c8-f514-4aab-afe1-1c645bd0eebb tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 200 len: 1476 microversion: 2.1 time: 0.630030 Oct 28 19:09:13.860869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 241/479] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:13 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:13.866710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:13.867548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:13.874893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.876085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.877063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.881895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:13.882759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:13.883397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.713994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:14.727946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7472858-91e9-4e44-a10f-3e11bc35bc3b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1313 microversion: 2.1 time: 0.865516 Oct 28 19:09:14.732915 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 242/480] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:13 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:14.753482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-861926265", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "aa325377-9337-4f1f-b1f3-a267b86ca8bc"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:14.902012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] validate_networks() for [('aa325377-9337-4f1f-b1f3-a267b86ca8bc', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:15.457456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:15.459487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:15.461498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:15.462284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:15.463434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:15.491298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.492176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.493921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.497692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.498926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.500819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.549083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Getting quotas for project 2cabf5bc7f864f11b150f8b15825922c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:15.566387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Getting quotas for user 8468bb4493eb4cf5951029cda891cec9 and project 2cabf5bc7f864f11b150f8b15825922c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:15.602209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:15.606661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:15.703667 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad79f35d-7a80-4521-8bfc-cac2e3ce4ba3 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.551129 Oct 28 19:09:15.705302 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 239/481] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:09:15.711575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:15.712692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:15.721347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.722935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.723631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.724713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.725785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.726743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.270928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:16.272115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:16.272789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:16.273886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:16.276018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:16.293485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:16.294887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=25 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:16.297826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.304026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.305381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.306718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.308686 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58616430-4499-41b0-98fc-283d4078d6f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1492 microversion: 2.1 time: 0.601228 Oct 28 19:09:16.309273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 240/482] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:15 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1492 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:16.309815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.310459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.349255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:16.349865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:16.359238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:16.372858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for user 1b1defe0b46f45fc8ff3d354bb4d361e and project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:16.373100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.373499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.373929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.379854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.380702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.381320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.404546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:16.410591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:16.536722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:16.549759 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00def90d-c988-46f5-a1f4-888d3bdd3c29 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1278 microversion: 2.1 time: 0.214875 Oct 28 19:09:16.569028 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 241/483] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:16 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:16.570121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67ea0cd6-6880-4a53-8ef2-f6442833aae6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.834037 Oct 28 19:09:16.571884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 243/484] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:09:16.582136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-86a66527-9a01-4feb-b282-c187e3d5ad40 req-6d317bb9-3fc4-49ee-896e-a61e3d39340a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386", "name": "network-vif-deleted", "tag": "c73e5aed-f76f-4c24-8d01-4461bf33df76"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:16.589405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:16.594319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] [instance: 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:16.606502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-86a66527-9a01-4feb-b282-c187e3d5ad40 req-6d317bb9-3fc4-49ee-896e-a61e3d39340a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.607015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-86a66527-9a01-4feb-b282-c187e3d5ad40 req-6d317bb9-3fc4-49ee-896e-a61e3d39340a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.607449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-86a66527-9a01-4feb-b282-c187e3d5ad40 req-6d317bb9-3fc4-49ee-896e-a61e3d39340a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.618197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.618988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.623828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.624831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.639499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.641290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.648706 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-86a66527-9a01-4feb-b282-c187e3d5ad40 req-6d317bb9-3fc4-49ee-896e-a61e3d39340a service nova] Creating event network-vif-deleted:c73e5aed-f76f-4c24-8d01-4461bf33df76 for instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 on n-h2-862769-3 Oct 28 19:09:16.663748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-86a66527-9a01-4feb-b282-c187e3d5ad40 req-6d317bb9-3fc4-49ee-896e-a61e3d39340a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093146 Oct 28 19:09:16.666066 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 242/485] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:16.668429 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] HTTP exception thrown: Instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 could not be found. Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Request method failure captured: Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 HTTP/1.1 Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCjCM8EXurcu_ibqz8-OHX0zXGlFq3vRc5apo5to8PS0GH1ykpW97sv3TSEMojyDMenB8vkaHYzzX4AGGTYsF91yPNUW-LMAw1ozh994x36xDWc2jYQfIPq7a31xPmagKRUd0ka2bQ6evVO2jd5pHmrUfMyXR1MxaKo6FfvSytvRu_A Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48ee36f1887d40efb7a6ee6787c44501 Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-531014292 Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:16.674179 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48ee36f1887d40efb7a6ee6787c44501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48ee36f1887d40efb7a6ee6787c44501", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48ee36f1887d40efb7a6ee6787c44501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48ee36f1887d40efb7a6ee6787c44501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-531014292 Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48ee36f1887d40efb7a6ee6787c44501 Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-531014292 Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerDiagnosticsNegativeTest-531014292-project Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2d0cd2464c6546a5afe23f9231feb95c Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-531014292-project Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 could not be found. Oct 28 19:09:16.675473 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386'} Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 could not be found. Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:16.676298 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 could not be found. Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 could not be found. Oct 28 19:09:16.677444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:16.680477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] Returning 404 to user: Instance 0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:16.684092 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f96c8bf6-53db-4846-a308-caa85458ede2 tempest-ServerDiagnosticsNegativeTest-531014292 tempest-ServerDiagnosticsNegativeTest-531014292-project] 10.222.0.44 "GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386" status: 404 len: 111 microversion: 2.1 time: 0.107484 Oct 28 19:09:16.685531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 244/486] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:16 2022] GET /compute/v2.1/servers/0a02c4f3-0a4d-4e12-8bf7-b8fb474ea386 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:16.825570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2ecba94-4937-485e-a344-c5126592510e tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Action: 'create', calling method: .version_select at 0x7f1d7c38d8b0>, body: {"pool": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:16.983693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1688961226", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "eaf8a972-4544-4697-b19b-9248b3c756b9"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:17.109735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] validate_networks() for [('eaf8a972-4544-4697-b19b-9248b3c756b9', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:18.726656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:18.728425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:18.729068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:18.729682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:18.730272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:18.772958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:18.791056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:18.793509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:18.797823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:18.800241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:18.800908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:18.891203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Getting quotas for project aa88591c155d44528bf278ff93f3c2e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:18.912926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Getting quotas for user 0e591cea1b324e78bd62e7e06b1d2623 and project aa88591c155d44528bf278ff93f3c2e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:19.001636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:19.007741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:19.188321 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bde4a7a6-10d1-44cb-82b6-6f8af938e058 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.495411 Oct 28 19:09:19.192145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 245/487] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:09:19.223438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:19.230128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:19.261452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:19.262144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:19.264678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:19.265955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:19.270215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:19.272224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:19.903121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:19.915669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d614486-e852-4cc3-9457-b8975bd61d9a tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1321 microversion: 2.1 time: 0.719342 Oct 28 19:09:19.916880 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 246/488] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:19 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1321 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:19.924496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:19.925102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:19.955735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:19.956254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:19.956693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:19.957409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:19.957860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:19.958271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.442774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:20.454278 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a38d899f-3218-43be-8736-b134b7c1ba60 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1313 microversion: 2.1 time: 0.533597 Oct 28 19:09:20.463941 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 247/489] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:19 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:20.488180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:20.491071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:20.516687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.519131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.523528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.524617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.525296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.525997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.936097 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-945db939-6345-4131-be8d-ca4139c6318c tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1643 microversion: 2.1 time: 0.469917 Oct 28 19:09:20.938121 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 248/490] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:20 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1643 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:20.943993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:20.944873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:20.954470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.955479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.956158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.957074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.957749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.959137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.072866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:21.083107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:21.084537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:21.085648 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b73de015-f839-44bb-9760-4d8e20473680 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1319 microversion: 2.25 time: 0.146235 Oct 28 19:09:21.086350 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 249/491] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:20 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:21.114875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f9743afd-f69c-463b-97c2-342689c00f32 req-17658b77-7186-49b6-9416-458e62e1d292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b9d8c7-fd45-4793-8005-48a329af61fc", "name": "network-vif-plugged", "status": "completed", "tag": "acb14376-c9d5-489b-91db-914a95c06be3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:21.129483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f9743afd-f69c-463b-97c2-342689c00f32 req-17658b77-7186-49b6-9416-458e62e1d292 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.131080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f9743afd-f69c-463b-97c2-342689c00f32 req-17658b77-7186-49b6-9416-458e62e1d292 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.131744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f9743afd-f69c-463b-97c2-342689c00f32 req-17658b77-7186-49b6-9416-458e62e1d292 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.146666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f9743afd-f69c-463b-97c2-342689c00f32 req-17658b77-7186-49b6-9416-458e62e1d292 service nova] Creating event network-vif-plugged:acb14376-c9d5-489b-91db-914a95c06be3 for instance 98b9d8c7-fd45-4793-8005-48a329af61fc on n-h2-862769-3 Oct 28 19:09:21.173070 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f9743afd-f69c-463b-97c2-342689c00f32 req-17658b77-7186-49b6-9416-458e62e1d292 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070324 Oct 28 19:09:21.173668 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 250/492] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:21.179778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:21.180511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:21.195043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.195582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.196022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.196734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.197831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.198272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.881975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:21.892774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-691e6c9e-942f-4712-a95e-90a4c4a68641 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1320 microversion: 2.1 time: 0.717743 Oct 28 19:09:21.893724 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 251/493] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:21 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1320 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:21.906622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ff24aa9e-760e-4e00-90ec-78cde70d55ef req-33ff061e-015a-4133-ac8d-bb2f7648de6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831d5ec9-b916-4990-84b9-8750b7b09827", "name": "network-vif-deleted", "tag": "d197f992-5d98-43d0-bd9c-b28888bacc66"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:21.921565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ff24aa9e-760e-4e00-90ec-78cde70d55ef req-33ff061e-015a-4133-ac8d-bb2f7648de6a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.922047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ff24aa9e-760e-4e00-90ec-78cde70d55ef req-33ff061e-015a-4133-ac8d-bb2f7648de6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.922475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ff24aa9e-760e-4e00-90ec-78cde70d55ef req-33ff061e-015a-4133-ac8d-bb2f7648de6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.946104 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ff24aa9e-760e-4e00-90ec-78cde70d55ef req-33ff061e-015a-4133-ac8d-bb2f7648de6a service nova] Creating event network-vif-deleted:d197f992-5d98-43d0-bd9c-b28888bacc66 for instance 831d5ec9-b916-4990-84b9-8750b7b09827 on n-h1-862769-3 Oct 28 19:09:21.958180 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ff24aa9e-760e-4e00-90ec-78cde70d55ef req-33ff061e-015a-4133-ac8d-bb2f7648de6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063121 Oct 28 19:09:21.958820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 252/494] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:21.967914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:21.977735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:21.991694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.994860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.995562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.002870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.003549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.004188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.311031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:22.344368 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e42f8c3-4c98-4021-8ef2-56f7c26c4b49 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1282 microversion: 2.1 time: 0.377409 Oct 28 19:09:22.370240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 253/495] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:21 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1282 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:22.387185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:22.388115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:22.409872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.410712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.411745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.412848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.413506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.414621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.613314 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2ecba94-4937-485e-a344-c5126592510e tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.945684 Oct 28 19:09:22.614534 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 243/496] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:09:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:22.619992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:22.621011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:22.641073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.642852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.645326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.646107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.646576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.647091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.979950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:22.994083 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6dfdfaac-8420-4215-893d-0497cfd2af5c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1389 microversion: 2.1 time: 0.622549 Oct 28 19:09:22.996094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 254/497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:22 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1389 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:23.001611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.003057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:23.016935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.017772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.018430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.019515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.020286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.021005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.065315 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8447d0e0-9167-4621-8dbc-dcba09a06ac9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1643 microversion: 2.1 time: 0.449430 Oct 28 19:09:23.065906 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 244/498] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:22 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1643 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:23.093147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.093752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:23.121614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.122138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.123344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.129206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.129742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.130188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.350415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:23.359537 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28739c9b-7d40-4b13-a90d-2913bc983ce8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1313 microversion: 2.1 time: 0.362217 Oct 28 19:09:23.375929 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 255/499] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:22 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:23.383592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1faee51d-26ab-4c7c-953e-8c7d45d55ea6 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Action: 'create', calling method: .version_select at 0x7f1d7c21f940>, body: {"pool": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:23.489114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:23.502255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:23.503848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:23.505411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3cfffd8-7921-448e-b2fd-2fbc87b885e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1361 microversion: 2.25 time: 0.418706 Oct 28 19:09:23.506202 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 245/500] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1361 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:23.511188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.512166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:23.529166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.529990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.530625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.531549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.532199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.533123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.800824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:23.812965 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-64b7e4f7-0999-4a7c-ac72-3af1f976d549 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1320 microversion: 2.1 time: 0.305336 Oct 28 19:09:23.814021 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 246/501] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:23.818934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.823391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.824048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.824623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.825659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.826252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.826849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.859118 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b47c5b7-33a8-435a-a6e5-397a9c8df677 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043708 Oct 28 19:09:23.860194 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 247/502] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:23.865051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.866046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:23.875253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.876162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.876897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.878540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.879003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.879498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.513810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:24.524150 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75cc71d5-5af3-4c3a-86eb-7559fd7b7ce3 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1324 microversion: 2.1 time: 0.662323 Oct 28 19:09:24.525621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 248/503] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1324 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:24.693451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-886009390", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:24.758983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:24.759402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:24.759992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:24.760396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:24.760968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:24.772415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.773024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.773699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.774511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.775758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.776541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.796750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Getting quotas for project 9d4713b9094941c5a10b080a37d1edef. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:24.803466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Getting quotas for user 86ab55a22b59402f8e85da092e389e39 and project 9d4713b9094941c5a10b080a37d1edef. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:24.818594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:24.821399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:24.876229 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da73cc32-858b-4c38-8282-e2904dedf2c2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.348830 Oct 28 19:09:24.877379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 249/504] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:09:24.883493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:24.884324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:24.903383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.903962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.904478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.905418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.917306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.921195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.009225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69ad2c21-f3b1-48a2-bf84-eedf3800e79b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5/action" status: 202 len: 0 microversion: 2.1 time: 0.129892 Oct 28 19:09:25.010414 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 250/505] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:24 2022] POST /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:25.042163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.044179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:25.066637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.067380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.067854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.068582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.069096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.069458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.339505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.356491 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f6f9669-3758-463a-b734-ecad5ea62ee6 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1389 microversion: 2.1 time: 0.341202 Oct 28 19:09:25.357228 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 251/506] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1389 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:25.363616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-be33e361-deaf-42fc-9e39-3d2db0cb7ab1 req-67de7740-c0f3-4b82-b05a-50ecfc522f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9", "tag": "d6dc4cb8-995e-4b93-816e-975d11150f2b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:25.385240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be33e361-deaf-42fc-9e39-3d2db0cb7ab1 req-67de7740-c0f3-4b82-b05a-50ecfc522f77 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.385789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be33e361-deaf-42fc-9e39-3d2db0cb7ab1 req-67de7740-c0f3-4b82-b05a-50ecfc522f77 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.386424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be33e361-deaf-42fc-9e39-3d2db0cb7ab1 req-67de7740-c0f3-4b82-b05a-50ecfc522f77 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.400163 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-be33e361-deaf-42fc-9e39-3d2db0cb7ab1 req-67de7740-c0f3-4b82-b05a-50ecfc522f77 service nova] Creating event network-changed:d6dc4cb8-995e-4b93-816e-975d11150f2b for instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 on n-h1-862769-3 Oct 28 19:09:25.406482 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-be33e361-deaf-42fc-9e39-3d2db0cb7ab1 req-67de7740-c0f3-4b82-b05a-50ecfc522f77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047717 Oct 28 19:09:25.407991 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 252/507] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:25.417208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.418017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:25.427695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.428466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.429113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.430095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.430842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.431657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.677177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.686080 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a2b767b-b69b-4c66-82b7-82a6643fb24a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1463 microversion: 2.1 time: 0.276690 Oct 28 19:09:25.686639 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 253/508] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:25.692126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.692729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:25.706056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:25.707653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.708559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.709730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.710788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.711661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.712110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.802509 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1faee51d-26ab-4c7c-953e-8c7d45d55ea6 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.424484 Oct 28 19:09:25.811878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 256/509] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:09:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:25.817571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.819004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:25.827978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.828479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.828915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.829626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.830151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.830792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.884051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.894051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.895656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.898109 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc1dbcae-8365-4a3b-9695-b2748f94a5d1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1361 microversion: 2.25 time: 0.210249 Oct 28 19:09:25.898793 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 254/510] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:25.906064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.907062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:25.921055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.921886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.922324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.923264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.923887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.924312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.971669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.980310 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3156f4ea-eacb-44b3-bc36-b7b9c1f70b67 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1320 microversion: 2.1 time: 0.167027 Oct 28 19:09:25.981374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 257/511] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:25.987269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2c5f5af4-35fe-4cfc-88ab-6de071639a69 req-c6e3b38c-3b24-4e0d-bbbe-81e3c3311fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e779b9-4e72-4124-838a-8e428fc2bd29", "tag": "1fa7cc0b-ccb9-4372-b67c-befe8c316492"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:25.998609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2c5f5af4-35fe-4cfc-88ab-6de071639a69 req-c6e3b38c-3b24-4e0d-bbbe-81e3c3311fe1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.999361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2c5f5af4-35fe-4cfc-88ab-6de071639a69 req-c6e3b38c-3b24-4e0d-bbbe-81e3c3311fe1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.999861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2c5f5af4-35fe-4cfc-88ab-6de071639a69 req-c6e3b38c-3b24-4e0d-bbbe-81e3c3311fe1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.011245 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2c5f5af4-35fe-4cfc-88ab-6de071639a69 req-c6e3b38c-3b24-4e0d-bbbe-81e3c3311fe1 service nova] Creating event network-changed:1fa7cc0b-ccb9-4372-b67c-befe8c316492 for instance 37e779b9-4e72-4124-838a-8e428fc2bd29 on n-h1-862769-3 Oct 28 19:09:26.016419 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2c5f5af4-35fe-4cfc-88ab-6de071639a69 req-c6e3b38c-3b24-4e0d-bbbe-81e3c3311fe1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033363 Oct 28 19:09:26.017583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 258/512] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:26.024155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:26.025072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:26.031755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.032361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.032894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.033658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.034176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.034656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.039048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:26.049601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.052249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:26.061658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.064709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.073786 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dfb1bac5-7297-422f-8e97-baa35bf32ad5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1504 microversion: 2.91 time: 0.172912 Oct 28 19:09:26.074373 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 255/513] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:26.079441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:26.080306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:26.086722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.087473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.088100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.088988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.090026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.090642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.218264 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba52db8d-f4ce-4c11-8197-b9073bbc5af4 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1628 microversion: 2.1 time: 0.198955 Oct 28 19:09:26.218861 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 259/514] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:26 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1628 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:26.225328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:26.228533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:26.237580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.238077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.238481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.239685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.240144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.240565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.247222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.255218 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99364b0f-e221-4e29-849a-eee7d80f6b71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1324 microversion: 2.1 time: 0.179557 Oct 28 19:09:26.255975 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 256/515] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:26 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1324 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:26.260245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dee0b181-07f2-438c-b22b-46f4a0abc24d tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Action: 'create', calling method: .version_select at 0x7f1d7c438040>, body: {"pool": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:26.358910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.370996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Old instance type m1.heat2, new instance type m1.heat {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:09:26.381501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:26.382710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:26.383348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:26.383901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:26.384491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:26.518743 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-013fa651-9cbc-4d91-bbae-88c6c52f28cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc/action" status: 202 len: 0 microversion: 2.1 time: 0.298349 Oct 28 19:09:26.523810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 260/516] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:26 2022] POST /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:26.530125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-3", "block_migration": true, "disk_over_commit": false}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:26.532634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:26.541556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.542273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.542939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.544094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.544737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.545341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.576839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lazy-loading 'flavor' on Instance uuid c725ea7f-facb-47c1-94c4-15b43b75fcd5 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:26.597721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Going to try to live migrate instance to n-h1-862769-3 {{(pid=120629) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:09:28.058397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dee0b181-07f2-438c-b22b-46f4a0abc24d tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.801306 Oct 28 19:09:28.059169 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 257/517] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:09:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:28.065645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.066613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.072058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26a2035e-5b2b-4e3e-91e6-8bb8bb30fc87 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5/action" status: 202 len: 0 microversion: 2.1 time: 1.546692 Oct 28 19:09:28.072652 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 261/518] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:26 2022] POST /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5/action => generated 0 bytes in 1548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:28.077524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.078141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.081999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.084490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.085201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.087613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.089126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:28.089584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.090283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.099055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.099942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.101612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.103414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.104869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.105560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.347936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.353247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.363204 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65d6f886-3312-470d-8aca-e8709b2c9b16 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1389 microversion: 2.1 time: 0.302412 Oct 28 19:09:28.364786 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 258/519] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1389 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:28.369851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.370456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.372391 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2043a59c-8b64-4009-b35e-c9d5bf46ab47 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1472 microversion: 2.1 time: 0.297562 Oct 28 19:09:28.373749 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 262/520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:28.385070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.386088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.386578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.388538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.393490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.394387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.394940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.395403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.400145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.401547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.402711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.404579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.405361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.406516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.651429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.681996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.682263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.687043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.690269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2a6b2ed-7260-4f3e-a92b-3b5e5e85bbde tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1361 microversion: 2.25 time: 0.323373 Oct 28 19:09:28.692000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ebb5651-e60d-4002-b5b1-b231f33253bd tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1320 microversion: 2.1 time: 0.316314 Oct 28 19:09:28.693029 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 259/521] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:28.698488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 263/522] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:28.715704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.716583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.716874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.717679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.723392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.724069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.724519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.725520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.725706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.726177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.726575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.726726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.727329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.728276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.728900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.729480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.828444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.845021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:28.859065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.874277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.885611 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f59d421-27d6-48bc-9bbb-6cdb3531e99e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1510 microversion: 2.91 time: 0.178385 Oct 28 19:09:28.886677 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 260/523] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:28.892780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80", "tag": "cd16c7b0-8e25-407f-bbb3-31e955ef9ab9"}, {"name": "network-changed", "server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:28.922931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.927775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.931670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.963990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] Creating event network-changed:cd16c7b0-8e25-407f-bbb3-31e955ef9ab9 for instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 on n-h1-862769-3 Oct 28 19:09:28.965061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] Creating event network-changed:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:09:28.977177 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c322c5d4-808f-4d52-a9e4-aceccd47920f req-1968b112-f77e-4314-b917-44a961d91dcb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089164 Oct 28 19:09:28.980289 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 261/524] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:28.982818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=11 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:29.004889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06c5e9ed-c629-4a52-8e9f-425dffb925e6 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Action: 'create', calling method: .version_select at 0x7f1d7c38dca0>, body: {"pool": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:29.369152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:29.381265 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1d13e911-2ceb-4224-a909-9361a23e2327 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1324 microversion: 2.1 time: 0.681343 Oct 28 19:09:29.382252 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 264/525] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1324 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:29.387111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:29.387881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:29.395049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.396103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.396867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:29.397730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.398337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.398936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:29.692772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:29.703185 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c1f3ce31-fb62-4dbb-8f6f-5073a9dd0077 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1502 microversion: 2.1 time: 0.319617 Oct 28 19:09:29.717548 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 265/526] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:29 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:29.720450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-58944ab4-bf08-4d43-b788-cd5320a364c3 req-001bb062-b5d6-40cc-bb99-ce65a1353384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9", "name": "network-vif-plugged", "status": "completed", "tag": "d6dc4cb8-995e-4b93-816e-975d11150f2b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:29.737940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-58944ab4-bf08-4d43-b788-cd5320a364c3 req-001bb062-b5d6-40cc-bb99-ce65a1353384 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.738419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-58944ab4-bf08-4d43-b788-cd5320a364c3 req-001bb062-b5d6-40cc-bb99-ce65a1353384 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.738870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-58944ab4-bf08-4d43-b788-cd5320a364c3 req-001bb062-b5d6-40cc-bb99-ce65a1353384 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:29.806590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-58944ab4-bf08-4d43-b788-cd5320a364c3 req-001bb062-b5d6-40cc-bb99-ce65a1353384 service nova] Creating event network-vif-plugged:d6dc4cb8-995e-4b93-816e-975d11150f2b for instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 on n-h1-862769-3 Oct 28 19:09:29.820357 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-58944ab4-bf08-4d43-b788-cd5320a364c3 req-001bb062-b5d6-40cc-bb99-ce65a1353384 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101813 Oct 28 19:09:29.822518 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 266/527] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:29.856416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:29.858177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:29.866298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.867156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.870025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:29.871091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.872545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.873368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.290144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:30.302234 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b964111-967c-4ef7-8289-0f0bd9661891 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1389 microversion: 2.1 time: 0.478163 Oct 28 19:09:30.303151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 267/528] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:29 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1389 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:30.325200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:30.325927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:30.333728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.334429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.335000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.336975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.337654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.338443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.704414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:30.721768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdc56afe-a2c2-431d-9b97-00687369e402 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1472 microversion: 2.1 time: 0.400653 Oct 28 19:09:30.723063 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 268/529] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:30 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:30.730089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:30.731418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:30.740388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.742070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.742810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.744135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.746135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.746856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.032317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.041062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.042774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.044171 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9d237ca-7294-4cdd-91d5-2235df2e7361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1361 microversion: 2.25 time: 0.319277 Oct 28 19:09:31.055109 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 269/530] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:30 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:31.067843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:31.068746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:31.075868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.076520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.077099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.077974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.078574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.079162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.322445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.330400 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71201d13-dbcb-4b33-9c84-7b2a94bc3b27 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1320 microversion: 2.1 time: 0.273953 Oct 28 19:09:31.331103 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 270/531] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:31.335962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:31.336681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:31.343397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.344093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.344740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.345636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.346267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.346897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.715713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.725910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.727612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.734837 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-167dcad6-33ff-4eb2-8565-4eab08475ad0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1531 microversion: 2.91 time: 0.402505 Oct 28 19:09:31.735513 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 271/532] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1531 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:31.761563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:31.762098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:31.764320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06c5e9ed-c629-4a52-8e9f-425dffb925e6 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.782335 Oct 28 19:09:31.772812 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 262/533] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:09:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:31.773122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.773122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.773122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.773122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.773495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.773495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.776919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:31.777749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:31.784744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.785317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.785808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.786557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.787109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.787614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.983769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.987982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.991692 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a61dc00e-93f6-43a7-b736-eb7d11cdc7d8 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1324 microversion: 2.1 time: 0.243515 Oct 28 19:09:31.992269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 272/534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:31.995961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3be701fc-2e33-40e8-958f-d30ec1b286bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1502 microversion: 2.1 time: 0.229076 Oct 28 19:09:31.996515 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 263/535] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:32.001056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.001656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.007379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.007857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.008469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.009151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.009599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.010011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.011596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e38019ae-e636-4520-bd2f-d9eff4621603 req-9466cfaf-437d-4e92-a4f9-899274ce6c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c725ea7f-facb-47c1-94c4-15b43b75fcd5", "name": "network-vif-unplugged", "status": "completed", "tag": "ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:32.023159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e38019ae-e636-4520-bd2f-d9eff4621603 req-9466cfaf-437d-4e92-a4f9-899274ce6c85 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.023724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e38019ae-e636-4520-bd2f-d9eff4621603 req-9466cfaf-437d-4e92-a4f9-899274ce6c85 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.024254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e38019ae-e636-4520-bd2f-d9eff4621603 req-9466cfaf-437d-4e92-a4f9-899274ce6c85 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.028687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:32.036566 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e38019ae-e636-4520-bd2f-d9eff4621603 req-9466cfaf-437d-4e92-a4f9-899274ce6c85 service nova] Creating event network-vif-unplugged:ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0 for instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 on n-h2-862769-3 Oct 28 19:09:32.041763 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e38019ae-e636-4520-bd2f-d9eff4621603 req-9466cfaf-437d-4e92-a4f9-899274ce6c85 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033866 Oct 28 19:09:32.042397 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 273/536] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:32.047595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.048353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.054985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.055508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.055942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.056642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.057097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.057518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.193618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.202620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5325c718-594a-4e41-88ee-343f3f81f400 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1389 microversion: 2.1 time: 0.205022 Oct 28 19:09:32.203305 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 264/537] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1389 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:32.222961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.232755 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6ebc3b8-7d83-4456-8f52-8c84497adbed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.189174 Oct 28 19:09:32.233359 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 274/538] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:32.237764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7de8541c-9f8a-47a0-aef6-b47be41fac46 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c177820>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.259326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.259989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.265892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.266401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.266855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.267533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.267975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.268388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.408365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lazy-loading 'services' on Instance uuid c5e35a18-e0b7-432b-9139-2afe6f9be925 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:32.425571 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1bd78f89-934b-4cfa-8ac5-fb67cbf969bf tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1936 microversion: 2.91 time: 0.221094 Oct 28 19:09:32.426154 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 265/539] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1936 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:32.430562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80", "name": "network-vif-plugged", "status": "completed", "tag": "cd16c7b0-8e25-407f-bbb3-31e955ef9ab9"}, {"server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "name": "network-vif-plugged", "status": "completed", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:32.440870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.441340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.441761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.454432 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] Creating event network-vif-plugged:cd16c7b0-8e25-407f-bbb3-31e955ef9ab9 for instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 on n-h1-862769-3 Oct 28 19:09:32.454977 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] Creating event network-vif-plugged:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:09:32.462401 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7de8541c-9f8a-47a0-aef6-b47be41fac46 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips/be21e0c3-3737-4ebf-88dc-1d9107a68f0e" status: 200 len: 142 microversion: 2.1 time: 0.228034 Oct 28 19:09:32.462930 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-47b56c24-f856-48c8-97dd-ddbab0ae9180 req-95877376-d0d0-46f5-af7d-b01ebcca09a7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035629 Oct 28 19:09:32.463057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 275/540] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/os-floating-ips/be21e0c3-3737-4ebf-88dc-1d9107a68f0e => generated 142 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:32.463905 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 266/541] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:32.468874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.469423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.475891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.476565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.477219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.478138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.478593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.479032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.479610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.480229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.490378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.490902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.491338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.492135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.492587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.492997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.732630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.740872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-496b2d86-f80f-40af-b043-106087371977 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1469 microversion: 2.1 time: 0.275944 Oct 28 19:09:32.741438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 267/542] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:32.745731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.746516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.754078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.760178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.760670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.761114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.761803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.762246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.762388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.762665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.763790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.764883 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-254c0848-ccdc-4242-be15-320b696df135 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1361 microversion: 2.25 time: 0.300933 Oct 28 19:09:32.765400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 276/543] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:32.769997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56492e0a-14d6-491a-a761-4971cf6889c0 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c21fd30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.854159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lazy-loading 'services' on Instance uuid c5e35a18-e0b7-432b-9139-2afe6f9be925 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:32.872088 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ac4dd02-98be-4fbf-a7a0-213c8c9b1e03 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1936 microversion: 2.91 time: 0.129612 Oct 28 19:09:32.872690 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 268/544] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1936 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:32.877287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:32.879431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:32.885882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.886367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.886829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.887514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.887963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.888373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.969013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b35daf4d-851c-4f86-8a8e-9026aedb7466 tempest-DeleteServersAdminTestJSON-1431352868 tempest-DeleteServersAdminTestJSON-1431352868-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.095230 Oct 28 19:09:32.969696 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 269/545] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:32 2022] POST /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:32.974438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.978066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.978550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.979004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.979809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.980184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.980600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.003392 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bfea58d2-9ca7-424f-b9f7-33aef691afd4 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.032391 Oct 28 19:09:33.003981 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 270/546] 10.222.0.44 () {60 vars in 1217 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:09:33.008486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.009090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.016967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.017413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.017954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.018708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.019265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.019940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.053776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.054240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.054665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.055130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lazy-loading 'fault' on Instance uuid 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:33.291547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:33.299749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2fbbd9f5-2ef7-4bf5-9f40-fe03a383f365 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1452 microversion: 2.1 time: 0.294813 Oct 28 19:09:33.300507 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 271/547] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1452 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:33.318531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:33.319087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.325257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.325745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.326173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.326900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.327493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.327779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.351399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lazy-loading 'flavor' on Instance uuid c5e35a18-e0b7-432b-9139-2afe6f9be925 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:33.426767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:33.583310 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-413d328f-84a1-4013-8c1f-00dabb8375c3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action" status: 202 len: 0 microversion: 2.91 time: 0.268700 Oct 28 19:09:33.587101 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 272/548] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:09:33 2022] POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:33.587238 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56492e0a-14d6-491a-a761-4971cf6889c0 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/be21e0c3-3737-4ebf-88dc-1d9107a68f0e" status: 202 len: 0 microversion: 2.1 time: 0.818973 Oct 28 19:09:33.587238 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 277/549] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:09:32 2022] DELETE /compute/v2.1/os-floating-ips/be21e0c3-3737-4ebf-88dc-1d9107a68f0e => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:33.589808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.590052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.590726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.591389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.597234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.597764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.598187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.598908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.599010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.599351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.599450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.599807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.599917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.600530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.600980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.601398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.794340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:33.796849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:33.802875 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cfd097f4-3dcc-4000-965a-1f23b28984be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1324 microversion: 2.1 time: 0.217518 Oct 28 19:09:33.803549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 273/550] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:33.808325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.808988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.815090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.815660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.816150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.816933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.817438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.817922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.819128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-455af5b6-3dc5-4deb-b4b6-d7b5bafe06bb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1502 microversion: 2.1 time: 0.231930 Oct 28 19:09:33.819728 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 278/551] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:33.824434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.825219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:33.831533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.832234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.832826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.833673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.834351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.834955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.034218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.036718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.043482 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05d1f602-55eb-42a0-a9d9-bf90f9677aed tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1389 microversion: 2.1 time: 0.238796 Oct 28 19:09:34.044077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 274/552] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1389 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:34.044777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6cce9d26-aa21-412c-81a6-135d0dcff5e5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.223830 Oct 28 19:09:34.045304 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 279/553] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:34.048868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.049361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.055781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.056370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.056897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.057809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.058140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.058581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.059069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.059202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.065145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.065629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.066055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.066754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.067203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.067615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.084251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:09:34.133888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.144806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.146567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.152697 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f24600ef-18ae-448a-81e8-0be4d9db9de9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.106286 Oct 28 19:09:34.153575 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 280/554] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:34.158591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b85fbe0-78f0-4f06-8196-eb055e4c45ef tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c0a13a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.186818 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-779231ab-c8c2-4e7a-baa3-7a5b0f580a4d tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 204 len: 0 microversion: 2.1 time: 0.141424 Oct 28 19:09:34.187507 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 275/555] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:34 2022] DELETE /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:34.192848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.193582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.199625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.200105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.200605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.201298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.201777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.202197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.403691 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b85fbe0-78f0-4f06-8196-eb055e4c45ef tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.249120 Oct 28 19:09:34.404243 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 281/556] 10.222.0.44 () {58 vars in 1164 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:09:34.414316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b5981cb5-a665-42ce-a4da-09d868bd988c req-e293354d-3829-45df-a007-5aa8f6be6362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c725ea7f-facb-47c1-94c4-15b43b75fcd5", "tag": "ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:34.423959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b5981cb5-a665-42ce-a4da-09d868bd988c req-e293354d-3829-45df-a007-5aa8f6be6362 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.424445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b5981cb5-a665-42ce-a4da-09d868bd988c req-e293354d-3829-45df-a007-5aa8f6be6362 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.424953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b5981cb5-a665-42ce-a4da-09d868bd988c req-e293354d-3829-45df-a007-5aa8f6be6362 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.427961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.436300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.436616 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b5981cb5-a665-42ce-a4da-09d868bd988c req-e293354d-3829-45df-a007-5aa8f6be6362 service nova] Creating event network-changed:ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0 for instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 on n-h2-862769-3 Oct 28 19:09:34.437880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.439071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-623a9db8-4a9c-4494-aa78-3923d6d138e1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1361 microversion: 2.25 time: 0.250378 Oct 28 19:09:34.439738 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 276/557] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:34.441916 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b5981cb5-a665-42ce-a4da-09d868bd988c req-e293354d-3829-45df-a007-5aa8f6be6362 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031416 Oct 28 19:09:34.442639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 282/558] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:34.444596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.445092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.447585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0d7143b-2925-4439-9075-cc7b2eb35e42 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c28c1f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.451185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.451664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.452142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.452832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.453278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.453709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.485681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.486170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.486602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.487079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lazy-loading 'fault' on Instance uuid 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:34.796248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6c5e19c04148ceb2903f8bbb617550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d394b3626a64b55847ca2da79aeeef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:34.804211 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-012e0088-5551-4967-88ad-6539c792d26c tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 200 len: 1458 microversion: 2.1 time: 0.363613 Oct 28 19:09:34.804992 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 277/559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 1458 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:34.809577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-25cc01a6-b216-42ee-bb3a-b116fb756523 req-333b9388-9be2-409f-b441-d299c8132daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e779b9-4e72-4124-838a-8e428fc2bd29", "name": "network-vif-plugged", "status": "completed", "tag": "1fa7cc0b-ccb9-4372-b67c-befe8c316492"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:34.814543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=17 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:34.824130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-25cc01a6-b216-42ee-bb3a-b116fb756523 req-333b9388-9be2-409f-b441-d299c8132daa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.824602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-25cc01a6-b216-42ee-bb3a-b116fb756523 req-333b9388-9be2-409f-b441-d299c8132daa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.825019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-25cc01a6-b216-42ee-bb3a-b116fb756523 req-333b9388-9be2-409f-b441-d299c8132daa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.835554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0d7143b-2925-4439-9075-cc7b2eb35e42 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.391864 Oct 28 19:09:34.836235 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 283/560] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:34.842298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.843040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.845476 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-25cc01a6-b216-42ee-bb3a-b116fb756523 req-333b9388-9be2-409f-b441-d299c8132daa service nova] Creating event network-vif-plugged:1fa7cc0b-ccb9-4372-b67c-befe8c316492 for instance 37e779b9-4e72-4124-838a-8e428fc2bd29 on n-h1-862769-3 Oct 28 19:09:34.850733 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-25cc01a6-b216-42ee-bb3a-b116fb756523 req-333b9388-9be2-409f-b441-d299c8132daa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044529 Oct 28 19:09:34.851300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.851670 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 278/561] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:34.851978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.852474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.853324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.853991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.854464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.860160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:34.861085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:34.867358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.867843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.868264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:34.868958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:34.869435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:34.869850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:35.120186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:35.128525 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0491ffba-5dd6-4e97-88b9-13a6e21ef9cb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1520 microversion: 2.1 time: 0.290771 Oct 28 19:09:35.129292 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 284/562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:35.134084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb45672c-65dc-4e48-8c01-5f4ec706327a tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c1559d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:35.186550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:35.194961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a46f38d-29fd-4821-be56-e284012202ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1502 microversion: 2.1 time: 0.338819 Oct 28 19:09:35.206910 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 279/563] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:34 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1502 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:35.206910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:35.206910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:35.207735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:35.208224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:35.208651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:35.209349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:35.209854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:35.210270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:35.749899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:35.758873 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49fa9929-2ef2-4b60-b075-b1a892bf8505 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1588 microversion: 2.1 time: 0.561610 Oct 28 19:09:35.770717 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 280/564] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:35 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1588 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:35.779363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:35.779363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:35.785638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:35.786128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:35.786554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:35.787262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:35.787734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:35.788144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:36.109375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:36.118382 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-665c0c92-7cb1-4394-94df-aa901a3a213f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.357387 Oct 28 19:09:36.119278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 281/565] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:35 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:36.124125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-640caccf-ca38-44ec-bc43-15edd6fcba9a tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'create', calling method: .version_select at 0x7f1d7c2a7af0>, body: {"pool": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:36.959666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb45672c-65dc-4e48-8c01-5f4ec706327a tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/d67a2843-2ab8-4963-a2c4-07d58205533e" status: 202 len: 0 microversion: 2.1 time: 1.829017 Oct 28 19:09:36.960438 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 285/566] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:09:35 2022] DELETE /compute/v2.1/os-floating-ips/d67a2843-2ab8-4963-a2c4-07d58205533e => generated 0 bytes in 1830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:36.965220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:36.965830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:36.972314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:36.972801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:36.973235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:36.973932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:36.974368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:36.974827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.058316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.067187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.068937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.074423 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-05a0fec2-7e03-4114-8e1f-a1a020050322 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.112795 Oct 28 19:09:37.086971 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 286/567] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:36 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:37.095973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:37.096591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:37.104502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.104984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.105413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.106101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.106735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.107180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.431402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.439944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.441482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.442797 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-988f7ba9-dfe3-445d-af64-fbd66da6664b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1557 microversion: 2.25 time: 0.354775 Oct 28 19:09:37.443694 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 287/568] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:37 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1557 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:37.450501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:37.451424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:37.459271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.459767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.460337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.460891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.461336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.461940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.597433 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4df82d82-f929-4465-874c-f323c728bd3c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152175 Oct 28 19:09:37.598664 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 288/569] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:09:37 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:37.610639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:37.611273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:37.617794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.618278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.618820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.619788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.620348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.620782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.635725 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] HTTP exception thrown: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Request method failure captured: Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 HTTP/1.1 Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCi7ebMc8JyJSVagkjJhXLRNODmAOTBRG-IGE4eONHoM-SWweCaW0E_mVz3D3jtls9YsSEsHWz8nqahUnEnJtVrfwJwbCwX-Vbi5DLpwW1HpzHlXNc9Nqcyl89MfYcxypmcbJ_wy45bLpdOf2N_JjgvZpN3Ykmp9VNiNWhwpk7OSXfQ Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:37.637397 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d394b3626a64b55847ca2da79aeeef1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3c6c5e19c04148ceb2903f8bbb617550 Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:37.639071 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9'} Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:37.639968 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:37.641527 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:37.642823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Returning 404 to user: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:37.642823 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9872064-d03b-4731-a9e5-209d822c4800 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 404 len: 111 microversion: 2.1 time: 0.034303 Oct 28 19:09:37.647089 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 289/570] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:37 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:37.650724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:37.651322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:37.657382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.657919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.658543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.659433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.660051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.660481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:37.955352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:37.963645 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97b64cc1-a7f5-40e8-af06-9be0ad6d3f61 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1502 microversion: 2.1 time: 0.316605 Oct 28 19:09:37.977768 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 290/571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:37 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:37.983548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c77b7738-2f65-4c7b-8db7-31359857ba52 req-50da884a-65f2-4d0a-9359-06518cc9deea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9", "name": "network-vif-deleted", "tag": "d6dc4cb8-995e-4b93-816e-975d11150f2b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:37.993593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c77b7738-2f65-4c7b-8db7-31359857ba52 req-50da884a-65f2-4d0a-9359-06518cc9deea service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:37.994213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c77b7738-2f65-4c7b-8db7-31359857ba52 req-50da884a-65f2-4d0a-9359-06518cc9deea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:37.994733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c77b7738-2f65-4c7b-8db7-31359857ba52 req-50da884a-65f2-4d0a-9359-06518cc9deea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:38.006569 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c77b7738-2f65-4c7b-8db7-31359857ba52 req-50da884a-65f2-4d0a-9359-06518cc9deea service nova] Creating event network-vif-deleted:d6dc4cb8-995e-4b93-816e-975d11150f2b for instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 on n-h1-862769-3 Oct 28 19:09:38.013125 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c77b7738-2f65-4c7b-8db7-31359857ba52 req-50da884a-65f2-4d0a-9359-06518cc9deea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Oct 28 19:09:38.014139 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 291/572] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:38.025687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c19a8ec-1503-414f-95cb-39cda170774e tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c21dd30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:38.487741 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-640caccf-ca38-44ec-bc43-15edd6fcba9a tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.366533 Oct 28 19:09:38.502315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 282/573] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:09:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:38.508194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:38.509769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:38.519014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:38.520367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:38.521158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:38.546719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:38.551937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:38.552834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:38.833825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:38.843891 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6059403b-af52-4ef2-9df4-1e442823ef63 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.340324 Oct 28 19:09:38.845089 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 283/574] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:38 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:38.850545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:38.852163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:38.864967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:38.865674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:38.866101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:38.866996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:38.867442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:38.868026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.101001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 37e779b9-4e72-4124-838a-8e428fc2bd29 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:39.116953 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6fe9b441-620f-45a4-a93e-fe9b156d421b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 2049 microversion: 2.25 time: 0.269862 Oct 28 19:09:39.118588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 284/575] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:38 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 2049 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:39.123261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:39.124082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:39.144052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.144543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.144971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.145685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.146190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.146608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.166915 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] HTTP exception thrown: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Request method failure captured: Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 HTTP/1.1 Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi7ebMc8JyJSVagkjJhXLRNODmAOTBRG-IGE4eONHoM-SWweCaW0E_mVz3D3jtls9YsSEsHWz8nqahUnEnJtVrfwJwbCwX-Vbi5DLpwW1HpzHlXNc9Nqcyl89MfYcxypmcbJ_wy45bLpdOf2N_JjgvZpN3Ykmp9VNiNWhwpk7OSXfQ Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:09:39.169028 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d394b3626a64b55847ca2da79aeeef1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3c6c5e19c04148ceb2903f8bbb617550 Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:39.170309 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9'} Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:39.171059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:39.172172 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:39.173359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Returning 404 to user: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:39.173359 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8cc5aea2-f041-41a9-a95f-cb9206cb5eed tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 404 len: 111 microversion: 2.1 time: 0.050852 Oct 28 19:09:39.174291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 285/576] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:39 2022] DELETE /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:39.179381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:39.179985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:39.186205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.186680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.187344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.188032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.188742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.189183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.274049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:39.283826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:39.285269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:39.291104 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82543696-eb07-4289-b685-ff520543651d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.115460 Oct 28 19:09:39.291705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 286/577] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:39 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:39.296495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:39.297344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:39.303720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.304204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.304635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.305328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.305777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.306194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.363883 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c19a8ec-1503-414f-95cb-39cda170774e tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/d8a07209-9958-4c4b-8553-d363856afd74" status: 202 len: 0 microversion: 2.1 time: 1.347192 Oct 28 19:09:39.364855 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 292/578] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:09:38 2022] DELETE /compute/v2.1/os-floating-ips/d8a07209-9958-4c4b-8553-d363856afd74 => generated 0 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:39.371307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1410232498", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "eaf8a972-4544-4697-b19b-9248b3c756b9"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:39.450869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] validate_networks() for [('eaf8a972-4544-4697-b19b-9248b3c756b9', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:39.458374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:39.468134 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1110cb4f-f443-4481-9ee3-4d4011eb7182 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1588 microversion: 2.1 time: 0.175109 Oct 28 19:09:39.468964 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 287/579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:39 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1588 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:39.478336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:39.479330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:39.488985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.490076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.492318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.493400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.493935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.494646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.540383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:39.730072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:39.738321 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02517322-0453-4497-9516-e41644cbbf1f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1477 microversion: 2.1 time: 0.267819 Oct 28 19:09:39.739253 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 288/580] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:39 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:39.744726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:39.745702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:39.753838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.754623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.755443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.756435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.756935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.757581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.963385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 37e779b9-4e72-4124-838a-8e428fc2bd29 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:39.976392 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8243df0a-4843-4340-9e06-cbf538d746b9 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 2049 microversion: 2.25 time: 0.235230 Oct 28 19:09:39.976967 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 289/581] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:39 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 2049 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:39.981342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:39.981934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:39.982062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:39.982357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:39.983037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:39.983661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:39.984303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:39.988047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.988526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.989130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.989813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.990256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.990913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.993944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.994585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.995202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:39.996264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:39.996729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:39.997150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.004263 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] HTTP exception thrown: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Request method failure captured: Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 HTTP/1.1 Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCi7ebMc8JyJSVagkjJhXLRNODmAOTBRG-IGE4eONHoM-SWweCaW0E_mVz3D3jtls9YsSEsHWz8nqahUnEnJtVrfwJwbCwX-Vbi5DLpwW1HpzHlXNc9Nqcyl89MfYcxypmcbJ_wy45bLpdOf2N_JjgvZpN3Ykmp9VNiNWhwpk7OSXfQ Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:09:40.005859 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d394b3626a64b55847ca2da79aeeef1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3c6c5e19c04148ceb2903f8bbb617550 Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:40.007249 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9'} Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:40.007940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. Oct 28 19:09:40.009030 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.009988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Returning 404 to user: Instance 5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:40.009988 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70b03a88-6954-4ba6-8bc4-fcaccd96f70a tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9" status: 404 len: 111 microversion: 2.1 time: 0.029365 Oct 28 19:09:40.010783 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 290/582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:39 2022] GET /compute/v2.1/servers/5cdf6596-0b5c-45c5-a186-3c1c8b7fdfe9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:40.014727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Getting quotas for project aa88591c155d44528bf278ff93f3c2e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:40.015176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-555b85d8-afb0-4c48-b62d-2ebfff883db9 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] Calling method '.version_select at 0x7f1d7c1fd1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.019834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Getting quotas for user 0e591cea1b324e78bd62e7e06b1d2623 and project aa88591c155d44528bf278ff93f3c2e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:40.032003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:40.034408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:40.084135 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-739e8a5a-d13b-423b-8b5d-707f190f2019 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717993 Oct 28 19:09:40.085028 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 293/583] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:09:40.089709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b4b32a5-eb90-4b7c-9c31-62313ee2f960 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '.version_select at 0x7f1d7c058b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.093774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b4b32a5-eb90-4b7c-9c31-62313ee2f960 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.094421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b4b32a5-eb90-4b7c-9c31-62313ee2f960 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.094894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b4b32a5-eb90-4b7c-9c31-62313ee2f960 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.107852 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b4b32a5-eb90-4b7c-9c31-62313ee2f960 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.021665 Oct 28 19:09:40.118089 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 294/584] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:09:40 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:40.118089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.118089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:40.121162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.121648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.122076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.122791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.123241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.123651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.333153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:40.344107 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f8c70aa0-c40b-4723-b23d-ddbdcee6c916 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.234278 Oct 28 19:09:40.344963 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 295/585] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:40 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:40.366278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.369965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.370441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.370909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.371643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.372094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.372511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.397008 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4174407a-d379-41cf-8f02-bf8d385081ba tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034267 Oct 28 19:09:40.397950 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 296/586] 10.222.0.44 () {60 vars in 1217 bytes} [Fri Oct 28 19:09:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:09:40.402647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.403159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:40.409436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.409868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.410290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.411041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.411480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.412059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.426771 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] HTTP exception thrown: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Request method failure captured: Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f HTTP/1.1 Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCi7ebMc8JyJSVagkjJhXLRNODmAOTBRG-IGE4eONHoM-SWweCaW0E_mVz3D3jtls9YsSEsHWz8nqahUnEnJtVrfwJwbCwX-Vbi5DLpwW1HpzHlXNc9Nqcyl89MfYcxypmcbJ_wy45bLpdOf2N_JjgvZpN3Ykmp9VNiNWhwpk7OSXfQ Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:40.428698 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d394b3626a64b55847ca2da79aeeef1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3c6c5e19c04148ceb2903f8bbb617550 Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:40.430227 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0fa484dd-a603-4442-8bcb-adb9eb32932f'} Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:40.431182 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:40.432616 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:40.434217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Returning 404 to user: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:40.434217 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a260faf3-d496-45b7-9f6c-1e7cae558504 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 404 len: 111 microversion: 2.1 time: 0.031071 Oct 28 19:09:40.434217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 297/587] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:40 2022] DELETE /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:40.435441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-61c7a4bb-392a-49a7-bbb8-5a23a1e85318 req-b70d60a1-cd05-48f5-bca6-4c984eb671c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80", "tag": "cd16c7b0-8e25-407f-bbb3-31e955ef9ab9"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:40.444818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-61c7a4bb-392a-49a7-bbb8-5a23a1e85318 req-b70d60a1-cd05-48f5-bca6-4c984eb671c8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.445289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-61c7a4bb-392a-49a7-bbb8-5a23a1e85318 req-b70d60a1-cd05-48f5-bca6-4c984eb671c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.445869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-61c7a4bb-392a-49a7-bbb8-5a23a1e85318 req-b70d60a1-cd05-48f5-bca6-4c984eb671c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.457088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-61c7a4bb-392a-49a7-bbb8-5a23a1e85318 req-b70d60a1-cd05-48f5-bca6-4c984eb671c8 service nova] Creating event network-changed:cd16c7b0-8e25-407f-bbb3-31e955ef9ab9 for instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 on n-h1-862769-3 Oct 28 19:09:40.462558 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-61c7a4bb-392a-49a7-bbb8-5a23a1e85318 req-b70d60a1-cd05-48f5-bca6-4c984eb671c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030114 Oct 28 19:09:40.463047 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 298/588] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:40.468208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-971590bf-2866-4756-afce-43ee88ba358e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.468900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-971590bf-2866-4756-afce-43ee88ba358e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:40.568313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-971590bf-2866-4756-afce-43ee88ba358e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:40.575593 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-971590bf-2866-4756-afce-43ee88ba358e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1224 microversion: 2.1 time: 0.111387 Oct 28 19:09:40.576165 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 299/589] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:40 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:40.588628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.589211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:40.598168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.599004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.599978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.601113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.601793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.602217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.924384 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1676982-dba6-45b9-91c8-4f6f5a4f9916 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1628 microversion: 2.1 time: 0.347143 Oct 28 19:09:40.925073 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 300/590] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:40 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1628 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:40.930962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:40.931769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:40.941865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.942654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.943355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:40.944775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:40.945429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:40.946736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.023532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:41.032106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:41.033554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:41.039630 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98f92bdb-fe8c-4ca5-9e8c-832b06e293c6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.112977 Oct 28 19:09:41.040208 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 301/591] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:40 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:41.050808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:41.050808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:41.051245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.051915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.052499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.053398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.053855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.054276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.095161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:41.123348 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59367cac-623e-4a93-a652-bc06dace79b4 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29/action" status: 202 len: 0 microversion: 2.25 time: 0.081888 Oct 28 19:09:41.124253 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 302/592] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:09:41 2022] POST /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:41.137188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:41.137886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] [instance: 0fa484dd-a603-4442-8bcb-adb9eb32932f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:41.145063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.145733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.146299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.147107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.147629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.148117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.163735 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] HTTP exception thrown: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Request method failure captured: Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f HTTP/1.1 Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCi7ebMc8JyJSVagkjJhXLRNODmAOTBRG-IGE4eONHoM-SWweCaW0E_mVz3D3jtls9YsSEsHWz8nqahUnEnJtVrfwJwbCwX-Vbi5DLpwW1HpzHlXNc9Nqcyl89MfYcxypmcbJ_wy45bLpdOf2N_JjgvZpN3Ykmp9VNiNWhwpk7OSXfQ Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:41.165725 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d394b3626a64b55847ca2da79aeeef1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d394b3626a64b55847ca2da79aeeef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0d394b3626a64b55847ca2da79aeeef1 Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1246405489 Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3c6c5e19c04148ceb2903f8bbb617550 Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersAdminTestJSON-1246405489-project Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:41.167043 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0fa484dd-a603-4442-8bcb-adb9eb32932f'} Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:41.167861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. Oct 28 19:09:41.169153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:41.170503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] Returning 404 to user: Instance 0fa484dd-a603-4442-8bcb-adb9eb32932f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:41.170503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d0bb039-3e75-43fb-b6af-6c9a69311481 tempest-DeleteServersAdminTestJSON-1246405489 tempest-DeleteServersAdminTestJSON-1246405489-project] 10.222.0.44 "GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f" status: 404 len: 111 microversion: 2.1 time: 0.041901 Oct 28 19:09:41.170503 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 303/593] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:41 2022] GET /compute/v2.1/servers/0fa484dd-a603-4442-8bcb-adb9eb32932f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:41.172714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53a47537-6836-41be-9339-cc1d29c7885b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Action: 'create', calling method: .version_select at 0x7f1d7c1774c0>, body: {"keypair": {"name": "tempest-keypair-1002794543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtIlPfbkM53eFbvIjAkC/8t/8v+jqy3I0/frM/TBkE2E843qTOk2Mmlys8kI5n4Mw0Rrs7S7GbUZ5wH49vMLKzSNHwNZPe4REXhvcVHPyjXG5FO7UjPVRbQeqEKaxuYGw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:41.197677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-53a47537-6836-41be-9339-cc1d29c7885b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for project fcadf83882374e8d93bbf699425e501b. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:41.199958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:41.203404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-53a47537-6836-41be-9339-cc1d29c7885b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for user 6e2ff64ca72649d3ac2e8912da76c9af and project fcadf83882374e8d93bbf699425e501b. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:41.239023 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53a47537-6836-41be-9339-cc1d29c7885b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070022 Oct 28 19:09:41.239705 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 304/594] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:09:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:41.244338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:41.245476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:41.253033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.253750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.254557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.255317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.255761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.256170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.286610 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-555b85d8-afb0-4c48-b62d-2ebfff883db9 tempest-FloatingIPDetailsTestJSON-1252763301 tempest-FloatingIPDetailsTestJSON-1252763301-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/959be45b-d493-4478-94b6-70bc5ac834bc" status: 202 len: 0 microversion: 2.1 time: 1.274779 Oct 28 19:09:41.287739 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 291/595] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:09:40 2022] DELETE /compute/v2.1/os-floating-ips/959be45b-d493-4478-94b6-70bc5ac834bc => generated 0 bytes in 1277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:41.368796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:41.369416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:41.387071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.387566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.387991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:41.388682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:41.389129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:41.389540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:42.097426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 37e779b9-4e72-4124-838a-8e428fc2bd29 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:42.172399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:42.184077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91629174-33da-4bab-915e-ce246619a78b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 2054 microversion: 2.25 time: 0.943111 Oct 28 19:09:42.185210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 305/596] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:41 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 2054 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:42.186958 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-486e68f6-a17a-458c-afe4-b3d3ebb1a949 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.820642 Oct 28 19:09:42.190993 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 292/597] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:41 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:42.191590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:42.192355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:42.197985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:42.201868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:42.207599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:42.208458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:42.208988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:42.209768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:42.210284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:42.210925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:42.217682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:42.218369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:42.218845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:42.220592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:42.221071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:42.222606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:42.354558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:42.361054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:42.382609 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-853b07bc-c6e3-454a-96a8-5e29c216fc5e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1282 microversion: 2.1 time: 0.196063 Oct 28 19:09:42.384162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:42.397680 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 306/598] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:42 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:42.403364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:42.414198 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a96a1d73-87c6-4920-8344-02e43e67488b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.221431 Oct 28 19:09:42.425009 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 293/599] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:42 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:43.214222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:43.217638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:43.219475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:43.225745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:43.232217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=9 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:43.243578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:43.244068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:43.244493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:43.245371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:43.245963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:43.246521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:43.248858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:43.249993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:43.250436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:43.251258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:43.254202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:43.254660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:43.652462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:43.662572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 37e779b9-4e72-4124-838a-8e428fc2bd29 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:43.667337 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e88fab22-1bf1-4eb5-9dff-ac2cb58b7545 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.456726 Oct 28 19:09:43.676005 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 294/600] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:43 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:43.683893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1658068908", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e506fab6-553b-4be6-8b83-6b486040fd9f"}], "security_groups": [{"name": "tempest-securitygroup--676740139"}], "key_name": "tempest-keypair-1002794543", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:43.691217 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ac6eb18-68a6-4265-a75e-4daa115ca5ed tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 2034 microversion: 2.25 time: 0.480964 Oct 28 19:09:43.703099 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 307/601] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:43 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 2034 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:43.719533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:43.720232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:43.738030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:43.738495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:43.739430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:43.740314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:43.740928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:43.741532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:44.011372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] validate_networks() for [('e506fab6-553b-4be6-8b83-6b486040fd9f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:09:44.185882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:44.193747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f214864-d41f-4aec-85bf-b071de4497f7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.489520 Oct 28 19:09:44.194582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 308/602] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:43 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:44.203633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:44.204541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:44.213960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:44.214543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:44.215058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:44.215806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:44.216315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:44.216813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:44.353547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:44.362075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:44.363654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:44.369426 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-472cdb49-7813-4569-8e7c-886d4a5f25a7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.173659 Oct 28 19:09:44.370461 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 309/603] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:44 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:44.375266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-3", "block_migration": "auto"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:44.377998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:44.383933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:44.384552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:44.385151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:44.385884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:44.386574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:44.387211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:44.606850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'flavor' on Instance uuid 37e779b9-4e72-4124-838a-8e428fc2bd29 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:44.620431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Going to try to live migrate instance to n-h2-862769-3 {{(pid=120629) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:09:44.840195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:45.431449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:09:45.432032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:09:45.432787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:09:45.433457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:09:45.434184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:09:45.454059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:45.454621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:45.455100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:45.455854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:45.456310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:45.463290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:45.486442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:09:45.492036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for user 6e2ff64ca72649d3ac2e8912da76c9af and project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:09:45.505761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:09:45.508373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:09:45.580790 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d85dec1-b12a-40a9-a64a-b93d34f111a2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.902968 Oct 28 19:09:45.581930 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 295/604] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:09:45.590983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:45.591791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:45.599938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:45.602667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:45.606346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:45.607344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:45.607889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:45.608437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:45.887170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:45.899061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-67d4186e-8771-4d28-8406-a86eef92db48 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.313292 Oct 28 19:09:45.901194 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 296/605] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:45 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:46.092858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b34e7184-0189-4cd1-a0fc-cd6909f9069e tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-310559426", "id": 1474820495, "os-flavor-access:is_public": "False"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:46.114798 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b34e7184-0189-4cd1-a0fc-cd6909f9069e tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.212169 Oct 28 19:09:46.116070 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 297/606] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:45 2022] POST /compute/v2.1/flavors => generated 430 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:46.121635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:46.122320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:46.128682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.129433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.130386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.131705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.132362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.132979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.247475 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b1cfad2-1dc6-4d43-a828-ff85bb4aa8bb tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29/action" status: 202 len: 0 microversion: 2.25 time: 1.875345 Oct 28 19:09:46.248997 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 310/607] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:09:44 2022] POST /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29/action => generated 0 bytes in 1878 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:46.256384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:46.256983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:46.286102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.292088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.293841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.294980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.303605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.309644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.556441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:46.566865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:46.572048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:46.590630 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73431a17-e4bc-4744-9c0e-2fc5cd775c19 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.335610 Oct 28 19:09:46.591313 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 311/608] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:46 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:46.603560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:46.604541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:46.618648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.620350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.623032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.624998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.625533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.626169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.639607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:46.650220 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-041bca16-4a4e-4dc9-8eb5-2b0468fdbe43 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.532390 Oct 28 19:09:46.652490 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 298/609] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:46 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:46.672266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-bd284625-a78c-4767-bf05-42f013578c7a req-e9de7a1e-e6b8-411a-8dcd-8b5ca1fba56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d18b9-8ea4-4cbe-9673-8796c8479dfd", "tag": "d2d0c930-15f7-4652-9480-ef28765c09c5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:46.699576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bd284625-a78c-4767-bf05-42f013578c7a req-e9de7a1e-e6b8-411a-8dcd-8b5ca1fba56e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.703595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bd284625-a78c-4767-bf05-42f013578c7a req-e9de7a1e-e6b8-411a-8dcd-8b5ca1fba56e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.705877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bd284625-a78c-4767-bf05-42f013578c7a req-e9de7a1e-e6b8-411a-8dcd-8b5ca1fba56e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.732676 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-bd284625-a78c-4767-bf05-42f013578c7a req-e9de7a1e-e6b8-411a-8dcd-8b5ca1fba56e service nova] Creating event network-changed:d2d0c930-15f7-4652-9480-ef28765c09c5 for instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd on n-h2-862769-3 Oct 28 19:09:46.733837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:46.748193 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff756f87-7209-46d2-a080-99609fab5b0e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1231 microversion: 2.1 time: 0.154818 Oct 28 19:09:46.749026 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-bd284625-a78c-4767-bf05-42f013578c7a req-e9de7a1e-e6b8-411a-8dcd-8b5ca1fba56e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094626 Oct 28 19:09:46.749434 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 312/610] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:46 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1231 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:46.750279 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 299/611] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:46.758108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fe521f6-d2bf-4cdb-9780-77dbf19e5706 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "91ed00a7731e493da0da0e44f75f57a0"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:46.763923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:46.764947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:46.777471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.781090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.783262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.784219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.785399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.785824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.917691 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fe521f6-d2bf-4cdb-9780-77dbf19e5706 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1474820495/action" status: 200 len: 97 microversion: 2.1 time: 0.166933 Oct 28 19:09:46.923552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 313/612] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:09:46 2022] POST /compute/v2.1/flavors/1474820495/action => generated 97 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:09:46.928386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:46.928984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:46.934992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.935691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.936389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:46.937734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:46.939104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:46.939104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:47.068226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.077548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.079193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.080568 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c8f5fab-c39c-45cd-a612-22b2bd9c7a1c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.328808 Oct 28 19:09:47.081268 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 300/613] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:46 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:47.132058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.152354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-36c0012a-911d-40cd-aafb-5b928301da88 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.227592 Oct 28 19:09:47.155050 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 314/614] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:46 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:47.230879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cdcce55a-4265-4a8e-b817-52d5e8af6a48 tempest-FlavorsAccessTestJSON-581512473 tempest-FlavorsAccessTestJSON-581512473-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.261819 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cdcce55a-4265-4a8e-b817-52d5e8af6a48 tempest-FlavorsAccessTestJSON-581512473 tempest-FlavorsAccessTestJSON-581512473-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.179204 Oct 28 19:09:47.262569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 301/615] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:47.281494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15114c9f-973c-4f42-8b3b-3098dd36812c tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "91ed00a7731e493da0da0e44f75f57a0"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:47.353804 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15114c9f-973c-4f42-8b3b-3098dd36812c tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors/1474820495/action" status: 200 len: 21 microversion: 2.1 time: 0.076126 Oct 28 19:09:47.354404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 315/616] 10.222.0.44 () {60 vars in 1200 bytes} [Fri Oct 28 19:09:47 2022] POST /compute/v2.1/flavors/1474820495/action => generated 21 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:09:47.364364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1042db2-933a-4840-8d3e-1110a0e8e5bf tempest-FlavorsAccessTestJSON-581512473 tempest-FlavorsAccessTestJSON-581512473-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.385563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1042db2-933a-4840-8d3e-1110a0e8e5bf tempest-FlavorsAccessTestJSON-581512473 tempest-FlavorsAccessTestJSON-581512473-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.025035 Oct 28 19:09:47.386147 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 302/617] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:47.405325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8763df8-f45e-4fbf-b54c-4569326cb1c9 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.433179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a8763df8-f45e-4fbf-b54c-4569326cb1c9 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1474820495" status: 202 len: 0 microversion: 2.1 time: 0.031487 Oct 28 19:09:47.434126 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 316/618] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:09:47 2022] DELETE /compute/v2.1/flavors/1474820495 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:47.442767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3f42a79-5dd6-4eb5-b0c8-165fc8067a0f tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.465863 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3f42a79-5dd6-4eb5-b0c8-165fc8067a0f tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.027272 Oct 28 19:09:47.466599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 303/619] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:47.488579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0ce4e07-c387-4e34-9349-505b02346035 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1041912571", "id": 1151454215, "os-flavor-access:is_public": "False"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:47.526130 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0ce4e07-c387-4e34-9349-505b02346035 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.041730 Oct 28 19:09:47.527032 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 317/620] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:09:47 2022] POST /compute/v2.1/flavors => generated 431 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:47.541091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25c1c1ec-1b1e-4360-88b2-5a8bcc803d7b tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.568658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25c1c1ec-1b1e-4360-88b2-5a8bcc803d7b tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/1151454215/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.031821 Oct 28 19:09:47.569537 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 304/621] 10.222.0.44 () {58 vars in 1209 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/flavors/1151454215/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:09:47.583069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f3c5fe66-7356-49a7-a99b-0e11681847a5 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.604034 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f3c5fe66-7356-49a7-a99b-0e11681847a5 tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1151454215" status: 202 len: 0 microversion: 2.1 time: 0.026969 Oct 28 19:09:47.608704 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 318/622] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:09:47 2022] DELETE /compute/v2.1/flavors/1151454215 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:47.616438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4162a699-80f1-41db-9d02-68d430a6e2ee tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.624281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.624910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:47.634476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:47.635130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:47.635832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:47.636862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:47.637472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:47.638052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:47.645387 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4162a699-80f1-41db-9d02-68d430a6e2ee tempest-FlavorsAccessTestJSON-1114925854 tempest-FlavorsAccessTestJSON-1114925854-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.035440 Oct 28 19:09:47.646364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 305/623] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:47.679605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.680217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:47.691066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:47.691877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:47.692460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:47.701287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:47.702353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:47.702982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:47.873143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.886967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.890035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:47.903415 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0664745d-ed8c-4366-a7c3-ba06c55e8050 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.283901 Oct 28 19:09:47.905507 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 319/624] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:47.914327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:47.916058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:47.924371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:47.925203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:47.926741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:47.928114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:47.930236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:47.931109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:48.061113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:48.071682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7094c093-8da3-4f8e-9f25-a008643cca38 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1293 microversion: 2.1 time: 0.164642 Oct 28 19:09:48.073559 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 320/625] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:48.104807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:48.109865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:48.110518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:48.115125 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-204fb646-a74a-4234-9d52-9def4aa6888f tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.439662 Oct 28 19:09:48.115711 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 306/626] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:47 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:48.134089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:48.137800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:48.141135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:48.145967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:48.148904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:48.153150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:48.180118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:48.181874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:48.198606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:48.199140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:48.200199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:48.200932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:48.201598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:48.202044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:48.969644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:48.986802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:48.991075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:48.994004 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9f6dc47-56f9-4f2f-80cd-75cb12eb7eb4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.892129 Oct 28 19:09:49.004423 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 321/627] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:48 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:49.013629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:49.014803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:49.030439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:49.035492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.036350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.037199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.038196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5d4a17e4-4ed3-40f8-8a2e-42eb45bc508b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.862152 Oct 28 19:09:49.038623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.039132 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 307/628] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:48 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:49.040429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.041730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.051866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ff159401-16cc-4da7-86a0-6bedb72bebac req-d5bd9254-e8e9-4c21-b17d-326698eddacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e779b9-4e72-4124-838a-8e428fc2bd29", "name": "network-vif-unplugged", "status": "completed", "tag": "1fa7cc0b-ccb9-4372-b67c-befe8c316492"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:49.072566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ff159401-16cc-4da7-86a0-6bedb72bebac req-d5bd9254-e8e9-4c21-b17d-326698eddacc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.073901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ff159401-16cc-4da7-86a0-6bedb72bebac req-d5bd9254-e8e9-4c21-b17d-326698eddacc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.074507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ff159401-16cc-4da7-86a0-6bedb72bebac req-d5bd9254-e8e9-4c21-b17d-326698eddacc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.096684 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ff159401-16cc-4da7-86a0-6bedb72bebac req-d5bd9254-e8e9-4c21-b17d-326698eddacc service nova] Creating event network-vif-unplugged:1fa7cc0b-ccb9-4372-b67c-befe8c316492 for instance 37e779b9-4e72-4124-838a-8e428fc2bd29 on n-h1-862769-3 Oct 28 19:09:49.102543 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ff159401-16cc-4da7-86a0-6bedb72bebac req-d5bd9254-e8e9-4c21-b17d-326698eddacc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055624 Oct 28 19:09:49.103906 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 308/629] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:49.111265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:49.112772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:49.119493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.120209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.120816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.121852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.122638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.123600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.279685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:49.284067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:49.284763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:49.294924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:49.297066 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4a2d23d4-101d-4dcd-a550-826d6aa910ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1293 microversion: 2.1 time: 0.191576 Oct 28 19:09:49.297752 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 309/630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:49 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:49.298411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:49.303999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:49.304874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:49.306334 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4bf6efbc-e3b6-451d-9c75-ec26f6909659 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.300255 Oct 28 19:09:49.307266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 322/631] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:49 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:49.326880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.327655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.328232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.329037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:49.329505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:49.330066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:49.746175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:49.761967 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43490e23-ecfb-43f4-a273-6b638693e14e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.462996 Oct 28 19:09:49.762555 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 310/632] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:49 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:50.025158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:50.027326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:50.045337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.046181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.048839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.050231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.051569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.055607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.063457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:50.064797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:50.079710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.080778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.081971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.086141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.089075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.089791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.378018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:50.501035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.507185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.516050 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-993e2fff-8879-48fd-84ad-57dd89d2fbcf tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.457584 Oct 28 19:09:50.530975 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 311/633] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:50 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:50.530975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:50.530975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:50.530975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.530975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.531386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.531386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.531386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.531809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.536268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.538249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.541814 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a2265acc-9210-4844-9243-953fc0e466ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.523962 Oct 28 19:09:50.543995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 323/634] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:50 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:50.549155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:50.550065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:50.560358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.560988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.561430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.562173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.562628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.563302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.721540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.748353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.750174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.757521 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-70e1a601-1c92-40c6-b501-d109e52a3d8e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.211900 Oct 28 19:09:50.758835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 324/635] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:50 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:50.789240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:50.789872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:50.797648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.798122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.799098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.799861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:50.800641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:50.801087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:50.854051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:50.864735 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8c3efc5a-9303-4ea1-a4ce-d1e601aecb5d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1360 microversion: 2.1 time: 0.345152 Oct 28 19:09:50.878719 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 312/636] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:50 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1360 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:51.037752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:51.050810 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4213c42-3ee2-4f44-b1d9-187bb0489fa6 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.266647 Oct 28 19:09:51.051797 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 325/637] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:50 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:51.126261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fb3c332a-1d3e-4568-878b-5f7e6c137db1 req-a61d51de-66d3-426a-b51a-e42bca15156d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e779b9-4e72-4124-838a-8e428fc2bd29", "tag": "1fa7cc0b-ccb9-4372-b67c-befe8c316492"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:51.139859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fb3c332a-1d3e-4568-878b-5f7e6c137db1 req-a61d51de-66d3-426a-b51a-e42bca15156d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:51.141992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fb3c332a-1d3e-4568-878b-5f7e6c137db1 req-a61d51de-66d3-426a-b51a-e42bca15156d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:51.142846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fb3c332a-1d3e-4568-878b-5f7e6c137db1 req-a61d51de-66d3-426a-b51a-e42bca15156d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:51.154970 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fb3c332a-1d3e-4568-878b-5f7e6c137db1 req-a61d51de-66d3-426a-b51a-e42bca15156d service nova] Creating event network-changed:1fa7cc0b-ccb9-4372-b67c-befe8c316492 for instance 37e779b9-4e72-4124-838a-8e428fc2bd29 on n-h1-862769-3 Oct 28 19:09:51.160299 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fb3c332a-1d3e-4568-878b-5f7e6c137db1 req-a61d51de-66d3-426a-b51a-e42bca15156d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041518 Oct 28 19:09:51.161088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 313/638] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:51.373136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:51.409676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-08c38459-b14b-492e-8da7-4bf15d005e88 req-8186abec-93cd-48de-af3b-d74af3d07008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97e4371-c171-43ac-8520-da07711dcbb1", "tag": "2da3baa2-5257-4f18-bfd0-e9e9e09faf0f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:51.431721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-08c38459-b14b-492e-8da7-4bf15d005e88 req-8186abec-93cd-48de-af3b-d74af3d07008 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:51.432256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-08c38459-b14b-492e-8da7-4bf15d005e88 req-8186abec-93cd-48de-af3b-d74af3d07008 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:51.432696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-08c38459-b14b-492e-8da7-4bf15d005e88 req-8186abec-93cd-48de-af3b-d74af3d07008 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:51.460823 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-08c38459-b14b-492e-8da7-4bf15d005e88 req-8186abec-93cd-48de-af3b-d74af3d07008 service nova] Creating event network-changed:2da3baa2-5257-4f18-bfd0-e9e9e09faf0f for instance e97e4371-c171-43ac-8520-da07711dcbb1 on n-h1-862769-3 Oct 28 19:09:51.471319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-08c38459-b14b-492e-8da7-4bf15d005e88 req-8186abec-93cd-48de-af3b-d74af3d07008 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067888 Oct 28 19:09:51.471924 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 314/639] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:09:51.549777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:51.550483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:51.567555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:51.568057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:51.568491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:51.569233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:51.569689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:51.570110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:51.702817 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b9c85ce-9f20-4fcf-95a9-49b05ecaab79 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] 10.222.0.44 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.335827 Oct 28 19:09:51.703348 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 326/640] 10.222.0.44 () {58 vars in 1128 bytes} [Fri Oct 28 19:09:51 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 19:09:51.711176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:51.712237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:51.718318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:51.718843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:51.719278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:51.720088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:51.720540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:51.720958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:51.824260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:51.842873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:51.853326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.308280 Oct 28 19:09:51.854522 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 315/641] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:51 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:51.855633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:51.856753 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d4bdca3c-f08d-4a20-9697-336176507607 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001271 Oct 28 19:09:51.857521 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 316/642] 10.222.0.44 () {56 vars in 886 bytes} [Fri Oct 28 19:09:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 19:09:51.862984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9907af62-73ac-47d4-88e2-477601775cf8 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Calling method '.version_select at 0x7f1d7c230160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:51.953370 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9907af62-73ac-47d4-88e2-477601775cf8 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] HTTP exception thrown: Image not found. Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9907af62-73ac-47d4-88e2-477601775cf8 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Request method failure captured: Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCj_sdnlKYvB195bRXjU6UojH3rnECyASkiJM1jZTXU02qhgQVo86NL1ZGyuMchGZIk-2djxIQXvypbX2ZvkJhiAPUJwK5p9Woxejq4vkwFwRbDjwZKAZ8mO5CaUdJn0DTCac4pSw6xdl8BWlTcpHtqtevBX3nIBAtsFt6QUNLRX-zc Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:09:51.968369 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d2ea8eecce48429385ed2e6fecc11652", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 32966617c5044640b4fd205aa10bff10 Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '-1'} Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:51.969724 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.970558 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:51.971928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9907af62-73ac-47d4-88e2-477601775cf8 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:51.973710 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9907af62-73ac-47d4-88e2-477601775cf8 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] 10.222.0.44 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.114450 Oct 28 19:09:51.978822 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 317/643] 10.222.0.44 () {58 vars in 1134 bytes} [Fri Oct 28 19:09:51 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:09:51.984313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:51.988944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:51.989625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:52.001398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.002039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.002354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.003014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.003798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.003920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.004386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.004987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b3e74db-6937-4c1c-9bdc-cc5495a7b024 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.299971 Oct 28 19:09:52.005375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.015339 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 327/644] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:51 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:52.019373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.020559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:52.036749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.037292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.037731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.038505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.039451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.039962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.124924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.133858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.135689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.141441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-597713dc-63bf-4522-bcc9-6e8390e02040 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.160776 Oct 28 19:09:52.142356 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 318/645] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:51 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:52.172207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f3d550a-53da-4ed3-a0e9-4baf2b570430 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Calling method '.version_select at 0x7f1d7c20a940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.204224 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1f3d550a-53da-4ed3-a0e9-4baf2b570430 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] HTTP exception thrown: Image not found. Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f3d550a-53da-4ed3-a0e9-4baf2b570430 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Request method failure captured: Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/images/9783353b-d66c-4cc6-a9f0-b2ea29ddac9j HTTP/1.1 Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCj_sdnlKYvB195bRXjU6UojH3rnECyASkiJM1jZTXU02qhgQVo86NL1ZGyuMchGZIk-2djxIQXvypbX2ZvkJhiAPUJwK5p9Woxejq4vkwFwRbDjwZKAZ8mO5CaUdJn0DTCac4pSw6xdl8BWlTcpHtqtevBX3nIBAtsFt6QUNLRX-zc Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:09:52.206158 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d2ea8eecce48429385ed2e6fecc11652", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 32966617c5044640b4fd205aa10bff10 Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9783353b-d66c-4cc6-a9f0-b2ea29ddac9j'} Oct 28 19:09:52.207725 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9783353b-d66c-4cc6-a9f0-b2ea29ddac9j to delete Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.208568 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9783353b-d66c-4cc6-a9f0-b2ea29ddac9j could not be found. Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:52.210638 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:09:52.212326 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.215808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f3d550a-53da-4ed3-a0e9-4baf2b570430 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:52.216956 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1f3d550a-53da-4ed3-a0e9-4baf2b570430 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] 10.222.0.44 "DELETE /compute/v2.1/images/9783353b-d66c-4cc6-a9f0-b2ea29ddac9j" status: 404 len: 62 microversion: 2.1 time: 0.058011 Oct 28 19:09:52.218087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 319/646] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:52 2022] DELETE /compute/v2.1/images/9783353b-d66c-4cc6-a9f0-b2ea29ddac9j => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:09:52.226168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.227375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:52.235685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.237796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.238429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.239406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.240129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.240726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.258583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.268309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-895531f9-f482-4182-a6ab-3ad0acda90b5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1360 microversion: 2.1 time: 0.260758 Oct 28 19:09:52.268898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 328/647] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:52 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1360 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:52.273382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-db8aaabc-07f1-4ec5-8d9e-d6aa0e800b15 req-c0085372-cdbc-4fc3-8370-e33bb2b22a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d18b9-8ea4-4cbe-9673-8796c8479dfd", "name": "network-vif-plugged", "status": "completed", "tag": "d2d0c930-15f7-4652-9480-ef28765c09c5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:52.283054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-db8aaabc-07f1-4ec5-8d9e-d6aa0e800b15 req-c0085372-cdbc-4fc3-8370-e33bb2b22a65 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.283527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-db8aaabc-07f1-4ec5-8d9e-d6aa0e800b15 req-c0085372-cdbc-4fc3-8370-e33bb2b22a65 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.283945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-db8aaabc-07f1-4ec5-8d9e-d6aa0e800b15 req-c0085372-cdbc-4fc3-8370-e33bb2b22a65 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.295899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-db8aaabc-07f1-4ec5-8d9e-d6aa0e800b15 req-c0085372-cdbc-4fc3-8370-e33bb2b22a65 service nova] Creating event network-vif-plugged:d2d0c930-15f7-4652-9480-ef28765c09c5 for instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd on n-h2-862769-3 Oct 28 19:09:52.301140 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-db8aaabc-07f1-4ec5-8d9e-d6aa0e800b15 req-c0085372-cdbc-4fc3-8370-e33bb2b22a65 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031082 Oct 28 19:09:52.301801 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 329/648] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:52.310441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af90afa2-0faa-4f28-824e-e68b385a04d4 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Calling method '.version_select at 0x7f1d7c0a1430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.329061 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-af90afa2-0faa-4f28-824e-e68b385a04d4 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] HTTP exception thrown: Image not found. Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af90afa2-0faa-4f28-824e-e68b385a04d4 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Request method failure captured: Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/cf951930-78ca-4ae6-9557-82e6df4f1e1e1 HTTP/1.1 Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCj_sdnlKYvB195bRXjU6UojH3rnECyASkiJM1jZTXU02qhgQVo86NL1ZGyuMchGZIk-2djxIQXvypbX2ZvkJhiAPUJwK5p9Woxejq4vkwFwRbDjwZKAZ8mO5CaUdJn0DTCac4pSw6xdl8BWlTcpHtqtevBX3nIBAtsFt6QUNLRX-zc Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:52.332783 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d2ea8eecce48429385ed2e6fecc11652", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 32966617c5044640b4fd205aa10bff10 Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'cf951930-78ca-4ae6-9557-82e6df4f1e1e1'} Oct 28 19:09:52.334005 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cf951930-78ca-4ae6-9557-82e6df4f1e1e1 to delete Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.334765 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cf951930-78ca-4ae6-9557-82e6df4f1e1e1 could not be found. Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:52.335934 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af90afa2-0faa-4f28-824e-e68b385a04d4 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:52.339706 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af90afa2-0faa-4f28-824e-e68b385a04d4 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] 10.222.0.44 "DELETE /compute/v2.1/images/cf951930-78ca-4ae6-9557-82e6df4f1e1e1" status: 404 len: 62 microversion: 2.1 time: 0.028185 Oct 28 19:09:52.341538 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 330/649] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:52 2022] DELETE /compute/v2.1/images/cf951930-78ca-4ae6-9557-82e6df4f1e1e1 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:09:52.345834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4df8656-376f-4a07-b73c-1c3ceae65056 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Calling method '.version_select at 0x7f1d7c1eaaf0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.370155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c4df8656-376f-4a07-b73c-1c3ceae65056 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] HTTP exception thrown: Image not found. Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4df8656-376f-4a07-b73c-1c3ceae65056 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Request method failure captured: Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/tempest-invalid-1261645675 HTTP/1.1 Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCj_sdnlKYvB195bRXjU6UojH3rnECyASkiJM1jZTXU02qhgQVo86NL1ZGyuMchGZIk-2djxIQXvypbX2ZvkJhiAPUJwK5p9Woxejq4vkwFwRbDjwZKAZ8mO5CaUdJn0DTCac4pSw6xdl8BWlTcpHtqtevBX3nIBAtsFt6QUNLRX-zc Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:52.372827 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d2ea8eecce48429385ed2e6fecc11652", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 32966617c5044640b4fd205aa10bff10 Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'tempest-invalid-1261645675'} Oct 28 19:09:52.374340 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1261645675 to delete Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.375197 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1261645675 could not be found. Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:52.376403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4df8656-376f-4a07-b73c-1c3ceae65056 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:52.377590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4df8656-376f-4a07-b73c-1c3ceae65056 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] 10.222.0.44 "DELETE /compute/v2.1/images/tempest-invalid-1261645675" status: 404 len: 62 microversion: 2.1 time: 0.032459 Oct 28 19:09:52.378436 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 331/650] 10.222.0.44 () {58 vars in 1206 bytes} [Fri Oct 28 19:09:52 2022] DELETE /compute/v2.1/images/tempest-invalid-1261645675 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:09:52.384076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b56c0d66-b9a2-43c3-a55e-503c1b8a4789 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Calling method '.version_select at 0x7f1d7c177790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.402840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:52.405483 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b56c0d66-b9a2-43c3-a55e-503c1b8a4789 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] HTTP exception thrown: Image not found. Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b56c0d66-b9a2-43c3-a55e-503c1b8a4789 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Request method failure captured: Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/5a51062d-868f-4199-9dea-c2d9c4492ce7 HTTP/1.1 Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCj_sdnlKYvB195bRXjU6UojH3rnECyASkiJM1jZTXU02qhgQVo86NL1ZGyuMchGZIk-2djxIQXvypbX2ZvkJhiAPUJwK5p9Woxejq4vkwFwRbDjwZKAZ8mO5CaUdJn0DTCac4pSw6xdl8BWlTcpHtqtevBX3nIBAtsFt6QUNLRX-zc Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:09:52.407333 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d2ea8eecce48429385ed2e6fecc11652", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d2ea8eecce48429385ed2e6fecc11652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: d2ea8eecce48429385ed2e6fecc11652 Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-779955970 Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 32966617c5044640b4fd205aa10bff10 Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-779955970-project Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5a51062d-868f-4199-9dea-c2d9c4492ce7'} Oct 28 19:09:52.408578 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a51062d-868f-4199-9dea-c2d9c4492ce7 to delete Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.409572 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a51062d-868f-4199-9dea-c2d9c4492ce7 could not be found. Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:52.410949 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b56c0d66-b9a2-43c3-a55e-503c1b8a4789 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:52.412570 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b56c0d66-b9a2-43c3-a55e-503c1b8a4789 tempest-ImagesDeleteNegativeTestJSON-779955970 tempest-ImagesDeleteNegativeTestJSON-779955970-project] 10.222.0.44 "DELETE /compute/v2.1/images/5a51062d-868f-4199-9dea-c2d9c4492ce7" status: 404 len: 62 microversion: 2.1 time: 0.028611 Oct 28 19:09:52.414606 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 332/651] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:52 2022] DELETE /compute/v2.1/images/5a51062d-868f-4199-9dea-c2d9c4492ce7 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:09:52.420959 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-63db1022-01c4-440f-addf-92c72ef89f46 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.192241 Oct 28 19:09:52.421574 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 320/652] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:52 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:52.879377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:52.881000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:52.890001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.890490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.891158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:52.891850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:52.892463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:52.892889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.030749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:53.031881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:53.040159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.041081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.041637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.042537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.043342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.043881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.090380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.099780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9746f054-79e9-4ac3-b73f-6ac92cfb0f7c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.226459 Oct 28 19:09:53.100446 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 333/653] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:52 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:53.183909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:53.184559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:53.190970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.191449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.192146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.193157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.193956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.194549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.213965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.224970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.226403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.227599 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e7943c9-19ce-46a3-95db-a2b45bbd021f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.200762 Oct 28 19:09:53.244080 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 321/654] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:53 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:53.280235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.291952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.292520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:53.293216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:53.293381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.299503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5c09439-ea5f-4e60-8a05-921859d74838 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.126220 Oct 28 19:09:53.300132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.300612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.301179 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 334/655] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:53 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:53.301984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.302895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.303572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.303988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.451086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:53.451847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:53.459428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.459936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.460620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.461376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:53.461972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:53.462378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:53.883744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:53.897666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8529ca9-dba4-4a87-9fdb-d324f96016f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1360 microversion: 2.1 time: 0.610467 Oct 28 19:09:53.898897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 322/656] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:53 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1360 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:54.007730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.029587 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-027a55b9-b465-4de0-b8ec-27ea5894acac tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1324 microversion: 2.1 time: 0.584670 Oct 28 19:09:54.033016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 335/657] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:53 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:54.124623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:54.126354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:54.137671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.138181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.138607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.139350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.139790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.141622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.256380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:54.256991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:54.274770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.275152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.275827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.276710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.277306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.277873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.679834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.691281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.694329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.695777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-38b81264-acab-42a5-8396-413ba3785ad6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.445071 Oct 28 19:09:54.697719 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 336/658] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:54 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:54.700977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.705032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:54.706858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:54.711552 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ec2d3f8-014d-421e-a401-6aa6be7a19f8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.591806 Oct 28 19:09:54.712124 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 323/659] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:54 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:54.714955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.715658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.716339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.717334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.718080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.718588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.800870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.811518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.813941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:54.820090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:54.823324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-060a8be0-278d-4c0c-86e1-819182518544 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.123942 Oct 28 19:09:54.823930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 337/660] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:54 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:54.923364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:54.924429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:54.931342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.932904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.933335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:54.934267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:54.934897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:54.935973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.061479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:55.062100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:55.071163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.071944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.072557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.074746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.075517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.076097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.199319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:55.212196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf7f405a-d1ce-4930-909c-267988726693 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1360 microversion: 2.1 time: 0.294867 Oct 28 19:09:55.213384 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 324/661] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:54 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1360 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:55.343647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:55.353289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-39eb1ab7-4959-4e59-9257-6fe2be418c89 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 200 len: 1520 microversion: 2.1 time: 0.298217 Oct 28 19:09:55.356503 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 338/662] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:55 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:55.380072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'action', calling method: .version_select at 0x7f1d7da73af0>, body: {"addFloatingIp": {"address": "172.25.9.240"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:55.382758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:55.389318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.389922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.390455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.391361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.391910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.392422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.468801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:09:55.469582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquired lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:09:55.475125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:55.499365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:55.725621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:55.726433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:55.738326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.744491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.745433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:55.747494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:55.748400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:55.751752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.171191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:56.190819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:56.198905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:56.203091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-16459086-e587-4804-a177-9ce06522ac76 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1567 microversion: 2.25 time: 0.479965 Oct 28 19:09:56.207837 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 339/663] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:55 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1567 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:09:56.237971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:56.238651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:56.253412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.254322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.255093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.255962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.256571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.257195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.609800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:56.623734 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cde81d3e-bda7-44fa-b4af-8868b94928b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.412858 Oct 28 19:09:56.624668 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 340/664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:56 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:56.802117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Calling method '.version_select at 0x7f1d7c11c700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:56.804226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.804938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.805624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.844861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.847375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.849192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.870636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.871564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.874374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.883666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bd1a593f-6a4f-4f2c-a1d2-828d8cdd4c87 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.257833 Oct 28 19:09:56.885062 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 341/665] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:09:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:56.903289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:56.903984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:56.910850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.911722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.912376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:56.913409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:56.914597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:56.915520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.088084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.103583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.108175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.125892 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56ae28e5-4e5a-47ad-83d4-69b1ae451e66 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.239371 Oct 28 19:09:57.126462 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 342/666] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:56 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:57.133743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:57.134594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:57.141094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.141874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.142585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.149891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.150664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.151341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.465206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.485425 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97182dd9-8400-45ef-b264-0a2748fde62c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1360 microversion: 2.1 time: 0.352973 Oct 28 19:09:57.488195 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 343/667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:57 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1360 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:57.498650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Calling method '.version_select at 0x7f1d7c177310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:57.501074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.501786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.502841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.514989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:57.532490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.533620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.535649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.579196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.579991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.580650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.587882 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c823fd29-94b8-4003-ab26-5900675a26e2 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/n-h2-862769-3/servers" status: 200 len: 591 microversion: 2.1 time: 0.097235 Oct 28 19:09:57.589207 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 344/668] 10.222.0.44 () {58 vars in 1212 bytes} [Fri Oct 28 19:09:57 2022] GET /compute/v2.1/os-hypervisors/n-h2-862769-3/servers => generated 591 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:57.594286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:57.595308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:57.601881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.602732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.603373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.604292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.604971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.605579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.903166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.912139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.913592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:57.915119 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43a289e3-8444-421f-98be-43e053a38d83 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1542 microversion: 2.25 time: 0.324684 Oct 28 19:09:57.933062 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 345/669] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:57 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1542 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:57.946351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Calling method '.version_select at 0x7f1d7c11caf0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:57.948185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.948674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.949130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:57.984706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:57.985333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:57.985778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.017243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.017864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.018331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.032561 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91b4e9fe-de0d-47ef-aede-32dbcc135384 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089731 Oct 28 19:09:58.039327 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 346/670] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:09:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:58.039327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:58.039327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:58.055229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.055723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.056151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.056856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.057302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.057718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.167970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Building network info cache for instance {{(pid=120628) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:09:58.642975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:58.656084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac6baf95-bfc5-4fdf-bd2e-e2a4dec40022 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.621309 Oct 28 19:09:58.684166 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 347/671] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:58 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:58.698757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-23605c99-2681-402f-98e3-ebd0bad7e7c5 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '.version_select at 0x7f1d7c177790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:58.702407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23605c99-2681-402f-98e3-ebd0bad7e7c5 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.710164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23605c99-2681-402f-98e3-ebd0bad7e7c5 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.711361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23605c99-2681-402f-98e3-ebd0bad7e7c5 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.754033 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-23605c99-2681-402f-98e3-ebd0bad7e7c5 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.068429 Oct 28 19:09:58.765280 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 348/672] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Oct 28 19:09:58 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:58.779374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Calling method '.version_select at 0x7f1d7c11caf0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:58.791036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.803990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.804829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.851441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.854076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.855221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.874418 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98d19c9d-032b-4872-9c3b-a531383da138 tempest-HypervisorAdminUnderV252Test-1393018816 tempest-HypervisorAdminUnderV252Test-1393018816-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors/n-h2-862769-3/search" status: 200 len: 104 microversion: 2.1 time: 0.106485 Oct 28 19:09:58.882127 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 349/673] 10.222.0.44 () {58 vars in 1209 bytes} [Fri Oct 28 19:09:58 2022] GET /compute/v2.1/os-hypervisors/n-h2-862769-3/search => generated 104 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:58.888809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:58.889631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:58.902678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.903481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.904662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:58.906522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:58.912852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:58.913625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.097657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:59.113857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:59.115567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:59.135466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4501bf56-f53f-46f8-9319-8ad3ff8a8923 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.251580 Oct 28 19:09:59.137330 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 350/674] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:58 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:09:59.148726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3164eb38-1099-4694-9e96-df8c841e3ff0 req-0f2ceb62-5982-4a46-a8ec-8baf829eca1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:59.183298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3164eb38-1099-4694-9e96-df8c841e3ff0 req-0f2ceb62-5982-4a46-a8ec-8baf829eca1d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.187120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3164eb38-1099-4694-9e96-df8c841e3ff0 req-0f2ceb62-5982-4a46-a8ec-8baf829eca1d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.187702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3164eb38-1099-4694-9e96-df8c841e3ff0 req-0f2ceb62-5982-4a46-a8ec-8baf829eca1d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.212123 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3164eb38-1099-4694-9e96-df8c841e3ff0 req-0f2ceb62-5982-4a46-a8ec-8baf829eca1d service nova] Creating event network-changed:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:09:59.228190 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3164eb38-1099-4694-9e96-df8c841e3ff0 req-0f2ceb62-5982-4a46-a8ec-8baf829eca1d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087853 Oct 28 19:09:59.229913 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 351/675] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:59.241614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:59.243756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:59.264962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.266885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.267561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.270023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.272027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.272741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.618017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Updating instance_info_cache with network_info: [{"id": "bd8ab30c-ab17-41d7-9969-4523b815028d", "address": "fa:16:3e:a6:db:1d", "network": {"id": "eaf8a972-4544-4697-b19b-9248b3c756b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-808985558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa88591c155d44528bf278ff93f3c2e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd8ab30c-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120628) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:09:59.640776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:59.657745 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4595b97-e8db-47f2-9101-8777fa5ac7f8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1360 microversion: 2.1 time: 0.422421 Oct 28 19:09:59.659798 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 352/676] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:59 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1360 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:59.683441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Releasing lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:09:59.684444 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85209b3a-38d7-4921-8931-0ab1374ac83c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action" status: 202 len: 0 microversion: 2.1 time: 4.308668 Oct 28 19:09:59.694005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a6cabbf0-e7da-4942-a34a-245306c57063 req-2589f78d-fa57-40e4-9075-f8a6904a5322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e4371-c171-43ac-8520-da07711dcbb1", "name": "network-vif-plugged", "status": "completed", "tag": "2da3baa2-5257-4f18-bfd0-e9e9e09faf0f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:59.694253 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 325/677] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:55 2022] POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action => generated 0 bytes in 4319 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:09:59.711947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:59.712613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:59.721252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a6cabbf0-e7da-4942-a34a-245306c57063 req-2589f78d-fa57-40e4-9075-f8a6904a5322 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.727875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a6cabbf0-e7da-4942-a34a-245306c57063 req-2589f78d-fa57-40e4-9075-f8a6904a5322 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.728489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a6cabbf0-e7da-4942-a34a-245306c57063 req-2589f78d-fa57-40e4-9075-f8a6904a5322 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.740816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.743245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.744887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.751865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.753397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.755066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.759946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a6cabbf0-e7da-4942-a34a-245306c57063 req-2589f78d-fa57-40e4-9075-f8a6904a5322 service nova] Creating event network-vif-plugged:2da3baa2-5257-4f18-bfd0-e9e9e09faf0f for instance e97e4371-c171-43ac-8520-da07711dcbb1 on n-h1-862769-3 Oct 28 19:09:59.774911 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a6cabbf0-e7da-4942-a34a-245306c57063 req-2589f78d-fa57-40e4-9075-f8a6904a5322 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094203 Oct 28 19:09:59.776575 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 353/678] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:59.785637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'action', calling method: .version_select at 0x7f1d7da74af0>, body: {"addFloatingIp": {"address": "172.25.9.240"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:59.793862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:59.831164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.832300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.835119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.836550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:59.840202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:59.841012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:59.946502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "refresh_cache-232d18b9-8ea4-4cbe-9673-8796c8479dfd" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:09:59.947117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquired lock "refresh_cache-232d18b9-8ea4-4cbe-9673-8796c8479dfd" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:10:00.268643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 37e779b9-4e72-4124-838a-8e428fc2bd29 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:00.296158 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13626c53-15b1-4450-a980-cd50384a0f4c tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 2034 microversion: 2.25 time: 0.596906 Oct 28 19:10:00.318412 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 326/679] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:09:59 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 2034 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:00.327221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:00.328662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:00.340713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:00.344690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:00.345509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:00.354946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:00.358502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:00.359367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:01.031794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:01.045922 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9beb17ca-8fdb-417a-a912-afc1632361dc tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.726051 Oct 28 19:10:01.048226 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 327/680] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:00 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:01.056094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:01.068270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:01.077642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:01.078858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:01.079588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:01.086295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:01.086981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:01.087522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:01.211946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:01.256745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:01.260558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:01.269925 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc098c64-c207-40e5-bdb2-8aaf14cd9e2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.220280 Oct 28 19:10:01.270438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 328/681] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:01 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:01.281962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20d8b11f-0e40-4f80-b2cd-91420e83ffe2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Action: 'create', calling method: .version_select at 0x7f1d7c2be550>, body: {"keypair": {"name": "tempest-keypair-2124424176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXK5hswKVfr9Sh5sJNlkfaL242YUbvHwg0mEqMGkviJVw+51HeEzLxO6QVZNDok7s8sUMCrmqFoRjOKuw+2/Ikx5ONlvP77M77RL1Pak6QcFI9FhqztcPpvuEcW5SRybg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:01.336344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-20d8b11f-0e40-4f80-b2cd-91420e83ffe2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for project df69faab58094a56ba4ecf152625b366. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:01.360583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-20d8b11f-0e40-4f80-b2cd-91420e83ffe2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for user 1b1defe0b46f45fc8ff3d354bb4d361e and project df69faab58094a56ba4ecf152625b366. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:01.387776 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20d8b11f-0e40-4f80-b2cd-91420e83ffe2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.109570 Oct 28 19:10:01.388714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 329/682] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:10:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:10:01.779578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75803732-6e93-4ade-a700-63aa2b2b8d71 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c17adc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2000797752", "description": "tempest-description-307528887"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:02.089485 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75803732-6e93-4ade-a700-63aa2b2b8d71 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.699482 Oct 28 19:10:02.090886 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 330/683] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:02.099055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:02.100284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:02.120619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.121484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.125177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.127180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.127620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.128054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.375448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:02.387734 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd91c2ca-2d4e-4e3a-a8bc-646eabe3ca8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1543 microversion: 2.1 time: 0.294412 Oct 28 19:10:02.404118 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 331/684] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:02 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1543 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:02.413375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:02.415642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:02.429034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.430466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.431151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.432591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.433204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.434053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.695184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:02.706882 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec382bd2-0d9f-4573-9783-9c1d9e6d0fe0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1477 microversion: 2.1 time: 0.301195 Oct 28 19:10:02.708282 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 332/685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:02 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:02.722727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-45110caf-57cc-48be-8252-8e7bc66bee39 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c32c430>, body: {"security_group_rule": {"parent_group_id": "631c62d5-22a4-4992-ad69-db3de15f65c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:03.318484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-45110caf-57cc-48be-8252-8e7bc66bee39 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.607783 Oct 28 19:10:03.319118 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 333/686] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:10:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:03.332121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:03.332925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:03.337489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:03.344824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.345716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.352029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.353028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.353798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.354439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.426673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.neutron [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] re-assign floating IP 172.25.9.240 from instance d9681047-4f32-42c2-b7df-664e7e529676 Oct 28 19:10:03.478138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:03.492259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:03.493718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:03.496657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Building network info cache for instance {{(pid=120629) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:10:03.505486 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-977c0329-026a-43bb-a860-408f68ae33be tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.180873 Oct 28 19:10:03.507311 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 334/687] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:03 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:03.512732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:03.513474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:03.519993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.520718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.521345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.522282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.522981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.523580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.611006 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d655d0dc-56a4-419a-bead-be87f296eef6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102347 Oct 28 19:10:03.612214 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 335/688] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:10:03 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:03.632059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-17083994", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "aa325377-9337-4f1f-b1f3-a267b86ca8bc"}], "security_groups": [{"name": "tempest-securitygroup--1838262817"}], "key_name": "tempest-keypair-2124424176", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:03.944137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] validate_networks() for [('aa325377-9337-4f1f-b1f3-a267b86ca8bc', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:10:04.674569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Updating instance_info_cache with network_info: [{"id": "bd8ab30c-ab17-41d7-9969-4523b815028d", "address": "fa:16:3e:a6:db:1d", "network": {"id": "eaf8a972-4544-4697-b19b-9248b3c756b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-808985558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa88591c155d44528bf278ff93f3c2e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd8ab30c-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120629) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:10:04.692178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Building network info cache for instance {{(pid=120629) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:10:04.713030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:04.713587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:04.714093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:04.714852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:04.715449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:04.738139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.738852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.739350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.740158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:04.740681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:04.741169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.781901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:04.787762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for user 1b1defe0b46f45fc8ff3d354bb4d361e and project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:04.802347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:04.806017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:04.877399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-995fbb63-d84d-45e7-bbb7-4dae430c5fae tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.263845 Oct 28 19:10:04.878399 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 336/689] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:10:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:10:04.891200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c04a4100-1f99-4065-814e-6838fc480eec tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c1561f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1715330491", "description": "tempest-description-955082876"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:05.423039 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c04a4100-1f99-4065-814e-6838fc480eec tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.542273 Oct 28 19:10:05.423854 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 337/690] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:05.431216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-449f1fc7-b281-4247-9c52-c1dc97750bee req-b39e81b2-f3b8-4c4e-bdae-226f915eb5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:05.488743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-449f1fc7-b281-4247-9c52-c1dc97750bee req-b39e81b2-f3b8-4c4e-bdae-226f915eb5d6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.492980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-449f1fc7-b281-4247-9c52-c1dc97750bee req-b39e81b2-f3b8-4c4e-bdae-226f915eb5d6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.497495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-449f1fc7-b281-4247-9c52-c1dc97750bee req-b39e81b2-f3b8-4c4e-bdae-226f915eb5d6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.537427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-449f1fc7-b281-4247-9c52-c1dc97750bee req-b39e81b2-f3b8-4c4e-bdae-226f915eb5d6 service nova] Creating event network-changed:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:10:05.551324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-449f1fc7-b281-4247-9c52-c1dc97750bee req-b39e81b2-f3b8-4c4e-bdae-226f915eb5d6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123687 Oct 28 19:10:05.555032 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 338/691] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:05.572280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:05.573270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:05.592234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.594220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.596285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.597385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.599228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.599734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.556474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:06.565139 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1fa2ea69-9979-4ddf-a79e-d8e6c7340bef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1476 microversion: 2.1 time: 1.008343 Oct 28 19:10:06.566331 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 339/692] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:05 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1476 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:06.632009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Updating instance_info_cache with network_info: [{"id": "d2d0c930-15f7-4652-9480-ef28765c09c5", "address": "fa:16:3e:e0:48:ca", "network": {"id": "eaf8a972-4544-4697-b19b-9248b3c756b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-808985558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa88591c155d44528bf278ff93f3c2e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2d0c930-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120629) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:10:06.648424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Releasing lock "refresh_cache-232d18b9-8ea4-4cbe-9673-8796c8479dfd" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:10:06.649793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a6f6c03-f36c-4be9-a447-4f7aba46910e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd/action" status: 202 len: 0 microversion: 2.1 time: 6.871451 Oct 28 19:10:06.650796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 354/693] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:59 2022] POST /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd/action => generated 0 bytes in 6873 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:10:06.667916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:06.668731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:06.675986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.676525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.677134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.677925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.678454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.679066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.796168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:06.808430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:06.809868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:06.829962 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83b91800-7e8b-47f7-a248-e8f5e8f8d6ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.176965 Oct 28 19:10:06.831234 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 355/694] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:06 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:06.844954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b9d8c7-fd45-4793-8005-48a329af61fc", "name": "network-vif-unplugged", "status": "completed", "tag": "acb14376-c9d5-489b-91db-914a95c06be3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:06.847165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1031368563", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:06.870407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.871201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.871801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.904582 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] Creating event network-vif-unplugged:acb14376-c9d5-489b-91db-914a95c06be3 for instance 98b9d8c7-fd45-4793-8005-48a329af61fc on n-h1-862769-3 Oct 28 19:10:06.913406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] Instance 98b9d8c7-fd45-4793-8005-48a329af61fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:10:06.958992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2eff489a-1a71-4c99-8b09-05b26b7dae0d req-72832d09-034b-4d25-b9c8-c4477d82e6ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119188 Oct 28 19:10:06.962879 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 356/695] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:06.967782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:06.968454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:06.969161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:06.969787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:06.970858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:06.976368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:06.977437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:06.992880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.993351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.999082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.999603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.999761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.000037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.000817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.001270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.001686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.002249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.004400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.005301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.039028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:07.073137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Getting quotas for project 18f360bda35240749d0e39ffd62fa983. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:07.092288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Getting quotas for user 84221ef6a4a340bf98b0abff80d0e9cc and project 18f360bda35240749d0e39ffd62fa983. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:07.134218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:07.140587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:07.269130 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-091b4f33-5d21-477a-a908-d5c90a1238b0 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.701081 Oct 28 19:10:07.269815 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 340/696] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:10:07.297165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ae54fcb-2302-4703-8ec8-b6aaa0b74334 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c20aee0>, body: {"security_group_rule": {"parent_group_id": "2545b81e-a9b0-4652-859a-299fc43617be", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:07.300835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:07.321985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:07.323499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:07.324671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a613050-88d1-461c-9077-6cb13f34f23e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1344 microversion: 2.25 time: 0.360137 Oct 28 19:10:07.330142 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 357/697] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:06 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1344 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:07.340247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'action', calling method: .version_select at 0x7f1d7da74c10>, body: {"removeFloatingIp": {"address": "172.25.9.240"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:08.132082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.139824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.140475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.141085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.145519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.146232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.148013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.353501 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ae54fcb-2302-4703-8ec8-b6aaa0b74334 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.080636 Oct 28 19:10:08.355072 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 341/698] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:10:07 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:08.361302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:08.368479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.400763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.401799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.402455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.403466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.404138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.404629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.507052 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] HTTP exception thrown: Floating IP 172.25.9.240 is not associated with instance d9681047-4f32-42c2-b7df-664e7e529676. Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Request method failure captured: Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action HTTP/1.1 Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 49 Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCjaC5kDuKW74UnzQCYIkLxCu4U9wrpha5sroQgna3_MGVjerkgEr7iOKaEKWwZ7dFj7yd99EFUJfkWl3X5MMkrvXYDAjAu11CEtCMmqjBSqY_2kpa0n-laFV-tZVmisvAtDDDp7VLNf7K1A9hkA_LJ1PgBE60iMF8WgrAkgaC598uc Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:08.509026 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa88591c155d44528bf278ff93f3c2e5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 0e591cea1b324e78bd62e7e06b1d2623 Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: {"removeFloatingIp": {"address": "172.25.9.240"}} Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:10:08.510576 n-d-862769-3 devstack@n-api.service[120629]: exception: Floating IP 172.25.9.240 is not associated with instance d9681047-4f32-42c2-b7df-664e7e529676. Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd9681047-4f32-42c2-b7df-664e7e529676', 'body': {'removeFloatingIp': {'address': '172.25.9.240'}}} Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.240 is not associated with instance d9681047-4f32-42c2-b7df-664e7e529676. Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:08.512400 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:08.513982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:08.513982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:08.513982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:08.513982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:08.513982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.240 is not associated with instance d9681047-4f32-42c2-b7df-664e7e529676. Oct 28 19:10:08.513982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:08.516191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Returning 409 to user: Floating IP 172.25.9.240 is not associated with instance d9681047-4f32-42c2-b7df-664e7e529676. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:08.517283 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a565dc5-d2b1-4756-b9ff-f9d3ad434be7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action" status: 409 len: 146 microversion: 2.1 time: 1.185941 Oct 28 19:10:08.518114 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 358/699] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:07 2022] POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action => generated 146 bytes in 1187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:10:08.524533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:08.533526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.553878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.556264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.559662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.560162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.560846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.561300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.565692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.582343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.583829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.601230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-127288cc-52f5-4526-8d6b-61a2bcbc383b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "PUT /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1363 microversion: 2.75 time: 0.244781 Oct 28 19:10:08.601841 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 342/700] 10.222.0.44 () {62 vars in 1297 bytes} [Fri Oct 28 19:10:08 2022] PUT /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:08.613009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b9b3b5e7-68a3-4779-863b-b4bb36cb91b0 req-c30dda14-5611-44b9-bda5-111af14c2d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d18b9-8ea4-4cbe-9673-8796c8479dfd", "tag": "d2d0c930-15f7-4652-9480-ef28765c09c5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:08.640803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b9b3b5e7-68a3-4779-863b-b4bb36cb91b0 req-c30dda14-5611-44b9-bda5-111af14c2d14 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.642632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b9b3b5e7-68a3-4779-863b-b4bb36cb91b0 req-c30dda14-5611-44b9-bda5-111af14c2d14 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.648438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b9b3b5e7-68a3-4779-863b-b4bb36cb91b0 req-c30dda14-5611-44b9-bda5-111af14c2d14 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.669859 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b9b3b5e7-68a3-4779-863b-b4bb36cb91b0 req-c30dda14-5611-44b9-bda5-111af14c2d14 service nova] Creating event network-changed:d2d0c930-15f7-4652-9480-ef28765c09c5 for instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd on n-h2-862769-3 Oct 28 19:10:08.681411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b9b3b5e7-68a3-4779-863b-b4bb36cb91b0 req-c30dda14-5611-44b9-bda5-111af14c2d14 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074102 Oct 28 19:10:08.682138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 343/701] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:08.687843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:08.688937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.697465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.698184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.698982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.699926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.700624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.701760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.834070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.851237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.853062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.868956 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2fee0767-eaab-4c5f-b797-329a79bd473b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.185486 Oct 28 19:10:08.872118 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 344/702] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:08 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:08.887506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:08.888196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:08.899427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.904238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.905453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.906485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.907173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.908695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.964695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.993446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a2f95368-7a90-47a6-899d-26abaef60ce6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1474 microversion: 2.1 time: 0.473753 Oct 28 19:10:08.994349 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 359/703] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:08 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:09.016518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc6c23e5-6936-4e83-906b-2acacd56637e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c177790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-672325616", "description": "tempest-description-554676018"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:09.060255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:09.075943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:09.077474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:09.084584 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-03452b67-87df-43e6-968c-f117e18b7353 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1342 microversion: 2.25 time: 0.205353 Oct 28 19:10:09.085474 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 345/704] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:08 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:09.103692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'action', calling method: .version_select at 0x7f1d7da73c10>, body: {"removeFloatingIp": {"address": "172.25.9.240"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:09.355824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:09.362007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.362719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.363318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.364219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.368403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.369082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.657624 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc6c23e5-6936-4e83-906b-2acacd56637e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.661756 Oct 28 19:10:09.659653 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 360/705] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:08 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:09.668745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:09.669948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:09.699622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.700279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.700553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.701943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.702705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.704570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.014955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:10.037102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:10.044588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:10.073818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a2e3690b-92db-43a1-b925-1105332101d8 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1411 microversion: 2.75 time: 0.412843 Oct 28 19:10:10.074432 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 361/706] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:09 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1411 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:10.090536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b9d8c7-fd45-4793-8005-48a329af61fc", "tag": "acb14376-c9d5-489b-91db-914a95c06be3"}, {"name": "network-changed", "server_uuid": "e97e4371-c171-43ac-8520-da07711dcbb1", "tag": "2da3baa2-5257-4f18-bfd0-e9e9e09faf0f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:10.113032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.113612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "refresh_cache-232d18b9-8ea4-4cbe-9673-8796c8479dfd" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:10:10.114035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquired lock "refresh_cache-232d18b9-8ea4-4cbe-9673-8796c8479dfd" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:10:10.114154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.114859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.132531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:10.141541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Creating event network-changed:acb14376-c9d5-489b-91db-914a95c06be3 for instance 98b9d8c7-fd45-4793-8005-48a329af61fc on n-h1-862769-3 Oct 28 19:10:10.142449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Creating event network-changed:2da3baa2-5257-4f18-bfd0-e9e9e09faf0f for instance e97e4371-c171-43ac-8520-da07711dcbb1 on n-h1-862769-3 Oct 28 19:10:10.160056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] Instance 98b9d8c7-fd45-4793-8005-48a329af61fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:10:10.189749 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d40c5f96-b6e9-4c0b-99de-d0176f8ab49b req-57c3ca70-7a67-4316-8fdd-43e802b33ab2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.106846 Oct 28 19:10:10.191182 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 362/707] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:10.198870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6521dca2-409a-4db5-8bca-db46cb19f9f7 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c4df3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-735989695", "description": "tempest-description-1254310062"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:10.912700 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6521dca2-409a-4db5-8bca-db46cb19f9f7 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.717651 Oct 28 19:10:10.915712 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 363/708] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:10.923401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:10.924639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:10.940585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.941700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.942361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:10.943867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:10.944436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:10.945092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.328121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:11.340165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:11.345494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:11.355367 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-255eaddf-2e11-4a2f-ab4f-09dc26c8d668 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.434548 Oct 28 19:10:11.356345 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 364/709] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:10 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:11.363893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:11.365220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:11.373982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.375274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.375941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.376919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.377616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.378239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.758392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:11.769225 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c530d26f-965f-46ba-9583-36d2b0e60e52 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1471 microversion: 2.1 time: 0.411487 Oct 28 19:10:11.770425 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 365/710] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:11 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:11.777931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:11.778774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:11.787608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.788319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.789240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.790107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.792593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.793990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:12.329128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Building network info cache for instance {{(pid=120628) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:10:12.491389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:12.508140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:12.509811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:12.511299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80524127-2f12-448b-a54d-88a52abe9d7d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1410 microversion: 2.25 time: 0.738245 Oct 28 19:10:12.511992 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 366/711] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:11 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1410 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:12.523299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e3c83c5-3847-4dbd-ad1f-e722961a0b18 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c378280>, body: {"security_group_rule": {"parent_group_id": "483490c8-09bf-4f86-ba6f-9371d2a714dc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8a8dcde5-1c26-46f1-933d-1e58b7caa9d7"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:13.449295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e3c83c5-3847-4dbd-ad1f-e722961a0b18 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.935973 Oct 28 19:10:13.451073 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 367/712] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:10:12 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:13.458039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:13.459177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:13.468069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.469104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.470461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.472033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.474543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.481235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.632464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:13.643886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:13.645632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:13.651538 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c9cf05a-7005-48ad-b342-b2358a443b69 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1438 microversion: 2.75 time: 0.198667 Oct 28 19:10:13.652558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 368/713] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:13 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1438 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:13.657849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:13.663418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:13.679375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.680141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.680742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.682293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.682792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.684538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.792339 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-374d5867-3145-46d8-a220-5b0bb482a54d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc/action" status: 204 len: 0 microversion: 2.1 time: 0.138222 Oct 28 19:10:13.795471 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 369/714] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:13 2022] POST /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc/action => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:13.801059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b9d8c7-fd45-4793-8005-48a329af61fc", "name": "network-vif-plugged", "status": "completed", "tag": "acb14376-c9d5-489b-91db-914a95c06be3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:13.819148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.819699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Updating instance_info_cache with network_info: [{"id": "d2d0c930-15f7-4652-9480-ef28765c09c5", "address": "fa:16:3e:e0:48:ca", "network": {"id": "eaf8a972-4544-4697-b19b-9248b3c756b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-808985558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa88591c155d44528bf278ff93f3c2e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2d0c930-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120628) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:10:13.823389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.842440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Releasing lock "refresh_cache-232d18b9-8ea4-4cbe-9673-8796c8479dfd" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:10:13.846814 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-42ddcf21-0f07-4622-8db8-f6754680afbd tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd/action" status: 202 len: 0 microversion: 2.1 time: 4.757928 Oct 28 19:10:13.849931 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 346/715] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:09 2022] POST /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd/action => generated 0 bytes in 4764 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:10:13.853444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.860415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-313b15af-5fed-4aff-b0d2-5f5b6c3424e4 req-0dd8e501-e57a-4fc0-8a7c-0911219c55a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d18b9-8ea4-4cbe-9673-8796c8479dfd", "tag": "d2d0c930-15f7-4652-9480-ef28765c09c5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:13.873214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] Creating event network-vif-plugged:acb14376-c9d5-489b-91db-914a95c06be3 for instance 98b9d8c7-fd45-4793-8005-48a329af61fc on n-h1-862769-3 Oct 28 19:10:13.880507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] Instance 98b9d8c7-fd45-4793-8005-48a329af61fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:10:13.897023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-313b15af-5fed-4aff-b0d2-5f5b6c3424e4 req-0dd8e501-e57a-4fc0-8a7c-0911219c55a5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.897622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-313b15af-5fed-4aff-b0d2-5f5b6c3424e4 req-0dd8e501-e57a-4fc0-8a7c-0911219c55a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.898093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-313b15af-5fed-4aff-b0d2-5f5b6c3424e4 req-0dd8e501-e57a-4fc0-8a7c-0911219c55a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.899552 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f5965598-f8cc-4603-a92a-8948369c5fe9 req-25f71723-89ba-494c-9c44-6e561b42aa6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102205 Oct 28 19:10:13.900656 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 370/716] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:13.907843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:13.908729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:13.929125 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-313b15af-5fed-4aff-b0d2-5f5b6c3424e4 req-0dd8e501-e57a-4fc0-8a7c-0911219c55a5 service nova] Creating event network-changed:d2d0c930-15f7-4652-9480-ef28765c09c5 for instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd on n-h2-862769-3 Oct 28 19:10:13.939922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.943921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.944599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.945501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.946110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.946372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-313b15af-5fed-4aff-b0d2-5f5b6c3424e4 req-0dd8e501-e57a-4fc0-8a7c-0911219c55a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090768 Oct 28 19:10:13.948260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.958072 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 347/717] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:13.976361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd49bf64-d672-45d8-9699-0db01d3c0abe tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c44a310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1993423907", "description": "tempest-description-1008809485"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:14.115493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.131779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.137306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.148926 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f46bb888-f280-44d8-999f-e3ca1de1d84b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.246584 Oct 28 19:10:14.177292 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 371/718] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:13 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:14.182427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:14.183155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.195498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.195734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.197407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.198391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.202087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.202603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.709047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.724508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.726352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.727661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c087150-1516-4cf0-8821-5b1b54ddb49c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1410 microversion: 2.25 time: 0.549142 Oct 28 19:10:14.739064 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 372/719] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:14 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1410 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:14.744651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:14.747733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.760155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.761915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.761915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.763029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.763670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.764769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.773216 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd49bf64-d672-45d8-9699-0db01d3c0abe tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.811082 Oct 28 19:10:14.774552 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 348/720] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:14.780199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:14.781306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.796153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.799341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.800069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.803621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.804341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.804976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.876953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:14.877723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:14.878363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:14.878945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:14.879713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:14.969040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:14.980887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.983477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.984514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.985441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.986204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.986934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.154966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.172909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.179822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.187343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-133cd2d9-2268-48ea-8aef-96df4121b857 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "POST /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501/action" status: 202 len: 1495 microversion: 2.75 time: 0.446390 Oct 28 19:10:15.188633 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 373/721] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:10:14 2022] POST /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501/action => generated 1495 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 19:10:15.195572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.195572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.201311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.201886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.202501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.203374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.203966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.204857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.237670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:10:15.402599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-916d5d2f-5adb-44a8-92ae-f4ca9c8e4341 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "DELETE /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 204 len: 0 microversion: 2.1 time: 0.212570 Oct 28 19:10:15.409423 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 374/722] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:15 2022] DELETE /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:15.416202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.420281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.424198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:15.432716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.433229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.433719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.435074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.435525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.435940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.488419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:10:15.537660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:15.601662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.612963 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5321057-9533-4253-9cb5-f80ee6c463b5 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 204 len: 0 microversion: 2.1 time: 0.202007 Oct 28 19:10:15.614243 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 375/723] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:15 2022] DELETE /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:15.620034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5246308f-073b-4dc6-ab3b-728f363adeef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1471 microversion: 2.1 time: 0.844054 Oct 28 19:10:15.630779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a5e55c53-d3e0-4e65-805a-6e55bad53a2c tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c342280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-565804882", "description": "tempest-description-138625244"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:15.632485 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 349/724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:14 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1471 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:15.644849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.645699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.654711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.655222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.655660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.656429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.656881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.657466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.757156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.768402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.771953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.781277 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-164854ee-9690-42ac-b149-3c07002aa291 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.141660 Oct 28 19:10:15.781872 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 350/725] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:15.789430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.790130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.796147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.797018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.797635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.798604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.799310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.799938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.882709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.888148 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a5e55c53-d3e0-4e65-805a-6e55bad53a2c tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.272426 Oct 28 19:10:15.893524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.895155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.898721 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 376/726] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:15.903795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.240"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:15.904979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6545824-3863-4e27-9cc3-2a9fc442ef53 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.121988 Oct 28 19:10:15.906435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.906914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 351/727] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:15.912461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.913069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:15.920084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.920892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.921511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.922472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.923098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.923859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.928735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.929433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.929868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.930567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.931031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.931518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.960831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:10:15.961226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquired lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:10:16.194467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.205064 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2e7ecc7-b6ea-41c8-8e31-0d58718d8a1c tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1713 microversion: 2.1 time: 0.296898 Oct 28 19:10:16.208773 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 352/728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1713 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:16.214197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.215057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:16.236197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.236882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.237480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.239282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.239903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.240320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.473520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.490563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.492696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:16.494099 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a99617e-62f9-49db-870e-c7c6fc5aceba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1410 microversion: 2.25 time: 0.284173 Oct 28 19:10:16.495186 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 353/729] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:16 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1410 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:16.500098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58380aef-7dbf-4506-ba7a-7a601af6fff4 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c44a3a0>, body: {"security_group_rule": {"parent_group_id": "77671f8d-5d06-44f7-88af-e625bd1f5a5b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b5518151-6e3d-402b-bddd-0c11e0e3b237"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:17.032646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:17.142223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=16 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:17.554782 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58380aef-7dbf-4506-ba7a-7a601af6fff4 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.058315 Oct 28 19:10:17.555593 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 354/730] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:10:16 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:17.560290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0022808d-b847-47de-bf63-027a4889af41 req-cf7af5a1-7b39-4a11-a5bd-961e3741e636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7de605-17c2-4004-99c0-2461d81bf4b7", "tag": "2ba7e6ec-b446-4804-ac52-5db82ecf7f7f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:17.583553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0022808d-b847-47de-bf63-027a4889af41 req-cf7af5a1-7b39-4a11-a5bd-961e3741e636 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.584276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0022808d-b847-47de-bf63-027a4889af41 req-cf7af5a1-7b39-4a11-a5bd-961e3741e636 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.584870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0022808d-b847-47de-bf63-027a4889af41 req-cf7af5a1-7b39-4a11-a5bd-961e3741e636 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.600613 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0022808d-b847-47de-bf63-027a4889af41 req-cf7af5a1-7b39-4a11-a5bd-961e3741e636 service nova] Creating event network-changed:2ba7e6ec-b446-4804-ac52-5db82ecf7f7f for instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 on n-h1-862769-3 Oct 28 19:10:17.606649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0022808d-b847-47de-bf63-027a4889af41 req-cf7af5a1-7b39-4a11-a5bd-961e3741e636 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049844 Oct 28 19:10:17.607909 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 355/731] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:17.613701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:17.614424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:17.621535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.622047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.622480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.623457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.624058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.624532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.918806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.927600 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aa37d70d-71be-4638-87a0-9bd9f641fd80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1463 microversion: 2.1 time: 0.318275 Oct 28 19:10:17.928525 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 356/732] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:17 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:17.933522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:17.934532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:17.941131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.941887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.942561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.943790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:17.944450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:17.945426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.034279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.047463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.049708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.055912 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f74e67e-2d85-453c-aab9-dedd47cfb1dd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.125833 Oct 28 19:10:18.057161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 357/733] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:17 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:18.064010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:18.064944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:18.071964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.075708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.075708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.075708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.075708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.076512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.187867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.207583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.210372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.230537 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e9cc0d5-1121-4695-a53b-e3ccb233345a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.169558 Oct 28 19:10:18.231242 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 358/734] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:18 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:18.241773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:18.242676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:18.256853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.257567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Building network info cache for instance {{(pid=120629) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:10:18.258378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.258950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.260395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.261834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.262075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.011725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8468bb4493eb4cf5951029cda891cec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cabf5bc7f864f11b150f8b15825922c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:19.025180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6fa52b4-afa5-4a43-a6b8-f40111df36dc tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 200 len: 1713 microversion: 2.1 time: 0.791226 Oct 28 19:10:19.028591 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 359/735] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:18 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 1713 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:19.035453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:19.039986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:19.053786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.054678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.058035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.059063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.059787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.060428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.174909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.185507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.191662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.192926 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-565be2b4-3d7f-455d-b894-903b79b882af tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1410 microversion: 2.25 time: 1.162813 Oct 28 19:10:20.203304 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 360/736] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:19 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1410 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:20.225304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37df5598-6610-4ac5-b26d-f405c0452db9 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c40b8b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.735319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Updating instance_info_cache with network_info: [{"id": "bd8ab30c-ab17-41d7-9969-4523b815028d", "address": "fa:16:3e:a6:db:1d", "network": {"id": "eaf8a972-4544-4697-b19b-9248b3c756b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-808985558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa88591c155d44528bf278ff93f3c2e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd8ab30c-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120629) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:10:20.774005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Releasing lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:10:20.778058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8b9481c-7ebc-4321-8703-f437fcef425c tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action" status: 202 len: 0 microversion: 2.1 time: 4.877000 Oct 28 19:10:20.780513 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 377/737] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:15 2022] POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action => generated 0 bytes in 4881 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:10:20.805108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.805855 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37df5598-6610-4ac5-b26d-f405c0452db9 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/b5518151-6e3d-402b-bddd-0c11e0e3b237" status: 202 len: 0 microversion: 2.1 time: 0.600841 Oct 28 19:10:20.811442 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 361/738] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:20 2022] DELETE /compute/v2.1/os-security-groups/b5518151-6e3d-402b-bddd-0c11e0e3b237 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:20.813466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:20.819868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.828198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:20.844042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.845388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.846297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.849689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.850660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.854126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.865099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.874602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.883644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.885343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.886469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.887636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.968119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:21.174027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.183814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.185292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.190988 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-320b312c-6aa0-4d27-8d28-c70fcb97cea6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.382003 Oct 28 19:10:21.207258 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 362/739] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:20 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:21.219809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.220650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.227422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.228182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.228794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.229694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.230307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.232787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.325175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.328914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.340348 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a67c833a-ec27-44d2-83cb-b83470884bf2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1463 microversion: 2.1 time: 0.557781 Oct 28 19:10:21.340979 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 378/740] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:20 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1463 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:21.354922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.354922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.355269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}, {"server_uuid": "232d18b9-8ea4-4cbe-9673-8796c8479dfd", "name": "network-vif-deleted", "tag": "d2d0c930-15f7-4652-9480-ef28765c09c5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:21.355365 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0fc8e13c-97cc-4fbe-a2f8-4a4e8394d6bb tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.141363 Oct 28 19:10:21.355365 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 363/741] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:21.355764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4fad8eb2-5cf9-4dcd-ac44-e05de10bd56c req-0a65c1a5-8117-4fa8-884a-85f148bb80c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80", "name": "network-vif-deleted", "tag": "cd16c7b0-8e25-407f-bbb3-31e955ef9ab9"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:21.368523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4fad8eb2-5cf9-4dcd-ac44-e05de10bd56c req-0a65c1a5-8117-4fa8-884a-85f148bb80c6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.369099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4fad8eb2-5cf9-4dcd-ac44-e05de10bd56c req-0a65c1a5-8117-4fa8-884a-85f148bb80c6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.369589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4fad8eb2-5cf9-4dcd-ac44-e05de10bd56c req-0a65c1a5-8117-4fa8-884a-85f148bb80c6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.378293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.378895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.379512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.384693 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4fad8eb2-5cf9-4dcd-ac44-e05de10bd56c req-0a65c1a5-8117-4fa8-884a-85f148bb80c6 service nova] Creating event network-vif-deleted:cd16c7b0-8e25-407f-bbb3-31e955ef9ab9 for instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 on n-h1-862769-3 Oct 28 19:10:21.398921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4fad8eb2-5cf9-4dcd-ac44-e05de10bd56c req-0a65c1a5-8117-4fa8-884a-85f148bb80c6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038100 Oct 28 19:10:21.402862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 364/742] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:21.406973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] Creating event network-changed:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:10:21.407759 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] Creating event network-vif-deleted:d2d0c930-15f7-4652-9480-ef28765c09c5 for instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd on n-h2-862769-3 Oct 28 19:10:21.409478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.410182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.416627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:21.418495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.418634 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1f77a739-df42-460d-a89f-6562c7083beb req-e5db98e5-d38f-4dc9-bd01-a09599b4b1a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075002 Oct 28 19:10:21.419134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.419570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.419981 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 379/743] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:21.420649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.421104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.421908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.428329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e718a7e-e0de-4b21-83f6-1b1ca433ce71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '.version_select at 0x7f1d7c5414c0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.453787 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 HTTP/1.1 Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:10:21.455534 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:21.456947 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80'} Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:21.457741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:21.458981 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.460089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:21.460089 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-959a8866-e460-4d49-9d32-86d173f33ab4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 404 len: 111 microversion: 2.1 time: 0.052403 Oct 28 19:10:21.460089 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 365/744] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:21.464024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8277d28-2edf-4527-ae4b-9d5d7f5154a6 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c361a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.692140 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8277d28-2edf-4527-ae4b-9d5d7f5154a6 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/77671f8d-5d06-44f7-88af-e625bd1f5a5b" status: 200 len: 248 microversion: 2.1 time: 0.231692 Oct 28 19:10:21.693588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 366/745] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/os-security-groups/77671f8d-5d06-44f7-88af-e625bd1f5a5b => generated 248 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:21.706147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.708028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.718960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.719744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.720419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.721433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.722116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.724695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.854813 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e718a7e-e0de-4b21-83f6-1b1ca433ce71 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips/9f13aee5-4855-4fe5-9f82-21234f00ab5d" status: 200 len: 185 microversion: 2.1 time: 0.432825 Oct 28 19:10:21.855404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 380/746] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/os-floating-ips/9f13aee5-4855-4fe5-9f82-21234f00ab5d => generated 185 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:21.860205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2acc27b2-3357-4506-aad0-b5ae226287d4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'create', calling method: .version_select at 0x7f1d7c65a0d0>, body: {"keypair": {"name": "tempest-keypair-411543595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSYmr3kx1fGhCpd4xqbRB6zQSHKkfmxW5oDfd3c6WaqQbvLSgnzTvsKHAGLLG7+GXEPpdqKyb2zgKfUjMkfIecC6EHR0dC6xD/fj5xBA+o+9luy9TwOyrpoYDkeokkYmA=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:21.893276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2acc27b2-3357-4506-aad0-b5ae226287d4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:21.901298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2acc27b2-3357-4506-aad0-b5ae226287d4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for user 3142fd0059aa4b658c2cea015b1f3d93 and project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:21.955055 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2acc27b2-3357-4506-aad0-b5ae226287d4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098108 Oct 28 19:10:21.956054 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 381/747] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:10:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:21.963265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.964364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:21.973721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.974503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.975274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.976207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.976820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.977457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.995672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 HTTP/1.1 Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:21.997582 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:21.999061 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '831d5ec9-b916-4990-84b9-8750b7b09827'} Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:21.999837 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.001127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.004675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:22.005901 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa851e97-ea2b-418a-b3c3-0e08d916d22f tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 404 len: 111 microversion: 2.1 time: 0.048746 Oct 28 19:10:22.007048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 382/748] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:21 2022] DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:22.016676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7752b06b-4f22-4a77-97f3-9db838d5cb57 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c37dc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1817705024", "description": "tempest-description-234422935"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:22.245720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.278336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.282005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.285047 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6674bf32-3a9c-4b09-88fa-ee85420940bb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1410 microversion: 2.25 time: 0.589950 Oct 28 19:10:22.314550 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 367/749] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1410 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:22.324020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.240"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:22.708666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7752b06b-4f22-4a77-97f3-9db838d5cb57 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.700258 Oct 28 19:10:22.709331 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 383/750] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:10:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:22.719493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.721405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.738489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.739316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.740721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.741669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.743218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.745273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.766139 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 HTTP/1.1 Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:22.768085 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.769348 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '831d5ec9-b916-4990-84b9-8750b7b09827'} Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:22.770061 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:22.771326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:22.773711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:22.774844 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-afeb25c3-4a86-4299-bf14-a9d0de1604b7 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 404 len: 111 microversion: 2.1 time: 0.064227 Oct 28 19:10:22.775652 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 384/751] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:22.780831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.781782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.791430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.792428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.793176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.800252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.807174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.807991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.831830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:22.838306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.838849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.839344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.840061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.843721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.844198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.949106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.964621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.966524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.989111 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4828f882-ed53-4621-8f9d-4bfddfcb4080 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.211924 Oct 28 19:10:22.998746 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 385/752] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:22.998746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.998746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:23.019137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.019588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.020081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.020917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.021412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.021961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.150555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:23.164029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:23.166112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:23.173270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-deaf2507-114d-45e1-8581-f3e7cb2135e2 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.182494 Oct 28 19:10:23.188669 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 386/753] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:23.188669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1161c9c4-eda4-47f5-aa1e-7edf539bbc2a req-c7c53e16-f664-4bac-842c-23978d8e0561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7de605-17c2-4004-99c0-2461d81bf4b7", "name": "network-vif-plugged", "status": "completed", "tag": "2ba7e6ec-b446-4804-ac52-5db82ecf7f7f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:23.190833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1161c9c4-eda4-47f5-aa1e-7edf539bbc2a req-c7c53e16-f664-4bac-842c-23978d8e0561 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.191749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1161c9c4-eda4-47f5-aa1e-7edf539bbc2a req-c7c53e16-f664-4bac-842c-23978d8e0561 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.192706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1161c9c4-eda4-47f5-aa1e-7edf539bbc2a req-c7c53e16-f664-4bac-842c-23978d8e0561 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.204172 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1161c9c4-eda4-47f5-aa1e-7edf539bbc2a req-c7c53e16-f664-4bac-842c-23978d8e0561 service nova] Creating event network-vif-plugged:2ba7e6ec-b446-4804-ac52-5db82ecf7f7f for instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 on n-h1-862769-3 Oct 28 19:10:23.210167 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1161c9c4-eda4-47f5-aa1e-7edf539bbc2a req-c7c53e16-f664-4bac-842c-23978d8e0561 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Oct 28 19:10:23.214102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 387/754] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:23.227051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb2ec3a3-c2d2-42d6-91a8-36a983591d8e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c2e83a0>, body: {"security_group_rule": {"parent_group_id": "e198fcba-dd48-4082-8b49-3ec38b62f1ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:23.231066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:10:23.232219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquired lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:10:23.719832 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb2ec3a3-c2d2-42d6-91a8-36a983591d8e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.504234 Oct 28 19:10:23.721145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 388/755] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:10:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:23.727715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a09f7dac-6e85-4b3d-8aba-6fd3dffcac96 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '.version_select at 0x7f1d7c1eac10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:23.758426 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a09f7dac-6e85-4b3d-8aba-6fd3dffcac96 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275537579" status: 202 len: 0 microversion: 2.1 time: 0.035873 Oct 28 19:10:23.759921 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 389/756] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275537579 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:23.768396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:23.769708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:23.780752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.782062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.782854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:23.784090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:23.784901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:23.785653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.469303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:24.478120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:24.479688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:24.480873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-06e6eb3a-91ce-4fc1-bdaf-9d343cf7e6e8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1410 microversion: 2.25 time: 0.719452 Oct 28 19:10:24.481651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 390/757] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:23 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1410 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:24.485994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26cf9089-68f5-4df9-a16a-796f37b4fcdc tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '.version_select at 0x7f1d7c37d430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.489394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26cf9089-68f5-4df9-a16a-796f37b4fcdc tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.489875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26cf9089-68f5-4df9-a16a-796f37b4fcdc tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.490304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26cf9089-68f5-4df9-a16a-796f37b4fcdc tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.507728 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26cf9089-68f5-4df9-a16a-796f37b4fcdc tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.025116 Oct 28 19:10:24.508360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 391/758] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:24.512997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34976637-3fe2-4959-8a19-bea9b62c4200 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Action: 'create', calling method: .version_select at 0x7f1d7c2e8820>, body: {"security_group_rule": {"parent_group_id": "e198fcba-dd48-4082-8b49-3ec38b62f1ea", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:24.660156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Building network info cache for instance {{(pid=120628) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:10:24.883483 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34976637-3fe2-4959-8a19-bea9b62c4200 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.374096 Oct 28 19:10:24.885217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 392/759] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:10:24 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:24.893050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.895097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:24.904342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.905346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.906193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.907255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.907910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.908530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.995891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.004851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.012130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.017800 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-30497f9e-93af-4dc7-bc77-de70f2fa582b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1535 microversion: 2.91 time: 0.131170 Oct 28 19:10:25.018384 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 393/760] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1535 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:25.023421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.024420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.031407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.032115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.032711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.033575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.034178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.034797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.142457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.152502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.154396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.160322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b480851c-1d7a-4554-9a63-524f5754fc5c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.140653 Oct 28 19:10:25.170998 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 394/761] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:25.170998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78f0bee2-0349-4ce3-901a-8607649f840c tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.188433 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78f0bee2-0349-4ce3-901a-8607649f840c tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/2007963952" status: 202 len: 0 microversion: 2.1 time: 0.025880 Oct 28 19:10:25.189236 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 395/762] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/flavors/2007963952 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:25.194307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-def06089-0e74-4d22-b36a-c2fdf945f97f tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.201244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-def06089-0e74-4d22-b36a-c2fdf945f97f tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011062 Oct 28 19:10:25.203173 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 396/763] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:25.206988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-217bc799-71eb-4bc0-83b0-21a3bb08e6ac req-cd831d36-aff3-4f84-b0b7-062a86fbe5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:25.218835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-217bc799-71eb-4bc0-83b0-21a3bb08e6ac req-cd831d36-aff3-4f84-b0b7-062a86fbe5f1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.219308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-217bc799-71eb-4bc0-83b0-21a3bb08e6ac req-cd831d36-aff3-4f84-b0b7-062a86fbe5f1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.219727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-217bc799-71eb-4bc0-83b0-21a3bb08e6ac req-cd831d36-aff3-4f84-b0b7-062a86fbe5f1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.231095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-217bc799-71eb-4bc0-83b0-21a3bb08e6ac req-cd831d36-aff3-4f84-b0b7-062a86fbe5f1 service nova] Creating event network-changed:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:10:25.237268 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-217bc799-71eb-4bc0-83b0-21a3bb08e6ac req-cd831d36-aff3-4f84-b0b7-062a86fbe5f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033625 Oct 28 19:10:25.237867 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 397/764] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:25.243314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44ea949f-6763-4bf6-9a03-7c1de9f00af8 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c177670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.325129 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44ea949f-6763-4bf6-9a03-7c1de9f00af8 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/e198fcba-dd48-4082-8b49-3ec38b62f1ea" status: 200 len: 664 microversion: 2.1 time: 0.085713 Oct 28 19:10:25.325823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 398/765] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/os-security-groups/e198fcba-dd48-4082-8b49-3ec38b62f1ea => generated 664 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:25.331940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e6d28d4-eb84-4c96-b193-692b485b2f3a tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.334942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Updating instance_info_cache with network_info: [{"id": "bd8ab30c-ab17-41d7-9969-4523b815028d", "address": "fa:16:3e:a6:db:1d", "network": {"id": "eaf8a972-4544-4697-b19b-9248b3c756b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-808985558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa88591c155d44528bf278ff93f3c2e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd8ab30c-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120628) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:10:25.349369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Releasing lock "refresh_cache-d9681047-4f32-42c2-b7df-664e7e529676" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:10:25.350574 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-484c8063-cc47-48be-9281-3ea8654544e7 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action" status: 202 len: 0 microversion: 2.1 time: 3.034365 Oct 28 19:10:25.351403 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 368/766] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:22 2022] POST /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676/action => generated 0 bytes in 3036 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:10:25.353087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e6d28d4-eb84-4c96-b193-692b485b2f3a tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.026016 Oct 28 19:10:25.359381 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 399/767] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:25.359569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e83c7164-b501-4b0a-85f4-f2fe8ed3e97f tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1202525552", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:25.359699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b5dd1537-0a52-4cf3-baec-1ef62a4cd9fd tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c5418b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.380374 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e83c7164-b501-4b0a-85f4-f2fe8ed3e97f tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.027663 Oct 28 19:10:25.381109 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 369/768] 10.222.0.44 () {60 vars in 1146 bytes} [Fri Oct 28 19:10:25 2022] POST /compute/v2.1/flavors => generated 499 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:25.386139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.386971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.393466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.397185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.397688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.399079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.399548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.400490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.415977 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] HTTP exception thrown: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Request method failure captured: Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd HTTP/1.1 Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCjaC5kDuKW74UnzQCYIkLxCu4U9wrpha5sroQgna3_MGVjerkgEr7iOKaEKWwZ7dFj7yd99EFUJfkWl3X5MMkrvXYDAjAu11CEtCMmqjBSqY_2kpa0n-laFV-tZVmisvAtDDDp7VLNf7K1A9hkA_LJ1PgBE60iMF8WgrAkgaC598uc Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:10:25.417537 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa88591c155d44528bf278ff93f3c2e5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0e591cea1b324e78bd62e7e06b1d2623 Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.419087 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '232d18b9-8ea4-4cbe-9673-8796c8479dfd'} Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:25.419956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.421314 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.423356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Returning 404 to user: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:25.423356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c3f7e7a9-973a-432e-b486-4e1cce0d580e tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "DELETE /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 404 len: 111 microversion: 2.1 time: 0.040986 Oct 28 19:10:25.423875 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 370/769] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:25.437046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29b9666f-b1a9-4b08-a0a6-89c8f2f7997e tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.457015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29b9666f-b1a9-4b08-a0a6-89c8f2f7997e tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/2082668900" status: 202 len: 0 microversion: 2.1 time: 0.032060 Oct 28 19:10:25.457597 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 371/770] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/flavors/2082668900 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:25.464958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f87ffd41-52a2-4f56-ad6a-604c36bdc48a tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.473310 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f87ffd41-52a2-4f56-ad6a-604c36bdc48a tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014662 Oct 28 19:10:25.474096 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 372/771] 10.222.0.44 () {58 vars in 1182 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:10:25.478914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.479720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: 232d18b9-8ea4-4cbe-9673-8796c8479dfd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.489029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.489945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.490743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.491608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.492266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.493470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.508319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] HTTP exception thrown: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Request method failure captured: Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd HTTP/1.1 Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCjaC5kDuKW74UnzQCYIkLxCu4U9wrpha5sroQgna3_MGVjerkgEr7iOKaEKWwZ7dFj7yd99EFUJfkWl3X5MMkrvXYDAjAu11CEtCMmqjBSqY_2kpa0n-laFV-tZVmisvAtDDDp7VLNf7K1A9hkA_LJ1PgBE60iMF8WgrAkgaC598uc Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:10:25.510072 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa88591c155d44528bf278ff93f3c2e5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0e591cea1b324e78bd62e7e06b1d2623 Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.511637 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '232d18b9-8ea4-4cbe-9673-8796c8479dfd'} Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:25.512543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. Oct 28 19:10:25.513973 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.515416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Returning 404 to user: Instance 232d18b9-8ea4-4cbe-9673-8796c8479dfd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:25.515416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f5bc0317-04e8-4289-b296-6f2fa74f5fdb tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd" status: 404 len: 111 microversion: 2.1 time: 0.036518 Oct 28 19:10:25.515416 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 373/772] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/232d18b9-8ea4-4cbe-9673-8796c8479dfd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:25.519842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0514b08-4e1f-4219-94f2-085abf314f1a tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.541599 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0514b08-4e1f-4219-94f2-085abf314f1a tempest-ServersWithSpecificFlavorTestJSON-1025176372 tempest-ServersWithSpecificFlavorTestJSON-1025176372-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.025023 Oct 28 19:10:25.542922 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 374/773] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:25.548425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.549356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.555804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.556518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.557210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.558075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.558676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.560293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.564035 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b5dd1537-0a52-4cf3-baec-1ef62a4cd9fd tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-group-rules/0bd225b6-80aa-4822-ad23-762520a9555c" status: 202 len: 0 microversion: 2.1 time: 0.208993 Oct 28 19:10:25.564612 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 400/774] 10.222.0.44 () {58 vars in 1287 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/os-security-group-rules/0bd225b6-80aa-4822-ad23-762520a9555c => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:25.571221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c393f291-430b-492f-b7c2-04302f4972d0 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '.version_select at 0x7f1d7c4df3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.862261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.875227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.884451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.885925 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee2812e1-2268-4e8e-a4a3-cd8bfc60bacc tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1606 microversion: 2.25 time: 0.341792 Oct 28 19:10:25.886512 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 375/775] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1606 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:25.915069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.915595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:25.923728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.924746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.925425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.926364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.927130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.927751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.948520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 HTTP/1.1 Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:10:25.950407 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:25.951933 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80'} Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:25.952804 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:25.953991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:25.955154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:25.955154 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-762533b0-055f-4b6a-ba55-8ff5739697b9 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 404 len: 111 microversion: 2.1 time: 0.041281 Oct 28 19:10:25.955638 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 376/776] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:25.960906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e078242-302a-4dfc-9fe6-e63665b7445f tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c19d430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:26.581832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e078242-302a-4dfc-9fe6-e63665b7445f tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/e198fcba-dd48-4082-8b49-3ec38b62f1ea" status: 202 len: 0 microversion: 2.1 time: 0.624694 Oct 28 19:10:26.582617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 377/777] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/os-security-groups/e198fcba-dd48-4082-8b49-3ec38b62f1ea => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:26.588196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2098327765", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "79ce5af7-3c1a-4ac2-a9a9-58d96966f945"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:26.656982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:10:26.966486 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c393f291-430b-492f-b7c2-04302f4972d0 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/9f13aee5-4855-4fe5-9f82-21234f00ab5d" status: 202 len: 0 microversion: 2.1 time: 1.400366 Oct 28 19:10:26.967114 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 401/778] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:10:25 2022] DELETE /compute/v2.1/os-floating-ips/9f13aee5-4855-4fe5-9f82-21234f00ab5d => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:26.972515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:26.973117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:26.980109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.980582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.981006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:26.981694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:26.982152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:26.982664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.033470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:27.033957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:27.034376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:27.034831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:27.035262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:27.045746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.046276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.046812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.047549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.048024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.048472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.067639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:27.071485 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-948f5d00-9366-4e41-9971-3853524af69e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.103037 Oct 28 19:10:27.072092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 402/779] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:10:26 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:10:27.072743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for user 3142fd0059aa4b658c2cea015b1f3d93 and project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:27.077014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.077645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.084778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.085270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.085699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.085883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:27.086539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.087107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.087535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.088631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:27.101776 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 HTTP/1.1 Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:27.103483 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:27.104958 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80'} Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:27.105760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. Oct 28 19:10:27.106976 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.109032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:27.109869 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-989c35f7-4531-41c7-9f78-c5075cf437c4 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80" status: 404 len: 111 microversion: 2.1 time: 0.036481 Oct 28 19:10:27.110421 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 403/780] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/03e3fc8a-dbcb-4b24-a1ed-5437cfbb7c80 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:27.115496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.116227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.122337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.122930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.123446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.124207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.124913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.125402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.147037 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f1f8113-deeb-466a-8688-8ee0f989ad2d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563223 Oct 28 19:10:27.149714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 378/781] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:10:27.155008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.155684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.163859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.164611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.165322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.166226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.166867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.167445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.206809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.215722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.226428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.250087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba9b6474-0033-4bc2-ab01-97e169ecf2a4 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1478 microversion: 2.91 time: 0.136345 Oct 28 19:10:27.270722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 404/782] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1478 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:27.270722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c541310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.271220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.274632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.277348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.283014 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3076475a-4689-4f9a-8a6e-bd98713e1866 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.132159 Oct 28 19:10:27.283371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:10:27.290741 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 379/783] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:27.290931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Neutron security group b5518151-6e3d-402b-bddd-0c11e0e3b237 not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:10:27.290931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] HTTP exception thrown: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.290931 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] Oct 28 19:10:27.291147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.291147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.297985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Request method failure captured: Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/b5518151-6e3d-402b-bddd-0c11e0e3b237 HTTP/1.1 Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCkIAgtCLvgjmL1YBUay83zyzWvpwIUJvLdrw1KoOFKlKy87OTHRDoxlNgx6nswjrXQLSD4GJ4Vx6shNjP_hCDBaqjoqC8BuQcmVSLsXaH77BtFDCr78zAHrwrFhV2ipjE7WWWsTmlr01wwaPNnbFlDpXYZ_SyQQG_wdoti-w_tVx9k Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: aa3451a02ac84531a8df9f4fb6e7874c Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-89600981 Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:27.298135 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa3451a02ac84531a8df9f4fb6e7874c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa3451a02ac84531a8df9f4fb6e7874c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa3451a02ac84531a8df9f4fb6e7874c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa3451a02ac84531a8df9f4fb6e7874c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupRulesTestJSON-89600981 Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: aa3451a02ac84531a8df9f4fb6e7874c Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-89600981 Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupRulesTestJSON-89600981-project Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1e8b4dfed5ab4a109d1477a5057b44ed Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupRulesTestJSON-89600981-project Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] Oct 28 19:10:27.299442 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'b5518151-6e3d-402b-bddd-0c11e0e3b237'} Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:27.300248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:10:27.301326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.302546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Returning 404 to user: Security group b5518151-6e3d-402b-bddd-0c11e0e3b237 does not exist Oct 28 19:10:27.304038 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-8f8108ac-d017-4735-afa0-620105eb765d'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:27.305390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.305390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.305657 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-acdc997b-0170-4312-ae8a-073b5342843e tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/b5518151-6e3d-402b-bddd-0c11e0e3b237" status: 404 len: 194 microversion: 2.1 time: 0.047778 Oct 28 19:10:27.305657 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 405/784] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:27 2022] DELETE /compute/v2.1/os-security-groups/b5518151-6e3d-402b-bddd-0c11e0e3b237 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:27.305870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.305870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.305870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.308797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.309325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.316661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.317158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.317593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.318325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.319079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.319527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.333103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:10:27.334423 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 HTTP/1.1 Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:27.336044 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.337450 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '831d5ec9-b916-4990-84b9-8750b7b09827'} Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:27.338650 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.340114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.347521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:27.347521 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-692138ae-a441-4c11-80e5-a6c82f7e0e25 tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 404 len: 111 microversion: 2.1 time: 0.034817 Oct 28 19:10:27.347521 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 406/785] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:27 2022] DELETE /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:27.347521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d6b5e1c-b130-4269-9351-2320014f699d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.347521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d6b5e1c-b130-4269-9351-2320014f699d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.415480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d6b5e1c-b130-4269-9351-2320014f699d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.423281 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d6b5e1c-b130-4269-9351-2320014f699d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1279 microversion: 2.1 time: 0.080389 Oct 28 19:10:27.432477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 407/786] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:27.438742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:27.442065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.446701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72df39de-9b8c-4fc6-b9de-6746c74a0114 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 204 len: 0 microversion: 2.1 time: 0.161441 Oct 28 19:10:27.447339 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 380/787] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:27 2022] DELETE /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:27.453646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.454369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.454974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.455869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.456461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.456583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e9489556-c144-435f-af55-b8d7c7aed1f0 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c1948b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.457116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.514367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862769-3". {{(pid=120629) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:10:27.614071 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-769249b2-df4f-4ce1-a435-540c3b089b47 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action" status: 202 len: 0 microversion: 2.91 time: 0.176505 Oct 28 19:10:27.621959 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 408/788] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:10:27 2022] POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:27.630402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.631590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] [instance: 831d5ec9-b916-4990-84b9-8750b7b09827] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.641479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.642138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.642617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.643643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.644338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.645180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.668420 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] HTTP exception thrown: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Request method failure captured: Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 HTTP/1.1 Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChwK6Exv58tm6A5sYq1QGWeZzJLhBTTJ1ddvMBa0VU0HQXZOQq3buuXPWiTkEJ4NmAuLVTTEjP-X5wr7tOEzzJUvwZHfNdc6k6ojy4fwkji_8WEDpHI52MTiGxoydNsX20sIsU1b450mheiZCQaK8ynOINc3qCXayISvbpXbpQCA5A Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:27.677799 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cabf5bc7f864f11b150f8b15825922c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cabf5bc7f864f11b150f8b15825922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2cabf5bc7f864f11b150f8b15825922c Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916 Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8468bb4493eb4cf5951029cda891cec9 Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1121544916-project Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.679867 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '831d5ec9-b916-4990-84b9-8750b7b09827'} Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:27.680878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. Oct 28 19:10:27.682409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:27.688289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] Returning 404 to user: Instance 831d5ec9-b916-4990-84b9-8750b7b09827 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:27.688289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8ad9bdab-96ba-4ef9-a57f-af0c9760e75d tempest-ServersWithSpecificFlavorTestJSON-1121544916 tempest-ServersWithSpecificFlavorTestJSON-1121544916-project] 10.222.0.44 "GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827" status: 404 len: 111 microversion: 2.1 time: 0.058593 Oct 28 19:10:27.688289 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 409/789] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/831d5ec9-b916-4990-84b9-8750b7b09827 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:27.691914 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e9489556-c144-435f-af55-b8d7c7aed1f0 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/77671f8d-5d06-44f7-88af-e625bd1f5a5b" status: 202 len: 0 microversion: 2.1 time: 0.243267 Oct 28 19:10:27.693294 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 381/790] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:27 2022] DELETE /compute/v2.1/os-security-groups/77671f8d-5d06-44f7-88af-e625bd1f5a5b => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:27.697654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.699360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.702168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:27.704991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:27.711601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.711851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.712279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.717058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.717601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.718845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.720569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.722593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.725393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.727491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.730918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.731492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.742530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:27.859239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.869243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.871299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:27.877609 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f2f22953-e76c-483e-b990-7451b8ff2502 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1486 microversion: 2.91 time: 0.182404 Oct 28 19:10:27.878214 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 382/791] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1486 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:27.886522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-786de561-41bc-4091-9749-e280179552da tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c590310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.056421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.070715 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6cc81b3e-5d12-43bf-9499-264a3e492173 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1526 microversion: 2.1 time: 0.385154 Oct 28 19:10:28.086587 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 410/792] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:27 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1526 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:28.313521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.314129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.320252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.320740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.321166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.321853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.322305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.322735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.429465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.443618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.445603 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-786de561-41bc-4091-9749-e280179552da tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/8a8dcde5-1c26-46f1-933d-1e58b7caa9d7" status: 202 len: 0 microversion: 2.1 time: 0.566069 Oct 28 19:10:28.446094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.446218 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 383/793] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:27 2022] DELETE /compute/v2.1/os-security-groups/8a8dcde5-1c26-46f1-933d-1e58b7caa9d7 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:28.451040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-86e821af-2f06-4287-b0d3-68b43d9b31ce req-3fdbcbb2-e245-4df4-bd1d-2143d1ec5a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7de605-17c2-4004-99c0-2461d81bf4b7", "tag": "2ba7e6ec-b446-4804-ac52-5db82ecf7f7f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:28.475737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-86e821af-2f06-4287-b0d3-68b43d9b31ce req-3fdbcbb2-e245-4df4-bd1d-2143d1ec5a42 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.476208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-86e821af-2f06-4287-b0d3-68b43d9b31ce req-3fdbcbb2-e245-4df4-bd1d-2143d1ec5a42 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.476630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-86e821af-2f06-4287-b0d3-68b43d9b31ce req-3fdbcbb2-e245-4df4-bd1d-2143d1ec5a42 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.476765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb0aa7e7-ecc6-48d9-b68c-746a87c39b4d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.164930 Oct 28 19:10:28.493170 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 411/794] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:28.495042 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-86e821af-2f06-4287-b0d3-68b43d9b31ce req-3fdbcbb2-e245-4df4-bd1d-2143d1ec5a42 service nova] Creating event network-changed:2ba7e6ec-b446-4804-ac52-5db82ecf7f7f for instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 on n-h1-862769-3 Oct 28 19:10:28.512629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-86e821af-2f06-4287-b0d3-68b43d9b31ce req-3fdbcbb2-e245-4df4-bd1d-2143d1ec5a42 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064954 Oct 28 19:10:28.513264 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 384/795] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:28.517405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd997f90-9697-4600-ac81-98c7172ce151 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c37d790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.519830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.520722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.534137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.542339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.543093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.544006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.545051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.545625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.741432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:28.749856 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74573ffd-5f67-46b6-8b11-0bcfdcf0e0ef tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1283 microversion: 2.1 time: 0.235136 Oct 28 19:10:28.750629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 385/796] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1283 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:28.908675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:28.909739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:28.918369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.919199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.919894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:28.920831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:28.921557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:28.922200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.222814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.231396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.233059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.243362 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c41370c9-8a14-43de-8760-918620c5e07b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.339009 Oct 28 19:10:29.244479 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 386/797] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:28 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:29.249510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.250317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.256678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.257371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.258026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.258930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.259672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.260284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.840443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:29.849285 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c46fae0-7edf-4c88-9dbd-4cc7b781b090 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1526 microversion: 2.1 time: 0.603526 Oct 28 19:10:29.862918 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 387/798] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1526 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:29.862918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.862918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.866431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.866945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.867373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.868065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.868514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.868925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.878620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd997f90-9697-4600-ac81-98c7172ce151 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/483490c8-09bf-4f86-ba6f-9371d2a714dc" status: 202 len: 0 microversion: 2.1 time: 1.383903 Oct 28 19:10:29.882558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 412/799] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:28 2022] DELETE /compute/v2.1/os-security-groups/483490c8-09bf-4f86-ba6f-9371d2a714dc => generated 0 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:29.888794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:29.889477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:29.895909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.896431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.897020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:29.897950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:29.898449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:29.899154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.001108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.010896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.012815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.036899 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f7b9919-331d-45d6-a064-a00a9b974eaf tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.185122 Oct 28 19:10:30.037535 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 388/800] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:30.058736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e12235c7-9f24-4818-9a97-d753e79e8e81 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d7c19d820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.207823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.222356 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a244707-a18d-4adc-b922-8a72b4a93c14 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1331 microversion: 2.1 time: 0.338455 Oct 28 19:10:30.245726 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 413/801] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:29 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1331 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:30.270868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.272011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:30.280906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.285500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.286139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.288168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.289848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.291254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.402457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.415412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.417778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:30.425449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:30.429257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fbb4e5ad-9e52-48b0-86be-011ec826ffb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.161902 Oct 28 19:10:30.430358 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 414/802] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:30 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:30.825564 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e12235c7-9f24-4818-9a97-d753e79e8e81 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/2545b81e-a9b0-4652-859a-299fc43617be" status: 202 len: 0 microversion: 2.1 time: 0.785350 Oct 28 19:10:30.826117 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 389/803] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:30 2022] DELETE /compute/v2.1/os-security-groups/2545b81e-a9b0-4652-859a-299fc43617be => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:30.835756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6dbb5580-01ac-4cc4-94a8-96b61006dea8 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] Calling method '.version_select at 0x7f1d77f6e5e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.873231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:30.873909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:30.884414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.886889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.889184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.889933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:30.892778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:30.894032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:30.949705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:31.092076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.113674 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5d826f4-53a5-4b07-bd92-f1c627ecbb5b tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1484 microversion: 2.1 time: 0.242190 Oct 28 19:10:31.126854 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 390/804] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:30 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1484 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:31.154719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fed737b5-1120-4e25-aac3-788347dd900e req-5de15f4b-7a9a-4fe3-9772-4393bbe76036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9681047-4f32-42c2-b7df-664e7e529676", "name": "network-vif-deleted", "tag": "bd8ab30c-ab17-41d7-9969-4523b815028d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:31.195269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fed737b5-1120-4e25-aac3-788347dd900e req-5de15f4b-7a9a-4fe3-9772-4393bbe76036 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.203167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fed737b5-1120-4e25-aac3-788347dd900e req-5de15f4b-7a9a-4fe3-9772-4393bbe76036 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.209226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fed737b5-1120-4e25-aac3-788347dd900e req-5de15f4b-7a9a-4fe3-9772-4393bbe76036 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.273790 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fed737b5-1120-4e25-aac3-788347dd900e req-5de15f4b-7a9a-4fe3-9772-4393bbe76036 service nova] Creating event network-vif-deleted:bd8ab30c-ab17-41d7-9969-4523b815028d for instance d9681047-4f32-42c2-b7df-664e7e529676 on n-h2-862769-3 Oct 28 19:10:31.306286 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fed737b5-1120-4e25-aac3-788347dd900e req-5de15f4b-7a9a-4fe3-9772-4393bbe76036 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162179 Oct 28 19:10:31.309068 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 391/805] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:31.331421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:31.332158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:31.352801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.353181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.353795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.355820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.356456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.357049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.451319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6dbb5580-01ac-4cc4-94a8-96b61006dea8 tempest-SecurityGroupRulesTestJSON-89600981 tempest-SecurityGroupRulesTestJSON-89600981-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/631c62d5-22a4-4992-ad69-db3de15f65c5" status: 202 len: 0 microversion: 2.1 time: 0.620086 Oct 28 19:10:31.453694 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 415/806] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:30 2022] DELETE /compute/v2.1/os-security-groups/631c62d5-22a4-4992-ad69-db3de15f65c5 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:31.457630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:31.458237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:31.474216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.475266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.476943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.477856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.484228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.484708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.724119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.733948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.742870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.753369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2eb5d1dc-0553-4fd0-8f0c-0b1659ccd11c tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.442348 Oct 28 19:10:31.756577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 392/807] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:31 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:31.770421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:31.771367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:31.786843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.787542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.790296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.791235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:31.792148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:31.799469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:31.884630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.893547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b3d9a2a6-8495-446d-bbe3-91bb249aafad tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.439977 Oct 28 19:10:31.898323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 416/808] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:31 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:31.981638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:31.994080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.000371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.011952 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-488fe7b8-118f-4db3-a769-a87f46fe1c85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.252903 Oct 28 19:10:32.012539 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 393/809] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:31 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:32.146224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.147477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.157230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.160436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.161737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.162649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.163132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.165816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.284680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.285209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.285658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.286127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lazy-loading 'fault' on Instance uuid d9681047-4f32-42c2-b7df-664e7e529676 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:32.643775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e591cea1b324e78bd62e7e06b1d2623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa88591c155d44528bf278ff93f3c2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:32.656949 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fd99e184-eab0-490c-90af-b7ff5e9f33be tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 200 len: 1314 microversion: 2.1 time: 0.516016 Oct 28 19:10:32.657830 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 417/810] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:32.788689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.789294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.802153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.802654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.807941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.807941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.807941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.807941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.924092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:32.924666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:32.938707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.954626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.957965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:32.958894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:32.959535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:32.960068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.003999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.015385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.024180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.044615 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a0532df-15cb-4602-aa7e-afe2f9ec4a7a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.260247 Oct 28 19:10:33.059699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 394/811] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:33.059699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:33.059699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:33.071277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.071456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.072426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.073554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.074672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.075575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.617401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.630110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.632063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:33.645161 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff20e4f5-3699-459a-b165-7d51ac9fed5e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.598361 Oct 28 19:10:33.647690 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 395/812] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:33 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:33.670985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9aa53ba2-8ce0-4d75-9be8-71673841f218 req-ab2a8c3f-0f04-4d03-8fb9-14fd2a8db571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:33.691744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9aa53ba2-8ce0-4d75-9be8-71673841f218 req-ab2a8c3f-0f04-4d03-8fb9-14fd2a8db571 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.692780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9aa53ba2-8ce0-4d75-9be8-71673841f218 req-ab2a8c3f-0f04-4d03-8fb9-14fd2a8db571 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.693514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9aa53ba2-8ce0-4d75-9be8-71673841f218 req-ab2a8c3f-0f04-4d03-8fb9-14fd2a8db571 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.710004 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9aa53ba2-8ce0-4d75-9be8-71673841f218 req-ab2a8c3f-0f04-4d03-8fb9-14fd2a8db571 service nova] Creating event network-changed:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h2-862769-3 Oct 28 19:10:33.724643 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9aa53ba2-8ce0-4d75-9be8-71673841f218 req-ab2a8c3f-0f04-4d03-8fb9-14fd2a8db571 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075294 Oct 28 19:10:33.728354 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 396/813] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:33.742357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:33.744505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] [instance: d9681047-4f32-42c2-b7df-664e7e529676] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:33.774797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.775938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.776620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.777584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:33.782090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:33.782906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:33.852597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] HTTP exception thrown: Instance d9681047-4f32-42c2-b7df-664e7e529676 could not be found. Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Request method failure captured: Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 HTTP/1.1 Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCjaC5kDuKW74UnzQCYIkLxCu4U9wrpha5sroQgna3_MGVjerkgEr7iOKaEKWwZ7dFj7yd99EFUJfkWl3X5MMkrvXYDAjAu11CEtCMmqjBSqY_2kpa0n-laFV-tZVmisvAtDDDp7VLNf7K1A9hkA_LJ1PgBE60iMF8WgrAkgaC598uc Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:10:33.857610 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa88591c155d44528bf278ff93f3c2e5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa88591c155d44528bf278ff93f3c2e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: aa88591c155d44528bf278ff93f3c2e5 Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-174834031 Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0e591cea1b324e78bd62e7e06b1d2623 Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-174834031-project Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d9681047-4f32-42c2-b7df-664e7e529676 could not be found. Oct 28 19:10:33.863377 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd9681047-4f32-42c2-b7df-664e7e529676'} Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9681047-4f32-42c2-b7df-664e7e529676 could not be found. Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:33.865027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9681047-4f32-42c2-b7df-664e7e529676 could not be found. Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9681047-4f32-42c2-b7df-664e7e529676 could not be found. Oct 28 19:10:33.869203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:33.881358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] Returning 404 to user: Instance d9681047-4f32-42c2-b7df-664e7e529676 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:33.882051 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12b715d0-3a94-4796-9676-60ec6b44c191 tempest-FloatingIPsAssociationTestJSON-174834031 tempest-FloatingIPsAssociationTestJSON-174834031-project] 10.222.0.44 "GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676" status: 404 len: 111 microversion: 2.1 time: 0.143392 Oct 28 19:10:33.883224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 397/814] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:33 2022] GET /compute/v2.1/servers/d9681047-4f32-42c2-b7df-664e7e529676 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:34.082404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.084614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:34.085233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:34.094426 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f11d1fa-03ae-4502-bdd4-f92c241a90e7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 1.175078 Oct 28 19:10:34.106726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.106726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.106726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.106726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.107257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.107257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.108341 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 418/815] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:32 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:34.424121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.442256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.444207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.451255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:34.471077 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2eb222a-abdf-4f1a-b8e6-c2be3ba5ea99 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.390279 Oct 28 19:10:34.471980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 398/816] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:34 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:34.686497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:34.688087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:34.702174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.702764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.705204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.706029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:34.706578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:34.718222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:34.874085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.897346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.899106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:34.904768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-33899cb3-f252-40a1-b116-772afcf08e86 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.224026 Oct 28 19:10:34.929155 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 419/817] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:34 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:35.126292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:35.129259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:35.140643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.142821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.144575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.145533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.146264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.146937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.501439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:35.502771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:35.512211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.515383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.516088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.517081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.519613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.520282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.536871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.555297 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2785cf79-7e7f-422d-a2c7-09d29a694985 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.430534 Oct 28 19:10:35.557316 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 399/818] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:35 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:35.715164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.747269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.748836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:35.782455 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e5c9b33-61af-431c-8ecb-8146744c17f1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.284694 Oct 28 19:10:35.783228 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 420/819] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:35 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:35.936655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:35.937376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:35.947174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.947667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.948100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:35.954870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:35.955475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:35.955922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.160111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.170854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.172705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:36.178208 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-86a74345-fd15-40ce-81c7-3d59f07c3deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.245503 Oct 28 19:10:36.191451 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 400/820] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:35 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:36.584756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:36.585544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:36.597740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.598474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.599942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.602579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.604328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.604862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.814026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:36.814947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:36.824660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.827339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.829653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:36.830570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:36.832300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:36.839567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.056560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:37.080202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:37.101966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.121720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-321ab04b-0320-4344-85e7-a6bbbc71aa4f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.539248 Oct 28 19:10:37.134013 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 421/821] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:36 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:37.211972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:37.212758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:37.235184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.235343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.236033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.238613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:37.241114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:37.249559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:37.265582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.293772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.300842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.359681 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9439e81-7dac-414c-b52a-165056a3e64f tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.549716 Oct 28 19:10:37.375932 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 401/822] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:36 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:37.419855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:37.534009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.550015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.557287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:37.576485 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ce97610-d3a2-4650-b8c4-1d3c113fb331 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.368351 Oct 28 19:10:37.592807 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 422/823] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:37 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:38.153329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:38.153943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:38.173789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:38.174263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:38.178997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:38.179960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:38.183198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:38.183838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:38.390233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:38.391146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:38.402475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:38.403175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:38.414254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:38.415280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:38.415896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:38.416460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:39.129720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.140059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.156541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.176006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e3f300b-e0cc-4bca-83a5-0c8c8a598f81 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.790986 Oct 28 19:10:39.176623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 423/824] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:38 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:39.189762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:39.194989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:39.209591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:39.212535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:39.213546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:39.216676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:39.219612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:39.220277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:39.273765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.281741 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5ed6010-a027-4ad9-98aa-7a101cd5b0ee tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 1.132143 Oct 28 19:10:39.287431 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 402/825] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:38 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:39.363810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.376803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.379012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:39.389859 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4aa3578-3d71-4063-8ca1-f2299a62561d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.210894 Oct 28 19:10:39.391288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 424/826] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:39 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:40.213904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.214781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:40.224632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.225126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.225559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.226264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.239343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.240877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.309317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.310046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:40.328789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.329305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.329931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.332267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.332939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.333539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.473636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.498364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.501633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.518855 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf3c88ee-c578-481c-a50a-22c8bca99023 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.310642 Oct 28 19:10:40.532917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 403/827] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:40.544746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.545529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:40.561723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.561723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.561723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.561723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.562106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.562199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.908244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.941869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.948865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.962993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2bb32ab-b1d8-43dc-88b4-9558f760b4ca tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.426927 Oct 28 19:10:40.992871 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 404/828] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:41.020253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:41.039861 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8d096e3-d885-4679-bcb4-f0451623e46a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.734772 Oct 28 19:10:41.041244 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 425/829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:41.309469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:41.310333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:41.318764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.324815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.326226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.328105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.330671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.332132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.554153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:41.554785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:41.564139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.568647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.570808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.572485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.574591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.575942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.841417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:41.852413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:41.890164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:41.902791 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-237da772-2b9d-4fe4-b071-ff46128ece49 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.355889 Oct 28 19:10:41.924093 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 426/830] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:41 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:41.947520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d924137d-dbce-4d59-820c-2178631a93c6 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1813 microversion: 2.1 time: 0.641616 Oct 28 19:10:41.963767 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 405/831] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:41 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1813 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:41.980642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:41.988480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.989297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.989895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.991480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:41.992155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:41.992743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:41.998238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:41.999202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:42.013052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.014544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.015457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.016865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.017296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.017933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.048703 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a68eca40-752c-452e-adfa-3aa3455fcab9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.072142 Oct 28 19:10:42.057184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 427/832] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:10:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:42.069329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:42.071290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:42.079327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.080746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.082373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.083352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.084028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.085166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.186371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:42.204139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:42.205573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:42.221705 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc92c017-50d7-4139-ae26-be2220909278 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.227118 Oct 28 19:10:42.222285 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 406/833] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:41 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:42.367336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:42.378205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9859a21b-cac4-4656-b32d-30bc33a55855 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.313673 Oct 28 19:10:42.400730 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 428/834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:42 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:42.736090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-cdb5ec81-34bc-4c63-ba07-c26a097fcfad req-f24dca89-75b5-4a25-b051-15606321840f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "name": "network-vif-plugged", "status": "completed", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:42.772396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cdb5ec81-34bc-4c63-ba07-c26a097fcfad req-f24dca89-75b5-4a25-b051-15606321840f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.773425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cdb5ec81-34bc-4c63-ba07-c26a097fcfad req-f24dca89-75b5-4a25-b051-15606321840f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.775543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cdb5ec81-34bc-4c63-ba07-c26a097fcfad req-f24dca89-75b5-4a25-b051-15606321840f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.808061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-cdb5ec81-34bc-4c63-ba07-c26a097fcfad req-f24dca89-75b5-4a25-b051-15606321840f service nova] Creating event network-vif-plugged:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h2-862769-3 Oct 28 19:10:42.816913 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-cdb5ec81-34bc-4c63-ba07-c26a097fcfad req-f24dca89-75b5-4a25-b051-15606321840f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090618 Oct 28 19:10:42.817827 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 407/835] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:43.035368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:43.037730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:43.049142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:43.061808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:43.065901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.070748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:43.072179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:43.074760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.144018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:43.255530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:43.257806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:43.276089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:43.279939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:43.282811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.285673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:43.286358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:43.288680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.485114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.501083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.507088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.521592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.522863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.528551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.540887 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6008d1a8-21fb-4d17-a57d-cea7172393e1 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1447 microversion: 2.75 time: 0.517281 Oct 28 19:10:43.542489 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f71c84f7-fe1a-444d-802d-e7e52216b7d5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.292748 Oct 28 19:10:43.544600 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 429/836] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:43 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1447 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:43.559146 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 408/837] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:43 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:43.579641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:43.589989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:43.601553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:43.602092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:43.602523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.603295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:43.604248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:43.604248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:43.885488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:43.901804 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e563f1a8-0d3f-4d22-a524-2b5e4be04212 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.355948 Oct 28 19:10:43.902432 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 430/838] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:43 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:44.573918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:44.575170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:44.587433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:44.588052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:44.592549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.598670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.599853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.601336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.601700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.601857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.602602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.605412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.606772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.613689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.614467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.615754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.905473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.937239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.943293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.944868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.953909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:44.965132 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc89c223-5168-4439-a32e-6b273192c663 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.381903 Oct 28 19:10:44.972333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.975862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.979726 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 431/839] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:44 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:44.984779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bd47de1-69ee-4903-b3ca-5b3ea29b9235 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1453 microversion: 2.75 time: 0.414718 Oct 28 19:10:44.986161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 409/840] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:44 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1453 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:45.011903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:45.012765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:45.019697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:45.020173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:45.026231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:45.030598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:45.033272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:45.035386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:45.413915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:45.438610 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e9297c2-8b26-443b-a369-ed422d542f21 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.457582 Oct 28 19:10:45.439774 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 432/841] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:44 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:46.004465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:46.005995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:46.020201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.020823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.022593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.024358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.025441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.027424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.028461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:46.033976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:46.063388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.065279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.065803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.068638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.069199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.073277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.163805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:46.174574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:46.176614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:46.186182 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f824a0e0-7e5f-440b-b82b-f585d5dfa542 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.186389 Oct 28 19:10:46.187743 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 410/842] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:45 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:46.237149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:46.276967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:46.286462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:46.294041 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07206f34-63aa-40fd-a325-4dc59f6b2c93 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1453 microversion: 2.75 time: 0.279972 Oct 28 19:10:46.295515 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 433/843] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:46 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1453 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:46.465530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:46.466411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:46.474161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.475101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.475698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.476592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.477313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.477967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.569356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "179511fa-3ffe-47fa-b529-8e8b2a84a510", "device": "/dev/xvdb"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:46.573465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:46.580318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.580991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.581582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:46.583231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:46.583849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:46.584420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:47.147732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.171292 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65a86e8f-6403-4ae2-9250-8b3fdb8f71e9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1379 microversion: 2.1 time: 0.711983 Oct 28 19:10:47.189053 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 411/844] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:46 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1379 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:47.217651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:47.218777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:47.225149 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ebff4d4-5353-4ede-bf2b-48c840fa004f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "POST /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660050 Oct 28 19:10:47.233595 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 434/845] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:10:46 2022] POST /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:47.240192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:47.242229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:47.245413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:47.246543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:47.247404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:47.248762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:47.324818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:47.325708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:47.347278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:47.348161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:47.348848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:47.349835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:47.350529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:47.351254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:47.423920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.442346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.448693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.456887 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cccde23c-7f04-4200-8f67-eff8438602a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.244860 Oct 28 19:10:47.461849 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 412/846] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:47 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:47.497535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.507844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.511962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:47.530155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf4a2f04-dbc5-4ba0-8c10-899b757b957a tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1453 microversion: 2.75 time: 0.208376 Oct 28 19:10:47.533217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 435/847] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:47 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:48.216083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:48.216898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:48.232130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.233047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.234465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.235612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.237061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.238638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.496314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:48.497076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:48.510111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.511025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.511705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.515693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.516435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.517090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.733457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:48.751887 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c2f6274a-8f05-4c29-bc6d-71b3aff7c56c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1529 microversion: 2.1 time: 0.542097 Oct 28 19:10:48.752506 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 413/848] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:48 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1529 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:48.763157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:48.764984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:48.765605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:48.776230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:48.777694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:48.789848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e2aae75-4a44-42cd-bd15-1d5ccb40aa33 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1531 microversion: 2.91 time: 0.298850 Oct 28 19:10:48.791227 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 436/849] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:48 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1531 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:48.796302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:48.796506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.797013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.797418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:48.797561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.798140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.798594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.806451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.821737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.822469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.823541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:48.828185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:48.830385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:48.830996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.245978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:49.258379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:49.262735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:49.279673 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54471f91-77ed-457e-9d4b-f6f55d3f3e84 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1438 microversion: 2.75 time: 0.520810 Oct 28 19:10:49.281417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 414/850] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:48 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1438 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:49.294848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:49.295364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:49.312553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:49.313566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:49.331716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.335680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:49.339409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:49.343105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.446993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:49.461331 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94110357-aac0-4810-8728-399e7cd03530 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1529 microversion: 2.1 time: 0.668594 Oct 28 19:10:49.468402 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 437/851] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:48 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1529 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:49.600390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lazy-loading 'services' on Instance uuid c5e35a18-e0b7-432b-9139-2afe6f9be925 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:49.669539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8b51a94-6647-4291-b99b-7192814bd6c7 tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1936 microversion: 2.91 time: 0.384487 Oct 28 19:10:49.670379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 415/852] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:49 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1936 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:49.687587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3cee1202-7397-4584-b92e-4c920ce23ae0 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:49.716004 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3cee1202-7397-4584-b92e-4c920ce23ae0 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/79ce5af7-3c1a-4ac2-a9a9-58d96966f945" status: 202 len: 0 microversion: 2.1 time: 0.044049 Oct 28 19:10:49.716970 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 416/853] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:49 2022] DELETE /compute/v2.1/flavors/79ce5af7-3c1a-4ac2-a9a9-58d96966f945 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:49.739536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:49.740210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:49.762774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:49.770816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:49.771641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.776757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:49.777260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:49.777704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:49.878065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lazy-loading 'flavor' on Instance uuid c5e35a18-e0b7-432b-9139-2afe6f9be925 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:50.275534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:50.279725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:50.303698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.314586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.315355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.317897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.319376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.321961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.443983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51dbcc00-7e7c-4ec2-8ac7-892dcef65d62 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action" status: 202 len: 0 microversion: 2.91 time: 0.725390 Oct 28 19:10:50.455061 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 417/854] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:10:49 2022] POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:10:50.475310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-690caf2a-6d92-454e-9d41-fd053214f741 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:50.527352 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-690caf2a-6d92-454e-9d41-fd053214f741 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067987 Oct 28 19:10:50.541159 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 418/855] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:50.546426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:50.547259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:50.566334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:50.566863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:50.571267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:50.573981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.574778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.575591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.577098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:50.577526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:50.578869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.579959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.581859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.776400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:50.787181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.787683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.796839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.798368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.798561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:50.804015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.807428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.809495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:50.810963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:50.841707 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1af84003-4cd6-4bb5-81e3-003340b45e9b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.309828 Oct 28 19:10:50.842341 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 419/856] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:50 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:50.859251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:50.872202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:50.897828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.900275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.900775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:50.901607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:50.909271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:50.910023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.195700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:51.227232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:51.236169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Old instance type tempest-test_resize_flavor_-1202525552, new instance type m1.heat {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:10:51.241436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f7d9719-af5c-4726-b8fb-82bc3d8b5782 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501/action" status: 202 len: 1942 microversion: 2.75 time: 1.770460 Oct 28 19:10:51.257123 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 438/857] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:10:49 2022] POST /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501/action => generated 1942 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 19:10:51.259428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:51.262064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:51.264015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:51.265050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:51.266946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:51.276031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:51.277286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:51.285771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.286736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.287315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.289015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.290593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.291250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.434950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:51.482402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15058f42-08c8-423c-959a-f1e55cc7841d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.211584 Oct 28 19:10:51.499956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 439/858] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:51 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:51.555909 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd7d5ad7-98a7-456f-adb7-14371c056e50 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.707528 Oct 28 19:10:51.564009 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 420/859] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:50 2022] POST /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:51.565485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:51.566247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:51.581500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.582907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.584401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.585738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.587195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.589313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.873339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:51.874206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:51.891925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.894775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.897624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.899853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:51.902381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:51.903684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:51.912097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:51.928370 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6482c39c-94bc-4ddf-81d5-4f614b410fb3 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1538 microversion: 2.1 time: 0.363688 Oct 28 19:10:51.929936 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 440/860] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:51 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1538 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:52.099729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:52.129696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:52.131156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:52.147702 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bcc4637d-2877-442e-9eb9-851ddf997ec9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.280056 Oct 28 19:10:52.148306 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 421/861] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:51 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:52.517711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:52.518467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:52.520716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:52.535095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.536351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.545077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.546845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.547688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.548415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.658421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:52.663883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:52.710483 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0aa7249a-5d11-4c7b-a854-79528d06cc7d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.198698 Oct 28 19:10:52.715805 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 441/862] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:52 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:52.956297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:52.957067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:52.968615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.973506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.974813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:52.976849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:52.977478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:52.978059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.181766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:53.182839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:53.205414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:53.209709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:53.210738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.211899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:53.247295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:53.248590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.291752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:53.303009 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e3720ad-050b-4d42-bc9f-2e0c68c9c833 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1538 microversion: 2.1 time: 0.350639 Oct 28 19:10:53.304320 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 422/863] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:52 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1538 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:53.460688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:53.476396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:53.482299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:53.499438 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83e0464e-88ac-48fd-8403-c0335ba34ab6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.322576 Oct 28 19:10:53.503294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 442/864] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:53 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:10:53.748904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:53.750153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:53.767916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:53.772232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:53.775964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.780040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:53.785805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:53.790349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:53.857559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-67d96b28-4b08-419d-a894-d0c8f262d257 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1797969944", "id": 1947782541, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:53.897348 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-67d96b28-4b08-419d-a894-d0c8f262d257 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.365395 Oct 28 19:10:53.901629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 423/865] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:53.921943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-257df775-1e68-4434-a13a-7e06a2e3bf82 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:53.984769 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-257df775-1e68-4434-a13a-7e06a2e3bf82 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1947782541" status: 202 len: 0 microversion: 2.1 time: 0.074754 Oct 28 19:10:53.986961 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 424/866] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:53 2022] DELETE /compute/v2.1/flavors/1947782541 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:54.007711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-687e41d2-c26f-4340-8237-cfab667d22e9 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.081795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:54.086484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-687e41d2-c26f-4340-8237-cfab667d22e9 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093948 Oct 28 19:10:54.088666 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 425/867] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:54.110402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-955c9f0f-ce6f-4390-b494-cdec64fc9d41 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-401072998", "id": 1493972585, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:54.128707 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b34cd6eb-c5cf-4045-809c-992a1eec0240 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.384090 Oct 28 19:10:54.129574 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 443/868] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:53 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:54.154396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:54.166417 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-955c9f0f-ce6f-4390-b494-cdec64fc9d41 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.059922 Oct 28 19:10:54.171621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 426/869] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:54 2022] POST /compute/v2.1/flavors => generated 416 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:54.191520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1eea8d53-5057-419f-bcca-97b13fc8cdbb tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.262597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1eea8d53-5057-419f-bcca-97b13fc8cdbb tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.082696 Oct 28 19:10:54.264103 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 444/870] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:54.289463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc6ea254-aa85-424c-b66e-10e2587bbfa5 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.331959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.333006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:54.339399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc6ea254-aa85-424c-b66e-10e2587bbfa5 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1493972585" status: 202 len: 0 microversion: 2.1 time: 0.055373 Oct 28 19:10:54.343237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:54.345358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 427/871] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:54 2022] DELETE /compute/v2.1/flavors/1493972585 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:54.347222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:54.347948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:54.355410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:54.357733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72a95c92-fb0c-45f2-8aa1-b047979362b8 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.359585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:54.359695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:54.360141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:54.423430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72a95c92-fb0c-45f2-8aa1-b047979362b8 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073675 Oct 28 19:10:54.424032 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 428/872] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:54.466190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e1cb1e3-be8e-467b-b089-26072977f03a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-99887020", "id": 1124659610, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:54.510542 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e1cb1e3-be8e-467b-b089-26072977f03a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.070735 Oct 28 19:10:54.515236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 429/873] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:54 2022] POST /compute/v2.1/flavors => generated 427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:54.527519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2134a521-c9e6-4d2d-9106-aa0979a42879 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.564344 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2134a521-c9e6-4d2d-9106-aa0979a42879 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1124659610" status: 202 len: 0 microversion: 2.1 time: 0.040544 Oct 28 19:10:54.565238 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 430/874] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:54 2022] DELETE /compute/v2.1/flavors/1124659610 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:54.573505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.574342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:54.586344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:54.593519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:54.594472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:54.595458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:54.596162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:54.596828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:54.757093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:54.771130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:54.773131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:54.788974 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68294ee5-1bd5-4d2d-857c-e0b2f3bb0bba tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.221400 Oct 28 19:10:54.792556 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 431/875] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:54.799864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a63d6fd2-45eb-412e-9f77-d73fd7093339 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.858287 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a63d6fd2-45eb-412e-9f77-d73fd7093339 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063167 Oct 28 19:10:54.859061 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 432/876] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:54.884282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f54c8853-678e-4519-a57b-5455740ba0c4 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1261199613", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:54.901801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:54.913324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cde98d28-dcac-45a8-a1cd-c4082e8991fd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1538 microversion: 2.1 time: 0.587022 Oct 28 19:10:54.917326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f54c8853-678e-4519-a57b-5455740ba0c4 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.036688 Oct 28 19:10:54.921274 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 433/877] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:54 2022] POST /compute/v2.1/flavors => generated 507 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:54.928873 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 445/878] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1538 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:54.939399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f823f8c2-d424-43a0-92c1-b95eb4640ea1 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:54.974680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f823f8c2-d424-43a0-92c1-b95eb4640ea1 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/f2d3795f-b0bf-4325-9e5c-d47517c7c9c1" status: 202 len: 0 microversion: 2.1 time: 0.047220 Oct 28 19:10:54.975679 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 434/879] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:54 2022] DELETE /compute/v2.1/flavors/f2d3795f-b0bf-4325-9e5c-d47517c7c9c1 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:54.983763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3341ffb9-1a7d-419d-9293-a06decc89c5f tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.026351 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3341ffb9-1a7d-419d-9293-a06decc89c5f tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046318 Oct 28 19:10:55.027009 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 446/880] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:55.050134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8efe486e-9c00-49c5-9d01-31bfd105c24a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-786183652", "id": "df03f027-7084-4cab-a389-c07602209a75", "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:55.089065 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8efe486e-9c00-49c5-9d01-31bfd105c24a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.043605 Oct 28 19:10:55.089705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 435/881] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:55 2022] POST /compute/v2.1/flavors => generated 506 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:55.104322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d58f4952-2cf3-48ac-aea4-ab785f95ea6c tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.141623 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d58f4952-2cf3-48ac-aea4-ab785f95ea6c tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/df03f027-7084-4cab-a389-c07602209a75" status: 202 len: 0 microversion: 2.1 time: 0.042814 Oct 28 19:10:55.142251 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 447/882] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:10:55 2022] DELETE /compute/v2.1/flavors/df03f027-7084-4cab-a389-c07602209a75 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:55.151327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ebee115-beb2-48a5-8f3b-07fe3a620428 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.162927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.164088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:55.181248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.183730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.184622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.186200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.187922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.189289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.196941 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ebee115-beb2-48a5-8f3b-07fe3a620428 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049984 Oct 28 19:10:55.198295 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 436/883] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:55.218811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c1253b6-9541-4de5-ba38-be24c98f4d47 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1195869642", "id": 1984794862, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:55.257353 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c1253b6-9541-4de5-ba38-be24c98f4d47 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.042559 Oct 28 19:10:55.266536 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 437/884] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:55.273894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ef9f5e5-a738-4c7c-a5b5-7ef1b98192c7 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.281651 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ef9f5e5-a738-4c7c-a5b5-7ef1b98192c7 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/1984794862" status: 200 len: 414 microversion: 2.1 time: 0.013867 Oct 28 19:10:55.282228 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 438/885] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/flavors/1984794862 => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:55.351996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:55.419635 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-60785f05-fd49-45b1-87cf-e1fe2245ce57 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.262232 Oct 28 19:10:55.425273 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 448/886] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:55.580062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c54e71b-20c9-4c9b-ae7b-8ef7dba040e6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.636532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c54e71b-20c9-4c9b-ae7b-8ef7dba040e6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.337970 Oct 28 19:10:55.660827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4cbf646-b4f9-4dfe-b7b3-54b2ad071a75 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.661070 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 439/887] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:55.700836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4cbf646-b4f9-4dfe-b7b3-54b2ad071a75 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1984794862" status: 202 len: 0 microversion: 2.1 time: 0.044421 Oct 28 19:10:55.701935 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 449/888] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:55 2022] DELETE /compute/v2.1/flavors/1984794862 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:10:55.711735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8536dc4-2705-4c84-b512-50e9a1e65c07 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.769278 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8536dc4-2705-4c84-b512-50e9a1e65c07 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043871 Oct 28 19:10:55.784392 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 440/889] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:55.790930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f1d1380-2045-402f-8c21-64c31ec2011a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-853534795", "id": 1065965635, "os-flavor-access:is_public": "False"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:55.822584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.823113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:55.833265 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f1d1380-2045-402f-8c21-64c31ec2011a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.046860 Oct 28 19:10:55.841757 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 450/890] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:55 2022] POST /compute/v2.1/flavors => generated 429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:55.842782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.843441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.843855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.844621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:55.845093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:55.845537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:55.864832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fd24cf0-ea64-4aa3-a588-be3b8ae9d7f6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "1065965635"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:55.897051 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2fd24cf0-ea64-4aa3-a588-be3b8ae9d7f6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] HTTP exception thrown: Flavor 1065965635 could not be found. Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fd24cf0-ea64-4aa3-a588-be3b8ae9d7f6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] Request method failure captured: Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 107 Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCk8RmCEYdzU1RGBmLBE_84JECa3EfqHCeesRlXD9J228nQDzrrtml7_zAaWDAv3x9EbpICjoxv9iGhawghIzVU8zZRLAyB3klnjH_qPt1kxWsbad-FWuVBJBVVG5eSiFIHH6ljzwUsvq96MGULi5LFB0Oz9IIg_rDOAeyTWYaYRE0E Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: a672579b8fad4913977400eb1cefaac7 Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FlavorsAdminTestJSON-239444532 Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:55.902230 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a672579b8fad4913977400eb1cefaac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a672579b8fad4913977400eb1cefaac7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a672579b8fad4913977400eb1cefaac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a672579b8fad4913977400eb1cefaac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FlavorsAdminTestJSON-239444532 Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: a672579b8fad4913977400eb1cefaac7 Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-239444532 Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FlavorsAdminTestJSON-239444532-project Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6a8bab1231c048dc9b6a0276c2914196 Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FlavorsAdminTestJSON-239444532-project Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "test", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "1065965635"}} Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:10:55.904358 n-d-862769-3 devstack@n-api.service[120629]: exception: Flavor 1065965635 could not be found. Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '1065965635'}}} Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1065965635 could not be found. Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:55.905279 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1065965635 could not be found. Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:55.906508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:55.909556 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:55.909556 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:55.909556 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:55.909556 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1065965635 could not be found. Oct 28 19:10:55.909556 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:55.914457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fd24cf0-ea64-4aa3-a588-be3b8ae9d7f6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] Returning 400 to user: Flavor 1065965635 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:55.917177 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fd24cf0-ea64-4aa3-a588-be3b8ae9d7f6 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.068865 Oct 28 19:10:55.919388 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 451/891] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:55 2022] POST /compute/v2.1/servers => generated 81 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:10:55.936890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22aa36dd-ba71-44de-91ab-c0816e97b120 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.982890 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22aa36dd-ba71-44de-91ab-c0816e97b120 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1065965635" status: 202 len: 0 microversion: 2.1 time: 0.058760 Oct 28 19:10:55.984218 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 452/892] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:55 2022] DELETE /compute/v2.1/flavors/1065965635 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:55.991758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:55.996532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:56.019248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:56.019740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:56.020164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:56.020920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:56.021336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:56.021736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:56.080525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:56.084826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:56.106044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:56.107638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:56.121932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b15b3b25-d613-4349-95a7-0bf89d31ed51 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.303903 Oct 28 19:10:56.124473 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 441/893] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:56.140372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96aad7ae-5052-4b22-ad9b-631b08f264c7 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.192979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-96aad7ae-5052-4b22-ad9b-631b08f264c7 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063724 Oct 28 19:10:56.198520 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 442/894] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:56.219990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da044e04-13aa-4713-b6ad-92ba21660b6b tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1758743452", "id": 381488056, "os-flavor-access:is_public": "False"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:56.253203 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da044e04-13aa-4713-b6ad-92ba21660b6b tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.038338 Oct 28 19:10:56.254020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 443/895] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:56 2022] POST /compute/v2.1/flavors => generated 412 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:56.274334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6569fe00-4ca1-44f5-8c56-dc186821f81d tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2056296978", "id": 15993061, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:56.330732 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6569fe00-4ca1-44f5-8c56-dc186821f81d tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.068015 Oct 28 19:10:56.338254 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 444/896] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:56.356985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-237b731b-afe7-4605-ba72-f2775b3399a1 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.436220 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-237b731b-afe7-4605-ba72-f2775b3399a1 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.077183 Oct 28 19:10:56.437543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 445/897] 10.222.0.44 () {58 vars in 1169 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:56.452126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e52b9ac-9f90-45a0-84bd-6a9a44719084 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.475955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e52b9ac-9f90-45a0-84bd-6a9a44719084 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.027902 Oct 28 19:10:56.479541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 446/898] 10.222.0.44 () {58 vars in 1177 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:56.489040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.490736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:56.508021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:56.508021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:56.508426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:56.514943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:56.515625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:56.516070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:56.581323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:56.593250 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4fb4a0a5-8bfa-40e6-97d6-a1ed5938568a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1538 microversion: 2.1 time: 0.607649 Oct 28 19:10:56.593835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 453/899] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:55 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1538 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:56.603810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-23b93dfb-6701-4ae9-b758-f7b3283a0cd4 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.642055 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-23b93dfb-6701-4ae9-b758-f7b3283a0cd4 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.046855 Oct 28 19:10:56.642648 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 454/900] 10.222.0.44 () {58 vars in 1171 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:56.675161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:56.708802 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-872a70a7-3263-4c9e-b76d-11f4a9ad502e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.227856 Oct 28 19:10:56.709653 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 447/901] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:56.716540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef584e84-c200-4b7f-b9c0-b12ba87aee26 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.739400 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ef584e84-c200-4b7f-b9c0-b12ba87aee26 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.028472 Oct 28 19:10:56.745679 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 448/902] 10.222.0.44 () {58 vars in 1169 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:56.750386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Calling method '.version_select at 0x7f1d77dd3700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.762909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2edb4e66-21e1-40ce-85d4-7a02119ac79f tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.785566 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2edb4e66-21e1-40ce-85d4-7a02119ac79f tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5389 microversion: 2.1 time: 0.029045 Oct 28 19:10:56.787806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:10:56.789054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Neutron security group 0403d471-232b-4cd7-bdae-733524945983 not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:10:56.789891 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] HTTP exception thrown: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.789891 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] Oct 28 19:10:56.790149 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 449/903] 10.222.0.44 () {58 vars in 1169 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5389 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Request method failure captured: Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/0403d471-232b-4cd7-bdae-733524945983 HTTP/1.1 Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClAcESBzWBbhyve-mxVYXzjcd79lJlHoh6SJd5-moaX_Z-VxfAJATD0PwM-pGSuIxS9Mpn7MFiHs8UMHjGtVC41Py0WNMc01lV9rHcvaqRWfZQPY3y4TW1kH5nb9cdtmb956ux_91nC1NfsnlvHvO24glDHwBY1i8eKThJ0uW8NWGs Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:56.792725 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f94d611b8df6463199475bcf3f403bbb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 843b7c9d3dfa4008b350cb45310c7194 Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] Oct 28 19:10:56.794403 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0403d471-232b-4cd7-bdae-733524945983'} Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:56.795429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:10:56.796673 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.798792 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] Oct 28 19:10:56.801779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:56.803571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Returning 404 to user: Security group 0403d471-232b-4cd7-bdae-733524945983 does not exist Oct 28 19:10:56.803571 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-00b3eab5-e731-4ddc-acb4-39586586c95c'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:56.804838 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ccfaf3ee-324a-4d13-a0f3-a4080c231c93 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/0403d471-232b-4cd7-bdae-733524945983" status: 404 len: 194 microversion: 2.1 time: 0.161243 Oct 28 19:10:56.806048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 455/904] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:56 2022] DELETE /compute/v2.1/os-security-groups/0403d471-232b-4cd7-bdae-733524945983 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:56.806332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-76b237e8-97b8-4cc9-903e-cab46f9958c1 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.817025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a08de60c-f73c-4bb2-8ecb-47abacdf401f tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005364 Oct 28 19:10:56.817995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 456/905] 10.222.0.44 () {58 vars in 1164 bytes} [Fri Oct 28 19:10:56 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 28 19:10:56.833020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-265fa771-e9e8-4258-8748-e13c3187431d tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Calling method '.version_select at 0x7f1d7ca11310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.834820 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-76b237e8-97b8-4cc9-903e-cab46f9958c1 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5389 microversion: 2.1 time: 0.032284 Oct 28 19:10:56.840882 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 450/906] 10.222.0.44 () {58 vars in 1175 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5389 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:56.856934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b859a48-0866-4412-9bde-fa210ca83460 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.902013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b859a48-0866-4412-9bde-fa210ca83460 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5389 microversion: 2.1 time: 0.049717 Oct 28 19:10:56.903102 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 451/907] 10.222.0.44 () {58 vars in 1173 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5389 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:56.922199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4f3ae39-85cf-4f3d-9b02-2aad4e8c5465 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:56.951026 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4f3ae39-85cf-4f3d-9b02-2aad4e8c5465 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5389 microversion: 2.1 time: 0.032582 Oct 28 19:10:56.965238 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 452/908] 10.222.0.44 () {58 vars in 1169 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5389 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:56.971890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6dd31d50-7396-4288-b201-e94b6f4af113 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.036949 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6dd31d50-7396-4288-b201-e94b6f4af113 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/15993061" status: 202 len: 0 microversion: 2.1 time: 0.067761 Oct 28 19:10:57.038815 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 453/909] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:10:56 2022] DELETE /compute/v2.1/flavors/15993061 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:57.049102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-645b45f8-e653-4fdd-bf5b-d71cd55ec280 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.095898 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-645b45f8-e653-4fdd-bf5b-d71cd55ec280 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052819 Oct 28 19:10:57.099196 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 454/910] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:57.118214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60ef8606-b66a-4a49-9b26-02e2be348865 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.137073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=14,nova_api:INSERT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:57.153920 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-60ef8606-b66a-4a49-9b26-02e2be348865 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/381488056" status: 202 len: 0 microversion: 2.1 time: 0.039583 Oct 28 19:10:57.156354 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 455/911] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:10:57 2022] DELETE /compute/v2.1/flavors/381488056 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:57.171112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.171956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:57.181791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.182713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.183318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:57.184185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.184830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.185409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:57.328624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:57.348173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:57.353183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:57.364114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43abefdd-093c-45d0-b694-cda43cde8e85 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.202293 Oct 28 19:10:57.365575 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 456/912] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:57.372661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9810f85e-a1f1-4f8d-9c0d-82442c17f18c tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.376323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-265fa771-e9e8-4258-8748-e13c3187431d tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.553085 Oct 28 19:10:57.376910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 457/913] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:10:56 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:57.398368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c977d2e3-783e-4af1-a756-869293cde548 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Calling method '.version_select at 0x7f1d77f6e700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.407600 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9810f85e-a1f1-4f8d-9c0d-82442c17f18c tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040096 Oct 28 19:10:57.408541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 457/914] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:57.431439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-862829af-5d0f-4f0b-92e6-3171e99f3314 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1390590828", "id": 1408143818, "os-flavor-access:is_public": "False"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:57.459805 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-862829af-5d0f-4f0b-92e6-3171e99f3314 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.033696 Oct 28 19:10:57.469874 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 458/915] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:57.474952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2aeb6dea-4a35-414a-a4ae-5948c479a332 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.504068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2aeb6dea-4a35-414a-a4ae-5948c479a332 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032099 Oct 28 19:10:57.516926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 459/916] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:57.530360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c65c410d-b9df-4488-ac45-01a6822f0a3c tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.564013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c65c410d-b9df-4488-ac45-01a6822f0a3c tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044231 Oct 28 19:10:57.564935 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 460/917] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:57.607602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b2f6397-3298-4a9f-864e-05a293f8e0a0 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.665386 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b2f6397-3298-4a9f-864e-05a293f8e0a0 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1408143818" status: 202 len: 0 microversion: 2.1 time: 0.075585 Oct 28 19:10:57.667557 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 461/918] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:57 2022] DELETE /compute/v2.1/flavors/1408143818 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:57.688353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.689418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:57.702861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.703659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.705114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:57.706029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.706648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.707617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:57.884757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-c977d2e3-783e-4af1-a756-869293cde548 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:10:57.886117 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c977d2e3-783e-4af1-a756-869293cde548 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 28 19:10:57.886117 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c977d2e3-783e-4af1-a756-869293cde548 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Request method failure captured: Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/483ee12a-5476-4977-9f7a-8cd54051e0f6 HTTP/1.1 Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClAcESBzWBbhyve-mxVYXzjcd79lJlHoh6SJd5-moaX_Z-VxfAJATD0PwM-pGSuIxS9Mpn7MFiHs8UMHjGtVC41Py0WNMc01lV9rHcvaqRWfZQPY3y4TW1kH5nb9cdtmb956ux_91nC1NfsnlvHvO24glDHwBY1i8eKThJ0uW8NWGs Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:57.887350 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f94d611b8df6463199475bcf3f403bbb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 843b7c9d3dfa4008b350cb45310c7194 Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: exception: Insufficient rights for removing default security group. Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] Oct 28 19:10:57.888651 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '483ee12a-5476-4977-9f7a-8cd54051e0f6'} Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:57.889591 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 28 19:10:57.898346 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:57.899754 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c977d2e3-783e-4af1-a756-869293cde548 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-21c54fcb-0062-40c1-9f00-aaa24de24d09'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c977d2e3-783e-4af1-a756-869293cde548 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/483ee12a-5476-4977-9f7a-8cd54051e0f6" status: 400 len: 182 microversion: 2.1 time: 0.498195 Oct 28 19:10:57.901917 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 458/919] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:10:57 2022] DELETE /compute/v2.1/os-security-groups/483ee12a-5476-4977-9f7a-8cd54051e0f6 => generated 182 bytes in 500 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:10:57.902663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f985e3b2-909c-4300-9ac5-398739d32c36 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.936015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f985e3b2-909c-4300-9ac5-398739d32c36 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044151 Oct 28 19:10:57.941817 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 459/920] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:57.955902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:57.956910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:57.963894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.964593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.965205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:57.966129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:57.966805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:57.967466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:58.027772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:58.040999 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-368a8d89-36f5-4d1e-b102-648f058908be tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.371257 Oct 28 19:10:58.056593 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 462/921] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:58.073315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Calling method '.version_select at 0x7f1d7c619940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:58.169307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:10:58.170945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.security_group_api [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Neutron security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 not found {{(pid=120628) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:10:58.171700 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] HTTP exception thrown: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.171700 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] Oct 28 19:10:58.176518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Request method failure captured: Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-security-groups/d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 HTTP/1.1 Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClAcESBzWBbhyve-mxVYXzjcd79lJlHoh6SJd5-moaX_Z-VxfAJATD0PwM-pGSuIxS9Mpn7MFiHs8UMHjGtVC41Py0WNMc01lV9rHcvaqRWfZQPY3y4TW1kH5nb9cdtmb956ux_91nC1NfsnlvHvO24glDHwBY1i8eKThJ0uW8NWGs Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:10:58.177646 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f94d611b8df6463199475bcf3f403bbb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 843b7c9d3dfa4008b350cb45310c7194 Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: exception: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] Oct 28 19:10:58.178913 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd1ffabf8-e32e-4aa5-b61c-8e0bf410a703'} Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.179700 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:10:58.180815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.181840 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] Oct 28 19:10:58.183069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.185617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Returning 404 to user: Security group d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 does not exist Oct 28 19:10:58.185617 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-bd3ca912-38c9-440c-af11-6a428bbeed4a'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:58.186985 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b50e7c4-1d61-44aa-ba67-fa077b245083 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/d1ffabf8-e32e-4aa5-b61c-8e0bf410a703" status: 404 len: 194 microversion: 2.1 time: 0.119892 Oct 28 19:10:58.193088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 463/922] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:10:58 2022] GET /compute/v2.1/os-security-groups/d1ffabf8-e32e-4aa5-b61c-8e0bf410a703 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:58.201899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00c426ab-32e9-4685-9d52-0af764c23c9a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-344301058", "id": 2024808152, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:58.238182 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00c426ab-32e9-4685-9d52-0af764c23c9a tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.043543 Oct 28 19:10:58.240790 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17f90963-f977-4a7b-a17d-162956462590 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.291705 Oct 28 19:10:58.241706 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 464/924] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:58.241821 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 460/924] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:57 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:58.249180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Action: 'update', calling method: .version_select at 0x7f1d77e79820>, body: {"security_group": {"name": "tempest-sg-906768295", "description": "tempest-description-2129915765"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:58.261791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-977c313a-4ed1-4f3e-96cd-abe35f2db7f2 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:58.289565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:10:58.289771 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-977c313a-4ed1-4f3e-96cd-abe35f2db7f2 tempest-FlavorsAdminTestJSON-239444532 tempest-FlavorsAdminTestJSON-239444532-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.031603 Oct 28 19:10:58.290145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Neutron security group 51711b91-b0d1-413c-bbfc-39500de9cafc not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:10:58.290820 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] HTTP exception thrown: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.290820 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] Oct 28 19:10:58.291074 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 465/925] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Request method failure captured: Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/os-security-groups/51711b91-b0d1-413c-bbfc-39500de9cafc HTTP/1.1 Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 101 Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClAcESBzWBbhyve-mxVYXzjcd79lJlHoh6SJd5-moaX_Z-VxfAJATD0PwM-pGSuIxS9Mpn7MFiHs8UMHjGtVC41Py0WNMc01lV9rHcvaqRWfZQPY3y4TW1kH5nb9cdtmb956ux_91nC1NfsnlvHvO24glDHwBY1i8eKThJ0uW8NWGs Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:10:58.292855 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f94d611b8df6463199475bcf3f403bbb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f94d611b8df6463199475bcf3f403bbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f94d611b8df6463199475bcf3f403bbb Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169 Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 843b7c9d3dfa4008b350cb45310c7194 Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1725288169-project Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: {"security_group": {"name": "tempest-sg-906768295", "description": "tempest-description-2129915765"}} Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:10:58.294342 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '51711b91-b0d1-413c-bbfc-39500de9cafc', 'body': {'security_group': {'name': 'tempest-sg-906768295', 'description': 'tempest-description-2129915765'}}} Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:10:58.295445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:10:58.296652 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] Oct 28 19:10:58.297803 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] Returning 404 to user: Security group 51711b91-b0d1-413c-bbfc-39500de9cafc does not exist Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-cb14ea71-1471-4ed3-a57b-42efbe8232a0'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:10:58.299187 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e133745-6519-4e5a-9761-9f9ec7463d61 tempest-SecurityGroupsNegativeTestJSON-1725288169 tempest-SecurityGroupsNegativeTestJSON-1725288169-project] 10.222.0.44 "PUT /compute/v2.1/os-security-groups/51711b91-b0d1-413c-bbfc-39500de9cafc" status: 404 len: 194 microversion: 2.1 time: 0.051690 Oct 28 19:10:58.300073 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 461/926] 10.222.0.44 () {60 vars in 1290 bytes} [Fri Oct 28 19:10:58 2022] PUT /compute/v2.1/os-security-groups/51711b91-b0d1-413c-bbfc-39500de9cafc => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:10:58.315099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c8a594c-75a7-40af-b45e-9080168a9715 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:58.343005 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c8a594c-75a7-40af-b45e-9080168a9715 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/2024808152" status: 202 len: 0 microversion: 2.1 time: 0.036907 Oct 28 19:10:58.347577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 466/927] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:10:58 2022] DELETE /compute/v2.1/flavors/2024808152 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:58.352766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf8de8ce-0866-4d61-8af9-5a9455aeff31 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:58.381998 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf8de8ce-0866-4d61-8af9-5a9455aeff31 tempest-FlavorsAdminTestJSON-635837878 tempest-FlavorsAdminTestJSON-635837878-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030261 Oct 28 19:10:58.387460 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 462/928] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:10:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:58.405752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:58.406368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:58.414347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:58.419885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:58.420574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:58.421470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:58.422115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:58.423273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:58.564466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:58.577587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:58.579540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:58.585973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1337316339", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "6cded4e8-248a-436b-b141-6debca321857"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:58.595508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb915f17-4478-4753-868e-9b3d7df9ebb2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.193765 Oct 28 19:10:58.597468 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 467/929] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:58 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:58.686719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] validate_networks() for [('6cded4e8-248a-436b-b141-6debca321857', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:10:59.070483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:59.071402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:59.078335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.079059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.079645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.080505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.086582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.087326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.271009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:59.271799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:59.272283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:59.275150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:59.280674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:59.293053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.294169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.294624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.295493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.295941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.296605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:59.302364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.307702 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6146ca57-2f26-4e59-bcc0-56f97f75c16e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.241365 Oct 28 19:10:59.308894 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 468/930] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:59 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:59.314552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:59.315487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:59.327004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.327775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.332100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.333467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.334133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.335226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.337682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for project 396065b7b553417d9ad5022d9e57404c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:59.343250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for user 8222e34ca7794fa686f94cc2b220c4e3 and project 396065b7b553417d9ad5022d9e57404c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:59.361573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:59.364982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:59.432674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e503346d-548b-4fcf-8907-d8d093b28063 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936295 Oct 28 19:10:59.433318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 463/931] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:10:59.445502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-811d4bff-7486-42a9-84be-5a31423a65d7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:59.446123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-811d4bff-7486-42a9-84be-5a31423a65d7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:59.599389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:10:59.604202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-811d4bff-7486-42a9-84be-5a31423a65d7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:59.611742 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-811d4bff-7486-42a9-84be-5a31423a65d7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1225 microversion: 2.1 time: 0.170692 Oct 28 19:10:59.613964 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 464/932] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:59 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:59.632882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:59.633494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:10:59.651812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.653027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.656794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.657927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:59.659008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:59.659710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:59.662361 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74fca3c2-248d-4d35-83e5-c58285403a0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.352118 Oct 28 19:10:59.663363 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 469/933] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:59 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:10:59.829412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:59.844904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:59.847865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:59.854299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80e570a1-4d8a-48e8-b960-381108f5361b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.225655 Oct 28 19:10:59.877715 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 465/934] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:10:59 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:00.332934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:00.333640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:00.349648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:00.353544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:00.354164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:00.355076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:00.355674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:00.363301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:00.642426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:00.643241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:00.650172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:00.659636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:00.660088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:00.660852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:00.661315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:00.661740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:01.031534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:01.062441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d90e389-75fb-46a9-81ff-78debe007873 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.733526 Oct 28 19:11:01.063085 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 470/935] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:00 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:01.082305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:01.085105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:01.091805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:01.092599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:01.093355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:01.094266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:01.094939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:01.095548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:01.140482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:01.151407 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ece6de70-81ed-4c68-b2d0-270e3ddde01e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1277 microversion: 2.1 time: 0.512897 Oct 28 19:11:01.152016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 466/936] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:00 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1277 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:01.161990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:01.162598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:01.178841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:01.179328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:01.184093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:01.185580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:01.186290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:01.186893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:01.190840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:01.239354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f7a5a94-a9b0-4734-a0bc-d9e43ba17109 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.173030 Oct 28 19:11:01.240330 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 471/937] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:01 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:01.381165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:01.393646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:01.401483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:01.423244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35ec7db6-8d47-44d4-9abc-a744854d0d4b tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.267611 Oct 28 19:11:01.425020 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 467/938] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:01 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:02.085335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:02.085934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:02.111055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.118739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.118739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.119038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.119462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.119878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.177452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:02.179161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:02.192197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.194349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.195322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.197465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.200333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.201024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.391725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:02.405211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17977191-915e-4d8a-a0ae-f4f0b9ad872d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1283 microversion: 2.1 time: 0.232838 Oct 28 19:11:02.409674 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 468/939] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:02 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1283 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:02.425643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:02.426313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:02.437636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.438342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.439233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.442069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.442877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.443529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.572115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:02.620606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8632739-91c5-4465-88af-15a3e9c2682d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.209066 Oct 28 19:11:02.623304 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 469/940] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:02 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:02.631352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:02.635484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:02.641128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:02.651047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.651731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.652170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.652924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:02.653394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:02.653807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:02.660245 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9677790-48c5-41cd-a90b-fe84f93d4d23 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.578694 Oct 28 19:11:02.661253 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 472/941] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:02 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:02.792255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:02.801315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:02.803098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:02.808874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d29b420f-a886-4a14-a0a4-9672a63c7c77 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.184335 Oct 28 19:11:02.823427 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 470/942] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:02 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:03.430369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:03.431166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:03.445541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.449650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.450298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.452996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.454040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.455871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.657495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:03.659658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:03.682037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.682717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.683411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.684789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.685467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.686477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.740198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:03.759538 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c6bfda1-5f33-4ac4-b13e-0fb219d471c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.332462 Oct 28 19:11:03.762406 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 473/943] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:03 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:03.784850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:03.785462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:03.816634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.817579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.818189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.819097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.819691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.820254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.887783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:03.924410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9d81be5c-ae5f-49c4-a314-3eba503b5c5b tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.272355 Oct 28 19:11:03.925244 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 471/944] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:03 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:03.938446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:03.941757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:03.954199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.958024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.958904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:03.960052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:03.961969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:03.965526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.177245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:04.190806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:04.192577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:04.205416 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07e43c16-9c3a-4bca-9619-085639867044 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.275462 Oct 28 19:11:04.226998 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 472/945] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:03 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:04.405260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:04.413894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da65d547-9fe5-4482-9ced-25e9ffcdae80 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.646344 Oct 28 19:11:04.417789 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 474/946] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:03 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:04.526785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Calling method '.version_select at 0x7f1d77ddd1f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:04.530386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.533228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.533732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.537126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.537126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.537126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.548352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:04.584912 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a9dd05a9-beaa-4575-a27d-4aebf3e88cba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.356450 Oct 28 19:11:04.585723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 473/947] 10.222.0.44 () {58 vars in 1128 bytes} [Fri Oct 28 19:11:04 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:04.724221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a3d980ce-2a61-4b1e-8730-fc6c913493b3 req-d7877fe7-5fa4-4d38-8cbe-eaf8ade05463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba9cd8c-5182-44fc-b42f-b385b586e9ac", "tag": "cf376f3b-d17f-4b96-8145-060372bd22f9"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:04.739411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a3d980ce-2a61-4b1e-8730-fc6c913493b3 req-d7877fe7-5fa4-4d38-8cbe-eaf8ade05463 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.740026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a3d980ce-2a61-4b1e-8730-fc6c913493b3 req-d7877fe7-5fa4-4d38-8cbe-eaf8ade05463 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.740743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a3d980ce-2a61-4b1e-8730-fc6c913493b3 req-d7877fe7-5fa4-4d38-8cbe-eaf8ade05463 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.755674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a3d980ce-2a61-4b1e-8730-fc6c913493b3 req-d7877fe7-5fa4-4d38-8cbe-eaf8ade05463 service nova] Creating event network-changed:cf376f3b-d17f-4b96-8145-060372bd22f9 for instance aba9cd8c-5182-44fc-b42f-b385b586e9ac on n-h1-862769-3 Oct 28 19:11:04.761289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a3d980ce-2a61-4b1e-8730-fc6c913493b3 req-d7877fe7-5fa4-4d38-8cbe-eaf8ade05463 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041616 Oct 28 19:11:04.761976 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 474/948] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:11:04.781624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:04.784188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:04.800654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:04.803075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.803751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.804206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.805162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.806232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.806912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.839212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-503962e7-ad0c-4299-a5f9-b77b8707327b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Calling method '.version_select at 0x7f1d77f720d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:04.844403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-503962e7-ad0c-4299-a5f9-b77b8707327b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ebfb7d88504142c9b7b873374c073eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240729d73f82475ca94a6ec6e43fc1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-503962e7-ad0c-4299-a5f9-b77b8707327b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Request method failure captured: Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClG89JE5NGsEkyq1261VTbjaWP60W2bvaDwgZELy3cIIBy1hDY8noYWumMPnktkUD4JTDBVZ8Hl0oaHAvzPMcfyiYSeLlcqWG2HXmt5vLoOT4uBjEVyq5_5iaHV93csx1eC23IboJxmXSrNgVh713reLk-zwCOkWwEfQkLhYNgdcpc Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:04.846296 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_240729d73f82475ca94a6ec6e43fc1b6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ebfb7d88504142c9b7b873374c073eed Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:11:04.847962 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:04.848902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 19:11:04.850262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:04.851748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-503962e7-ad0c-4299-a5f9-b77b8707327b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:04.861558 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-503962e7-ad0c-4299-a5f9-b77b8707327b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] 10.222.0.44 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.268174 Oct 28 19:11:04.862137 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 475/949] 10.222.0.44 () {58 vars in 1128 bytes} [Fri Oct 28 19:11:04 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:04.870488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:04.871264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:04.880088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.880773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.881465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:04.882315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:04.882938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:04.883502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.005884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 3d7de605-17c2-4004-99c0-2461d81bf4b7 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:05.021887 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-13fa19db-fdf3-41c7-b9d5-55261b63e080 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 2342 microversion: 2.25 time: 0.249637 Oct 28 19:11:05.022602 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 475/950] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:04 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 2342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:05.027527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50e61620-b234-40a4-981c-49aa9a18d66a tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Calling method '.version_select at 0x7f1d77cf2e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.030177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-50e61620-b234-40a4-981c-49aa9a18d66a tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ebfb7d88504142c9b7b873374c073eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240729d73f82475ca94a6ec6e43fc1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50e61620-b234-40a4-981c-49aa9a18d66a tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Request method failure captured: Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-hosts/n-d-862769-3/reboot HTTP/1.1 Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClG89JE5NGsEkyq1261VTbjaWP60W2bvaDwgZELy3cIIBy1hDY8noYWumMPnktkUD4JTDBVZ8Hl0oaHAvzPMcfyiYSeLlcqWG2HXmt5vLoOT4uBjEVyq5_5iaHV93csx1eC23IboJxmXSrNgVh713reLk-zwCOkWwEfQkLhYNgdcpc Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:11:05.032707 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_240729d73f82475ca94a6ec6e43fc1b6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: ebfb7d88504142c9b7b873374c073eed Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'n-d-862769-3'} Oct 28 19:11:05.034435 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.035409 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 19:11:05.036654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.039061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50e61620-b234-40a4-981c-49aa9a18d66a tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.040078 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50e61620-b234-40a4-981c-49aa9a18d66a tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] 10.222.0.44 "GET /compute/v2.1/os-hosts/n-d-862769-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016236 Oct 28 19:11:05.040817 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 476/951] 10.222.0.44 () {58 vars in 1188 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/n-d-862769-3/reboot => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:05.048721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.049673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:05.056707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.057275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.057776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.058563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.059351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.059848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.074288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.088052 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3089a0dd-a2ea-44b0-9f45-56e4766e03fa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.222211 Oct 28 19:11:05.089650 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 476/952] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:04 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:05.099122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.102826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.103665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.104288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.105479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.105928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.106339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.131385 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69c931ed-1ffa-451b-af8e-134e69917e49 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040469 Oct 28 19:11:05.132341 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 477/953] 10.222.0.44 () {60 vars in 1217 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:05.136830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e81faf5-e484-49ae-8d58-6109dadb2611 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Calling method '.version_select at 0x7f1d77f72790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.142749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:05.146232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-6e81faf5-e484-49ae-8d58-6109dadb2611 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e81faf5-e484-49ae-8d58-6109dadb2611 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:11:05.149879 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'nonexistent_hostname'} Oct 28 19:11:05.151150 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:11:05.151905 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 19:11:05.153025 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e81faf5-e484-49ae-8d58-6109dadb2611 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e81faf5-e484-49ae-8d58-6109dadb2611 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.017857 Oct 28 19:11:05.154111 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 478/954] 10.222.0.44 () {58 vars in 1212 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:05.168826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6f060b3-289b-4e41-8b1b-abedf49db5bd tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.119833 Oct 28 19:11:05.168826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 477/955] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b064d01b-3955-4061-92b4-751d4df2644b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Calling method '.version_select at 0x7f1d7c82c8b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b064d01b-3955-4061-92b4-751d4df2644b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ebfb7d88504142c9b7b873374c073eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240729d73f82475ca94a6ec6e43fc1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b064d01b-3955-4061-92b4-751d4df2644b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Request method failure captured: Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts/n-d-862769-3 HTTP/1.1 Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClG89JE5NGsEkyq1261VTbjaWP60W2bvaDwgZELy3cIIBy1hDY8noYWumMPnktkUD4JTDBVZ8Hl0oaHAvzPMcfyiYSeLlcqWG2HXmt5vLoOT4uBjEVyq5_5iaHV93csx1eC23IboJxmXSrNgVh713reLk-zwCOkWwEfQkLhYNgdcpc Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.169254 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_240729d73f82475ca94a6ec6e43fc1b6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ebfb7d88504142c9b7b873374c073eed Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.170392 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'n-d-862769-3'} Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.171580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 19:11:05.172748 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.174449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b064d01b-3955-4061-92b4-751d4df2644b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.174449 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b064d01b-3955-4061-92b4-751d4df2644b tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] 10.222.0.44 "GET /compute/v2.1/os-hosts/n-d-862769-3" status: 403 len: 109 microversion: 2.1 time: 0.008927 Oct 28 19:11:05.174449 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 479/956] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/n-d-862769-3 => generated 109 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:11:05.184543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c49dff23-23c3-45d0-9f7c-23f2c57e86cb tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Calling method '.version_select at 0x7f1d77dc7c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.202727 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c49dff23-23c3-45d0-9f7c-23f2c57e86cb tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c49dff23-23c3-45d0-9f7c-23f2c57e86cb tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:11:05.204673 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'nonexistent_hostname'} Oct 28 19:11:05.206045 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.206843 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.207955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.210369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c49dff23-23c3-45d0-9f7c-23f2c57e86cb tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.211538 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c49dff23-23c3-45d0-9f7c-23f2c57e86cb tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035242 Oct 28 19:11:05.212700 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 478/957] 10.222.0.44 () {58 vars in 1191 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:05.225779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c279910-f398-4e6c-80d4-b6585d83c5b8 tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Calling method '.version_select at 0x7f1d7c75cca0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.228365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c279910-f398-4e6c-80d4-b6585d83c5b8 tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ebfb7d88504142c9b7b873374c073eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240729d73f82475ca94a6ec6e43fc1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c279910-f398-4e6c-80d4-b6585d83c5b8 tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Request method failure captured: Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts/n-d-862769-3/shutdown HTTP/1.1 Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClG89JE5NGsEkyq1261VTbjaWP60W2bvaDwgZELy3cIIBy1hDY8noYWumMPnktkUD4JTDBVZ8Hl0oaHAvzPMcfyiYSeLlcqWG2HXmt5vLoOT4uBjEVyq5_5iaHV93csx1eC23IboJxmXSrNgVh713reLk-zwCOkWwEfQkLhYNgdcpc Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:05.230794 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_240729d73f82475ca94a6ec6e43fc1b6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ebfb7d88504142c9b7b873374c073eed Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'n-d-862769-3'} Oct 28 19:11:05.232059 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.232889 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 19:11:05.234121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.235934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c279910-f398-4e6c-80d4-b6585d83c5b8 tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.237605 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7c279910-f398-4e6c-80d4-b6585d83c5b8 tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] 10.222.0.44 "GET /compute/v2.1/os-hosts/n-d-862769-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016546 Oct 28 19:11:05.244373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.244980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:05.249110 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 480/958] 10.222.0.44 () {58 vars in 1194 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/n-d-862769-3/shutdown => generated 113 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:05.269283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.269794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.270417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdb945ef-3a87-4aa9-909a-0b88445b5366 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Calling method '.version_select at 0x7f1d7c44a940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.273711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.275160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.279366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.280031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.293248 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-fdb945ef-3a87-4aa9-909a-0b88445b5366 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdb945ef-3a87-4aa9-909a-0b88445b5366 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:11:05.296882 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'nonexistent_hostname'} Oct 28 19:11:05.298147 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:11:05.299006 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 19:11:05.300063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.301115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdb945ef-3a87-4aa9-909a-0b88445b5366 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.304583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fdb945ef-3a87-4aa9-909a-0b88445b5366 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.042207 Oct 28 19:11:05.305763 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 481/959] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:05.323484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5673af9-39ab-431e-a504-63cb667d620c tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Calling method '.version_select at 0x7f1d77f72d30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.330161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e5673af9-39ab-431e-a504-63cb667d620c tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ebfb7d88504142c9b7b873374c073eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240729d73f82475ca94a6ec6e43fc1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5673af9-39ab-431e-a504-63cb667d620c tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Request method failure captured: Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts/n-d-862769-3/startup HTTP/1.1 Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClG89JE5NGsEkyq1261VTbjaWP60W2bvaDwgZELy3cIIBy1hDY8noYWumMPnktkUD4JTDBVZ8Hl0oaHAvzPMcfyiYSeLlcqWG2HXmt5vLoOT4uBjEVyq5_5iaHV93csx1eC23IboJxmXSrNgVh713reLk-zwCOkWwEfQkLhYNgdcpc Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:05.334381 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_240729d73f82475ca94a6ec6e43fc1b6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ebfb7d88504142c9b7b873374c073eed Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'n-d-862769-3'} Oct 28 19:11:05.335764 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.336509 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 19:11:05.337585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.340811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5673af9-39ab-431e-a504-63cb667d620c tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.341658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5673af9-39ab-431e-a504-63cb667d620c tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] 10.222.0.44 "GET /compute/v2.1/os-hosts/n-d-862769-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.030472 Oct 28 19:11:05.343034 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 482/960] 10.222.0.44 () {58 vars in 1191 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/n-d-862769-3/startup => generated 110 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:05.360236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5823b653-1459-48cd-98ce-051dd5800c58 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Calling method '.version_select at 0x7f1d77f72c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.373383 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-5823b653-1459-48cd-98ce-051dd5800c58 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5823b653-1459-48cd-98ce-051dd5800c58 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:11:05.375713 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'nonexistent_hostname'} Oct 28 19:11:05.377136 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:11:05.378044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 19:11:05.379387 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.383129 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.386346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5823b653-1459-48cd-98ce-051dd5800c58 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.388272 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5823b653-1459-48cd-98ce-051dd5800c58 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.038297 Oct 28 19:11:05.389890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 483/961] 10.222.0.44 () {58 vars in 1215 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:05.405177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94589e43-ad2e-4d20-b16a-76d062bca7cf tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c619280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94589e43-ad2e-4d20-b16a-76d062bca7cf tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/os-hosts/n-d-862769-3 HTTP/1.1 Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 51 Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:11:05.417792 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: {"status": "enable", "maintenance_mode": "invalid"} Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.419195 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'n-d-862769-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance: Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.419934 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.421598 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94589e43-ad2e-4d20-b16a-76d062bca7cf tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94589e43-ad2e-4d20-b16a-76d062bca7cf tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-hosts/n-d-862769-3" status: 400 len: 199 microversion: 2.1 time: 0.022813 Oct 28 19:11:05.423476 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 484/962] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:11:05 2022] PUT /compute/v2.1/os-hosts/n-d-862769-3 => generated 199 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:11:05.432406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6724fdb-e5e5-4ee3-94fe-4a48309cdd4f tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c5325e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6724fdb-e5e5-4ee3-94fe-4a48309cdd4f tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/os-hosts/n-d-862769-3 HTTP/1.1 Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 51 Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:11:05.439496 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: {"status": "invalid", "maintenance_mode": "enable"} Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:05.440861 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'n-d-862769-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance: Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.441614 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.443060 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6724fdb-e5e5-4ee3-94fe-4a48309cdd4f tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.444137 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6724fdb-e5e5-4ee3-94fe-4a48309cdd4f tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-hosts/n-d-862769-3" status: 400 len: 189 microversion: 2.1 time: 0.013684 Oct 28 19:11:05.447295 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 485/963] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:11:05 2022] PUT /compute/v2.1/os-hosts/n-d-862769-3 => generated 189 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:11:05.452794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.453417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:05.461895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.462289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.462742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.463448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.463892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.464306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.643938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.653283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.659310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.684209 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb779590-0777-4fd2-b576-cec5088e3492 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.443584 Oct 28 19:11:05.696342 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 479/964] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:05.715545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26dbc13c-1530-4b53-821c-5efe99a06b6e tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Action: 'update', calling method: .version_select at 0x7f1d77d290d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:05.748632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26dbc13c-1530-4b53-821c-5efe99a06b6e tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ebfb7d88504142c9b7b873374c073eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240729d73f82475ca94a6ec6e43fc1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26dbc13c-1530-4b53-821c-5efe99a06b6e tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Request method failure captured: Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/os-hosts/n-d-862769-3 HTTP/1.1 Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 50 Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClG89JE5NGsEkyq1261VTbjaWP60W2bvaDwgZELy3cIIBy1hDY8noYWumMPnktkUD4JTDBVZ8Hl0oaHAvzPMcfyiYSeLlcqWG2HXmt5vLoOT4uBjEVyq5_5iaHV93csx1eC23IboJxmXSrNgVh713reLk-zwCOkWwEfQkLhYNgdcpc Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:11:05.750298 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_240729d73f82475ca94a6ec6e43fc1b6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/240729d73f82475ca94a6ec6e43fc1b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 240729d73f82475ca94a6ec6e43fc1b6 Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-599723001 Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: ebfb7d88504142c9b7b873374c073eed Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-HostsAdminNegativeTestJSON-599723001-project Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 19:11:05.751600 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'n-d-862769-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.752457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 19:11:05.753599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.754665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26dbc13c-1530-4b53-821c-5efe99a06b6e tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.754665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26dbc13c-1530-4b53-821c-5efe99a06b6e tempest-HostsAdminNegativeTestJSON-599723001 tempest-HostsAdminNegativeTestJSON-599723001-project] 10.222.0.44 "PUT /compute/v2.1/os-hosts/n-d-862769-3" status: 403 len: 111 microversion: 2.1 time: 0.048407 Oct 28 19:11:05.754665 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 480/965] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:11:05 2022] PUT /compute/v2.1/os-hosts/n-d-862769-3 => generated 111 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:05.765356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91c1ff05-9da4-4220-8aa0-af0be8c28708 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77dd3a60>, body: {"status": null, "maintenance_mode": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91c1ff05-9da4-4220-8aa0-af0be8c28708 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/os-hosts/n-d-862769-3 HTTP/1.1 Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 42 Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:11:05.771818 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: {"status": null, "maintenance_mode": null} Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 19:11:05.774833 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'n-d-862769-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance: Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi None Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.776225 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.778480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.780508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:11:05.780508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:11:05.780508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 19:11:05.780508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.781518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91c1ff05-9da4-4220-8aa0-af0be8c28708 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.782533 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91c1ff05-9da4-4220-8aa0-af0be8c28708 tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-hosts/n-d-862769-3" status: 400 len: 127 microversion: 2.1 time: 0.024712 Oct 28 19:11:05.784201 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 481/966] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:11:05 2022] PUT /compute/v2.1/os-hosts/n-d-862769-3 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:11:05.795677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f158efc1-88fd-42ad-8dcd-7b24dc01bbba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77f6e700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:05.802803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.hosts [None req-f158efc1-88fd-42ad-8dcd-7b24dc01bbba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Enabling host nonexistent_hostname. Oct 28 19:11:05.812578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-f158efc1-88fd-42ad-8dcd-7b24dc01bbba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f158efc1-88fd-42ad-8dcd-7b24dc01bbba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Request method failure captured: Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 50 Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClHSSDQkRAzqqw7zWAe7lNs3arDkNXvExcAvGO2R_I1VFMpr25utq4gy0qy2FbqAzOAyJv5KYreI1yvM_4GL6u5o6LLPckbGQVr1Bl78SBSuk8lPfcWQ_Wr4hL4yTKDbaP-f5Uw0ekVGiF4dLVMb3YeA-0RJQX5FiHtLBkFr1Pp7yE Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:11:05.815211 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e7bd5dd23bb044648af283dad21596a2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e7bd5dd23bb044648af283dad21596a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e7bd5dd23bb044648af283dad21596a2 Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-254545548 Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 14299ed198f248b49742b5bb53b3d708 Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-HostsAdminNegativeTestJSON-254545548-project-admin Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.816776 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 19:11:05.817906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:05.819227 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 19:11:05.820543 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:05.822780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f158efc1-88fd-42ad-8dcd-7b24dc01bbba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:05.823967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f158efc1-88fd-42ad-8dcd-7b24dc01bbba tempest-HostsAdminNegativeTestJSON-254545548 tempest-HostsAdminNegativeTestJSON-254545548-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033396 Oct 28 19:11:05.824992 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 482/967] 10.222.0.44 () {60 vars in 1211 bytes} [Fri Oct 28 19:11:05 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:05.887807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:05.904915 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1de9601-af89-45df-8582-e56c5275e9b0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.455534 Oct 28 19:11:05.905663 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 486/968] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:05.923456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:05.925033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:05.933204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.934449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.935361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:05.937435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:05.938325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:05.939448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.113310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:06.114079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:06.140875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.141822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.142581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.143571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.144321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.144940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.341324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-815040ec-f5f8-420e-9a95-0ed508ce5d81 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1859 microversion: 2.1 time: 0.421982 Oct 28 19:11:06.343036 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 483/969] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:05 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1859 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:06.348185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:06.348990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:06.355596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.356351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.356977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.357972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.358622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.359337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.394869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:06.407442 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06be23de-9457-4be0-b645-ed84ee3efdab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.299504 Oct 28 19:11:06.409288 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 487/970] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:06 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:06.415861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-3", "block_migration": true, "disk_over_commit": false}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:06.419003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:06.426300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.426811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.427219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.427938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.428499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.429063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.467705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:06.514245 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c128441f-b33a-4616-8cdd-a5e1a5727b35 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.169784 Oct 28 19:11:06.515497 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 484/971] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:06 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:06.577501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lazy-loading 'flavor' on Instance uuid e97e4371-c171-43ac-8520-da07711dcbb1 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:06.642381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Going to try to live migrate instance to n-h2-862769-3 {{(pid=120628) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:11:06.647130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:06.716177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:06.716802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:06.727068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.727564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.728000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.730939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:06.731599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:06.733727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:06.945469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:06.957683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:06.968999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:06.974555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb9280da-729c-44c4-8b20-a61745b09efb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.262945 Oct 28 19:11:06.976031 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 485/972] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:06 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:06.999562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:07.000373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:07.012549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:07.014086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:07.016091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:07.025673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:07.026578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:07.027306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:07.346485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:07.355061 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d3ef91f-5da1-47c4-a244-565dc40a0d28 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.377233 Oct 28 19:11:07.355582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 486/973] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:06 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:07.435325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:07.439787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:07.454129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:07.454853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:07.456458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:07.457333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:07.462441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:07.463144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:07.642604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:07.655947 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc434c0b-5a38-4048-8957-4e58b06cfb9d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.223833 Oct 28 19:11:07.657453 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 487/974] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:07 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:07.674889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:07.675782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:07.685443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:07.685985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:07.686434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:07.687397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:07.688006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:07.688418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:07.825178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:07.868671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0d6c77e-6b91-46e3-b9cf-c0cdf1dddcae tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.209104 Oct 28 19:11:07.879098 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 488/975] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:07 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:08.002002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:08.002729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:08.010203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.010735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.011203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.011964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.015111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.015111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.110728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:08.120120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:08.122534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:08.129013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d60a22e5-a58f-46e0-bd2d-ae4a669bd488 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.131336 Oct 28 19:11:08.129773 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 489/976] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:07 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:08.208998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55811ef8-8705-4232-98ed-79a4d7289eab", "device": "/dev/xvdb"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:08.211469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:08.234664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.235375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.235991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.236867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.237466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.238039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.620463 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3f72284-214d-4acf-8986-497817ab9f2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "POST /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.415212 Oct 28 19:11:08.626611 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 490/977] 10.222.0.44 () {62 vars in 1364 bytes} [Fri Oct 28 19:11:08 2022] POST /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:08.648251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:08.649605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:08.659833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.660203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.660818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:08.669268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:08.670028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:08.671385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.005418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:09.019276 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2c0bf41-64c3-49fd-bedb-ef025df720d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.396307 Oct 28 19:11:09.044196 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 491/978] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:08 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:09.051466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:09.052123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:09.060098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.061863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.062515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.063998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.064626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.065215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.182241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-933f7e36-8d5d-4ac2-91c3-1c1936aaa5c9 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/action" status: 202 len: 0 microversion: 2.1 time: 2.771678 Oct 28 19:11:09.183518 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 488/979] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:11:06 2022] POST /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/action => generated 0 bytes in 2774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:11:09.192280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:09.193608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:09.208426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.209250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.212372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.214256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.216024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.216714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.392671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:09.416920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:09.430003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8536e34-43b9-4fa5-adc7-290a7b686ef0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.383784 Oct 28 19:11:09.431838 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 492/980] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:09 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:09.443659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:09.444569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:09.461110 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b723ee4-e6b6-4169-849b-dc443433ec34 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.275263 Oct 28 19:11:09.463904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 489/981] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:09 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:09.471959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.472464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.472899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.473607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.474060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.474479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.478270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:09.479410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:09.486170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.486663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.489570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.490516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:09.496289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:09.497094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:09.525685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:09.610922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:09.713714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:09.731790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:09.745974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:09.758087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-175cbd2e-a66f-467d-8a81-f21ea72e743f tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.324982 Oct 28 19:11:09.759156 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 493/982] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:09 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:10.043372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:10.050994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:10.051736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:10.064476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.064971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.065396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.066099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.066538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.072268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.078509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6be1ea65-0185-4dd8-855e-8efbca068464 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.610388 Oct 28 19:11:10.080835 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 490/983] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:09 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:10.459699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:10.461200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:10.473765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.474568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.476283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:10.477793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:10.480800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:10.481562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.015837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:11.041133 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf491a30-ad43-4b26-9f73-0ee98244ce10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.993274 Oct 28 19:11:11.043703 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 494/984] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:10 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:11.054439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.057853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:11.070724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.071302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.071858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.072615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.073077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.073511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.238159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:11.278029 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92f56211-32f7-4ded-bb32-e76e27786509 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.233186 Oct 28 19:11:11.279125 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 495/985] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:11.298648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:11.311207 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd18cace-32bb-4184-9187-63f5624bce97 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.855916 Oct 28 19:11:11.316932 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 491/986] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:10 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:11.329957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.333438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:11.342621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.348352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.351084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.353662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.356209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.356928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.470662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:11.483130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:11.484909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:11.515279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49a4f94b-b5b5-41a8-8859-d41430d5e16d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.192058 Oct 28 19:11:11.517528 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 492/987] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:11.527659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-cb4e23ac-a6bd-4f9f-9b58-0447104325e7 req-4c01d5cd-79fe-4620-a4e7-407b563bbbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba9cd8c-5182-44fc-b42f-b385b586e9ac", "name": "network-vif-plugged", "status": "completed", "tag": "cf376f3b-d17f-4b96-8145-060372bd22f9"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:11.548860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cb4e23ac-a6bd-4f9f-9b58-0447104325e7 req-4c01d5cd-79fe-4620-a4e7-407b563bbbeb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.549349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cb4e23ac-a6bd-4f9f-9b58-0447104325e7 req-4c01d5cd-79fe-4620-a4e7-407b563bbbeb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.549774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cb4e23ac-a6bd-4f9f-9b58-0447104325e7 req-4c01d5cd-79fe-4620-a4e7-407b563bbbeb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.556228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24f08205-28f9-44e3-a46b-1808faf1f8d9 tempest-InstanceUsageAuditLogTestJSON-1940474646 tempest-InstanceUsageAuditLogTestJSON-1940474646-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.574726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-cb4e23ac-a6bd-4f9f-9b58-0447104325e7 req-4c01d5cd-79fe-4620-a4e7-407b563bbbeb service nova] Creating event network-vif-plugged:cf376f3b-d17f-4b96-8145-060372bd22f9 for instance aba9cd8c-5182-44fc-b42f-b385b586e9ac on n-h1-862769-3 Oct 28 19:11:11.601950 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24f08205-28f9-44e3-a46b-1808faf1f8d9 tempest-InstanceUsageAuditLogTestJSON-1940474646 tempest-InstanceUsageAuditLogTestJSON-1940474646-project-admin] 10.222.0.44 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 19:11:10" status: 200 len: 318 microversion: 2.1 time: 0.320158 Oct 28 19:11:11.610489 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-cb4e23ac-a6bd-4f9f-9b58-0447104325e7 req-4c01d5cd-79fe-4620-a4e7-407b563bbbeb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082479 Oct 28 19:11:11.610489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 493/988] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:11.610778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 496/989] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2019%3A11%3A10 => generated 318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:11.615908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ffacc70-a15e-4b26-b904-62a2a39fa4a8 tempest-InstanceUsageAuditLogTestJSON-1940474646 tempest-InstanceUsageAuditLogTestJSON-1940474646-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.640793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ffacc70-a15e-4b26-b904-62a2a39fa4a8 tempest-InstanceUsageAuditLogTestJSON-1940474646 tempest-InstanceUsageAuditLogTestJSON-1940474646-project-admin] 10.222.0.44 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.028675 Oct 28 19:11:11.641561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 497/990] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:11:11.652280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:11.653101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:11.683190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.683944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.684532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:11.685461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:11.686136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:11.686723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.031193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:12.044942 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e735db35-8b33-45bb-ae5d-710cecd8b04e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.436842 Oct 28 19:11:12.049312 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 494/991] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:11 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:12.067303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:12.068894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:12.087596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.088262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.090900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.094286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.094835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.095281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.310941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:12.311569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:12.323034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.323533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.323975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.324691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.335769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.336222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.477721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:12.519071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:12.524708 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1a3d199-df34-484b-b86e-b15ae6197867 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.219109 Oct 28 19:11:12.528817 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 495/992] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:12 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:12.542196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:12.545127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:12.559847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:12.561074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.563211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.567099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.569122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3856378-9cc5-4847-92cf-ea33ed0947ba tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.505977 Oct 28 19:11:12.570854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.571443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.571968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.572629 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 498/993] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:12 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:12.585910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:12.586852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:12.600555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.601347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.601972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.602927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:12.607081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:12.607802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:12.793176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:12.805076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:12.812082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:12.831051 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f09d4500-b4c4-42c3-b35d-8c1870b38deb tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.249282 Oct 28 19:11:12.833616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 499/994] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:12 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:13.073330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:13.075260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:13.087040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.089319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.089923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.091995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.092675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.095850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.196369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:13.209925 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1421501f-da18-462f-bf94-f9279b1ad91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1325 microversion: 2.1 time: 0.677705 Oct 28 19:11:13.211699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 496/995] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:12 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1325 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:13.430448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:13.439808 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8cb50cca-719e-4d0d-80be-6f52bc0c7ac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.370417 Oct 28 19:11:13.445654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 500/996] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:13 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:13.561438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:13.562043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:13.569909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.570391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.570842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.575593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.577812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.580130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.605233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:13.606282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:13.620774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.653731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.654836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.656044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.656688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.657830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.700297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:13.748795 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8dcb394-1a0d-4236-85d9-0826f61f7d0f tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.191051 Oct 28 19:11:13.772278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 497/997] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:13 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:13.865015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:13.865015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:13.877884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.878384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.878867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.879579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:13.880033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:13.880455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:13.965998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:13.978513 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02dafc82-1bc2-4fcd-92ea-4247192a366e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.378689 Oct 28 19:11:13.980630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 501/998] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:13 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:14.014476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.025646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.045695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.059501 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dee292a8-6a4a-43b7-bcf6-8371b38ae7cd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.198593 Oct 28 19:11:14.060565 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 498/999] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:13 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:14.235059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:14.235952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:14.250682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.251416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.252366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.270455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.271578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.274934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.472350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:14.473611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:14.481748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.485285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.486098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.489437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.490172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.490795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.544153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:14.700644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.711693 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-86f42ea3-9abe-4902-a7d3-55d9c52fea94 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.481714 Oct 28 19:11:14.712294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 502/1000] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:14 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:14.736191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:14.741833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:14.757953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.758445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.758925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.759901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.760362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.760838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.892355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:14.904638 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6686e8a5-ad05-4afe-b57d-501c939149e4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.436454 Oct 28 19:11:14.905003 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 499/1001] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:14 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:14.926890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:14.927505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:14.937218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.937712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.938146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:14.938882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:14.939335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:14.939753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.048672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.059503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:15.062308 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6cfffa2-2cfb-483a-bac2-7f11110524aa tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.330798 Oct 28 19:11:15.075135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 503/1002] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:14 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:15.084454 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0010760-6d69-443a-9b45-cf8a42b468a0 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.176692 Oct 28 19:11:15.100703 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 500/1003] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:14 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:15.100703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.100703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.112025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.112656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.113199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.114233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.115715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.116157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.117105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:15.286174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1915383698", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:15.316115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.325185 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0cd96d1-551f-4178-ad7c-ae038a25b36f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.234577 Oct 28 19:11:15.326436 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 501/1004] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:15.331923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-226e9e78-5ae7-4de5-8de7-af6452c9ea61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1379550540", "metadata": {"": ""}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-226e9e78-5ae7-4de5-8de7-af6452c9ea61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action HTTP/1.1 Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 107 Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:15.336319 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1379550540", "metadata": {"": ""}}} Oct 28 19:11:15.337949 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1379550540', 'metadata': {'': ''}}}} Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'': ''} Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:15.338875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.340328 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:15.341641 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:15.341641 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:15.341641 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:11:15.341641 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:11:15.341641 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:15.341641 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:15.343677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-226e9e78-5ae7-4de5-8de7-af6452c9ea61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:15.344464 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-226e9e78-5ae7-4de5-8de7-af6452c9ea61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action" status: 400 len: 170 microversion: 2.1 time: 0.016523 Oct 28 19:11:15.345038 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 502/1005] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Oct 28 19:11:15 2022] POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action => generated 170 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:11:15.350255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.351104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.358909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.359438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.360106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.360891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.361405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.361848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.388857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:15.486559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.509691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.518021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.536333 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7268f9f9-fde7-43b1-8d82-d21cd279a336 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.189433 Oct 28 19:11:15.537295 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 503/1006] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:15.545283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.546921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.554612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.555329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.555938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.557430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.558214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.558950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.564260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:15.914788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:15.927769 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e7107cde-370c-477a-b7d5-2683c8ffa47d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.386760 Oct 28 19:11:15.928356 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 504/1007] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:15.948545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.950271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.978034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.984327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.986087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.989686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.990472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.991856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.076650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:16.077280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:16.078025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:16.078524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:16.079195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:16.090569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.091427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.092153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.093166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.093875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.094518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.121439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:16.130701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:16.144190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:16.146919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:16.210378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72f0c103-1f88-4228-98c4-32874a349509 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133786 Oct 28 19:11:16.217888 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 504/1008] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:16.224030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.224871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.232874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.233642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.234915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.235792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.236394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.236970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.381270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.393126 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b6cae2b-3e01-4443-8712-2bb9139e76ca tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.459862 Oct 28 19:11:16.394660 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 505/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:16.399962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.400945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.419571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.421547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.422068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.424845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.425420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.426884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.490968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.509916 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a12652ba-7790-4c51-9548-1c14f2d3a91a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.281147 Oct 28 19:11:16.516107 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 505/1010] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:16.522730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4fbe741-44a2-4d55-bf4f-aa57c7f758c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.523481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4fbe741-44a2-4d55-bf4f-aa57c7f758c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.582976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:16.623261 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce86f715-aa77-4ea7-92e5-a05d029d43b4 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.226957 Oct 28 19:11:16.635212 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 506/1011] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:16.658382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.659021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.665362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.667274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.668089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.668964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.669571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.670217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.670860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d4fbe741-44a2-4d55-bf4f-aa57c7f758c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.683756 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4fbe741-44a2-4d55-bf4f-aa57c7f758c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1215 microversion: 2.1 time: 0.164233 Oct 28 19:11:16.685188 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 506/1012] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:16.709160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e448e6dd-8172-43d8-bf4f-aced2669c097 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1731789013", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e448e6dd-8172-43d8-bf4f-aced2669c097 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action HTTP/1.1 Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 619 Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:11:16.730881 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:16.732603 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:11:16.733344 n-d-862769-3 devstack@n-api.service[120629]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1731789013", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 28 19:11:16.733344 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:11:16.733344 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1731789013', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 19:11:16.733573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:16.734303 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.735368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:16.736092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:16.736092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:16.736092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:11:16.736092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:11:16.736092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:11:16.736092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:16.736490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e448e6dd-8172-43d8-bf4f-aced2669c097 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:16.736490 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e448e6dd-8172-43d8-bf4f-aced2669c097 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action" status: 400 len: 938 microversion: 2.1 time: 0.036427 Oct 28 19:11:16.739513 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 507/1013] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Oct 28 19:11:16 2022] POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action => generated 938 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:11:16.747268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.747914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.767106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.767513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.767943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.768636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.769089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.779477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.852814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.864940 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-daf278e6-6a2a-4a61-a668-563b365c8229 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.227041 Oct 28 19:11:16.866069 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 507/1014] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:16.883339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.884904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.903171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.907630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.913450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.915778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.916966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.917876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.922500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.932482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.934428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.940012 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77e40f78-0e8a-4aad-abbf-2afbb083805d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1558 microversion: 2.91 time: 0.197497 Oct 28 19:11:16.940786 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 508/1015] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:17.156547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:17.165955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-608ca843-2f59-4fd5-88aa-6a9ac254bb61 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.296190 Oct 28 19:11:17.167374 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 508/1016] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:16 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.197745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.199748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.207503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.208313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.208910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.209790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.210384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.210981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.405891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:17.421820 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b5f754ea-119b-4e12-902a-362697179507 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.228981 Oct 28 19:11:17.422925 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 509/1017] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.428188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.428912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.455531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.456414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.459219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.460558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.461305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.462557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.590485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36c5d3e2-97dd-4c54-99b1-5eb538ea70c8 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Action: 'create', calling method: .version_select at 0x7f1d77f17dc0>, body: {"keypair": {"name": "tempest-keypair-1639334412", "type": "ssh", "user_id": "cda3b5376bf147ba9d8f4da6b36df0d8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmsaJEFIh2K4TYDBn9g7w7A3U/QE5aLrLGI1+AQLgz1vrf06Wi/MVH0swkxhZsJFODpdBvrpdKHFXjNRSf+7PBu2jt2lyJegyrabN5t0hpK4AkMOsW3I4cTqEpjULiOTw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:17.618837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-36c5d3e2-97dd-4c54-99b1-5eb538ea70c8 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Getting quotas for project ec2bae6f56b84cdf9ca4f4b0052ae28b. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:17.635528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-36c5d3e2-97dd-4c54-99b1-5eb538ea70c8 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Getting quotas for user c40008c5e36c443ab6fe74adf364fd45 and project ec2bae6f56b84cdf9ca4f4b0052ae28b. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:17.672210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:17.682211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-338d3294-3f50-42dd-aa06-98dafdc8b6e8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.257972 Oct 28 19:11:17.683156 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 510/1018] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.695653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc6a09d0-f0be-4f53-80c8-3794d19bc1de tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc6a09d0-f0be-4f53-80c8-3794d19bc1de tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action HTTP/1.1 Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 285 Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:11:17.700564 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:11:17.702020 n-d-862769-3 devstack@n-api.service[120629]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:11:17.702875 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:11:17.704246 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:11:17.705771 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:11:17.706774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:11:17.706774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:17.706774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc6a09d0-f0be-4f53-80c8-3794d19bc1de tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:17.706774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc6a09d0-f0be-4f53-80c8-3794d19bc1de tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action" status: 400 len: 619 microversion: 2.1 time: 0.016530 Oct 28 19:11:17.708598 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 511/1019] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Oct 28 19:11:17 2022] POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:11:17.711200 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36c5d3e2-97dd-4c54-99b1-5eb538ea70c8 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.368408 Oct 28 19:11:17.712320 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 509/1020] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:11:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 19:11:17.720821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.720821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.721484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.722201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.726971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.727463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.727935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.728845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.729300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.729718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.730994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.731578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.732118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.734450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.735056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.737528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.851783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:17.860173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-47af142b-9c32-4f15-a4eb-161f29ab2def tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1267 microversion: 2.1 time: 0.143968 Oct 28 19:11:17.879890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 510/1021] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.895397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:17.914534 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-468aeb61-1ed7-4fce-87bb-4542bebd489e tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.204118 Oct 28 19:11:17.915707 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 512/1022] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:17.920560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.921305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-935f16c7-82b9-426b-9783-7728611326af tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Action: 'create', calling method: .version_select at 0x7f1d77c45310>, body: {"keypair": {"name": "tempest-keypair-1488332911", "type": "ssh", "user_id": "cda3b5376bf147ba9d8f4da6b36df0d8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlu1zZtze0co/JOlegyPfi4H+o4X/17KWc/E+BRj3RLO1Orn1O7h15lmxLKYyWxPLA0cvrU/gCgSq2dV16srXQg0VmKNGhSZfhw3CIu7GJeO3IS2NOijMwuXKzcPgyWbQ=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:17.925817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.929427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:17.940224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-935f16c7-82b9-426b-9783-7728611326af tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Getting quotas for project ec2bae6f56b84cdf9ca4f4b0052ae28b. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:17.945904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-935f16c7-82b9-426b-9783-7728611326af tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Getting quotas for user c40008c5e36c443ab6fe74adf364fd45 and project ec2bae6f56b84cdf9ca4f4b0052ae28b. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:17.953589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.954085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.954518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.955251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.955700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.956166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.984546 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-935f16c7-82b9-426b-9783-7728611326af tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.066481 Oct 28 19:11:17.988160 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 513/1023] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:11:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:11:17.999549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.000435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:18.010863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.011727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.012375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.013348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.014116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.015384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.204730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.216448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-784dcad1-e46a-4f1a-bb23-1925517bb251 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.334556 Oct 28 19:11:18.217761 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 511/1024] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:18.224209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.225118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:18.246566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.255611 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6906a3ab-b31c-440b-a40f-31b9c724a094 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1543 microversion: 2.1 time: 0.266180 Oct 28 19:11:18.256932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 514/1025] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1543 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:18.263195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.263864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-daa740c8-46f3-4c6e-801b-91c93aa0caa7 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Calling method '.version_select at 0x7f1d77cf9c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.264003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.264516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.265439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.265988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.266497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.275091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-daa740c8-46f3-4c6e-801b-91c93aa0caa7 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "GET /compute/v2.1/os-keypairs/tempest-keypair-1639334412?user_id=cda3b5376bf147ba9d8f4da6b36df0d8" status: 200 len: 512 microversion: 2.10 time: 0.016377 Oct 28 19:11:18.285528 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 515/1026] 10.222.0.44 () {60 vars in 1340 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1639334412?user_id=cda3b5376bf147ba9d8f4da6b36df0d8 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:18.290941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.291759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:18.298459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.304098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.304779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.306303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.307418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.308151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.478908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.491076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.493271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.500855 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12faebb1-ad78-48d7-8003-361eeaaac8c0 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.280447 Oct 28 19:11:18.514856 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 512/1027] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:18.528572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7957e106-d7ef-4fe0-97f0-408aa479fb4e tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Action: 'create', calling method: .version_select at 0x7f1d7c5fc5e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1564637475", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhSQly5dJO0F4i2c3202WVaBTDf3fPCJiLHKq2XTRu6fVegxmSrDdF1uruhHkc097w/id/J6Ms7T7iwwHLrhbfbyArsRPcNPeD6/IJ7LfntX4FbZNQ0uYyRD6ythSylcg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:18.575189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-7957e106-d7ef-4fe0-97f0-408aa479fb4e tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Getting quotas for project ec2bae6f56b84cdf9ca4f4b0052ae28b. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:18.583516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-7957e106-d7ef-4fe0-97f0-408aa479fb4e tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Getting quotas for user c40008c5e36c443ab6fe74adf364fd45 and project ec2bae6f56b84cdf9ca4f4b0052ae28b. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:18.620260 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7957e106-d7ef-4fe0-97f0-408aa479fb4e tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.103601 Oct 28 19:11:18.622353 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 513/1028] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:11:18 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:11:18.636594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b703ff10-678d-4e78-b12d-292cafd6d7bf tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Calling method '.version_select at 0x7f1d77f17dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.648590 n-d-862769-3 devstack@n-api.service[120628]: WARNING oslo_db.sqlalchemy.utils [None req-b703ff10-678d-4e78-b12d-292cafd6d7bf tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 19:11:18.661219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b703ff10-678d-4e78-b12d-292cafd6d7bf tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "GET /compute/v2.1/os-keypairs?user_id=cda3b5376bf147ba9d8f4da6b36df0d8" status: 200 len: 726 microversion: 2.10 time: 0.031319 Oct 28 19:11:18.662504 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 514/1029] 10.222.0.44 () {60 vars in 1259 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/os-keypairs?user_id=cda3b5376bf147ba9d8f4da6b36df0d8 => generated 726 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:11:18.675972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9baa401c-6b9f-4b76-b475-b512c3e9aa08 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Calling method '.version_select at 0x7f1d77f72940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.716774 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9baa401c-6b9f-4b76-b475-b512c3e9aa08 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1564637475" status: 204 len: 0 microversion: 2.10 time: 0.045564 Oct 28 19:11:18.718342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 515/1030] 10.222.0.44 () {60 vars in 1325 bytes} [Fri Oct 28 19:11:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1564637475 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:11:18.724857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.725725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:18.733656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.734346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.734977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.736508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.737210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.738069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.917349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.927250 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6537473d-6273-40b7-b99f-1f4d58eba884 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.640273 Oct 28 19:11:18.931644 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 516/1031] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:18.936786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0751f0f6-c69b-4471-a29d-f94dda472f7b tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Calling method '.version_select at 0x7f1d77cb8790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.978147 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0751f0f6-c69b-4471-a29d-f94dda472f7b tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488332911?user_id=cda3b5376bf147ba9d8f4da6b36df0d8" status: 204 len: 0 microversion: 2.10 time: 0.044895 Oct 28 19:11:18.979101 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 517/1032] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:11:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488332911?user_id=cda3b5376bf147ba9d8f4da6b36df0d8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:11:18.986187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.990218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.000716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.006254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.007020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.008102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.012037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.012588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.045365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:19.080073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:19.092919 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-196e4aed-f3fd-4aa3-8ddb-cb16c13a64d8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.373223 Oct 28 19:11:19.096748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 516/1033] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:19.102302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.106108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.124490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.124992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.125428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.126145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.126620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.128557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.227243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:19.242126 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eff2cf85-f328-480e-a971-f68c2e542886 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1273 microversion: 2.1 time: 0.261584 Oct 28 19:11:19.243271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 518/1034] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:19.251211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1532022831"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:19.261855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.277607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.278366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.279323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.280232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.281001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.281660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.320295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:19.361550 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-540f7925-4478-4bdf-82f3-8483e0a3a96d tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.263428 Oct 28 19:11:19.376982 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 517/1035] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:19.400718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e24807d-25a7-44b5-93e0-7889f718e1a4 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] Calling method '.version_select at 0x7f1d7c5fc160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.450198 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e24807d-25a7-44b5-93e0-7889f718e1a4 tempest-KeyPairsV210TestJSON-208664629 tempest-KeyPairsV210TestJSON-208664629-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639334412?user_id=cda3b5376bf147ba9d8f4da6b36df0d8" status: 204 len: 0 microversion: 2.10 time: 0.066947 Oct 28 19:11:19.450879 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 518/1036] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639334412?user_id=cda3b5376bf147ba9d8f4da6b36df0d8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:11:19.471366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.477929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.499864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.502030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.503434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.506086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.508983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.511036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.855167 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a7e667dc-f6a1-4fd2-bd6c-c970d0ef3ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action" status: 202 len: 0 microversion: 2.1 time: 0.610289 Oct 28 19:11:19.856275 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 519/1037] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:11:19 2022] POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:11:19.868549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.869645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.882070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.883748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.885601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.887758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.888470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.889401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.059029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.070870 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-351e1b12-75f2-4b50-bb4b-2f73b7998057 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1542 microversion: 2.1 time: 0.612965 Oct 28 19:11:20.074351 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 519/1038] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1542 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:20.093470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-563595838"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:20.096885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:20.112191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.115456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.121213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.122053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.125574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.126104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.144174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.156586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.174382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.207104 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee6eb3fd-ad2d-4d0a-bb5e-11ee1b3a2d6a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.343907 Oct 28 19:11:20.231452 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 520/1039] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:20.249623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:20.253018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:20.266662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.267365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.267847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.270919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.272166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.273862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.277955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Cannot 'createImage' instance aba9cd8c-5182-44fc-b42f-b385b586e9ac while it is in task_state image_snapshot Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action HTTP/1.1 Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 84 Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:20.279624 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-563595838"}} Oct 28 19:11:20.281295 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'createImage' instance aba9cd8c-5182-44fc-b42f-b385b586e9ac while it is in task_state image_snapshot Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-563595838'}}} Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:20.282040 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance aba9cd8c-5182-44fc-b42f-b385b586e9ac while it is in task_state image_snapshot Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance aba9cd8c-5182-44fc-b42f-b385b586e9ac while it is in task_state image_snapshot Oct 28 19:11:20.283213 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:20.284326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 409 to user: Cannot 'createImage' instance aba9cd8c-5182-44fc-b42f-b385b586e9ac while it is in task_state image_snapshot {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:20.284326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1bf14b2f-6a05-4c45-9809-e519161e8c00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action" status: 409 len: 159 microversion: 2.1 time: 0.205386 Oct 28 19:11:20.284326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 520/1040] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:11:20 2022] POST /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac/action => generated 159 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:20.307240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:20.307771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:20.332547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.341811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.342373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.345474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.346192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.346861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.623314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:20.632107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8bb355fb-9554-42b7-9556-4c5a8bd5dbba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1273 microversion: 2.1 time: 0.349462 Oct 28 19:11:20.635488 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 521/1041] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:20 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:20.660963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91522920-2bbc-42ea-bfdd-e280921e0b00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '.version_select at 0x7f1d77f72af0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:20.946320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91522920-2bbc-42ea-bfdd-e280921e0b00 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/images/c57ac86c-4263-4922-8a80-da0e80c3f0cd" status: 204 len: 0 microversion: 2.1 time: 0.295053 Oct 28 19:11:20.950962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 522/1042] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:20 2022] DELETE /compute/v2.1/images/c57ac86c-4263-4922-8a80-da0e80c3f0cd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:20.956567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:20.957234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:20.973233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.977164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.977965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:20.978993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:20.981886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:20.990319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.208160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:21.221765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63828fce-3b22-4a60-8c3a-5a2a37ad1c22 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.988896 Oct 28 19:11:21.226966 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 521/1043] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:20 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:21.231862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "name": "network-vif-unplugged", "status": "completed", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:21.250980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:21.255200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.255950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.257361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.285696 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] Creating event network-vif-unplugged:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h1-862769-3 Oct 28 19:11:21.298204 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ff99471-6ad9-4cb7-a38a-97f75059d8c3 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1929 microversion: 2.75 time: 0.345368 Oct 28 19:11:21.298828 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 523/1044] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:20 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1929 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:21.310948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] Instance 73968331-d034-4594-8fa9-67a317e9b7bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:11:21.323592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e952f0e9-8928-4cbc-a8b3-1acb3fcd6a51 req-9478c943-22ac-47b0-9379-519589c9d02f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095065 Oct 28 19:11:21.326671 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 522/1045] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:21.332829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:21.336864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:21.338177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:21.344211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:21.349904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.350239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.350753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.351380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.354200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.354621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.354760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.356207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.360560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:21.361158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:21.362524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:21.362650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.215908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.226942 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd2fbf14-fa52-4777-9051-7913490c1c3c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1542 microversion: 2.1 time: 0.897719 Oct 28 19:11:22.243100 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 524/1046] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:21 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1542 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:22.255538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:22.259461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.280076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.282374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.283636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.290064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.290864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.291474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.339900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.355995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3a6b747-76da-4129-b775-123dfc8bb85f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1540 microversion: 2.1 time: 1.023428 Oct 28 19:11:22.378874 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 523/1047] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:21 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1540 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:22.386533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:22.395203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.416048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.416558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.417000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.417725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.418182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.418603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.546029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.548423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:22.560927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.569339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.584389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46859718-cfde-44ec-ad32-31bdb85bcea9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.339646 Oct 28 19:11:22.599259 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 525/1048] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:22.612212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:22.623581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:22.629695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:22.631363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.632176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.633011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.633887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:22.638830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:22.639473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:22.941045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.959014 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea03d841-86e1-45ee-8c05-f6a8f8b88c39 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.578452 Oct 28 19:11:22.964620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:22.978975 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 524/1049] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:22.980326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efa0ab8d-3da8-405f-ac48-c43f260a1b42 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.378937 Oct 28 19:11:22.983540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 526/1050] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:23.000518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:23.001961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:23.012883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.015399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.018014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.019028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.022004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.022639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.196541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:23.249901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:23.250957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:23.252800 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e579be23-43fc-492f-afd3-36e27bcc5f2c tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1947 microversion: 2.75 time: 0.271118 Oct 28 19:11:23.253947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 525/1051] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:22 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1947 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:23.275987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.277232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.277859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.283133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.283949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.284694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.385463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:23.386084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:23.397768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.398579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.398755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.402623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.407057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.407720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.775339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.784450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:23.789211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b0874fc-2e72-44a4-89c9-efb58bbfc9e7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1540 microversion: 2.1 time: 0.406943 Oct 28 19:11:23.789937 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 526/1052] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:23 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1540 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:23.795013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:23.806523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.807277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.807854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.809880 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5af8e09a-08f9-4686-af3f-37aa247f45c5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1474 microversion: 2.1 time: 0.564327 Oct 28 19:11:23.812223 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 527/1053] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:23 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1474 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:23.832377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:23.833123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:23.847961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.848711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.849044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.850760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:23.851448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:23.852108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:23.860355 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] Creating event network-changed:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h1-862769-3 Oct 28 19:11:23.870551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] Instance 73968331-d034-4594-8fa9-67a317e9b7bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:11:23.898933 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-77f8c495-d47f-4f6a-a1e6-551376ec867a req-3675c170-bfc4-4f67-8aa1-77b4851272fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106118 Oct 28 19:11:23.905574 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 527/1054] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:23.985202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:23.991395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:23.992348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.003330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.005244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.008910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.009394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.010028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.013219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c63ef43a-03fc-40b8-84eb-d6c4af6eeb26 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.199475 Oct 28 19:11:24.014565 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 528/1055] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:23 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:24.019361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:24.020393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:24.022505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.022982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.023575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.027304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.027960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.028572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.029448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.031028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.031872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.811694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.823991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-93b11ce3-f941-4d3b-bb06-5acd0c1eaea4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.808093 Oct 28 19:11:24.824583 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 529/1056] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:24 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:24.830492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:24.831052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:24.840621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.841147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.841614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.843633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.845759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.846420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:24.934454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:24.950798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6edccb2c-6325-45a9-afef-6f52ab212e8b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.970797 Oct 28 19:11:24.958813 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 528/1057] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:23 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:24.968033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e99e368a-2d92-47ae-b353-9e309440c221 req-b9e42a17-c84a-444b-af27-ba3995909d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c1842b-26c7-4a28-81c8-fcc0506ce16f", "tag": "f5c9f454-b97f-4209-a9d4-f233fe280ad6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:24.984929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e99e368a-2d92-47ae-b353-9e309440c221 req-b9e42a17-c84a-444b-af27-ba3995909d00 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:24.986365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e99e368a-2d92-47ae-b353-9e309440c221 req-b9e42a17-c84a-444b-af27-ba3995909d00 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:24.991747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e99e368a-2d92-47ae-b353-9e309440c221 req-b9e42a17-c84a-444b-af27-ba3995909d00 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.015644 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e99e368a-2d92-47ae-b353-9e309440c221 req-b9e42a17-c84a-444b-af27-ba3995909d00 service nova] Creating event network-changed:f5c9f454-b97f-4209-a9d4-f233fe280ad6 for instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f on n-h1-862769-3 Oct 28 19:11:25.026946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e99e368a-2d92-47ae-b353-9e309440c221 req-b9e42a17-c84a-444b-af27-ba3995909d00 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065467 Oct 28 19:11:25.030747 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 529/1058] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:25.042494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1db9ed72-5703-4c41-8641-cba144640b51 req-82980829-fe71-42c0-a6a0-437c6523cac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba9cd8c-5182-44fc-b42f-b385b586e9ac", "name": "network-vif-plugged", "status": "completed", "tag": "cf376f3b-d17f-4b96-8145-060372bd22f9"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:25.060699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1db9ed72-5703-4c41-8641-cba144640b51 req-82980829-fe71-42c0-a6a0-437c6523cac8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.063049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1db9ed72-5703-4c41-8641-cba144640b51 req-82980829-fe71-42c0-a6a0-437c6523cac8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.064638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1db9ed72-5703-4c41-8641-cba144640b51 req-82980829-fe71-42c0-a6a0-437c6523cac8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.069329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:25.095830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1db9ed72-5703-4c41-8641-cba144640b51 req-82980829-fe71-42c0-a6a0-437c6523cac8 service nova] Creating event network-vif-plugged:cf376f3b-d17f-4b96-8145-060372bd22f9 for instance aba9cd8c-5182-44fc-b42f-b385b586e9ac on n-h1-862769-3 Oct 28 19:11:25.105601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1db9ed72-5703-4c41-8641-cba144640b51 req-82980829-fe71-42c0-a6a0-437c6523cac8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073086 Oct 28 19:11:25.109178 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 530/1059] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:25.114543 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2664d9d4-50a7-43bd-8b22-f069a8df771a tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1935 microversion: 2.75 time: 0.288768 Oct 28 19:11:25.116231 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 530/1060] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:24 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1935 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:25.119354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:25.120294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:25.127184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.128009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.128660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.129303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:25.129862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.130593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.131408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.133101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:25.165031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.165611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.166054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.169417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.169926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.170364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.704837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.713451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-31040c9d-5261-4d05-ad6f-cda87195b69b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1522 microversion: 2.1 time: 0.601243 Oct 28 19:11:25.713728 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 531/1061] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:25 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:25.737175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:25.737795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:25.762902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.762902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.763429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.767805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.768948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.769554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.822055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.830949 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f116683f-063f-420a-905d-ca29a0a5d2d0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1471 microversion: 2.1 time: 0.713658 Oct 28 19:11:25.847939 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 531/1062] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:25 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:25.859543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:25.860291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:25.866663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.867400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.868163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.869126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:25.869759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:25.870358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:25.906461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:25.927449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.945932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.948892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:25.959704 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44c7c4a4-bdf7-43df-ab67-30afdee79750 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.240377 Oct 28 19:11:25.973292 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 532/1063] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:25 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:26.001306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.002093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.019652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.020340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.020942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.021813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.022432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.023266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.023790 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d3a4e1e-4e8a-4ca5-ba88-539cf92349ab tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 204 len: 0 microversion: 2.1 time: 0.173436 Oct 28 19:11:26.024866 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 532/1064] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:25 2022] DELETE /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:26.048525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:26.049411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.068967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.069483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.069922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.071531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.071995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.072428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.111253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:26.125664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.126147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.126620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.127388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.127840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.128268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.163684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:26.169255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for user 3142fd0059aa4b658c2cea015b1f3d93 and project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:26.391556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.404895 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-39a3e559-008c-4f19-a3b6-b1e600646403 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.428924 Oct 28 19:11:26.409220 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 533/1065] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:25 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:26.419720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.420628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.433762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.438112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.439568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.442332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.443765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.444776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.468312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-76ab14db-c0e9-4195-ade6-3696297245c1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.431744 Oct 28 19:11:26.472231 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 533/1066] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:11:26 2022] POST /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:11:26.485458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.486141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.500570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.501056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.501484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.502480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.502599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.503055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.853887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.862526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0d9c810b-8908-4ec0-972f-859e32cdd7f7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1528 microversion: 2.1 time: 0.392348 Oct 28 19:11:26.866923 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 534/1067] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1528 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:26.872712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.873330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.889532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.890253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.890494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.891187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.891640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.896171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.898354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:26.917439 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47799ed3-c6bd-4313-9466-65bcae377a40 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.506892 Oct 28 19:11:26.935092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 534/1068] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:26.940863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:26.941479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:26.948104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.949299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.949973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.950931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:26.951538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:26.952236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:26.957214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:27.011857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] Lazy-loading 'services' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:27.040062 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25459403-0edf-4e64-a3da-96dfe50bb0d7 tempest-ServersAdmin275Test-2011952500 tempest-ServersAdmin275Test-2011952500-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1920 microversion: 2.75 time: 0.171989 Oct 28 19:11:27.042510 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 535/1069] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1920 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:27.139959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.150095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8cd8a7f4-91da-4302-b8ce-b14da6f35cd2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1470 microversion: 2.1 time: 0.213759 Oct 28 19:11:27.165011 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 535/1070] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:26 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:27.171134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.172280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.180985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.182098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.182786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.184645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.185379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.185963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.219355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77f72670>, body: {"quota_set": {"ram": "5120"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:27.278194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.287872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.289970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.295544 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c28be494-ad52-4ac4-9493-5e2f1adba613 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.128493 Oct 28 19:11:27.297016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 536/1071] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:27.299974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.301206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.301329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.301693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.302241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.303271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.303954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.304595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.307501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.307979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.308399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.309251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.310139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.310867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.338292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:27.379232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d628cea9-1821-410e-8145-6bf6ec61a12e tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8" status: 200 len: 148 microversion: 2.57 time: 0.335484 Oct 28 19:11:27.385871 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 536/1072] 10.222.0.44 () {62 vars in 1303 bytes} [Fri Oct 28 19:11:27 2022] PUT /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8 => generated 148 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:27.385871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "name": "network-vif-plugged", "status": "completed", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}, {"server_uuid": "aba9cd8c-5182-44fc-b42f-b385b586e9ac", "name": "network-vif-unplugged", "status": "completed", "tag": "cf376f3b-d17f-4b96-8145-060372bd22f9"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:27.396659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.397252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.397749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.417612 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Creating event network-vif-plugged:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h1-862769-3 Oct 28 19:11:27.417612 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Creating event network-vif-unplugged:cf376f3b-d17f-4b96-8145-060372bd22f9 for instance aba9cd8c-5182-44fc-b42f-b385b586e9ac on n-h1-862769-3 Oct 28 19:11:27.425001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] Instance 73968331-d034-4594-8fa9-67a317e9b7bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:11:27.439324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-52b54e7c-1fc7-4ab4-bf05-61ad778b75c0 req-f71b5e9e-1d5e-496b-9348-873a0f7a9af3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.057290 Oct 28 19:11:27.443939 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 537/1073] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:27.449145 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e74c7ab4-271e-4b2d-af02-60902a1956dd tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "DELETE /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 204 len: 0 microversion: 2.75 time: 0.150763 Oct 28 19:11:27.450316 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 537/1074] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:11:27 2022] DELETE /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:11:27.451352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Calling method '.version_select at 0x7f1d77f72790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.457816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.458926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.465427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.465847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.466409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.467133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.467577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.468399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.548855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.550575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.552261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.553521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.554486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.555343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.568665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:27.607813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9bc59f1c-8e71-4507-8175-30010eecedb7 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8/detail" status: 200 len: 463 microversion: 2.57 time: 0.161726 Oct 28 19:11:27.608479 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 538/1075] 10.222.0.44 () {60 vars in 1304 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8/detail => generated 463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:27.623048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.624026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.633279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.637118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.637926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.639689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.644116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.644743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.731400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.742139 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-682e5bd6-3222-4dd0-97e1-4a941490551b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.289318 Oct 28 19:11:27.760438 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 538/1076] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:27.781016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.797685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.799149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:27.810403 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb5dc725-7333-4118-a722-8e717ad1c31d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1444 microversion: 2.75 time: 0.200771 Oct 28 19:11:27.832674 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 539/1077] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1444 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:27.847100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77c7a4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:27.885994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:27.887306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:27.899154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.899969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.900612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.901468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.903234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.903926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.959266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.961750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.962389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:27.963552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:27.964209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:27.964825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.043227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.044036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.044747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.045745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.046346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.047050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.119260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.124850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:28.127249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1750f46f-a4cf-48fc-948e-5d25b502a7ed tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8?user_id=2a0694bd4e464185927590904b35b5c1" status: 200 len: 148 microversion: 2.57 time: 0.283919 Oct 28 19:11:28.134412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7eb28272-ddc1-4095-859b-5d4fd18c164a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1528 microversion: 2.1 time: 0.247569 Oct 28 19:11:28.135318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 539/1078] 10.222.0.44 () {62 vars in 1384 bytes} [Fri Oct 28 19:11:27 2022] PUT /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8?user_id=2a0694bd4e464185927590904b35b5c1 => generated 148 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:28.142864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.143760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.144028 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 540/1079] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:27 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1528 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:28.150794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.151602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.152155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b25c8f7-882c-49f7-9580-574bf07ad513 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] Calling method '.version_select at 0x7f1d7c5fc5e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.152503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.153466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.154203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.154926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.294381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b25c8f7-882c-49f7-9580-574bf07ad513 tempest-QuotasAdminTestV257-1365040705 tempest-QuotasAdminTestV257-1365040705-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8?user_id=2a0694bd4e464185927590904b35b5c1" status: 200 len: 190 microversion: 2.57 time: 0.146013 Oct 28 19:11:28.302671 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 541/1080] 10.222.0.44 () {60 vars in 1364 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/os-quota-sets/5c36979830d642de9af942a96de7e9c8?user_id=2a0694bd4e464185927590904b35b5c1 => generated 190 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:11:28.311252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.312220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.328095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.328618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.329053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.329768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.330229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.330648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.342212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.359649 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fd551b4c-c6a6-429f-acc6-0245584c6752 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.222846 Oct 28 19:11:28.363506 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 540/1081] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:28.375922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.376877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.384656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.390900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.392892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.393737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.395139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.395671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.574889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.600626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.602082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.608006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:28.617497 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a9076f2-55a2-430b-8317-455e4e551a38 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1470 microversion: 2.1 time: 0.319453 Oct 28 19:11:28.618448 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1d190c5f-c934-4c17-adf1-25f6502b81fd tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.251616 Oct 28 19:11:28.618829 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 542/1082] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:28.619570 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 541/1083] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:28.767169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.767828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.778627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.779208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.782628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.783315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.783777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.784199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.858456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:28.860447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:28.888714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.889205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.889674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:28.890339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:28.902965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:28.904228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.011069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.023725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.028250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.039682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92b94fc4-ad7e-4459-a455-b618be402c5b tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1444 microversion: 2.75 time: 0.185670 Oct 28 19:11:29.057478 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 542/1084] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1444 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:29.058137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:29.070329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:29.071012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:29.078485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.078952 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d9ad2677-961a-4d83-b78b-5348ab8d41d6 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.316602 Oct 28 19:11:29.079088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.079453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.079597 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 543/1085] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:28 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:29.080582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.081046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.081472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.157564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:29.158170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:29.183165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.183662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.187212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.187958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:29.188423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:29.188844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:29.977911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 3d7de605-17c2-4004-99c0-2461d81bf4b7 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:30.004067 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7de01edb-4a59-40bb-8f2a-eb0ec47e7861 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 2420 microversion: 2.25 time: 0.944196 Oct 28 19:11:30.005470 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 543/1086] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:29 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 2420 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:30.008617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.013014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:30.014143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.019748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0301ba07-ea0f-49dd-a5ed-81c1ee371116 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1528 microversion: 2.1 time: 0.866095 Oct 28 19:11:30.034974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.034974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.034974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.034974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.035358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.035358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.039439 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 544/1087] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:29 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1528 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:30.044866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:30.045492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.072149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.073475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.074456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.075506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.076214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.076873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.444679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.457795 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-37fb5ff8-5c3e-4235-a6b2-a83381d218d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.451434 Oct 28 19:11:30.458714 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 544/1088] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:30 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:30.475627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:30.476247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.494399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.494925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.495355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.496063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.496511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.496927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.565390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.588711 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3585069-5ef1-4505-a28d-c56b3bd0e1d1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1470 microversion: 2.1 time: 0.547787 Oct 28 19:11:30.589687 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 545/1089] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:30 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1470 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:30.595715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-3", "block_migration": "auto"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:30.599648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.611814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.615297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.615955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.616837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.617446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.627531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.685260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'flavor' on Instance uuid 3d7de605-17c2-4004-99c0-2461d81bf4b7 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:30.709637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Going to try to live migrate instance to n-h2-862769-3 {{(pid=120628) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:11:30.719737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.730118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.731569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:30.765812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-763a10cb-8d44-468e-b1af-c687ed8b73a6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.305993 Oct 28 19:11:30.783089 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 545/1090] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:30 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:30.792226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:30.793101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:30.799454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.800264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.800929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.801844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.802513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.803425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.897194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:30.901490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:30.903316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:30.903959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lazy-loading 'fault' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:31.078531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.092653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.096491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.109884 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f82a9edf-9892-4759-b15d-4d7e4e927e24 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1449 microversion: 2.75 time: 0.325354 Oct 28 19:11:31.110899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 546/1091] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:30 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1449 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:31.115490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:31.118336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:31.133314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.139258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.140243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.141154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.141829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.142358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.543227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.569953 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-19a62829-75b4-4eb6-97e9-c1ff8fc8b247 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.454290 Oct 28 19:11:31.573332 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 547/1092] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:31 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:31.584146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:31.585108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:31.593265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.594418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.595163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.596513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.597182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.597828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.639100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.640364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.641062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.641774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lazy-loading 'fault' on Instance uuid aba9cd8c-5182-44fc-b42f-b385b586e9ac {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:31.691872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:31.700865 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d070c95f-263c-464b-a8b5-79653f6736fe tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1315 microversion: 2.1 time: 0.125861 Oct 28 19:11:31.701536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 548/1093] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:31 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1315 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:31.710286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-39abc9fb-e674-414d-8e9c-77b72de7ac9f req-aa87eedd-72d8-42c4-a3dd-cd20be1ed850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba9cd8c-5182-44fc-b42f-b385b586e9ac", "name": "network-vif-deleted", "tag": "cf376f3b-d17f-4b96-8145-060372bd22f9"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:31.723838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39abc9fb-e674-414d-8e9c-77b72de7ac9f req-aa87eedd-72d8-42c4-a3dd-cd20be1ed850 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.724324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39abc9fb-e674-414d-8e9c-77b72de7ac9f req-aa87eedd-72d8-42c4-a3dd-cd20be1ed850 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.724907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39abc9fb-e674-414d-8e9c-77b72de7ac9f req-aa87eedd-72d8-42c4-a3dd-cd20be1ed850 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.743450 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-39abc9fb-e674-414d-8e9c-77b72de7ac9f req-aa87eedd-72d8-42c4-a3dd-cd20be1ed850 service nova] Creating event network-vif-deleted:cf376f3b-d17f-4b96-8145-060372bd22f9 for instance aba9cd8c-5182-44fc-b42f-b385b586e9ac on n-h1-862769-3 Oct 28 19:11:31.748886 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-39abc9fb-e674-414d-8e9c-77b72de7ac9f req-aa87eedd-72d8-42c4-a3dd-cd20be1ed850 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044576 Oct 28 19:11:31.750019 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 549/1094] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:31.767181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:31.767934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:31.775365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.775800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.776259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.777008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:31.777473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:31.777900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:31.803475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:32.033998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.045801 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8497fa48-eb2f-4dc6-98e4-d296c1981d8f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.294380 Oct 28 19:11:32.061655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 550/1095] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:31 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:32.067521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.068440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.076286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.077176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.077176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.077883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.078418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.079009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.278758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.287174 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a92915f-f7a9-436c-a096-1a38aef05d10 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1470 microversion: 2.1 time: 0.224312 Oct 28 19:11:32.303233 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 551/1096] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:32.308822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.309620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.316687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.317351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.317930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.318864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.319460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.320028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.452965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.468152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.469636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.483178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9faa5c32-8d35-4b62-9b18-4db2d757c0a1 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.177626 Oct 28 19:11:32.487517 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 552/1097] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:32.494726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.495334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.505595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.506088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.506508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.507744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.508459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.509030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.610886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.613024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.613484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.613937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lazy-loading 'fault' on Instance uuid 905ab679-1cd9-49c0-9ff4-956a7ef5d501 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:32.665351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.679601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.681582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84221ef6a4a340bf98b0abff80d0e9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f360bda35240749d0e39ffd62fa983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:32.688837 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bfad0720-ab8c-449e-a5b3-46a5d7dd062d tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 200 len: 1449 microversion: 2.75 time: 0.200264 Oct 28 19:11:32.695119 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 553/1098] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 1449 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:32.700326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f6af74e9-9e9e-485d-bb7f-a2e125105bf6 req-840cac3d-c224-4a5d-a6fc-e66ad4cc2485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c1842b-26c7-4a28-81c8-fcc0506ce16f", "name": "network-vif-plugged", "status": "completed", "tag": "f5c9f454-b97f-4209-a9d4-f233fe280ad6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:32.712079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6af74e9-9e9e-485d-bb7f-a2e125105bf6 req-840cac3d-c224-4a5d-a6fc-e66ad4cc2485 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.714628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6af74e9-9e9e-485d-bb7f-a2e125105bf6 req-840cac3d-c224-4a5d-a6fc-e66ad4cc2485 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.717863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6af74e9-9e9e-485d-bb7f-a2e125105bf6 req-840cac3d-c224-4a5d-a6fc-e66ad4cc2485 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.745981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f6af74e9-9e9e-485d-bb7f-a2e125105bf6 req-840cac3d-c224-4a5d-a6fc-e66ad4cc2485 service nova] Creating event network-vif-plugged:f5c9f454-b97f-4209-a9d4-f233fe280ad6 for instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f on n-h1-862769-3 Oct 28 19:11:32.758596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f6af74e9-9e9e-485d-bb7f-a2e125105bf6 req-840cac3d-c224-4a5d-a6fc-e66ad4cc2485 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059635 Oct 28 19:11:32.764135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 554/1099] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:32.797387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:32.799543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:32.821102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.828040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.828291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:32.832156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:32.832521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:32.832904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.254951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:33.267219 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7c2e8a2f-19b9-4175-a219-9c830db195d3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.501384 Oct 28 19:11:33.269784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 555/1100] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:32 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:33.278252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:33.279151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:33.289649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.295283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.297671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.299629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.304436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.305117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.371992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.372656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.377247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.377883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lazy-loading 'fault' on Instance uuid aba9cd8c-5182-44fc-b42f-b385b586e9ac {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:33.466819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:33.475309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9ab9727c-e785-415f-a254-34ac0917e66e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 200 len: 1315 microversion: 2.1 time: 0.204221 Oct 28 19:11:33.497923 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 556/1101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:33 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:33.503187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-00944d4e-94d3-4b7e-bef5-35da042c2769 req-487e60f6-1332-4827-8b39-6cca3962149d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e4371-c171-43ac-8520-da07711dcbb1", "name": "network-vif-unplugged", "status": "completed", "tag": "2da3baa2-5257-4f18-bfd0-e9e9e09faf0f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:33.524456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-00944d4e-94d3-4b7e-bef5-35da042c2769 req-487e60f6-1332-4827-8b39-6cca3962149d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.531175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-00944d4e-94d3-4b7e-bef5-35da042c2769 req-487e60f6-1332-4827-8b39-6cca3962149d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.531776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-00944d4e-94d3-4b7e-bef5-35da042c2769 req-487e60f6-1332-4827-8b39-6cca3962149d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.560571 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-00944d4e-94d3-4b7e-bef5-35da042c2769 req-487e60f6-1332-4827-8b39-6cca3962149d service nova] Creating event network-vif-unplugged:2da3baa2-5257-4f18-bfd0-e9e9e09faf0f for instance e97e4371-c171-43ac-8520-da07711dcbb1 on n-h1-862769-3 Oct 28 19:11:33.576598 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-00944d4e-94d3-4b7e-bef5-35da042c2769 req-487e60f6-1332-4827-8b39-6cca3962149d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076961 Oct 28 19:11:33.577469 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 557/1102] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:33.584140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:33.585469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:33.606930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.607600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.608329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.609211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.609821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.610399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.846642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:33.856374 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0b028e0-6537-4d50-8d6d-bd6b79f1ccc1 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/action" status: 202 len: 0 microversion: 2.25 time: 3.262972 Oct 28 19:11:33.859389 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc28e632-af2b-413a-b4af-91aee846dee4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.274774 Oct 28 19:11:33.860336 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 558/1103] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:33 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:33.863871 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 546/1104] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:11:30 2022] POST /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/action => generated 0 bytes in 3273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:33.870618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:33.882569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:33.886032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:33.889312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:33.892009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.892501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.892931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.893635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.894137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.895076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.923498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.929138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.929604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:33.930356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:33.930851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:33.931284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.129692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.149132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.151937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.169619 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c95e457a-18d6-4bd9-8255-6e10dfe8ad2d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.302562 Oct 28 19:11:34.171622 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 547/1105] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:33 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:34.177978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:34.179941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] [instance: 905ab679-1cd9-49c0-9ff4-956a7ef5d501] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:34.191673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.192476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.193242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.194179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.194881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.196072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.219679 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] HTTP exception thrown: Instance 905ab679-1cd9-49c0-9ff4-956a7ef5d501 could not be found. Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Request method failure captured: Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 HTTP/1.1 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCkKxgej-UtVpMKjMQlPhWIAB5b-ocbPnEoZoU75eRVhfmBSobavZcrlhRQqpew9l8JatW0ohqNWpmji40miO1QX_zRNuEUXOewlT1YkPcp4rw5XjEsPKA4i7mBCXEXRhnDzEHQ6VLQ91p3FD8RIIGppvHcIWb1faRGPoYW8GE9PEow Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.75 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 18f360bda35240749d0e39ffd62fa983 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdmin275Test-1792324910 Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:34.221773 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/18f360bda35240749d0e39ffd62fa983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_18f360bda35240749d0e39ffd62fa983", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/18f360bda35240749d0e39ffd62fa983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/18f360bda35240749d0e39ffd62fa983"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdmin275Test-1792324910 Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 18f360bda35240749d0e39ffd62fa983 Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdmin275Test-1792324910 Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdmin275Test-1792324910-project Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 84221ef6a4a340bf98b0abff80d0e9cc Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdmin275Test-1792324910-project Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 905ab679-1cd9-49c0-9ff4-956a7ef5d501 could not be found. Oct 28 19:11:34.223350 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '905ab679-1cd9-49c0-9ff4-956a7ef5d501'} Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905ab679-1cd9-49c0-9ff4-956a7ef5d501 could not be found. Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:34.224217 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905ab679-1cd9-49c0-9ff4-956a7ef5d501 could not be found. Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905ab679-1cd9-49c0-9ff4-956a7ef5d501 could not be found. Oct 28 19:11:34.225502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.230343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] Returning 404 to user: Instance 905ab679-1cd9-49c0-9ff4-956a7ef5d501 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:34.236790 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4774b079-ac1f-4b83-80d5-b26a611925e4 tempest-ServersAdmin275Test-1792324910 tempest-ServersAdmin275Test-1792324910-project] 10.222.0.44 "GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501" status: 404 len: 111 microversion: 2.75 time: 0.064006 Oct 28 19:11:34.237671 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 548/1106] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:34 2022] GET /compute/v2.1/servers/905ab679-1cd9-49c0-9ff4-956a7ef5d501 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:11:34.243804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:34.244754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:34.271402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.273069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.274794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.281949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.292081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.292216 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15d47cb4-4e70-472f-8556-f7fa428bebe9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1470 microversion: 2.1 time: 0.430762 Oct 28 19:11:34.293533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.296604 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 559/1107] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:33 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1470 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:34.298255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.303635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:34.305029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:34.313902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.314627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.315221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.316117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.316715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.317278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.695465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.704015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-922873f9-d232-43e7-b01f-e34a49132586 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.406224 Oct 28 19:11:34.704760 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 560/1108] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:34 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:34.717828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:34.720730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:34.729911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.730891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.731626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.732613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.733340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.734043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.748056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.757032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.766147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:34.767413 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ceeed09-834a-4429-b758-6e258a4077a8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.527620 Oct 28 19:11:34.783825 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 549/1109] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:34 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:34.785155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac HTTP/1.1 Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:11:34.786907 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:11:34.788660 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac'} Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:34.789413 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:11:34.790589 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:34.792717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:34.792717 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8664f05-9a05-4883-a143-856665a5d9c7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 404 len: 111 microversion: 2.1 time: 0.074718 Oct 28 19:11:34.800596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9086d80-81c8-4744-97fa-152bd6fd4379 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'create', calling method: .version_select at 0x7f1d77d99940>, body: {"keypair": {"name": "tempest-keypair-1698654127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNPT+jN6LSS28GtStH+32LbHIS24UlSVsOnvjtv7WgnWWWPHjwjG70b6/mn4m7dNiTmlXNx/0980xvabwNhy58ih2MQiFts/BDika6aJfn3z3ZczNHW8/vKUyyybO6jtw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:34.802780 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 561/1110] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:34 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:34.815275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:34.828829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c9086d80-81c8-4744-97fa-152bd6fd4379 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for project 396065b7b553417d9ad5022d9e57404c. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:34.834190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c9086d80-81c8-4744-97fa-152bd6fd4379 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for user 8222e34ca7794fa686f94cc2b220c4e3 and project 396065b7b553417d9ad5022d9e57404c. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:34.867708 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9086d80-81c8-4744-97fa-152bd6fd4379 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070877 Oct 28 19:11:34.869596 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 550/1111] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:11:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:34.883549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:34.884399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:34.893250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.894205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.894891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:34.895854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:34.896517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:34.897145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.117604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.126611 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f0eb9f0-dcf6-4cb1-bfbf-d9c1c6f837b8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1315 microversion: 2.1 time: 0.247161 Oct 28 19:11:35.129201 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 562/1112] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:34 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:35.209344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:35.212536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:35.258398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.258938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.260558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.264380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.265088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.267209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.421981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-430ab670-a046-43c5-934e-e0ed6c76ed55 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Calling method '.version_select at 0x7f1d77d93d30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:35.430553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.452608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.465873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.473426 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e77ab5f-c5e4-427d-b2fe-ad0181327fe5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.275218 Oct 28 19:11:35.474736 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 563/1113] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:35 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:35.483607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:35.485113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:35.495647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.496501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.497186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.498523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.499234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.499880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.611732 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-430ab670-a046-43c5-934e-e0ed6c76ed55 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 371 microversion: 2.1 time: 0.417181 Oct 28 19:11:35.613349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 551/1114] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:11:35 2022] GET /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:35.627838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77df5310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:35.737675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.738173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.738622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.739382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.739833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.740251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.808622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:35.827899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1bfd2676-13d3-4983-93d4-d7b1f8d38ceb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1470 microversion: 2.1 time: 0.350850 Oct 28 19:11:35.830283 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 564/1115] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:35 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1470 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:35.838561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4439e3c2-40ae-4876-b32f-7a2cd9863f08 req-fd48c220-7496-417b-9dd0-29ccbf87fb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97e4371-c171-43ac-8520-da07711dcbb1", "tag": "2da3baa2-5257-4f18-bfd0-e9e9e09faf0f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:35.867091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4439e3c2-40ae-4876-b32f-7a2cd9863f08 req-fd48c220-7496-417b-9dd0-29ccbf87fb4b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.867585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4439e3c2-40ae-4876-b32f-7a2cd9863f08 req-fd48c220-7496-417b-9dd0-29ccbf87fb4b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.869266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4439e3c2-40ae-4876-b32f-7a2cd9863f08 req-fd48c220-7496-417b-9dd0-29ccbf87fb4b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.872454 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6322619-7072-4b78-9046-7a1f0799ed5f tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 328 microversion: 2.1 time: 0.249753 Oct 28 19:11:35.887727 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 552/1116] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:35 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 328 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:35.898017 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4439e3c2-40ae-4876-b32f-7a2cd9863f08 req-fd48c220-7496-417b-9dd0-29ccbf87fb4b service nova] Creating event network-changed:2da3baa2-5257-4f18-bfd0-e9e9e09faf0f for instance e97e4371-c171-43ac-8520-da07711dcbb1 on n-h1-862769-3 Oct 28 19:11:35.898172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:35.898725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:35.905388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.906147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.906750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.908935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.909557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.910126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.911803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4439e3c2-40ae-4876-b32f-7a2cd9863f08 req-fd48c220-7496-417b-9dd0-29ccbf87fb4b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079003 Oct 28 19:11:35.914066 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 565/1117] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:35.924796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:35.925501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:35.953722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.954222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.954653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:35.956731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:35.957187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:35.957604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.516855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.525921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4236ad55-2045-4177-a52a-e4b0b006cd73 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.636995 Oct 28 19:11:36.531426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 553/1118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:35 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:36.581294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.596732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.602182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:36.604224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8b90af7-c811-40fb-9a3c-a1b997f70cd0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.689027 Oct 28 19:11:36.610609 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 566/1119] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:35 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:36.628660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:36.631303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:36.646258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.647121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.649310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.650339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.651464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.653233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.670220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-121882716", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:36.782647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:37.504370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.530652 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-16f8e1b0-93aa-42d7-9a7a-2aef006dced7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1503 microversion: 2.1 time: 0.918554 Oct 28 19:11:37.551598 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 567/1120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:36 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1503 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:37.565727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "name": "network-vif-unplugged", "status": "completed", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:37.588627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.589308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.589616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.606214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] Creating event network-vif-unplugged:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h2-862769-3 Oct 28 19:11:37.613932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] Instance 73968331-d034-4594-8fa9-67a317e9b7bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:11:37.667525 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-aa2abe45-4395-4354-b7da-d248e174f7b8 req-229231a7-3ddb-4ff7-9f09-77a21bc1124c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113426 Oct 28 19:11:37.672344 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 568/1121] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:37.679931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:37.680751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:37.688440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.689047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.689571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.690394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.690965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.691503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.696806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:37.854904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.864682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:37.865268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:37.866818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:37.868368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:37.868963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:37.878307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.880997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.889881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.890761 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b0fecc0-5e33-46d7-ad18-c62fefc0d28c tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1553 microversion: 2.91 time: 0.216261 Oct 28 19:11:37.891427 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 569/1122] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:37 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:37.896361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:37.896965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:37.899823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.902109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.904387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.907219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.907811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.908896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.909780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.910277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:37.910858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:37.911374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.911626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:37.967097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Getting quotas for project 3da7936bd9c943f1ad663de75e6c29c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:37.972598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Getting quotas for user f5585ebefeb340fb8ba84946e7a6dc99 and project 3da7936bd9c943f1ad663de75e6c29c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:37.985799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.utils [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] cores quota exceeded for 3da7936bd9c943f1ad663de75e6c29c5, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120628) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 19:11:37.987026 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Request method failure captured: Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 144 Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCllF2ala1hyCYRzMgzucC3XbngJK3Zcf1fm8mlj2sQJU-LC49UWCHEsQOAIdOagsOMBrE53-BQot_wmGodpkj0XOfW0rkHEp-6TSrktWkfRJPZjNcjxsSvrGNve5yJHqGfnx3CRnTznyzbwFv_F8RUf_-nCMMf9aVYVK0t0dHdOjvE Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:37.991023 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3da7936bd9c943f1ad663de75e6c29c5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f5585ebefeb340fb8ba84946e7a6dc99 Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-121882716", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} Oct 28 19:11:37.992432 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-121882716', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452'}}} Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 19:11:37.993174 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:37.994331 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.995571 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:37.996776 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:37.996776 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:37.996776 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:37.996776 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:37.996776 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 19:11:37.996776 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:37.999837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:38.001325 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35d19f45-9dde-4b00-9cf3-4e8b214868de tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.452296 Oct 28 19:11:38.002535 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 554/1123] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 1454 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:38.017920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-171433498", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:38.070727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:38.098441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] validate_networks() for [('6cded4e8-248a-436b-b141-6debca321857', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:38.120552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=32 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:38.440147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:38.451556 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-baed5d80-5954-46a1-9948-77bf1bde1513 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1536 microversion: 2.1 time: 0.558796 Oct 28 19:11:38.452425 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 570/1124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:37 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1536 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:38.466823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.467451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.473637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.474728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.476416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.477727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.478186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.478613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.810581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:38.819761 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4eae86b0-9fb6-4f40-9aba-c08b5a73571f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.366137 Oct 28 19:11:38.820337 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 571/1125] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:38 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:38.835117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.835988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.842285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.843182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.843886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.844937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.845873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.846683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.874371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:38.973069 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e56c1743-8d6f-44a2-a3f1-30155bbab768 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 204 len: 0 microversion: 2.1 time: 0.151191 Oct 28 19:11:38.974024 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 572/1126] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:38 2022] DELETE /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:38.980492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.981245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.988477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.989075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.989683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.990478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.991212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.991633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.026720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:39.027411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:39.027893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:39.028525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:39.029158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:39.042999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.044372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.044989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.045757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.046379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.047071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.068908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for project 396065b7b553417d9ad5022d9e57404c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:39.073860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for user 8222e34ca7794fa686f94cc2b220c4e3 and project 396065b7b553417d9ad5022d9e57404c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:39.088847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:39.091291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:39.146490 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-066c0132-b6cc-4208-9e54-72634c94f2a4 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.142588 Oct 28 19:11:39.147445 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 555/1127] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:39.153017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c45e040>, body: {"quota_set": {"cores": 20}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:39.394293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.411793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.415470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.419309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-819c733b-0961-477f-9363-ad208af89036 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.442693 Oct 28 19:11:39.420656 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 573/1128] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:38 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:39.430527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.433978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.440088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:39.451413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.452316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.452704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.453427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.453918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.454324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.534220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.535135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.535578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.536607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.537064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.537803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.541251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.552458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.553923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.563984 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd73487c-1184-4e39-9c3d-bc4d180853f6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1535 microversion: 2.91 time: 0.140706 Oct 28 19:11:39.564932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 574/1129] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1535 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:39.572351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.573596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.584087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.584671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.585220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.586318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.586900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.587428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.617895 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-26454421-2add-43c8-8c62-54fbe8a3e540 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 329 microversion: 2.1 time: 0.469224 Oct 28 19:11:39.618474 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 556/1130] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:39 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 329 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:39.627023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:39.638233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.638834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.639330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.651559 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] Creating event network-changed:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h2-862769-3 Oct 28 19:11:39.657945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] Instance 73968331-d034-4594-8fa9-67a317e9b7bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:11:39.670314 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c107e32f-abbf-4cac-a358-fef21695dd08 req-7d98807d-9078-4ed3-b08f-4680fe26f5d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050340 Oct 28 19:11:39.671172 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 557/1131] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:39.676716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ebe8642-9f21-4ad5-9d3f-e23650bbd8d0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.677502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ebe8642-9f21-4ad5-9d3f-e23650bbd8d0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.739362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6ebe8642-9f21-4ad5-9d3f-e23650bbd8d0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.747192 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ebe8642-9f21-4ad5-9d3f-e23650bbd8d0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1224 microversion: 2.1 time: 0.074593 Oct 28 19:11:39.748001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 558/1132] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1224 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:39.752847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.753649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.759770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.759942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.760576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.761172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.762005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.762669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.763245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.769481 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc4f09b5-33c2-44f5-89cc-003464cf53fc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1509 microversion: 2.1 time: 0.203222 Oct 28 19:11:39.770115 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 575/1133] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:39.896235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-726748908", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:39.899913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.907917 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9eda16ff-5445-4539-ae4e-6e21ce0b655c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1536 microversion: 2.1 time: 0.158672 Oct 28 19:11:39.908553 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 559/1134] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1536 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:39.913076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1115cb2-ba82-4875-987f-385b0a752c79 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Calling method '.version_select at 0x7f1d77d6c700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.951142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:39.978750 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1115cb2-ba82-4875-987f-385b0a752c79 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 371 microversion: 2.1 time: 0.069180 Oct 28 19:11:39.979370 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 560/1135] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:39.986338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.986338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.990428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.990943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.991374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.992150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.992607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.993026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.181344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.190081 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc49d497-83a5-4e98-9728-8aa69610eb71 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.209694 Oct 28 19:11:40.190664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 561/1136] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:40.195417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77d5b280>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:40.216279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:40.216686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:40.217184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:40.217590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:40.217961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:40.228154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.228649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.229080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.231675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.232143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.232568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.249876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:40.254781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:40.257225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.257704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.258123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.258907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.259362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.259786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.267149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:40.271363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:40.273040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:40.304466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:40.319807 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd85dc75-2540-4dc1-ba62-6a6fcbfc7942 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 328 microversion: 2.1 time: 0.127898 Oct 28 19:11:40.330748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 562/1137] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:40 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:40.330957 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-672366d8-b19e-4f7b-9e52-5bda0661163e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550015 Oct 28 19:11:40.330957 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 576/1138] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:40.337329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56e5a2a6-4333-492b-b78c-522e16c1d1f3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:40.337967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56e5a2a6-4333-492b-b78c-522e16c1d1f3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:40.405343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56e5a2a6-4333-492b-b78c-522e16c1d1f3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.414603 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56e5a2a6-4333-492b-b78c-522e16c1d1f3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1216 microversion: 2.1 time: 0.081884 Oct 28 19:11:40.415798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 563/1139] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:40 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:40.447426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:40.448041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:40.448502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-205785414", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:40.454451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.454677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.455289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.456069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.456442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.456859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.531954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:40.924454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.944400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.945849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.947107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bbfe0ead-ecb3-4e2c-a9e9-f720f5439c06 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.503803 Oct 28 19:11:40.947662 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 564/1140] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:40 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:40.952245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:40.952849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:40.978117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.978677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.980611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.982499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.982966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.983395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.114449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:41.118269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:41.118975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:41.119643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:41.120497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:41.133777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.134521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.135154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.136035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.136640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.137211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.159239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Getting quotas for project 3da7936bd9c943f1ad663de75e6c29c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:41.165161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Getting quotas for user f5585ebefeb340fb8ba84946e7a6dc99 and project 3da7936bd9c943f1ad663de75e6c29c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:41.189906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.utils [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] instances quota exceeded for 3da7936bd9c943f1ad663de75e6c29c5, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120629) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 19:11:41.190680 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Request method failure captured: Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 144 Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCllF2ala1hyCYRzMgzucC3XbngJK3Zcf1fm8mlj2sQJU-LC49UWCHEsQOAIdOagsOMBrE53-BQot_wmGodpkj0XOfW0rkHEp-6TSrktWkfRJPZjNcjxsSvrGNve5yJHqGfnx3CRnTznyzbwFv_F8RUf_-nCMMf9aVYVK0t0dHdOjvE Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:11:41.196345 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3da7936bd9c943f1ad663de75e6c29c5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: f5585ebefeb340fb8ba84946e7a6dc99 Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-205785414", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} Oct 28 19:11:41.197643 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-205785414', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452'}}} Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 19:11:41.198393 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:41.199509 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.200818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a2a3ffe-59aa-4570-8683-fd335f9ae41b tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.757904 Oct 28 19:11:41.202085 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 577/1141] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:40 2022] POST /compute/v2.1/servers => generated 119 bytes in 762 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:41.212183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.213552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.230473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.231273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.234007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.235540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.236179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.237848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.272806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.288417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.292972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.310319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b688b110-346b-41a2-b66a-deaba9064b9e tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1538 microversion: 2.91 time: 0.361468 Oct 28 19:11:41.311592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 565/1142] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:40 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1538 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:41.323078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.325688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.342023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.342853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.343510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.345151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.345947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.346617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.399339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.408603 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dbea2538-2869-4f3a-b0c5-80cd58b32d98 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1220 microversion: 2.1 time: 0.205969 Oct 28 19:11:41.409460 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 578/1143] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1220 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:41.431577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.437287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.445394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.446075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.446660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.447575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.448179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.448804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.509875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.520178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1e7b9dc-0ae9-4af4-a264-7fffb7378090 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 200 len: 1467 microversion: 2.1 time: 0.205225 Oct 28 19:11:41.521715 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 566/1144] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 1467 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:41.527325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77d63af0>, body: {"quota_set": {"instances": 10}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:41.627570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.628317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.629226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.632941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.633516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.634173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.696690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.706042 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5bb8a857-49c4-485e-85ab-4e6f5a621e5a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 329 microversion: 2.1 time: 0.182973 Oct 28 19:11:41.707199 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 567/1145] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:41 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 329 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:41.708928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa148e0c-bc7e-4f0e-a38a-5201b1122a6d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1536 microversion: 2.1 time: 0.286469 Oct 28 19:11:41.710054 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 579/1146] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1536 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:41.715380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:41.718327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.725756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.726602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.727335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.728291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.728962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.729602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.736435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.737053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.744596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.745110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.745624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.746336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.746814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.747440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.773528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862769-3". {{(pid=120629) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:11:41.862334 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17afef04-0ea6-41c2-815b-ee41cbbed30b tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action" status: 202 len: 0 microversion: 2.91 time: 0.150623 Oct 28 19:11:41.863326 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 580/1147] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:11:41 2022] POST /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:41.868675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.869359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.876435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.877133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.877769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.878668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.879300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.879876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.205723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.216354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4601696-a4db-42b7-b27b-61e3637e3468 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1212 microversion: 2.1 time: 0.351896 Oct 28 19:11:42.232744 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 581/1148] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1212 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:42.237758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6cd8ff1e-aef9-45c5-97da-0e15f2dd0c8f req-6ed68d18-06aa-44b0-ba81-aa04b253c366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c1842b-26c7-4a28-81c8-fcc0506ce16f", "name": "network-vif-deleted", "tag": "f5c9f454-b97f-4209-a9d4-f233fe280ad6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:42.254904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6cd8ff1e-aef9-45c5-97da-0e15f2dd0c8f req-6ed68d18-06aa-44b0-ba81-aa04b253c366 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.255567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6cd8ff1e-aef9-45c5-97da-0e15f2dd0c8f req-6ed68d18-06aa-44b0-ba81-aa04b253c366 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.256185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6cd8ff1e-aef9-45c5-97da-0e15f2dd0c8f req-6ed68d18-06aa-44b0-ba81-aa04b253c366 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.271577 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6cd8ff1e-aef9-45c5-97da-0e15f2dd0c8f req-6ed68d18-06aa-44b0-ba81-aa04b253c366 service nova] Creating event network-vif-deleted:f5c9f454-b97f-4209-a9d4-f233fe280ad6 for instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f on n-h1-862769-3 Oct 28 19:11:42.277629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6cd8ff1e-aef9-45c5-97da-0e15f2dd0c8f req-6ed68d18-06aa-44b0-ba81-aa04b253c366 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043611 Oct 28 19:11:42.283484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 582/1149] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:42.292432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88f47222-c733-430b-a9fd-4c7baae5c60a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Calling method '.version_select at 0x7f1d77bf5dc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.361131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.371014 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b158b138-d8c6-4ee8-a07c-41286d6b5955 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.662572 Oct 28 19:11:42.388442 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 568/1150] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:42.393554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.394384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.405402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88f47222-c733-430b-a9fd-4c7baae5c60a tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 371 microversion: 2.1 time: 0.118428 Oct 28 19:11:42.406066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.406571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.407139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.408507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.409017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.409444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.413388 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 583/1151] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:42.419729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.420536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.429242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.430036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.431059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.432332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.433066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.433801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.616370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.633026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.634464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.641354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7db2b90a-5e21-4f27-8549-3f72b6fc4c3a tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1546 microversion: 2.91 time: 0.255400 Oct 28 19:11:42.642254 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 569/1152] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1546 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:42.647404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77e4b3a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:42.722885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.742262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.744491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.745823 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b798abf-cca2-4a8f-bbdd-2360a35f247e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.331150 Oct 28 19:11:42.746960 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 584/1153] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:42.752106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.753425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.773175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.774327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.776373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.777509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.778091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.778866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.801497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.802507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.803225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.804087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.804619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.805393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.870324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.872890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:42.873127 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11c64a06-2533-4c7d-880e-5eba96449989 tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 325 microversion: 2.1 time: 0.229247 Oct 28 19:11:42.875076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 570/1154] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:42 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:42.881627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.882601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.890902 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10ddec5a-07d8-40a1-a058-687e9232d38a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1220 microversion: 2.1 time: 0.142567 Oct 28 19:11:42.891728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.892381 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 585/1155] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:42.899236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.899907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.900311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.901019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.901143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.901493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.901914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.911197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.912179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.913130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.914212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.914927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.915677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.948174 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f HTTP/1.1 Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:42.951326 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:11:42.952602 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '39c1842b-26c7-4a28-81c8-fcc0506ce16f'} Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:42.953352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:11:42.954539 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:42.955658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:42.955658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ef5d50d8-ed3c-407c-9526-077f5961c936 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 404 len: 111 microversion: 2.1 time: 0.075985 Oct 28 19:11:42.955658 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 571/1156] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:42.982155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1233285474", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:43.054029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:43.337964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:43.348107 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f08478dd-e51f-486a-a06b-1de54952a34d tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1536 microversion: 2.1 time: 0.454403 Oct 28 19:11:43.348698 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 586/1157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1536 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:43.354785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-108207002", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:43.415231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:43.716348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:43.716743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:43.717179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:43.717581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:43.717987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:43.740317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.741034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.741633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.743887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.744526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.745108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.773953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Getting quotas for project 3da7936bd9c943f1ad663de75e6c29c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:43.793267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Getting quotas for user f5585ebefeb340fb8ba84946e7a6dc99 and project 3da7936bd9c943f1ad663de75e6c29c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:43.822274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.utils [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] ram quota exceeded for 3da7936bd9c943f1ad663de75e6c29c5, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120628) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 19:11:43.823262 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Request method failure captured: Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 145 Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCllF2ala1hyCYRzMgzucC3XbngJK3Zcf1fm8mlj2sQJU-LC49UWCHEsQOAIdOagsOMBrE53-BQot_wmGodpkj0XOfW0rkHEp-6TSrktWkfRJPZjNcjxsSvrGNve5yJHqGfnx3CRnTznyzbwFv_F8RUf_-nCMMf9aVYVK0t0dHdOjvE Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:43.825480 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3da7936bd9c943f1ad663de75e6c29c5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f5585ebefeb340fb8ba84946e7a6dc99 Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1233285474", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} Oct 28 19:11:43.826818 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1233285474', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452'}}} Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 19:11:43.827664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:43.828945 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.830429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:43.831884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:43.831884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:43.831884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:43.831884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:43.831884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 19:11:43.831884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:43.833056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:43.834054 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ecfd93b2-11fe-48a8-844c-09b5f4d131a3 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.856527 Oct 28 19:11:43.836032 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 572/1158] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:42 2022] POST /compute/v2.1/servers => generated 110 bytes in 859 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:11:43.845277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:43.849674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:43.877557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.878339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.879029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.879984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.880794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.881432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.030463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.040892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec801e9b-bdcd-4f8f-99ce-aec4e0059a0a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1268 microversion: 2.1 time: 0.203539 Oct 28 19:11:44.042062 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 573/1159] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:43 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:44.049076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:44.053201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:44.064413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.064904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.065448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.066106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.066623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.067451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.485285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:44.486315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:44.486995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:44.487629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:44.488173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:44.507550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.511114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.511766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.512790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.515258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.515913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.546648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.559727 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-165f8e66-daf7-4140-bef7-55f432f09db5 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.515736 Oct 28 19:11:44.561755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:44.578076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 574/1160] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:44 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:44.581742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:44.590996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:44.592670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:44.605937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.607241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.607744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.609188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:44.610097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.610635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.611633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:44.612192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.712391 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-06f12394-e49b-415c-87da-77d73119f7de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362482 Oct 28 19:11:44.713390 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 587/1161] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:44.718445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:44.719385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:44.729508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.730840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.731556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.732497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.733165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.734129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.777336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.785918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.787706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.801780 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8017b89b-5a90-4522-98d0-7a309e51a3a2 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.216240 Oct 28 19:11:44.802601 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 575/1162] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:44 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:44.813737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77f72790>, body: {"quota_set": {"ram": 51200}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:44.977893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.978840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.981049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.983200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:44.987274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:44.989070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.086228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:45.097211 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ef5dbee-aea9-4c9d-aa4c-f8850978bdac tempest-QuotasAdminNegativeTest-801831371 tempest-QuotasAdminNegativeTest-801831371-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 200 len: 329 microversion: 2.1 time: 0.292448 Oct 28 19:11:45.105780 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 576/1163] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:44 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 329 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:45.111749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.112492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:45.126185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.127013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.127549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.128375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.130825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.131484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.377134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.390979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.392969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.396872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3613d868-3027-47ec-9565-86ee5f3d8eaf tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.682257 Oct 28 19:11:45.398658 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 588/1164] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:44 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:45.411022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.424416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:45.438052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.438751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.439238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.440024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.440484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.440933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.732839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.753332 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cefdb2a-1ae9-4c50-8eaf-ef5118f4ed7a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1324 microversion: 2.1 time: 0.653802 Oct 28 19:11:45.753914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 577/1165] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:45 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1324 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:45.777073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c218a82c-a6aa-41c1-ab1a-b44599724d61 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.777728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c218a82c-a6aa-41c1-ab1a-b44599724d61 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:45.997311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.009347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c218a82c-a6aa-41c1-ab1a-b44599724d61 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.013784 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8a4e783-98ca-44db-b7e4-9fb34894daeb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1529 microversion: 2.1 time: 0.613363 Oct 28 19:11:46.018934 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c218a82c-a6aa-41c1-ab1a-b44599724d61 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1214 microversion: 2.1 time: 0.254714 Oct 28 19:11:46.035964 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 589/1166] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:45 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1529 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:46.037257 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 578/1167] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:45 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:46.042391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.043024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.053684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7008e5ef-ce58-4fea-a402-1ef19d9bc603 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Action: 'update', calling method: .version_select at 0x7f1d77f72a60>, body: {"quota_set": {"ram": 0}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:46.055568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.056113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.056551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.062092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.062908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.063368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.071475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7008e5ef-ce58-4fea-a402-1ef19d9bc603 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f5585ebefeb340fb8ba84946e7a6dc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da7936bd9c943f1ad663de75e6c29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7008e5ef-ce58-4fea-a402-1ef19d9bc603 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Request method failure captured: Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 HTTP/1.1 Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 25 Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCllF2ala1hyCYRzMgzucC3XbngJK3Zcf1fm8mlj2sQJU-LC49UWCHEsQOAIdOagsOMBrE53-BQot_wmGodpkj0XOfW0rkHEp-6TSrktWkfRJPZjNcjxsSvrGNve5yJHqGfnx3CRnTznyzbwFv_F8RUf_-nCMMf9aVYVK0t0dHdOjvE Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:46.075090 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3da7936bd9c943f1ad663de75e6c29c5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3da7936bd9c943f1ad663de75e6c29c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3da7936bd9c943f1ad663de75e6c29c5 Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1639205762 Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f5585ebefeb340fb8ba84946e7a6dc99 Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-QuotasAdminNegativeTest-1639205762-project Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: {"quota_set": {"ram": 0}} Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 19:11:46.076404 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '3da7936bd9c943f1ad663de75e6c29c5', 'body': {'quota_set': {'ram': 0}}} Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:11:46.077303 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:46.078428 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:46.079657 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:46.079657 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:46.079657 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:11:46.079657 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:11:46.079657 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 19:11:46.079657 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:46.084968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7008e5ef-ce58-4fea-a402-1ef19d9bc603 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:46.086055 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7008e5ef-ce58-4fea-a402-1ef19d9bc603 tempest-QuotasAdminNegativeTest-1639205762 tempest-QuotasAdminNegativeTest-1639205762-project] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5" status: 403 len: 116 microversion: 2.1 time: 0.043830 Oct 28 19:11:46.086831 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 579/1168] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:11:46 2022] PUT /compute/v2.1/os-quota-sets/3da7936bd9c943f1ad663de75e6c29c5 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:46.110999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.125902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.143349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.151224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.154005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.155355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.156045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.158246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.493974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.504620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1c07ea7-f2a8-4450-b570-259f1d0dd3a4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1274 microversion: 2.1 time: 0.467867 Oct 28 19:11:46.506761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 590/1169] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1274 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:46.522663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.523575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.533642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.534377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.535026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.535922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.536570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.539239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.736328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.745873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.747395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.761654 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-60ef4b3e-ce0b-4e9c-83d5-92ddbacbe6a8 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.253639 Oct 28 19:11:46.768470 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 591/1170] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:46.776316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.777758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.787040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.804411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10f7a42b-f121-4448-84a5-6a2b8045f235 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.701379 Oct 28 19:11:46.807899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.808767 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 580/1171] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:46.811300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.813850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.816530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.818591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.822273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.833187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.836235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.868909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.869421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.869860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.870623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.871098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.871521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.706146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.714021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02b555af-dd2f-4e21-920d-68c43dfccf84 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1529 microversion: 2.1 time: 0.944206 Oct 28 19:11:47.731204 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 592/1172] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1529 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:47.735837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.736883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:47.737702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:47.744266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.744957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.745555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.746454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.747149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.747728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.748769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.750212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.751606 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fba43cf9-7316-4437-8568-944dcdf4bdc9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.940608 Oct 28 19:11:47.754161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 581/1173] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:47.760202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-187d9137-c70b-4607-a34b-b3a25f480a85 req-623862af-5f1b-4f9b-8e89-5fc0d01e4d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "name": "network-vif-plugged", "status": "completed", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:47.789264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:47.816722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-187d9137-c70b-4607-a34b-b3a25f480a85 req-623862af-5f1b-4f9b-8e89-5fc0d01e4d51 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.817978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-187d9137-c70b-4607-a34b-b3a25f480a85 req-623862af-5f1b-4f9b-8e89-5fc0d01e4d51 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.818572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-187d9137-c70b-4607-a34b-b3a25f480a85 req-623862af-5f1b-4f9b-8e89-5fc0d01e4d51 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.835184 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-187d9137-c70b-4607-a34b-b3a25f480a85 req-623862af-5f1b-4f9b-8e89-5fc0d01e4d51 service nova] Creating event network-vif-plugged:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h2-862769-3 Oct 28 19:11:47.846150 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-187d9137-c70b-4607-a34b-b3a25f480a85 req-623862af-5f1b-4f9b-8e89-5fc0d01e4d51 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087192 Oct 28 19:11:47.848282 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 582/1174] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:47.855516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e540fb5b-d8f6-4a8d-8b6c-80344e30be5b req-15259e47-4928-4115-a374-6a68a33de1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf731e0d-b279-4f5a-8942-113c77ac2777", "tag": "1e4b3ae2-e83b-4246-b919-6fdd496906ce"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:47.875933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e540fb5b-d8f6-4a8d-8b6c-80344e30be5b req-15259e47-4928-4115-a374-6a68a33de1fc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.878964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e540fb5b-d8f6-4a8d-8b6c-80344e30be5b req-15259e47-4928-4115-a374-6a68a33de1fc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.879671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e540fb5b-d8f6-4a8d-8b6c-80344e30be5b req-15259e47-4928-4115-a374-6a68a33de1fc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.906293 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e540fb5b-d8f6-4a8d-8b6c-80344e30be5b req-15259e47-4928-4115-a374-6a68a33de1fc service nova] Creating event network-changed:1e4b3ae2-e83b-4246-b919-6fdd496906ce for instance cf731e0d-b279-4f5a-8942-113c77ac2777 on n-h2-862769-3 Oct 28 19:11:47.920824 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e540fb5b-d8f6-4a8d-8b6c-80344e30be5b req-15259e47-4928-4115-a374-6a68a33de1fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069741 Oct 28 19:11:47.922951 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 583/1175] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:47.935690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:47.940632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:47.948931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.950674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.951562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.952681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.953466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.954139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.129773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.138394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a45c6d96-5341-473c-9015-372e9ad3fc66 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1324 microversion: 2.1 time: 0.405949 Oct 28 19:11:48.161710 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 593/1176] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:47 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:48.172305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.173656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.192375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.193263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.193929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.194928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.195600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.196236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.234972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.247408 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4dee8df2-d475-43e0-a6dc-ac02c4d264ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1266 microversion: 2.1 time: 0.322038 Oct 28 19:11:48.251508 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 584/1177] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:47 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:48.256276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f24728f-721a-4da6-a9b1-859b3fd7454d tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.281594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2f24728f-721a-4da6-a9b1-859b3fd7454d tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] HTTP exception thrown: Flavor 79ce5af7-3c1a-4ac2-a9a9-58d96966f945 could not be found. Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f24728f-721a-4da6-a9b1-859b3fd7454d tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Request method failure captured: Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/flavors/79ce5af7-3c1a-4ac2-a9a9-58d96966f945 HTTP/1.1 Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChyoHSTLDqzK4X9FCssTP0aGqBCp68D3yZ6iD2IKwn-XIvf2Y2AakChukZSAAV5UWaSrPcWcm4JkDmlVkkt7oLEUooOxU0pOJfzJ_V3n1eCPOpDwVTbmBA2H6qcQSo9ES4o4o26bUbJCZ_lkG8kwzDLKVOMwCT8xHHaHJtyf36-AIE Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 7f359020e3bb4db2bda3dd618ea63d58 Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-MigrationsAdminTest-5721115 Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:11:48.295224 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f359020e3bb4db2bda3dd618ea63d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f359020e3bb4db2bda3dd618ea63d58", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f359020e3bb4db2bda3dd618ea63d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f359020e3bb4db2bda3dd618ea63d58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-MigrationsAdminTest-5721115 Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 7f359020e3bb4db2bda3dd618ea63d58 Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-MigrationsAdminTest-5721115 Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-MigrationsAdminTest-5721115-project-admin Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: b48bee39ca514665aeb90007ffb30733 Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-MigrationsAdminTest-5721115-project-admin Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: exception: Flavor 79ce5af7-3c1a-4ac2-a9a9-58d96966f945 could not be found. Oct 28 19:11:48.296651 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '79ce5af7-3c1a-4ac2-a9a9-58d96966f945'} Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 79ce5af7-3c1a-4ac2-a9a9-58d96966f945 could not be found. Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:48.297415 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 79ce5af7-3c1a-4ac2-a9a9-58d96966f945 could not be found. Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 79ce5af7-3c1a-4ac2-a9a9-58d96966f945 could not be found. Oct 28 19:11:48.299029 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:48.309800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f24728f-721a-4da6-a9b1-859b3fd7454d tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Returning 404 to user: Flavor 79ce5af7-3c1a-4ac2-a9a9-58d96966f945 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:48.310924 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f24728f-721a-4da6-a9b1-859b3fd7454d tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/79ce5af7-3c1a-4ac2-a9a9-58d96966f945" status: 404 len: 109 microversion: 2.1 time: 0.058350 Oct 28 19:11:48.314537 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 585/1178] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:48 2022] DELETE /compute/v2.1/flavors/79ce5af7-3c1a-4ac2-a9a9-58d96966f945 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:11:48.335100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.337995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.353525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.354032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.354474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.356920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.357762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.358356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.581557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.602020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.606361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.615419 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f79725e5-2b6a-4d6e-891e-13d58ed56091 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.296007 Oct 28 19:11:48.616271 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 586/1179] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:48 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:48.622031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.623703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.630059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.630809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.631400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.632242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.632841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.633644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.921810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.939265 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-437b735e-6928-4d94-ac3d-77d9f577e191 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.775366 Oct 28 19:11:48.940112 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 594/1180] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:48 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:48.946547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1793815709", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:49.067078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:49.116778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.132311 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30598ac5-ed9c-4c6d-8b0b-e9ecb3e795ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1718 microversion: 2.1 time: 0.514823 Oct 28 19:11:49.133402 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 587/1181] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:48 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1718 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:49.151647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:49.152263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.164752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.165357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.165799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.166725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.167246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.167743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.173742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:49.709694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.734752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.741706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:49.742990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d5a4de47-cd48-42fd-879b-49b6326ce654 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.608573 Oct 28 19:11:49.745536 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 588/1182] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:49 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:49.753247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:49.759110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:49.759535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:49.760007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:49.760303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.760437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:49.760814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:49.769304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.770071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.770898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.771951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.772724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.774021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.793037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.793608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.794050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.794819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.795273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.795898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.838780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:49.857259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Getting quotas for user 3142fd0059aa4b658c2cea015b1f3d93 and project 3f4d9bdca05341e38e62618cfe5b9690. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:49.872709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:49.874518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:49.879661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:50.024139 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-784d7dda-ea0a-421e-8ddb-bb93cdf1b9ea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082699 Oct 28 19:11:50.043012 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 595/1183] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:50.049092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:50.049776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:50.073804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.074329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.074836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.075602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.079732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.086660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.258615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.294655 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f30f92e7-45eb-4099-9bcb-11ce4925f897 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1324 microversion: 2.1 time: 0.547786 Oct 28 19:11:50.295293 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 589/1184] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:49 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:50.297746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.305192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:50.305792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:50.309420 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-46ee4cec-0194-439f-bbb1-05225690a501 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1266 microversion: 2.1 time: 0.264875 Oct 28 19:11:50.310569 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 596/1185] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:50 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:50.317982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:50.319267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:50.329429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.330351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.331176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.332322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.333314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.334377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.351169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.352283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.360125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.367392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:50.368874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:50.372881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.691863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.702242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.710928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.752412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-55833a54-a064-4403-806f-18ee8440ee28 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.424330 Oct 28 19:11:50.754420 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 590/1186] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:50 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:50.759982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f5923a5-d997-48c0-a3a3-5e09c26c4f16 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:50.771839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f5923a5-d997-48c0-a3a3-5e09c26c4f16 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:50.999390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f5923a5-d997-48c0-a3a3-5e09c26c4f16 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.010169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f5923a5-d997-48c0-a3a3-5e09c26c4f16 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1213 microversion: 2.1 time: 0.253830 Oct 28 19:11:51.013855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 591/1187] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:50 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1213 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.024497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.026224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.063875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.066810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.068460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.071797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.072305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.072764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.127913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.139653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b9abfb3d-0b2a-486a-b31d-7d0cc40ea412 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.827637 Oct 28 19:11:51.141086 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 597/1188] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:50 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.158124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.159378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.168826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.169905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.170781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.172110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.173166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.174165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.456463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.466927 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ab60a66c-653a-4941-b20d-195279db9167 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1708 microversion: 2.1 time: 0.451511 Oct 28 19:11:51.471086 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 592/1189] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1708 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.481390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.482376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.498081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.501399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.502486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.503818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.507004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.507675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.538362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.566176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.572415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.576590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c509f6d-dcb7-40c2-aa6b-67bf98d9c980 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.434145 Oct 28 19:11:51.577651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 598/1190] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:51.595708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.596864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.605670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.612023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.612930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.613946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.614682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.615409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.771883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.783669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72eeb18e-273d-4904-881b-54d666daec80 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1266 microversion: 2.1 time: 0.203337 Oct 28 19:11:51.785120 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 599/1191] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.790906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-98f1da44-1101-49b5-ad11-802a702f6b19 req-67ae5217-02c7-4321-90c4-7028c54e1d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bea25a8-c910-4c3a-87a0-715a4885c7c8", "tag": "cc7fa0ef-7f7e-4701-8beb-32af6d540b6b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:51.803797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-98f1da44-1101-49b5-ad11-802a702f6b19 req-67ae5217-02c7-4321-90c4-7028c54e1d29 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.804635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-98f1da44-1101-49b5-ad11-802a702f6b19 req-67ae5217-02c7-4321-90c4-7028c54e1d29 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.805799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-98f1da44-1101-49b5-ad11-802a702f6b19 req-67ae5217-02c7-4321-90c4-7028c54e1d29 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.821146 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-98f1da44-1101-49b5-ad11-802a702f6b19 req-67ae5217-02c7-4321-90c4-7028c54e1d29 service nova] Creating event network-changed:cc7fa0ef-7f7e-4701-8beb-32af6d540b6b for instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 on n-h2-862769-3 Oct 28 19:11:51.829766 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-98f1da44-1101-49b5-ad11-802a702f6b19 req-67ae5217-02c7-4321-90c4-7028c54e1d29 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043044 Oct 28 19:11:51.831029 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 600/1192] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:51.837583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c0cfab9-6415-4653-a440-e44d7c3da7b3 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '.version_select at 0x7f1d77b8b040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.842242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c0cfab9-6415-4653-a440-e44d7c3da7b3 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.843179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c0cfab9-6415-4653-a440-e44d7c3da7b3 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.843928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c0cfab9-6415-4653-a440-e44d7c3da7b3 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.859081 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c0cfab9-6415-4653-a440-e44d7c3da7b3 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 3493 microversion: 2.1 time: 0.026393 Oct 28 19:11:51.860578 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 601/1193] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/os-migrations => generated 3493 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.872173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.876616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.891900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.892488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.893159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.894095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.894788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.895426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.021354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.035841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.037859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.044271 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4ef7f27c-f39d-4021-a093-7de3a996b76d tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.182030 Oct 28 19:11:52.045294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 602/1194] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:52.070963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.081036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.081663 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6bf0c749-aca2-447e-ab2f-da7c40992d25 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1324 microversion: 2.1 time: 0.609245 Oct 28 19:11:52.081789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.095679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.095941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 593/1195] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1324 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.098945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.101447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.107503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.108125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.111607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.114277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.116163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.125363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.125855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.126282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.127024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.127471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.127884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.310954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.321964 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c290c2c8-2d9d-48c0-a6d7-28e981c05e7f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1217 microversion: 2.1 time: 0.224401 Oct 28 19:11:52.338552 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 594/1196] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.345127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.361121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.393281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.394247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.395053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.400436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.401250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.401909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.421591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6be3ba6f-0f0b-4bf3-ba4f-0456019af651 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1859 microversion: 2.1 time: 0.374564 Oct 28 19:11:52.432832 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 603/1197] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1859 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.595286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.611290 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54c5e93e-b6c9-415a-b2f0-340290e7f571 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.271502 Oct 28 19:11:52.613063 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 595/1198] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.618505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.619401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.625743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.627086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.627738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.628847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.629624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.630527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.638381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-179388186", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:52.720422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:52.916098 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-831fa704-c2ed-477f-a36e-3e01c7641316 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1859 microversion: 2.1 time: 0.301675 Oct 28 19:11:52.916949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 596/1199] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.922491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.923269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.943431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.943862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.949442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.950264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.951221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.951438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.077732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:53.078137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:53.078599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:53.079024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:53.079637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:53.096069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.096550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.096974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.097683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.098126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.098534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.131418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Getting quotas for project 4246174ea1a24221850252a2e73d0dcf. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:53.141403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Getting quotas for user 1f35fe0054554a7c9a3f38521ac107f6 and project 4246174ea1a24221850252a2e73d0dcf. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:53.157876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.161502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:53.164671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:53.182943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.184459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.185658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c22f857f-9f6b-4440-85b6-b45dbd9d76eb tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.267994 Oct 28 19:11:53.187339 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 597/1200] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:53.201109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.201726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.212794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.213297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.213829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.214539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.215082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.215573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.273846 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-20dd1bc4-1b01-4a46-ac4f-a6b12a28addd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842354 Oct 28 19:11:53.280629 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 604/1201] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:53.280629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.281594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.307810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.308306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.308750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.309472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.309916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.310329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.351258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.371104 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-987775b6-2b44-4bd0-a834-9f93114963d0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1266 microversion: 2.1 time: 0.182623 Oct 28 19:11:53.377546 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 598/1202] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:53.388370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.389613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.400127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.400816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.401741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.402630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.403320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.403902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.517367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.532390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:53.535166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.536603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.547122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lazy-loading 'services' on Instance uuid e97e4371-c171-43ac-8520-da07711dcbb1 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:53.565175 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd5f1f4b-2971-428a-b0a1-afcc1d4f7fb3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.186463 Oct 28 19:11:53.581188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 599/1203] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:53.593733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.594616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.610765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.611450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.611576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.612292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.612743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.613162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.767909 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5ccbd9fc-79ad-48b9-8565-4ae6ac64b5ab tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments/179511fa-3ffe-47fa-b529-8e8b2a84a510" status: 202 len: 0 microversion: 2.1 time: 0.491609 Oct 28 19:11:53.769913 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 605/1204] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:11:53 2022] DELETE /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments/179511fa-3ffe-47fa-b529-8e8b2a84a510 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:11:53.775315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1864a4d3-313b-485c-b1cd-472d5bd161c1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.780262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1864a4d3-313b-485c-b1cd-472d5bd161c1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.950167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1864a4d3-313b-485c-b1cd-472d5bd161c1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.964028 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1864a4d3-313b-485c-b1cd-472d5bd161c1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1221 microversion: 2.1 time: 0.191192 Oct 28 19:11:53.966810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 606/1205] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:53.975781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.980263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.983130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.987947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-131f04c4-9cca-459d-9e72-9eb84d35dd57 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1324 microversion: 2.1 time: 0.403281 Oct 28 19:11:53.996511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 600/1206] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:53.996511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.996511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.005822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.005822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.005822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.006192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.010380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.010380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.010626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.010626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.010626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.011293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.011755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.012243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.135529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.148445 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2b3ee470-f760-4ce5-920e-ee57b851dc81 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1217 microversion: 2.1 time: 0.179530 Oct 28 19:11:54.149245 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 607/1207] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:54.157683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.166555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.176274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.176274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.176274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.176274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.176793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.176793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.212770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d45714b-d31c-4681-9151-bfbcfc675494 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062452 Oct 28 19:11:54.213545 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 608/1208] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:54.228977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.229717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.236288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.236566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.236993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.237696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.238138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.238990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.257560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.265735 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84f4c39e-7e5d-439a-9153-e01f93948359 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.275789 Oct 28 19:11:54.266312 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 601/1209] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:54.401551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.402521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.409610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.410195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.410954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.411721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.412807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.413425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.451772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.462840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.464267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.465540 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10e8af7b-2f2a-4425-b0b7-c92b2a406fd8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.250192 Oct 28 19:11:54.470783 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 609/1210] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:54.496318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.504190 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3675ea23-a98c-4290-888b-8b0711063596 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1266 microversion: 2.1 time: 0.107544 Oct 28 19:11:54.504751 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 602/1211] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:54.597588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.598234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.607229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.607229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.607639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.608342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.608947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.609374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.678143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.687380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.688884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.695158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-71f45b0f-daf9-4e42-a9b3-321e6dbf7594 req-7be8e3a9-c644-495b-b288-238ef48a49e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf731e0d-b279-4f5a-8942-113c77ac2777", "name": "network-vif-plugged", "status": "completed", "tag": "1e4b3ae2-e83b-4246-b919-6fdd496906ce"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:54.705081 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26e9411e-2541-45db-975f-4497715b43b3 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.111370 Oct 28 19:11:54.706267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 610/1212] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:54.720347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-71f45b0f-daf9-4e42-a9b3-321e6dbf7594 req-7be8e3a9-c644-495b-b288-238ef48a49e4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.720779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-71f45b0f-daf9-4e42-a9b3-321e6dbf7594 req-7be8e3a9-c644-495b-b288-238ef48a49e4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.721212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-71f45b0f-daf9-4e42-a9b3-321e6dbf7594 req-7be8e3a9-c644-495b-b288-238ef48a49e4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.738226 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-71f45b0f-daf9-4e42-a9b3-321e6dbf7594 req-7be8e3a9-c644-495b-b288-238ef48a49e4 service nova] Creating event network-vif-plugged:1e4b3ae2-e83b-4246-b919-6fdd496906ce for instance cf731e0d-b279-4f5a-8942-113c77ac2777 on n-h2-862769-3 Oct 28 19:11:54.743702 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-71f45b0f-daf9-4e42-a9b3-321e6dbf7594 req-7be8e3a9-c644-495b-b288-238ef48a49e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052217 Oct 28 19:11:54.744471 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 603/1213] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:54.991815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.992707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.999730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.000296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.000801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.001574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.002032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.002455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.018925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.019903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.022496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=25 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:55.029058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.029657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.030349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.031148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.031667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.032149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.066826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.075400 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8462ba25-cf68-4af5-bdc1-7e43178fbd19 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1217 microversion: 2.1 time: 0.087524 Oct 28 19:11:55.076250 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 611/1214] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:55.169213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.172855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.173584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.178120 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6fda44fb-79dc-4b38-8ada-f67dd59c562f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1324 microversion: 2.1 time: 0.163684 Oct 28 19:11:55.179048 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 604/1215] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:55.180182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.180780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.181312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.182143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.182893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.183417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.251408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.253743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.265261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.267906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.268401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.268824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.270477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.272552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.273334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.275333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee489cb8-2931-45d9-8da6-163681ccb996 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1209 microversion: 2.1 time: 0.106628 Oct 28 19:11:55.276630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 612/1216] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:55.292834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.294021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.303115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.303865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.304625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.305632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.307104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.307601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.316818 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aeab7920-ba8e-4f94-a386-574429e3e73c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094746 Oct 28 19:11:55.317757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 605/1217] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:55.469322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.477272 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24e83e21-7d31-42ab-9663-052d96b51a16 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.189724 Oct 28 19:11:55.477891 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 613/1218] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:55.490215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.491025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.497582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.498098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.498647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.499480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.499999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.500483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.516989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:55.527370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.528066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.534185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.534820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.535283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.536028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.536540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.537034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.618089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.626789 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b098e98-06f8-4dd5-a731-5a247c918971 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1274 microversion: 2.1 time: 0.103388 Oct 28 19:11:55.627741 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 614/1219] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:55.655558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.664714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.666148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.667366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e202198e-a029-45c3-9106-07e3500e51b0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.181060 Oct 28 19:11:55.667959 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 606/1220] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:11:55.737527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.738149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.745071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.745552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.745978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.746632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.747145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.747580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.813668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.822593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.824073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.829349 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48c4b596-c5df-413b-ac5e-31f7d818b3b6 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.096001 Oct 28 19:11:55.829923 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 615/1221] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:56.098341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.099262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.106251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.106769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.107209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.108063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.108380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.109026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.175948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.184487 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc665f82-6595-461a-906b-aa7ae8b272f3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1217 microversion: 2.1 time: 0.090005 Oct 28 19:11:56.185044 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 607/1222] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:56.200747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.201455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.208931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.210024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.210468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.211415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.211864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.212286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.303596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.304537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.322436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.323324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.323764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.324525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.325083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.325505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.428894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.441445 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d93b9e0-fd40-4ab3-bc93-37cbf84e005f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1209 microversion: 2.1 time: 0.142020 Oct 28 19:11:56.458545 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 608/1223] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:56.462412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.464723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.471402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.471880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.472333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.473198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.473646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.474058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.511996 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e0561574-5832-4113-9e8e-0d67961b0234 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055383 Oct 28 19:11:56.517116 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 609/1224] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:56.522400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.523058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.529878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.530519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.530988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.531695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.532144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.532554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.940566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:56.960434 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4efc5b99-249c-4944-b4d7-a7697e6f0ae8 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1521 microversion: 2.1 time: 0.763533 Oct 28 19:11:56.970784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 616/1225] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1521 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:56.981236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.986822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.996674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.997475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.998101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.999047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.999729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.000448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.039728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.056796 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0809b2a4-7b42-49a4-9254-4c9355ab4f4b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.537680 Oct 28 19:11:57.071378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 610/1226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.080731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.081748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.089758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.090510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.091118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.092086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.092683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.093275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.211370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.235902 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-124539ad-dc5f-49b8-8357-de3682ba6846 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1272 microversion: 2.1 time: 0.264376 Oct 28 19:11:57.236520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 617/1227] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.262895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.263526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.277217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.278035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.278644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.279554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.280286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.281183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.406299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.411897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.422206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.425802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.428724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.428992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.431117 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3141aa10-731e-473f-a5f4-39999b3a5a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.357536 Oct 28 19:11:57.431863 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 611/1228] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:57.436767 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78c3bade-5c63-4c8a-9615-821071691936 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1544 microversion: 2.91 time: 0.197677 Oct 28 19:11:57.438092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.439643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.461102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 618/1229] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:57.466136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.466791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.472763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.473625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.475233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.476796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.478936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.479169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.479424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.479637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.479851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.480548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.481061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.481476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.650793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.661992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99f38f0e-3daa-4542-aa9d-464a36ab9bc3 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1217 microversion: 2.1 time: 0.199703 Oct 28 19:11:57.662948 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 619/1230] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.678992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.680886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.701915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.703438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.704553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.705735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.706657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.707338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.829528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.842047 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9f43623-5024-472f-8f8e-0ff5ca3dabf5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1521 microversion: 2.1 time: 0.408928 Oct 28 19:11:57.847037 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 612/1231] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.852062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.854362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.863059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.875532 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28faf816-a0d9-4bd0-878f-0ba1ee95cff2 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1209 microversion: 2.1 time: 0.211531 Oct 28 19:11:57.875684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.879300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.883673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.884324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.884672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.885108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.905005 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 620/1232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1209 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.913642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1687416845"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:57.929317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.962545 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb46e247-8e91-47e1-b711-553e73af3145 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113178 Oct 28 19:11:57.971382 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 613/1233] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:57.976628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.977882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.983852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.985762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.991354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.992787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.087535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:58.088656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:58.104466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.105208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.108450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.112509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.113427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.115475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.377317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:58.406600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8dcc662f-7d5d-43e0-8776-9b56dff58e02 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777/action" status: 202 len: 0 microversion: 2.1 time: 0.499856 Oct 28 19:11:58.407608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 621/1234] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:11:57 2022] POST /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:11:58.418819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:58.419841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:58.426862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.427566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.428142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.429042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.429491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.429926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.492772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:58.502018 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-536c87e4-4a9e-4511-bcf6-1ee8d3fda8ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.420462 Oct 28 19:11:58.506159 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 614/1235] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:58 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:58.519373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aebcf3bb-0557-4e40-943c-ce182272b5af tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '.version_select at 0x7f1d77cd4c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:58.740524 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aebcf3bb-0557-4e40-943c-ce182272b5af tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07" status: 204 len: 0 microversion: 2.1 time: 0.233005 Oct 28 19:11:58.741177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 615/1236] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:58 2022] DELETE /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:58.746382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:58.747081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:58.753441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.754233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.754929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.755838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.756480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.757100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.965794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:58.976125 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0dabb2d8-e941-47b9-b6e7-7dc632776546 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.567087 Oct 28 19:11:59.001406 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 622/1237] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:58 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:59.008373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.009188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.015936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.016698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.017295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.021144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.021912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.022549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.180129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.191368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.196852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.211860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73a97bfa-0604-4e9d-9a78-ef532150afc5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1531 microversion: 2.91 time: 0.207706 Oct 28 19:11:59.215891 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 623/1238] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1531 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:59.222335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.227421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.239634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.240777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.241373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.241907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.242765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.243322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.244158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.252258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.254643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.261321 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8b54ae6-2537-4a56-bda4-1dd1a5293931 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.518870 Oct 28 19:11:59.261966 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 616/1239] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:58 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:59.269068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a664f5c-0bdb-4e74-ba9e-443ee7f640bc tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '.version_select at 0x7f1d77d16ca0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.304072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0a664f5c-0bdb-4e74-ba9e-443ee7f640bc tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Image not found. Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a664f5c-0bdb-4e74-ba9e-443ee7f640bc tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07 HTTP/1.1 Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:11:59.306541 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd7821d8f-28c4-4f20-8bbe-004631733e07'} Oct 28 19:11:59.308161 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:11:59.309202 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d7821d8f-28c4-4f20-8bbe-004631733e07 Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:11:59.310373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7821d8f-28c4-4f20-8bbe-004631733e07 could not be found. Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:11:59.311738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:11:59.312863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a664f5c-0bdb-4e74-ba9e-443ee7f640bc tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:59.314737 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a664f5c-0bdb-4e74-ba9e-443ee7f640bc tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07" status: 404 len: 62 microversion: 2.1 time: 0.043397 Oct 28 19:11:59.314737 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 617/1240] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:11:59.324098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-aa4b0ab4-463a-4691-8bd8-bab1d420af00 req-a908d32a-e614-4467-8ed5-e2e3ec97fb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bea25a8-c910-4c3a-87a0-715a4885c7c8", "name": "network-vif-plugged", "status": "completed", "tag": "cc7fa0ef-7f7e-4701-8beb-32af6d540b6b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:59.338350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-aa4b0ab4-463a-4691-8bd8-bab1d420af00 req-a908d32a-e614-4467-8ed5-e2e3ec97fb51 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.342488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-aa4b0ab4-463a-4691-8bd8-bab1d420af00 req-a908d32a-e614-4467-8ed5-e2e3ec97fb51 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.343321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-aa4b0ab4-463a-4691-8bd8-bab1d420af00 req-a908d32a-e614-4467-8ed5-e2e3ec97fb51 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.362155 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-aa4b0ab4-463a-4691-8bd8-bab1d420af00 req-a908d32a-e614-4467-8ed5-e2e3ec97fb51 service nova] Creating event network-vif-plugged:cc7fa0ef-7f7e-4701-8beb-32af6d540b6b for instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 on n-h2-862769-3 Oct 28 19:11:59.368632 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-aa4b0ab4-463a-4691-8bd8-bab1d420af00 req-a908d32a-e614-4467-8ed5-e2e3ec97fb51 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056788 Oct 28 19:11:59.370404 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 618/1241] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:59.379650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.380558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.387131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.388233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.388688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.389487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.390015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.390748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.450024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.460850 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ebc89ec6-793b-4206-8690-541c5528f71f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1291 microversion: 2.1 time: 0.242994 Oct 28 19:11:59.462218 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 624/1242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1291 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:59.468212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.470937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.477566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.478259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.478907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.479941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.480573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.481357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.501049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:59.515359 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5d26647-2702-4165-8672-45d5020250f4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1265 microversion: 2.1 time: 0.142579 Oct 28 19:11:59.518596 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 619/1243] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:59.539380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.542345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.559422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.561214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.561909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.563273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.563985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.565207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.568578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bd0e622-e7c0-4d8d-995f-77320e3b5d62 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104670 Oct 28 19:11:59.569443 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 625/1244] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:11:59.611354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.612134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.620010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.620634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.621475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.622657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.623337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.624007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.717554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] Lazy-loading 'services' on Instance uuid c5e35a18-e0b7-432b-9139-2afe6f9be925 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:59.752092 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ddfa7fa3-fd76-4e26-b8a2-d95a980bfb5a tempest-UnshelveToHostMultiNodesTest-13300185 tempest-UnshelveToHostMultiNodesTest-13300185-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1936 microversion: 2.91 time: 0.232175 Oct 28 19:11:59.759855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 620/1245] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1936 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:11:59.772546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:59.773335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:59.782767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.800610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.801675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:59.803016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:59.803685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:59.804443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.031307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.039435 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63117273-5f72-4f86-99b9-532e3e43bc33 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1539 microversion: 2.1 time: 0.440873 Oct 28 19:12:00.040015 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 626/1246] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1539 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:00.063356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:00.064125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:00.073473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.074420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.075170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.076157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.076933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.077554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.122834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:00.233937 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64826e40-ad6f-4144-ab37-bdfcb126b0c5 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 204 len: 0 microversion: 2.91 time: 0.186363 Oct 28 19:12:00.235785 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 627/1247] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:12:00 2022] DELETE /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:12:00.242595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9706c268-25dc-476a-a949-435e7c1b08fc req-43eda4a6-569b-41d0-bece-deee8ef9e745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa203d5-e7cb-40c8-9d42-be8413b3abe0", "tag": "2df9b8bc-b8b3-421b-a072-98080b43b82d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:00.253903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:00.256249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9706c268-25dc-476a-a949-435e7c1b08fc req-43eda4a6-569b-41d0-bece-deee8ef9e745 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.257779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9706c268-25dc-476a-a949-435e7c1b08fc req-43eda4a6-569b-41d0-bece-deee8ef9e745 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.258238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9706c268-25dc-476a-a949-435e7c1b08fc req-43eda4a6-569b-41d0-bece-deee8ef9e745 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.262602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.273027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aca16da2-df1a-40f3-b590-f3e984b54c62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1316 microversion: 2.1 time: 0.510208 Oct 28 19:12:00.275349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 621/1248] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:59 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:00.282963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:00.288876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:00.302283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.306792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.307580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.309002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.309768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.310257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.688806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9706c268-25dc-476a-a949-435e7c1b08fc req-43eda4a6-569b-41d0-bece-deee8ef9e745 service nova] Creating event network-changed:2df9b8bc-b8b3-421b-a072-98080b43b82d for instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 on n-h1-862769-3 Oct 28 19:12:00.697043 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9706c268-25dc-476a-a949-435e7c1b08fc req-43eda4a6-569b-41d0-bece-deee8ef9e745 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459349 Oct 28 19:12:00.698146 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 628/1249] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:00.705035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:00.705903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:00.714287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.714459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.715187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.716252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.716930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.717544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.813595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.817014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.823091 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2d1ba3d-b6ad-421d-9489-369d993815c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.545692 Oct 28 19:12:00.824404 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 622/1250] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:00 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:00.830567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:00.831514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:00.838611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.839425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.840070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.841071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.841865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.842821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.843652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.845082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:00.860653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a9eca4c-7f92-4f4e-b815-d6071fe425b7 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.161027 Oct 28 19:12:00.864368 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 629/1251] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:00 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:00.922165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:00.929814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:00.949437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.950089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.950539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:00.951290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:00.951993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:00.955834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.006760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:01.512801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.530569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.533114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.535763 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a290c367-0ac6-4cf4-9652-f6e734ff4b3f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.710162 Oct 28 19:12:01.538424 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 623/1252] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:00 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:01.547469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:01.548398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:01.565871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.575565 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef45fd6b-daf3-4f2c-8c41-2a8e457a8d5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 0.710129 Oct 28 19:12:01.577082 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 630/1253] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:00 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:01.577416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.578982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.579443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.580188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.583060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:01.583875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:01.587568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.588233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.591456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.592933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.593559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.594460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.594945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.595556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.847555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.858077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-36cdf0e0-f633-4283-a7f7-47de85fed18c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1539 microversion: 2.1 time: 0.279504 Oct 28 19:12:01.858704 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 631/1254] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:01 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1539 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:01.864077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:01.868808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:01.886487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:01.902802 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-42e57288-b053-457d-8d75-9d0eb46d0f93 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.361444 Oct 28 19:12:01.906103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.906655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.919611 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 624/1255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:01 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:01.922253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.924181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.924674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.925119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.938302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:01.940467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:01.952576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.953316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.953942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.956428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:01.957301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:01.957949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:01.991749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:02.291070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.304025 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-abddab12-da3c-49ac-bfc6-67e8b0a104de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.383105 Oct 28 19:12:02.304842 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 625/1256] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:01 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:02.314462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:02.319577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:02.330668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.332626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.340042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.348724 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f1b3cd4-8d9c-4da7-9d5c-689374e4645d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1466 microversion: 2.1 time: 0.488232 Oct 28 19:12:02.349686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.350719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.351520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 632/1257] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:01 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1466 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:02.352228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.353216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.507884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.521561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.523574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86ab55a22b59402f8e85da092e389e39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4713b9094941c5a10b080a37d1edef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.532049 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6ac0953-bdef-481b-935d-0cc8f0515da9 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 200 len: 1537 microversion: 2.91 time: 0.224047 Oct 28 19:12:02.543563 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 626/1258] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:02 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:02.568294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:02.569097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:02.580807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.585666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.586355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.587395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.588010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.588591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.589309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:02.589816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:02.608276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.610301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.610886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.615560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.616127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.616927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.942647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.953360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.957890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:02.964528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b0000ce-2ec5-4094-8f0f-b8fefef635ab tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.403301 Oct 28 19:12:02.965438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 627/1259] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:02 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:02.970241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:02.970881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:02.992056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:02.994217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:02.995053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:02.995773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:02.996262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.000428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.000973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.124401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=10 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:03.128451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83deedbf-8a3a-4fc6-909e-c1075b440ed6 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1617 microversion: 2.1 time: 0.755694 Oct 28 19:12:03.129907 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 633/1260] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:02 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1617 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:03.135572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3aa2bba9-45f2-4bef-a711-c1c52d65de2c req-731f4a5c-d104-4855-a0cc-bb4419feb091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01cc84a-8c24-46d3-bba7-37691ccdef7c", "tag": "36c7031c-029a-48fb-b8b7-8ec16f837c5e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:03.166803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3aa2bba9-45f2-4bef-a711-c1c52d65de2c req-731f4a5c-d104-4855-a0cc-bb4419feb091 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.167782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3aa2bba9-45f2-4bef-a711-c1c52d65de2c req-731f4a5c-d104-4855-a0cc-bb4419feb091 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.168874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3aa2bba9-45f2-4bef-a711-c1c52d65de2c req-731f4a5c-d104-4855-a0cc-bb4419feb091 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.213703 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3aa2bba9-45f2-4bef-a711-c1c52d65de2c req-731f4a5c-d104-4855-a0cc-bb4419feb091 service nova] Creating event network-changed:36c7031c-029a-48fb-b8b7-8ec16f837c5e for instance b01cc84a-8c24-46d3-bba7-37691ccdef7c on n-h1-862769-3 Oct 28 19:12:03.219881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3aa2bba9-45f2-4bef-a711-c1c52d65de2c req-731f4a5c-d104-4855-a0cc-bb4419feb091 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088212 Oct 28 19:12:03.221123 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 634/1261] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:03.231616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:03.232991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:03.243513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.245026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.245691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.246654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.247868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.248496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.362542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.376124 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a66f42ab-4657-41e5-8876-e0b769d733e7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 0.408305 Oct 28 19:12:03.376913 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 628/1262] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:02 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:03.385521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:03.398360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:03.405619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.406415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.407671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.408630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.410176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.411840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.731982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.741023 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2a99f52-1ca9-480e-8a50-d6410738f6a2 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1521 microversion: 2.1 time: 0.518070 Oct 28 19:12:03.745044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 635/1263] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:03 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:03.755984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0909db6f-4fad-4c18-aca1-0af11e9e67da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: .version_select at 0x7f1d77c3adc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2088255375", "policies": ["affinity"]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:03.797466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0909db6f-4fad-4c18-aca1-0af11e9e67da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:03.811740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0909db6f-4fad-4c18-aca1-0af11e9e67da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:03.881704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:03.889921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48861413-1a3a-466f-bb6e-e4d7d6b29cf4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.510440 Oct 28 19:12:03.894393 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 629/1264] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:03 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:03.902084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:03.904632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:03.917922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0909db6f-4fad-4c18-aca1-0af11e9e67da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:03.918872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.920581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.921177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.923709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.924344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.926617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.927728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0909db6f-4fad-4c18-aca1-0af11e9e67da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:03.957989 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0909db6f-4fad-4c18-aca1-0af11e9e67da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.211630 Oct 28 19:12:03.965372 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 636/1265] 10.222.0.44 () {60 vars in 1174 bytes} [Fri Oct 28 19:12:03 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:03.979551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:03.979551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] [instance: c5e35a18-e0b7-432b-9139-2afe6f9be925] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:03.989183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.989831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.990271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:03.991008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:03.991467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:03.991884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.016410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] HTTP exception thrown: Instance c5e35a18-e0b7-432b-9139-2afe6f9be925 could not be found. Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Request method failure captured: Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 HTTP/1.1 Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCjiO2Il5wgwEYvD6NzfNx_lS4HHLS6TzSmBagL6wVUJ-jKdTM656bRcgXVQAIm-lT58U6q2jxuPzCSdytYXnvWo3nciQIn1_jH2tLQWuukIQ3w12yswIXmsCNCINE-S8kYEkHpLQPtLlu0hvApjXgDyXrBlAltYYbqyccxK_0-p6Uo Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.91 Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9d4713b9094941c5a10b080a37d1edef Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-708369345 Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:04.018429 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9d4713b9094941c5a10b080a37d1edef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9d4713b9094941c5a10b080a37d1edef", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9d4713b9094941c5a10b080a37d1edef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9d4713b9094941c5a10b080a37d1edef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-708369345 Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9d4713b9094941c5a10b080a37d1edef Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-708369345 Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-UnshelveToHostMultiNodesTest-708369345-project Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 86ab55a22b59402f8e85da092e389e39 Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-708369345-project Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c5e35a18-e0b7-432b-9139-2afe6f9be925 could not be found. Oct 28 19:12:04.019814 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c5e35a18-e0b7-432b-9139-2afe6f9be925'} Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e35a18-e0b7-432b-9139-2afe6f9be925 could not be found. Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:04.020584 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e35a18-e0b7-432b-9139-2afe6f9be925 could not be found. Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e35a18-e0b7-432b-9139-2afe6f9be925 could not be found. Oct 28 19:12:04.021873 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:04.023003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] Returning 404 to user: Instance c5e35a18-e0b7-432b-9139-2afe6f9be925 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:04.023003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d94675d7-7671-4781-bf88-8fab0b17d538 tempest-UnshelveToHostMultiNodesTest-708369345 tempest-UnshelveToHostMultiNodesTest-708369345-project] 10.222.0.44 "GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925" status: 404 len: 111 microversion: 2.91 time: 0.053469 Oct 28 19:12:04.024049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 637/1266] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:03 2022] GET /compute/v2.1/servers/c5e35a18-e0b7-432b-9139-2afe6f9be925 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:04.029351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:04.029981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:04.039175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.039928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.041096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.041926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.042389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.042842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.113750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:04.174980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:04.292550 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bccc458e-9830-4c98-8c98-19e975443f68 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 204 len: 0 microversion: 2.1 time: 0.260700 Oct 28 19:12:04.299404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 638/1267] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:04 2022] DELETE /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:04.310123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:04.310926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:04.319205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.319706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.320180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.321031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.321734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.322510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.374847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.389709 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff22ade3-bbbf-4159-8901-ae9427b905cb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.489934 Oct 28 19:12:04.392806 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 630/1268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:03 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:04.405865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-205923448", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c84d4e94-dee6-4c81-98f1-e911bfc0fb35"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:04.522647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:04.665518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.683390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.702721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:04.708401 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f044d045-a16c-4bbe-ad51-50510079c54a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.405691 Oct 28 19:12:04.709185 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 639/1269] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:04 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:04.721249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:04.721874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:04.736770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.737461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.737724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.738394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:04.751092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:04.751662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:04.960528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:04.961383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:04.962017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:04.962587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:04.963207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:05.008820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.013296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.013987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.014805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.015260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.016732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.037429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:05.041042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:05.043436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:05.057553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Going to run 2 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:05.060026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:05.065501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-514f0510-48a0-45a2-97f1-f0c77296e90c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1527 microversion: 2.1 time: 0.355189 Oct 28 19:12:05.084282 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 640/1270] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:04 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1527 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:05.099925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.100668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:05.101410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120628) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 19:12:05.113212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.113985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.114727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.115734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.116439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.116986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.154010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:05.159524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:05.239604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:05.248724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:05.273521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=190716fd-7f95-4596-b6ca-7e21ce4ab687,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:05.349924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:05.355592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:05.369639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7efd510d-d3cc-47e5-a725-4c318b80cc2b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 0.282537 Oct 28 19:12:05.370441 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 641/1271] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:05.371357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:05.383734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ef7ae334-bd4b-403c-a413-029590daaed2 req-55c55b8e-52bf-4c50-bf69-a70dd3d2ae40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf731e0d-b279-4f5a-8942-113c77ac2777", "name": "network-vif-plugged", "status": "completed", "tag": "1e4b3ae2-e83b-4246-b919-6fdd496906ce"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:05.407439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ef7ae334-bd4b-403c-a413-029590daaed2 req-55c55b8e-52bf-4c50-bf69-a70dd3d2ae40 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.407841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ef7ae334-bd4b-403c-a413-029590daaed2 req-55c55b8e-52bf-4c50-bf69-a70dd3d2ae40 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.408267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ef7ae334-bd4b-403c-a413-029590daaed2 req-55c55b8e-52bf-4c50-bf69-a70dd3d2ae40 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.455428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:05.460693 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ef7ae334-bd4b-403c-a413-029590daaed2 req-55c55b8e-52bf-4c50-bf69-a70dd3d2ae40 service nova] Creating event network-vif-plugged:1e4b3ae2-e83b-4246-b919-6fdd496906ce for instance cf731e0d-b279-4f5a-8942-113c77ac2777 on n-h2-862769-3 Oct 28 19:12:05.463673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:05.475133 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ef7ae334-bd4b-403c-a413-029590daaed2 req-55c55b8e-52bf-4c50-bf69-a70dd3d2ae40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099960 Oct 28 19:12:05.489379 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 642/1272] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:05.500614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.501334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:05.520484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.520986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.521423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.522139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.526412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.526900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.566580 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bca6902d-ba3a-4910-80df-40f11ad46cea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.172274 Oct 28 19:12:05.570533 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 631/1273] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:04 2022] POST /compute/v2.1/servers => generated 32 bytes in 1176 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:12:05.577143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8c40e37f-9996-4f8f-9d9c-eea34ca0f451 req-f775e8e2-8d04-4987-95bb-abaf674971f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:05.597452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c40e37f-9996-4f8f-9d9c-eea34ca0f451 req-f775e8e2-8d04-4987-95bb-abaf674971f0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.598668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c40e37f-9996-4f8f-9d9c-eea34ca0f451 req-f775e8e2-8d04-4987-95bb-abaf674971f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.601290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c40e37f-9996-4f8f-9d9c-eea34ca0f451 req-f775e8e2-8d04-4987-95bb-abaf674971f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.625298 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8c40e37f-9996-4f8f-9d9c-eea34ca0f451 req-f775e8e2-8d04-4987-95bb-abaf674971f0 service nova] Creating event network-changed:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h1-862769-3 Oct 28 19:12:05.641484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8c40e37f-9996-4f8f-9d9c-eea34ca0f451 req-f775e8e2-8d04-4987-95bb-abaf674971f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069903 Oct 28 19:12:05.642111 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 632/1274] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:05.649828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.650536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:05.665836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.666656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.673714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.677095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.677596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.679198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.859087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:05.878379 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1bd81669-c33f-4037-9861-98235fcfdd4b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.387649 Oct 28 19:12:05.880754 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 643/1275] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:05.900861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.909339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:05.910506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Searching by: {'deleted': False, 'project_id': '6df42e9bda2b4307a800e2a35af177be'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:12:05.940709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:05.950276 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2947c0b0-0413-447e-9cfb-7bb8c8cd8ccd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.304597 Oct 28 19:12:05.953795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.954820 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 633/1276] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:05.955197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.955944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.956897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.957636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.959448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.959711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:05.960323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:05.973975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.974486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.974968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:05.975745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:05.976125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:05.976553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.072892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:12:06.253014 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4dbeda4-f966-4f2b-9cfc-44195b3aae9b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.370691 Oct 28 19:12:06.260743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 644/1277] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers => generated 1001 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:06.260743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:06.260743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:06.267345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:06.268021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:06.268768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.269616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:06.270084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:06.270611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.676914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.696967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.698621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.705549 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-50260bc5-3531-475b-99e8-0400d4681ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.749614 Oct 28 19:12:06.719663 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 634/1278] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:05 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:06.738531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f3aa57e-9296-4f3f-8632-372fc6072f01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:06.739638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f3aa57e-9296-4f3f-8632-372fc6072f01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:06.871669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f3aa57e-9296-4f3f-8632-372fc6072f01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.885478 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f3aa57e-9296-4f3f-8632-372fc6072f01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1218 microversion: 2.1 time: 0.164347 Oct 28 19:12:06.900939 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 635/1279] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:06 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:06.909566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:06.914047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:06.928931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:06.931109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:06.933096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.934766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:06.936138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:06.937446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:06.966583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:06.983957 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81884fa1-94ee-4602-9335-70adbf10c6cd tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1527 microversion: 2.1 time: 0.727560 Oct 28 19:12:06.986580 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 645/1280] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:06 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1527 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:06.997712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:06.999270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:07.018034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.018626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.019765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.021046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.022602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.024460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.611025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:07.625387 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17839b29-65c0-42cd-97d9-f7ae78f33ee7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.637250 Oct 28 19:12:07.628734 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 646/1281] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:06 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:07.642743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:07.643358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:07.653043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.660626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.660626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.660626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.660626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.661110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.675112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:07.690472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-831bf8fe-d75b-40f0-80a9-c288d249266c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 0.786175 Oct 28 19:12:07.697692 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 636/1282] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:06 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:07.736251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:07.737422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:07.749034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.749860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.752684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:07.757197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:07.758423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:07.759566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.224210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.234164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.247896 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ea55565-c2cb-4923-9c94-0344a5e46461 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.614143 Oct 28 19:12:08.248970 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 647/1283] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:07 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:08.263339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.265155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.275565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:08.276209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:08.282751 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7d21a44-ad2e-42d5-9061-2fb4c9032424 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.552852 Oct 28 19:12:08.296227 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 637/1284] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:07 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:08.319441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:08.320085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:08.330087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.330629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.335533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.336150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.336676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.343669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.346548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.347135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.347596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.348375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.348854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.349311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.694116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.694941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:08.704304 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4db356c8-4cb7-4ece-bd1b-8fa5a674569f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1485 microversion: 2.1 time: 0.406703 Oct 28 19:12:08.710949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 638/1285] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:08 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1485 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:08.723046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:08.724914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:08.742119 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c9c8875-d6e5-4cc5-b180-be0638e51bc4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1214 microversion: 2.1 time: 0.472424 Oct 28 19:12:08.743251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.744110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.744871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.745826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.746774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.748583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.756901 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 648/1286] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:08 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1214 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:08.784918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:08.789624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:08.797823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.798581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.799754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:08.801754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:08.804137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:08.804813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.265848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.275519 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a5d739f-a907-4c18-9705-a664d91bc402 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 0.517219 Oct 28 19:12:09.279917 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 649/1287] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:08 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:09.290753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-22cfa773-2667-4ab3-b4ca-250df8f8c35b req-82a54fdb-7ef2-4544-9f03-5e1442541215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf731e0d-b279-4f5a-8942-113c77ac2777", "name": "network-vif-deleted", "tag": "1e4b3ae2-e83b-4246-b919-6fdd496906ce"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:09.314159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.327304 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70c4f73b-5a11-4c7d-bdd3-36735657c7b1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.614815 Oct 28 19:12:09.330436 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 639/1288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:08 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:09.333739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-22cfa773-2667-4ab3-b4ca-250df8f8c35b req-82a54fdb-7ef2-4544-9f03-5e1442541215 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.334466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-22cfa773-2667-4ab3-b4ca-250df8f8c35b req-82a54fdb-7ef2-4544-9f03-5e1442541215 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.335153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-22cfa773-2667-4ab3-b4ca-250df8f8c35b req-82a54fdb-7ef2-4544-9f03-5e1442541215 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.345913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5e5c7ab9-57e5-4873-9850-3b7723e35170 req-e08d8cd9-d65e-4a5b-8f40-8da1b2e04d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa203d5-e7cb-40c8-9d42-be8413b3abe0", "name": "network-vif-plugged", "status": "completed", "tag": "2df9b8bc-b8b3-421b-a072-98080b43b82d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:09.360920 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-22cfa773-2667-4ab3-b4ca-250df8f8c35b req-82a54fdb-7ef2-4544-9f03-5e1442541215 service nova] Creating event network-vif-deleted:1e4b3ae2-e83b-4246-b919-6fdd496906ce for instance cf731e0d-b279-4f5a-8942-113c77ac2777 on n-h2-862769-3 Oct 28 19:12:09.366458 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-22cfa773-2667-4ab3-b4ca-250df8f8c35b req-82a54fdb-7ef2-4544-9f03-5e1442541215 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085076 Oct 28 19:12:09.371283 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 650/1289] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:09.377782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:09.379356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:09.386140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e5c7ab9-57e5-4873-9850-3b7723e35170 req-e08d8cd9-d65e-4a5b-8f40-8da1b2e04d70 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.387162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.387859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.388513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.389385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.389874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e5c7ab9-57e5-4873-9850-3b7723e35170 req-e08d8cd9-d65e-4a5b-8f40-8da1b2e04d70 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.390180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.390540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e5c7ab9-57e5-4873-9850-3b7723e35170 req-e08d8cd9-d65e-4a5b-8f40-8da1b2e04d70 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.391036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.423264 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5e5c7ab9-57e5-4873-9850-3b7723e35170 req-e08d8cd9-d65e-4a5b-8f40-8da1b2e04d70 service nova] Creating event network-vif-plugged:2df9b8bc-b8b3-421b-a072-98080b43b82d for instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 on n-h1-862769-3 Oct 28 19:12:09.438749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5e5c7ab9-57e5-4873-9850-3b7723e35170 req-e08d8cd9-d65e-4a5b-8f40-8da1b2e04d70 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106847 Oct 28 19:12:09.440355 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 640/1290] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:09.447405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:09.448362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:09.456143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.456979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.457693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.458627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.459324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.459965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.763577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.789570 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35b4c250-4e14-43cd-be50-5ca8dd78124a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1314 microversion: 2.1 time: 0.416743 Oct 28 19:12:09.805378 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 651/1291] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:09 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:09.813925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:09.815307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:09.823272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.824313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.826119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.827497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.829571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.830388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.884461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.885176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.885934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.887124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lazy-loading 'fault' on Instance uuid cf731e0d-b279-4f5a-8942-113c77ac2777 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:09.898051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.909499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.911751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.916269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a65bb57-5e23-4da6-9924-f2bc96ca66dd tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.474439 Oct 28 19:12:09.916899 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 641/1292] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:09 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:09.943456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:09.944313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:09.946731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:09.956705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:09.962248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.967349 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15d61218-95c3-452d-9420-95adb7b785a0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 200 len: 1314 microversion: 2.1 time: 0.159899 Oct 28 19:12:09.976320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.976998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.977771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:09.978256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:09.978728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:09.982890 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 652/1293] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:09 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:10.138115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:10.161261 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e92be68-14ba-4dc8-862d-29a5809b1cc9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1278 microversion: 2.1 time: 0.224810 Oct 28 19:12:10.164657 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 642/1294] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:09 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:10.310027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:10.311728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:10.329173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:10.329681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:10.330148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:10.330887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:10.331354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:10.334361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:10.352867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:10.353500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:10.368551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:10.369487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:10.370088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:10.375948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:10.376608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:10.377203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:11.106857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:11.119397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea3d1cbb-2c4e-4523-98c7-dd8b9817ce45 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.770211 Oct 28 19:12:11.121389 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 643/1295] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:10 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:11.136117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:11.136895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:11.170417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:11.172503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:11.172964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:11.176272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:11.177765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:11.180409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:11.201773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:11.217867 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd3ac5d9-b47b-414e-9a16-a687e1b7254d tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 0.910433 Oct 28 19:12:11.220414 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 653/1296] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:10 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:11.505121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:11.521324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-92784bdd-55ba-4142-b977-d14f0fe678df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1501 microversion: 2.1 time: 0.397428 Oct 28 19:12:11.522847 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 644/1297] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:11 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1501 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:11.541002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1056729143", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:11.541769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:11.554082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:11.596060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:11.598317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:11.605080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:11.611850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:11.612558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:11.612999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:11.627857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:11.686498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:12.101755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.122831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.124645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.125861 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e688783a-c0ed-40b3-a22e-52e8f5bdb5e2 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.600676 Oct 28 19:12:12.126420 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 645/1298] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:11 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:12.143333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:12.143948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:12.158331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.158780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.159388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.160085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.160540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.160951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.186973 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 HTTP/1.1 Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:12.188792 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:12.190280 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'cf731e0d-b279-4f5a-8942-113c77ac2777'} Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:12.191254 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:12.192586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:12.193772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:12.193772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba54f8aa-a89e-4c60-8688-083fa2ee9044 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 404 len: 111 microversion: 2.1 time: 0.062824 Oct 28 19:12:12.203558 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 646/1299] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:12 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:12.209482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:12.210371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:12.217321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.219445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.220387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.221539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.222375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.223120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.281962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:12.282445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:12.283179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:12.284166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:12.284736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:12.296158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=43 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:12.301926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.302582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.303380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.304461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.305134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.305720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.329797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Getting quotas for project a031a8a3ae0e4f38a28c754e94c479e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:12.335768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Getting quotas for user c71684a5c1374e97924b3fce4206907b and project a031a8a3ae0e4f38a28c754e94c479e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:12.355312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:12.359201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:12.402764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:12.446170 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7555476a-cb70-46df-b2ec-983068ab4557 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220565 Oct 28 19:12:12.449311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 654/1300] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:12:12.460558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7e438826-c775-4a10-89aa-a5993e98041e req-376ded6b-8be5-493a-8e01-21f8ad062d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01cc84a-8c24-46d3-bba7-37691ccdef7c", "name": "network-vif-plugged", "status": "completed", "tag": "36c7031c-029a-48fb-b8b7-8ec16f837c5e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:12.475599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7e438826-c775-4a10-89aa-a5993e98041e req-376ded6b-8be5-493a-8e01-21f8ad062d5b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.476958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7e438826-c775-4a10-89aa-a5993e98041e req-376ded6b-8be5-493a-8e01-21f8ad062d5b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.478216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7e438826-c775-4a10-89aa-a5993e98041e req-376ded6b-8be5-493a-8e01-21f8ad062d5b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.494991 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7e438826-c775-4a10-89aa-a5993e98041e req-376ded6b-8be5-493a-8e01-21f8ad062d5b service nova] Creating event network-vif-plugged:36c7031c-029a-48fb-b8b7-8ec16f837c5e for instance b01cc84a-8c24-46d3-bba7-37691ccdef7c on n-h1-862769-3 Oct 28 19:12:12.501842 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7e438826-c775-4a10-89aa-a5993e98041e req-376ded6b-8be5-493a-8e01-21f8ad062d5b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051081 Oct 28 19:12:12.503261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 655/1301] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:12.509511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:12.517404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:12.549783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.550420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.552104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.556504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.557284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.558039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.596377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:12.710842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:12.719945 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4638cdd-8620-4fcb-a913-ede4b9a1b1b2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.515255 Oct 28 19:12:12.739729 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 647/1302] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:12 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:12.756684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:12.757596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:12.791425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.792348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.793260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:12.794001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:12.794468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:12.794922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.643071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:13.653631 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e48c8a66-1943-4108-b189-57d2c33e8cc4 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 1.148666 Oct 28 19:12:13.654578 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 656/1303] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:12 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:13.660009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.660964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:13.676906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:13.678780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:13.679800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.680707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:13.681560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:13.683484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.805705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:13.824427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94f34a36-d4f1-445c-8f1a-c24167fcff61 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1321 microversion: 2.1 time: 1.083222 Oct 28 19:12:13.826897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 648/1304] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:12 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1321 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:13.837550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2126504146", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:13.841498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:13.875252 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ceb86a3e-203f-4507-b1a8-a897e6b31fbb tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1266 microversion: 2.1 time: 0.219238 Oct 28 19:12:13.877899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 657/1305] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:13.885075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:13.898203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:13.916031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:13.918970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:13.921099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.927249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:13.928047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:13.928726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:13.966714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] validate_networks() for [('6cded4e8-248a-436b-b141-6debca321857', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:14.438354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:14.453474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:14.457627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:14.461963 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35fd49b5-805d-44ec-8c7e-a7e94c6a97e9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.582365 Oct 28 19:12:14.464545 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 658/1306] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:13 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:14.471679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:14.472617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:14.483870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:14.484733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:14.485263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:14.487050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:14.490902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:14.497396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:14.928746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:14.937535 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-061f9524-1e2e-41d6-9682-050c678ba644 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.471545 Oct 28 19:12:14.938051 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 659/1307] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:14 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:14.945686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:14.946640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:14.947285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:14.947852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:14.948408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:14.961231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03cca598-3e3a-41e4-addd-025676c9421f"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:14.966218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:14.966738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:14.967173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:14.967905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:14.968355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:14.968775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:14.972018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:14.981190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:14.982354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:14.983265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:14.984877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:14.985920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:14.986582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:14.995215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for project 396065b7b553417d9ad5022d9e57404c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:15.002186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Getting quotas for user 8222e34ca7794fa686f94cc2b220c4e3 and project 396065b7b553417d9ad5022d9e57404c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:15.016772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:15.019315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:15.089122 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4389ed6d-caae-4386-a3ab-b706d4e394e3 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.260959 Oct 28 19:12:15.091087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 649/1308] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:12:15.097143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-10771ba6-9ab5-4471-b491-28e844ba5f69 req-b9707eb4-3003-4f02-9ba8-d9b5926be072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "name": "network-vif-plugged", "status": "completed", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:15.115928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-10771ba6-9ab5-4471-b491-28e844ba5f69 req-b9707eb4-3003-4f02-9ba8-d9b5926be072 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.117752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-10771ba6-9ab5-4471-b491-28e844ba5f69 req-b9707eb4-3003-4f02-9ba8-d9b5926be072 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.118852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-10771ba6-9ab5-4471-b491-28e844ba5f69 req-b9707eb4-3003-4f02-9ba8-d9b5926be072 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.147274 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-10771ba6-9ab5-4471-b491-28e844ba5f69 req-b9707eb4-3003-4f02-9ba8-d9b5926be072 service nova] Creating event network-vif-plugged:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h1-862769-3 Oct 28 19:12:15.152811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-10771ba6-9ab5-4471-b491-28e844ba5f69 req-b9707eb4-3003-4f02-9ba8-d9b5926be072 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059981 Oct 28 19:12:15.153572 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 650/1309] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:15.162476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:15.163835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:15.173620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.174642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.175530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.176670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.177563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.178871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.502601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:15.512392 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd1d2702-c584-4e28-b6b4-353f50cb17ed tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.357388 Oct 28 19:12:15.517586 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 651/1310] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:15 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:15.526458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-555e0be6-25b8-4805-ba8a-b7b2929bb229 req-db8aa12a-b1a9-4457-8502-0bc686fdce36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f520592c-588f-4e76-a134-d81ef8aad774", "tag": "09d15e14-ddee-47ff-8099-0abf5316a6c5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:15.554896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-555e0be6-25b8-4805-ba8a-b7b2929bb229 req-db8aa12a-b1a9-4457-8502-0bc686fdce36 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.555669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-555e0be6-25b8-4805-ba8a-b7b2929bb229 req-db8aa12a-b1a9-4457-8502-0bc686fdce36 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.556092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-555e0be6-25b8-4805-ba8a-b7b2929bb229 req-db8aa12a-b1a9-4457-8502-0bc686fdce36 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.574769 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d51b4bee-0b79-4b19-9480-9167e3418b5e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633639 Oct 28 19:12:15.575722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 660/1311] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:12:14 2022] POST /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:15.580048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-555e0be6-25b8-4805-ba8a-b7b2929bb229 req-db8aa12a-b1a9-4457-8502-0bc686fdce36 service nova] Creating event network-changed:09d15e14-ddee-47ff-8099-0abf5316a6c5 for instance f520592c-588f-4e76-a134-d81ef8aad774 on n-h2-862769-3 Oct 28 19:12:15.584264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:15.585002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:15.588921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-555e0be6-25b8-4805-ba8a-b7b2929bb229 req-db8aa12a-b1a9-4457-8502-0bc686fdce36 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069590 Oct 28 19:12:15.593699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 652/1312] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:15.603278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:15.605634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.606139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.606578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.607333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.607796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.608226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.608850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:15.624278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.626611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.627374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.628344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.629012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.630190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.743803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:15.760815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20fefb48-4628-464e-a78e-7fe185337d41 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1272 microversion: 2.1 time: 0.165556 Oct 28 19:12:15.761836 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 653/1313] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:15 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:15.775334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10655025-e137-4ebe-95ad-0f78b972ef76 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:15.775999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10655025-e137-4ebe-95ad-0f78b972ef76 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:15.913979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10655025-e137-4ebe-95ad-0f78b972ef76 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:15.930667 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10655025-e137-4ebe-95ad-0f78b972ef76 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1225 microversion: 2.1 time: 0.167724 Oct 28 19:12:15.931604 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 654/1314] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:15 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1225 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:15.942678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:15.943684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:15.946517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:15.961023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.962509 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb1f5428-3312-4d91-918d-8911c4d30c20 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1470 microversion: 2.1 time: 0.380118 Oct 28 19:12:15.963241 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 661/1315] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:15 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1470 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:15.963833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.964607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.966909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.967678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.968337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:15.973251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-61cd3a1c-11bc-4dae-a7e7-7b73b5f3f59e req-99305cd1-fdb8-4947-8451-451122a2167a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "190716fd-7f95-4596-b6ca-7e21ce4ab687", "tag": "a5d8621b-f95c-435e-8cf4-d6a0b29518bd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:15.998132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-61cd3a1c-11bc-4dae-a7e7-7b73b5f3f59e req-99305cd1-fdb8-4947-8451-451122a2167a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:15.998611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-61cd3a1c-11bc-4dae-a7e7-7b73b5f3f59e req-99305cd1-fdb8-4947-8451-451122a2167a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:15.999066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-61cd3a1c-11bc-4dae-a7e7-7b73b5f3f59e req-99305cd1-fdb8-4947-8451-451122a2167a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.019319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-61cd3a1c-11bc-4dae-a7e7-7b73b5f3f59e req-99305cd1-fdb8-4947-8451-451122a2167a service nova] Creating event network-changed:a5d8621b-f95c-435e-8cf4-d6a0b29518bd for instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 on n-h2-862769-3 Oct 28 19:12:16.025830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-61cd3a1c-11bc-4dae-a7e7-7b73b5f3f59e req-99305cd1-fdb8-4947-8451-451122a2167a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061382 Oct 28 19:12:16.026939 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 662/1316] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:16.033590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:16.034593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:16.042947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:16.043805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:16.044348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.045190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:16.045891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:16.046402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.319194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:16.328956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:16.331259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:16.332704 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ff94af3-2e01-42ee-b28d-28cb21be4225 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.399921 Oct 28 19:12:16.333998 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 655/1317] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:15 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:16.340274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:16.360347 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3214bb91-432f-438e-88d0-0d2bb7d588ed tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.331933 Oct 28 19:12:16.364126 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 663/1318] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:16 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:16.543010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:16.547030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-17cdab25-ebf1-481f-b53b-b6f8066b8463 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:16.547977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-17cdab25-ebf1-481f-b53b-b6f8066b8463 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] [instance: d98618df-a32a-420d-af7d-152ec70e6f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:16.549043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:16.560898 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-17cdab25-ebf1-481f-b53b-b6f8066b8463 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] HTTP exception thrown: Instance d98618df-a32a-420d-af7d-152ec70e6f78 could not be found. Oct 28 19:12:16.563001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:16.564994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:16.565648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.566710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:16.567378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:16.568036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-17cdab25-ebf1-481f-b53b-b6f8066b8463 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Request method failure captured: Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/d98618df-a32a-420d-af7d-152ec70e6f78/action HTTP/1.1 Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 15 Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCl4Ad6bo8zu5uketGQrZDdOvA5dDZY6C3ADBbIZir_drHpfWHjuI1j6RfbaNMpNoIcPG-JlhgCeQQBZrfom9JHWmgXabxS9jCZSuC2srljUjFqPCNCVorHmhSNNxAIdLf_rS-Kx4IpLs9PEl9ecMiWmUTQQN9XOm9BG1h8ygJ8ZCog Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:12:16.574092 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ff03ef747c94ed08f38f06c2c5bd664", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8d7d9855d2bd4df49ed4ecaf9726db5f Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: {"migrate": {}} Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:16.575624 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d98618df-a32a-420d-af7d-152ec70e6f78 could not be found. Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd98618df-a32a-420d-af7d-152ec70e6f78', 'body': {'migrate': {}}} Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98618df-a32a-420d-af7d-152ec70e6f78 could not be found. Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:16.576507 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98618df-a32a-420d-af7d-152ec70e6f78 could not be found. Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98618df-a32a-420d-af7d-152ec70e6f78 could not be found. Oct 28 19:12:16.577916 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:16.580646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-17cdab25-ebf1-481f-b53b-b6f8066b8463 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Returning 404 to user: Instance d98618df-a32a-420d-af7d-152ec70e6f78 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:16.581826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-17cdab25-ebf1-481f-b53b-b6f8066b8463 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/d98618df-a32a-420d-af7d-152ec70e6f78/action" status: 404 len: 111 microversion: 2.1 time: 0.246528 Oct 28 19:12:16.582987 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 656/1319] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:16 2022] POST /compute/v2.1/servers/d98618df-a32a-420d-af7d-152ec70e6f78/action => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:16.786501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:16.788386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:16.799284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:16.808907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:16.818725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.818725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:16.818725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:16.819632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:16.872562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:16.890342 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a68af8d-15b3-4852-96c0-0f1bfa184fff tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1313 microversion: 2.1 time: 0.354083 Oct 28 19:12:16.891070 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 664/1320] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:16 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:16.896756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1500520850", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:16.922014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:16.958854 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e135c00-5f65-435b-bf10-8f77fffd31f4 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1272 microversion: 2.1 time: 0.173588 Oct 28 19:12:16.962831 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 657/1321] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:16 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:16.975232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:16.980173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:17.001694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.003638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.006586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.009805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.011016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.013612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.066711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:17.168345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:17.179041 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29dabed8-8ee6-453c-985d-c671e4aabdff tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1221 microversion: 2.1 time: 0.214173 Oct 28 19:12:17.179621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 658/1322] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:16 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:17.363681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:17.364557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:17.375838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.376667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.378414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.379374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.386822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.387538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.631235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:17.633659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:17.634587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:17.635252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:17.636102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:17.647577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.648456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.649121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.650065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.650765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.651443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.701765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Getting quotas for project 4246174ea1a24221850252a2e73d0dcf. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:17.713167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Getting quotas for user 1f35fe0054554a7c9a3f38521ac107f6 and project 4246174ea1a24221850252a2e73d0dcf. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:17.755491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:17.761461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:17.900641 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a8b8712b-4ef3-40a2-b337-2d8a0be58ba4 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004417 Oct 28 19:12:17.909063 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 665/1323] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:12:17.914623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:17.929478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:17.953516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.954207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.954848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.955790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:17.956394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:17.956966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:17.982243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:17.998905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:18.002280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:18.007338 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5df9624e-5551-4884-96c9-19a339fbf18e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.647304 Oct 28 19:12:18.009036 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 659/1324] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:17 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:12:18.022544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-742f1e55-c4fa-4170-ad8d-1379d7dee2ea tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.023816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-742f1e55-c4fa-4170-ad8d-1379d7dee2ea tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:18.245346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-742f1e55-c4fa-4170-ad8d-1379d7dee2ea tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:18.261356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-742f1e55-c4fa-4170-ad8d-1379d7dee2ea tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1222 microversion: 2.1 time: 0.250796 Oct 28 19:12:18.261951 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 660/1325] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:18 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:18.292567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.294800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:18.311731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.312224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.312818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.313682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.326147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.326628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.679112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:18.696713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e1c337f-0e27-4e53-880f-9115d00c5f09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.783924 Oct 28 19:12:18.707129 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 666/1326] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:17 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:18.732843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.733473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:18.750275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:18.759611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.763611 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-200c7497-583f-4984-bfca-6c194df4a2f7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1462 microversion: 2.1 time: 0.495888 Oct 28 19:12:18.764711 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 661/1327] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:18 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1462 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:18.766356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.766874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.767627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.768099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.768523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.771835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-05d3ab25-e4ec-4093-97f5-7be30ed596bd req-74a8abf8-4823-451c-9482-6cbb15c7982d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7de605-17c2-4004-99c0-2461d81bf4b7", "name": "network-vif-unplugged", "status": "completed", "tag": "2ba7e6ec-b446-4804-ac52-5db82ecf7f7f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:18.783145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05d3ab25-e4ec-4093-97f5-7be30ed596bd req-74a8abf8-4823-451c-9482-6cbb15c7982d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.784007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05d3ab25-e4ec-4093-97f5-7be30ed596bd req-74a8abf8-4823-451c-9482-6cbb15c7982d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.784579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05d3ab25-e4ec-4093-97f5-7be30ed596bd req-74a8abf8-4823-451c-9482-6cbb15c7982d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.800745 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-05d3ab25-e4ec-4093-97f5-7be30ed596bd req-74a8abf8-4823-451c-9482-6cbb15c7982d service nova] Creating event network-vif-unplugged:2ba7e6ec-b446-4804-ac52-5db82ecf7f7f for instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 on n-h1-862769-3 Oct 28 19:12:18.809106 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-05d3ab25-e4ec-4093-97f5-7be30ed596bd req-74a8abf8-4823-451c-9482-6cbb15c7982d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042455 Oct 28 19:12:18.810558 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 662/1328] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:18.820638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:18.821400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:18.833191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.833947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.834761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:18.835673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:18.836366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:18.836935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.054533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.089290 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da42de24-a9de-4406-823c-1deb47cf649f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1285 microversion: 2.1 time: 0.277040 Oct 28 19:12:19.090561 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 663/1329] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:18 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:19.097017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.097781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:19.105670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.106515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.107242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.108280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.108980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.109856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.153185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.162365 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6da9f3ec-599a-4e3b-aa9d-2226fe4b5e9c tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.451938 Oct 28 19:12:19.162998 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 667/1330] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:18 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:19.173201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.173824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:19.211665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.230337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.230817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.231576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.232029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.232454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.402081 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ca03497-6a47-486a-b4e2-cc85e685d016 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1613 microversion: 2.1 time: 0.310014 Oct 28 19:12:19.402681 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 664/1331] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:19 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1613 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:19.407432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.408043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:19.414659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.415177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.415624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.416332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.416785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.417202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.591514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.601067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9953e191-0c85-43ea-9dea-be71db76366f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1274 microversion: 2.1 time: 0.196502 Oct 28 19:12:19.601067 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 665/1332] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:19 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:19.618371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:19.623039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:19.635720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.636634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.637371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.638100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.638835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.639911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.650083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.659269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.665919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.669114 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b146c14b-7b21-4a45-8ed5-3675610e0d9a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.500884 Oct 28 19:12:19.671117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 668/1333] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:19 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:19.722605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:19.724062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:19.733399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b48bee39ca514665aeb90007ffb30733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f359020e3bb4db2bda3dd618ea63d58', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.734042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] flavor_id is None. Assuming migration. {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 19:12:19.734482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:12:19.737149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.739151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.743503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.744712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:19.745418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:19.746108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:19.989363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:19.998510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fc5c0f6-b015-4413-a1cd-d93da47e8629 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.281244 Oct 28 19:12:20.012567 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 669/1334] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:19 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:20.114789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:20.115920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:20.123935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.124869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.125543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.126499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.127239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.127881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.234163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:20.244030 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dedd91d9-6d69-4082-a083-85cd85f38c85 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1283 microversion: 2.1 time: 0.133289 Oct 28 19:12:20.245639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 670/1335] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:20 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1283 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:20.263524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:20.264850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:20.287314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.288194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.289322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.291406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.292926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.294395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.316410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:20.376834 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c200bc54-df17-4798-8bba-be07c5f2df77 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab/action" status: 202 len: 0 microversion: 2.1 time: 0.773364 Oct 28 19:12:20.377346 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 666/1336] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:19 2022] POST /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:20.389789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:20.397794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:20.415785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.416594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.420274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.421098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.421541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.425690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.737633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:20.749889 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a89275e5-d51b-4c87-8224-e374eeef86b9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.501502 Oct 28 19:12:20.766063 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 671/1337] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:20 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:20.770260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:20.771198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:20.777622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.778416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.779111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.780607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.781306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.782098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.822346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:20.833186 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dbe76cf9-0b04-4775-b431-e7f61bf37624 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1471 microversion: 2.1 time: 0.446632 Oct 28 19:12:20.833977 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 667/1338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:20 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1471 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:20.838871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:20.839746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:20.846003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.846676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.847316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.848187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:20.848796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:20.849371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:20.922188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:20.937075 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-763f60a3-8405-414e-abeb-eae6b2319074 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1292 microversion: 2.1 time: 0.171888 Oct 28 19:12:20.956086 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 672/1339] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:20 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1292 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:20.998785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a5b27f68-276d-4d87-a456-2b0e9c980bf3 req-fb04335b-9f73-4d0c-8386-a1feb1d5ddc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7de605-17c2-4004-99c0-2461d81bf4b7", "tag": "2ba7e6ec-b446-4804-ac52-5db82ecf7f7f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:21.012088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5b27f68-276d-4d87-a456-2b0e9c980bf3 req-fb04335b-9f73-4d0c-8386-a1feb1d5ddc4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.012798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5b27f68-276d-4d87-a456-2b0e9c980bf3 req-fb04335b-9f73-4d0c-8386-a1feb1d5ddc4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.013370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5b27f68-276d-4d87-a456-2b0e9c980bf3 req-fb04335b-9f73-4d0c-8386-a1feb1d5ddc4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.020897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:21.033749 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a5b27f68-276d-4d87-a456-2b0e9c980bf3 req-fb04335b-9f73-4d0c-8386-a1feb1d5ddc4 service nova] Creating event network-changed:2ba7e6ec-b446-4804-ac52-5db82ecf7f7f for instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 on n-h1-862769-3 Oct 28 19:12:21.041904 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a5b27f68-276d-4d87-a456-2b0e9c980bf3 req-fb04335b-9f73-4d0c-8386-a1feb1d5ddc4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048357 Oct 28 19:12:21.043805 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 673/1340] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:21.056238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:21.057771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:21.069012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.069855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.070678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.071636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.072481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.073276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.336925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:21.350256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:21.353331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:21.358304 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca2fffeb-d28b-4706-b2ad-c74b685cfe0c tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.522345 Oct 28 19:12:21.362063 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 668/1341] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:20 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:21.378094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:21.379101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:21.396262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.396993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.399886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.401147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.401957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.403902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.428406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:21.443605 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43c07e1f-cdbc-499f-be1e-e0c219bb6f0c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.397829 Oct 28 19:12:21.455442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 674/1342] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:21 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:21.749762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:21.763349 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9672e9d8-baeb-4f6b-9f0c-bca58ae6b78b tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.397817 Oct 28 19:12:21.764988 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 669/1343] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:21 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:21.780270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:21.780898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:21.813117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.814363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.814954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.817172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.819258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.821548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.871278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:21.872161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:21.887441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.895018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.897256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:21.898023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:21.930258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:21.930717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:22.547409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:22.561281 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fea9689d-42bc-4b62-bbc1-1e78f6b9545f tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1471 microversion: 2.1 time: 0.694982 Oct 28 19:12:22.562583 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 670/1344] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:21 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1471 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:22.572634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:22.574412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:22.576875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:22.585569 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-578852f4-5cae-4a86-b3a8-ba32c58ee0da tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.816031 Oct 28 19:12:22.588059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:22.589473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:22.590171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:22.602782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:22.603051 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 675/1345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:21 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:22.604271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:22.605788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:22.606303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:22.608516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:22.633165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:22.636288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:22.644467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:22.646836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:22.647329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:22.649798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:22.822878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:22.832286 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c979adbf-32d2-43d2-bcbc-d00a4d0f6aa1 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1280 microversion: 2.1 time: 0.266723 Oct 28 19:12:22.833852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 671/1346] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:22 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:22.851942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:22.853327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:22.871701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:22.872445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:22.873597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:22.875974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:22.876403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:22.877204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:23.472128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:23.486481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:23.494837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:23.498232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92833d7e-1b00-4498-bc50-124a03d174d8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.900050 Oct 28 19:12:23.501552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 676/1347] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:22 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:23.515598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:23.516369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:23.533144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:23.533926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:23.535900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:23.537228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:23.539117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:23.543144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:23.770284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:23.790923 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8b058965-ab0d-4088-8647-5fa413efb1b7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.944937 Oct 28 19:12:23.806487 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 672/1348] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:22 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:23.811186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d9c53512-151b-4c6d-b3c4-ea9a99ef5798 req-4ef49358-e848-4e91-86fa-4c3f4be5cced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571ff37-845b-48ca-b2c1-f369f3cc3de6", "tag": "f9da24c8-10ba-4166-a23f-90efc55c93d0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:23.836409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d9c53512-151b-4c6d-b3c4-ea9a99ef5798 req-4ef49358-e848-4e91-86fa-4c3f4be5cced service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:23.850921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d9c53512-151b-4c6d-b3c4-ea9a99ef5798 req-4ef49358-e848-4e91-86fa-4c3f4be5cced service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:23.851091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d9c53512-151b-4c6d-b3c4-ea9a99ef5798 req-4ef49358-e848-4e91-86fa-4c3f4be5cced service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:23.877140 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d9c53512-151b-4c6d-b3c4-ea9a99ef5798 req-4ef49358-e848-4e91-86fa-4c3f4be5cced service nova] Creating event network-changed:f9da24c8-10ba-4166-a23f-90efc55c93d0 for instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 on n-h2-862769-3 Oct 28 19:12:23.889032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d9c53512-151b-4c6d-b3c4-ea9a99ef5798 req-4ef49358-e848-4e91-86fa-4c3f4be5cced service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095167 Oct 28 19:12:23.889784 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 673/1349] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:23.905067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7dcdbc6c-e3c7-41ef-b729-af90d86d8229 req-994f9d9b-53d7-495e-b305-f14476c716e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f520592c-588f-4e76-a134-d81ef8aad774", "name": "network-vif-plugged", "status": "completed", "tag": "09d15e14-ddee-47ff-8099-0abf5316a6c5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:23.935737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7dcdbc6c-e3c7-41ef-b729-af90d86d8229 req-994f9d9b-53d7-495e-b305-f14476c716e9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:23.939842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7dcdbc6c-e3c7-41ef-b729-af90d86d8229 req-994f9d9b-53d7-495e-b305-f14476c716e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:23.940438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7dcdbc6c-e3c7-41ef-b729-af90d86d8229 req-994f9d9b-53d7-495e-b305-f14476c716e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:23.967321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:23.967853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7dcdbc6c-e3c7-41ef-b729-af90d86d8229 req-994f9d9b-53d7-495e-b305-f14476c716e9 service nova] Creating event network-vif-plugged:09d15e14-ddee-47ff-8099-0abf5316a6c5 for instance f520592c-588f-4e76-a134-d81ef8aad774 on n-h2-862769-3 Oct 28 19:12:23.978065 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ca7fbb8-2b18-4260-ab1f-a64a3432d811 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.475195 Oct 28 19:12:23.982310 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7dcdbc6c-e3c7-41ef-b729-af90d86d8229 req-994f9d9b-53d7-495e-b305-f14476c716e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087305 Oct 28 19:12:23.983247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 674/1350] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:23.983745 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 677/1351] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:23 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:23.988971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:23.989512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:23.989654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:23.990220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:24.019562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.023375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.023856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.026401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.026802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.026989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.027421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.027868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.028563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.030069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.030708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.031309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.331900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:24.342585 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a9963ec-ac3b-4329-b42b-c68188518876 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1471 microversion: 2.1 time: 0.357264 Oct 28 19:12:24.343916 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 675/1352] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:23 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:24.349443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:24.350383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:24.362307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.366961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.367860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.368886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.374310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.375147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.754910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:24.763264 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-309fc4d1-382c-45b2-81fd-5118742ba94e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.778390 Oct 28 19:12:24.763850 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 678/1353] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:23 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:24.783219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:24.783841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:24.802509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.803099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.803461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.804178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.804635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.805054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.920937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:24.934990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04b9b139-2650-442c-8e73-de4fe8fc001a tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.588587 Oct 28 19:12:24.954229 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 676/1354] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:24 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:24.959968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:24.960791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:24.967151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.968076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.968962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.970154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:24.970786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:24.971353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:24.999485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:25.048538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:25.060852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:25.070986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:25.072588 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4f8de12-5961-49f6-9ccb-637713e7e361 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.307824 Oct 28 19:12:25.073311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 679/1355] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:24 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:25.083086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:25.084930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:25.101116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.102126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.102764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.103656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.106383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.107035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.277206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:25.286227 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf00d345-a2a6-409e-bee5-b60d5d55455b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1318 microversion: 2.1 time: 0.330395 Oct 28 19:12:25.290473 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 677/1356] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:24 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:25.367006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:25.367813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:25.375297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.375928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.376470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.377288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.377979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.378510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.498456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:25.514751 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68dd2991-f920-45b0-ae52-f6fb87cac1c9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.440016 Oct 28 19:12:25.521573 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 680/1357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:25 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:25.722926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:25.732992 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa6a61db-7a6b-4428-94bb-60bdc348d5ac tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1471 microversion: 2.1 time: 0.370384 Oct 28 19:12:25.733576 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 678/1358] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:25 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:25.786444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:25.787536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:25.800138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.803812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.804692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.805702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.806506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.807934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.962267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:25.964298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:25.973959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.975640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.978418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:25.980080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:25.982078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:25.983738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.035252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.053543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa133ae1-c449-4957-9c30-ff2196d6c977 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.271241 Oct 28 19:12:26.070865 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 681/1359] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:25 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:26.086130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b373be2d-acb7-441b-97e5-7f6a07f725ab req-05c7c040-2019-41d7-8710-1608b1fe61b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324b1c83-3221-4bf9-a955-7a49f50b24e3", "tag": "71b2e826-c1a1-4a34-bd47-f2c9872f592b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:26.141345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b373be2d-acb7-441b-97e5-7f6a07f725ab req-05c7c040-2019-41d7-8710-1608b1fe61b7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.144284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b373be2d-acb7-441b-97e5-7f6a07f725ab req-05c7c040-2019-41d7-8710-1608b1fe61b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.150728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b373be2d-acb7-441b-97e5-7f6a07f725ab req-05c7c040-2019-41d7-8710-1608b1fe61b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.169314 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b373be2d-acb7-441b-97e5-7f6a07f725ab req-05c7c040-2019-41d7-8710-1608b1fe61b7 service nova] Creating event network-changed:71b2e826-c1a1-4a34-bd47-f2c9872f592b for instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 on n-h1-862769-3 Oct 28 19:12:26.183434 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b373be2d-acb7-441b-97e5-7f6a07f725ab req-05c7c040-2019-41d7-8710-1608b1fe61b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110856 Oct 28 19:12:26.187642 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 682/1360] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:26.199187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d338154e-e9a2-4f32-80a5-e00bf5e66389 req-b7a51a86-8d25-41ef-89f2-403bbecd1f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190716fd-7f95-4596-b6ca-7e21ce4ab687", "name": "network-vif-plugged", "status": "completed", "tag": "a5d8621b-f95c-435e-8cf4-d6a0b29518bd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:26.212871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d338154e-e9a2-4f32-80a5-e00bf5e66389 req-b7a51a86-8d25-41ef-89f2-403bbecd1f89 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.213557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d338154e-e9a2-4f32-80a5-e00bf5e66389 req-b7a51a86-8d25-41ef-89f2-403bbecd1f89 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.214246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d338154e-e9a2-4f32-80a5-e00bf5e66389 req-b7a51a86-8d25-41ef-89f2-403bbecd1f89 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.235642 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d338154e-e9a2-4f32-80a5-e00bf5e66389 req-b7a51a86-8d25-41ef-89f2-403bbecd1f89 service nova] Creating event network-vif-plugged:a5d8621b-f95c-435e-8cf4-d6a0b29518bd for instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 on n-h2-862769-3 Oct 28 19:12:26.241364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d338154e-e9a2-4f32-80a5-e00bf5e66389 req-b7a51a86-8d25-41ef-89f2-403bbecd1f89 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052160 Oct 28 19:12:26.242458 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 683/1361] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:26.249413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.250293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.256983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.257685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.258290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.259192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.259795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.260357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.278954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.288776 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-08d7a97f-9ad9-43fa-9210-2eb313e5efb7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.330993 Oct 28 19:12:26.309288 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 679/1362] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:25 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:26.316472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.317233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.325025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.325671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.326211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.327055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.327618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.328196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.497086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.508095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.510517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.513490 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26a4cdf5-d901-4a6a-8e25-7fb70930638b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.268397 Oct 28 19:12:26.514478 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 684/1363] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:26.526639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.535124 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5029ffb0-98be-4638-bffa-d46b4c88ab66 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1467 microversion: 2.1 time: 0.224438 Oct 28 19:12:26.540776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.541621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 680/1364] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:26.545171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.553927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.555005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.555670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.556629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.557303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.558017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.565223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.565223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.570434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.570947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.571375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.572077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.572524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.572937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.776891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.779345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.785836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e3ce2be-b261-411f-9259-a47befa73d3d tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.249214 Oct 28 19:12:26.789400 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf287ec1-00ac-4672-8cab-37da819215ff tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1318 microversion: 2.1 time: 0.229446 Oct 28 19:12:26.799189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 685/1365] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:26.800484 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 681/1366] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:26.807548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:26.808428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:26.814913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.815520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.816058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.816863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:26.817419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:26.817937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:26.975066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:26.985236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4ef50abf-b041-4c66-ac43-4cb8160c86fe tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.183906 Oct 28 19:12:27.000315 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 686/1367] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:26 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:27.083490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:27.085862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:27.088752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:27.095692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.096505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.097095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.098466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.099616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.100192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.317083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:27.317691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:27.326935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.327430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.327856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.328574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.340957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.341607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.523471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:27.532797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-992fce74-976f-432e-a010-8b879c107693 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.453776 Oct 28 19:12:27.534078 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 682/1368] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:27 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:27.556001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:27.556768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:27.562701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.563207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.563635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.564414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.564973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.565404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.576690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:27.605650 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b2093ef-323a-4281-94bc-60a6d05fb972 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.292587 Oct 28 19:12:27.620190 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 687/1369] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:27 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:27.738489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:27.755436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:27.756728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:27.758090 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e238dca8-2798-48a2-b4da-a817709aa942 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.205952 Oct 28 19:12:27.761567 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 683/1370] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:27 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:12:27.827515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:27.828814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:27.831645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:27.832183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:27.864247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:27.866678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=11 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:27.886903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.887754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.893558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.897268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.900273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.901050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.906400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.907199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.907654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:27.910132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:27.913072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:27.926971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.016285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:28.252290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=34 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:28.379824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:28.396109 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-da4d0d5c-1494-4cf7-bd19-a8d8db292746 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.585016 Oct 28 19:12:28.397070 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 688/1371] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:27 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:28.418952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:28.420074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:28.428742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.431437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.432061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.433012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.435867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.446169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.483159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:28.494580 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5310ac58-40c6-4665-bb93-12f0b18a55e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1318 microversion: 2.1 time: 0.681521 Oct 28 19:12:28.505324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 684/1372] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:27 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:28.516617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8869d442-4cd4-4043-9be1-2f048cfe10df req-44672a79-191e-4b3d-9480-c8cd89cd7be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92103fb7-7ca6-44c1-b979-8fabb837a099", "tag": "b2e37c0d-763d-4d54-af1f-6ef9a984b09a"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:28.564598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8869d442-4cd4-4043-9be1-2f048cfe10df req-44672a79-191e-4b3d-9480-c8cd89cd7be5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.564753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8869d442-4cd4-4043-9be1-2f048cfe10df req-44672a79-191e-4b3d-9480-c8cd89cd7be5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.565168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8869d442-4cd4-4043-9be1-2f048cfe10df req-44672a79-191e-4b3d-9480-c8cd89cd7be5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.594224 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8869d442-4cd4-4043-9be1-2f048cfe10df req-44672a79-191e-4b3d-9480-c8cd89cd7be5 service nova] Creating event network-changed:b2e37c0d-763d-4d54-af1f-6ef9a984b09a for instance 92103fb7-7ca6-44c1-b979-8fabb837a099 on n-h1-862769-3 Oct 28 19:12:28.603586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8869d442-4cd4-4043-9be1-2f048cfe10df req-44672a79-191e-4b3d-9480-c8cd89cd7be5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096705 Oct 28 19:12:28.604492 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 685/1373] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:28.609828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:28.620051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:28.635762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.636654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.637315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.638390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.643585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.644097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.824660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:28.833098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1254f1b9-e7ba-498f-9d0f-ad83d2b8c059 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.434554 Oct 28 19:12:28.835534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 689/1374] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:28 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:28.842424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:28.845467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:28.866487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.867708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.868333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.869266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:28.869882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:28.870592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:28.992139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.005218 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1404d4b-e1d2-46ad-99fe-0630a23b9690 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.396675 Oct 28 19:12:29.007386 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 686/1375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:28 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:29.048870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:29.059871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:29.073503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.075517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.077308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.078288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.080743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.081379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.335591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.352047 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7aa5a974-7d70-476e-bdac-da3b64fe4130 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.513730 Oct 28 19:12:29.387573 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 690/1376] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:28 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:29.435640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:29.438830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:29.455455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.456504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.457195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.458245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.459149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.460631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.510481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.522341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.529646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.531916 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c479b6e3-20d6-44bc-ac48-07bf0524f234 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.498637 Oct 28 19:12:29.533569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 687/1377] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:29 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:29.539960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:29.540998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:29.549631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.550501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.552386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.553473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.555072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.555797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.637395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.642681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:29.651619 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7aa154de-9952-40a6-9054-4c492964ac18 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.226375 Oct 28 19:12:29.657432 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 691/1378] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:29 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:29.762080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.771936 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-871330c9-72e1-4bb1-808a-23bba9d57620 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1468 microversion: 2.1 time: 0.237076 Oct 28 19:12:29.784641 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 688/1379] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:29 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1468 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:29.794962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:29.798746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5116b295-c5e9-4df5-81bb-b9571ec40351 req-8d713fbf-7ff3-41d5-bfc5-351e5716a3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571ff37-845b-48ca-b2c1-f369f3cc3de6", "name": "network-vif-plugged", "status": "completed", "tag": "f9da24c8-10ba-4166-a23f-90efc55c93d0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:29.800057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:29.800920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Searching by: {'reservation_id': 'r-dstacvxl', 'deleted': False, 'project_id': '6df42e9bda2b4307a800e2a35af177be'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:12:29.806523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.807142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.807552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.808599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.809139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.809571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.809682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5116b295-c5e9-4df5-81bb-b9571ec40351 req-8d713fbf-7ff3-41d5-bfc5-351e5716a3a5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.810215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5116b295-c5e9-4df5-81bb-b9571ec40351 req-8d713fbf-7ff3-41d5-bfc5-351e5716a3a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.810769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5116b295-c5e9-4df5-81bb-b9571ec40351 req-8d713fbf-7ff3-41d5-bfc5-351e5716a3a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.825023 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5116b295-c5e9-4df5-81bb-b9571ec40351 req-8d713fbf-7ff3-41d5-bfc5-351e5716a3a5 service nova] Creating event network-vif-plugged:f9da24c8-10ba-4166-a23f-90efc55c93d0 for instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 on n-h2-862769-3 Oct 28 19:12:29.830064 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5116b295-c5e9-4df5-81bb-b9571ec40351 req-8d713fbf-7ff3-41d5-bfc5-351e5716a3a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035573 Oct 28 19:12:29.831040 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 689/1380] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:29.866301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:29.867263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:29.876490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.877308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.878151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.879736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:29.880733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:29.881357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:29.969324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:12:30.066036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.073561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.073865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.074023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.074451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.082492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30789593-5c9d-4ee0-b6b1-ff96fcfd5293 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.222098 Oct 28 19:12:30.087427 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 690/1381] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:29 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:30.087776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.088353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:30.094319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.094847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.095270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.095971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.096424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.096851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.255982 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-32ea8820-91b8-45e5-ae65-6565edb24748 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/detail?reservation_id=r-dstacvxl" status: 200 len: 2928 microversion: 2.1 time: 0.464849 Oct 28 19:12:30.257081 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 692/1382] 10.222.0.44 () {58 vars in 1197 bytes} [Fri Oct 28 19:12:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-dstacvxl => generated 2928 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:30.283044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dcd27a10-e6d1-4657-9b83-302ea26fb479 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.287049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.296857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6fbd6612-1e39-4d52-bf91-9c5b7548737e tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1314 microversion: 2.1 time: 0.212701 Oct 28 19:12:30.297564 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 691/1383] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:30.309412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.server_groups [None req-dcd27a10-e6d1-4657-9b83-302ea26fb479 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Querying cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) for 2 instances {{(pid=120629) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 19:12:30.310122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcd27a10-e6d1-4657-9b83-302ea26fb479 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.310617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcd27a10-e6d1-4657-9b83-302ea26fb479 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.311064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcd27a10-e6d1-4657-9b83-302ea26fb479 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.340642 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dcd27a10-e6d1-4657-9b83-302ea26fb479 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups/c84d4e94-dee6-4c81-98f1-e911bfc0fb35" status: 200 len: 266 microversion: 2.1 time: 0.061541 Oct 28 19:12:30.341225 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 693/1384] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/os-server-groups/c84d4e94-dee6-4c81-98f1-e911bfc0fb35 => generated 266 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:30.351708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.352316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:30.358560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.359068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.359492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.360177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.360624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.361040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.376436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.377200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:30.383199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.383912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.384353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.385212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.385696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.386159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.557375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.564499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04c658bd-31b6-4559-8253-af71f3185937 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1619 microversion: 2.1 time: 0.216389 Oct 28 19:12:30.578358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 692/1385] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1619 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:30.578358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.578358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:30.578358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.579040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.579040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.579040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.579496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.579809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.581502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8918b8d7-dc25-481c-be42-bc1f3ceb5811 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.209458 Oct 28 19:12:30.586166 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 694/1386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:30.602026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.602026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:30.602026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:30.603497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.603984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.604412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.605148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.605594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.606009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.777653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.787232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.788700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:30.789918 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6386c26c-21fc-4314-9c75-cbfdc86b429e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1813 microversion: 2.25 time: 0.223811 Oct 28 19:12:30.790534 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 693/1387] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1813 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:30.792153 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a08afe7-073e-469c-9a43-94231af4fecd tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 200 len: 1618 microversion: 2.1 time: 0.204271 Oct 28 19:12:30.792904 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 695/1388] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 1618 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:30.798067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1434896064", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e506fab6-553b-4be6-8b83-6b486040fd9f"}], "block_device_mapping_v2": [{"uuid": "bab34492-c323-48a3-be54-4e50c23b09a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:30.798211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:30.799087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:30.805980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.806878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.807593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.808655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:30.809415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:30.810045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:30.860726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] validate_networks() for [('e506fab6-553b-4be6-8b83-6b486040fd9f', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:31.035279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:31.054850 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46d7c80f-6260-4bb7-b88b-8c680512363f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.261346 Oct 28 19:12:31.057501 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 694/1389] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:30 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:31.067588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7b03e2c-f672-41b0-b76c-c5dd35da52e4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: .version_select at 0x7f1d77dcc1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1780719381", "policies": ["anti-affinity"]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:31.103872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d7b03e2c-f672-41b0-b76c-c5dd35da52e4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:31.110318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d7b03e2c-f672-41b0-b76c-c5dd35da52e4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:31.181474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d7b03e2c-f672-41b0-b76c-c5dd35da52e4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:31.187481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d7b03e2c-f672-41b0-b76c-c5dd35da52e4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:31.211370 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7b03e2c-f672-41b0-b76c-c5dd35da52e4 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.152251 Oct 28 19:12:31.214798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 695/1390] 10.222.0.44 () {60 vars in 1174 bytes} [Fri Oct 28 19:12:31 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:31.362807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:31.363503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:31.369813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.370481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.371120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.371841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.372300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.372724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.405181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:31.406361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:31.407598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:31.408163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:31.408761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:31.436321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.436897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.437487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.438463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.438933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.439438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.460717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:31.467696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Getting quotas for user 6e2ff64ca72649d3ac2e8912da76c9af and project fcadf83882374e8d93bbf699425e501b. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:31.529424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:31.537701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c4998241-c325-4944-984c-ac1894005dc1 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.324229 Oct 28 19:12:31.538712 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 696/1391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:31 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:31.544825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:31.545137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:31.545753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:31.547572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bab34492-c323-48a3-be54-4e50c23b09a1',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:31.551901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.552449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.552886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.553666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.554022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.554439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.690982 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb8ca300-f264-46cb-9be5-932098a32ac3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896976 Oct 28 19:12:31.698678 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 696/1392] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:12:31.704390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1697596377", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5cf9e50c-5469-4246-bd0b-60b48b60870d"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:31.705385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:31.713649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8698a970-5773-4e09-9028-2536b60d873f tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1464 microversion: 2.1 time: 0.172035 Oct 28 19:12:31.727240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 697/1393] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:31 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:31.735564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:31.736370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:31.744979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.745587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.746085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.746879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.747477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.747960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.769877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:31.778721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:31.889032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a257439-3f35-478e-a92b-ac81ad7da782 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 204 len: 0 microversion: 2.1 time: 0.160448 Oct 28 19:12:31.890125 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 698/1394] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:31 2022] DELETE /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:31.895838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:31.896542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:31.902799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.903291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.903750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:31.904437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:31.905114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:31.905545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.110773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:32.111626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:32.112103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:32.112502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:32.112908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:32.125188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.128725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.129212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.129695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.130431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.130906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.131571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.146824 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d4fa478-0383-499c-bba5-c087b6898e5b tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.255173 Oct 28 19:12:32.147792 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 699/1395] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:31 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:32.153310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7265ddfa-f3af-42e1-a909-41a6a46e4739 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.154032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7265ddfa-f3af-42e1-a909-41a6a46e4739 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:32.168733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:32.173658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:32.186502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Going to run 2 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:32.189042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:32.237268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7265ddfa-f3af-42e1-a909-41a6a46e4739 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.246191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120629) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 19:12:32.247811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7265ddfa-f3af-42e1-a909-41a6a46e4739 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1053 microversion: 2.1 time: 0.098704 Oct 28 19:12:32.248902 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 700/1396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1053 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:32.269480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:32.274399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:32.317609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Calling method '.version_select at 0x7f1d77d6cd30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.326725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:32.331398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.331631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:32.331885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.332312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.355348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.356143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.356597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.357985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=3a412528-3bbb-4ab8-993b-00d4c77c9fe1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:32.376127 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-814a1b9e-e491-4351-abb9-0e510b154717 tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] 10.222.0.44 "GET /compute/v2.1/os-simple-tenant-usage/a031a8a3ae0e4f38a28c754e94c479e6?start=2022-10-27T19%3A12%3A31.730630&end=2022-10-29T19%3A12%3A31.730630" status: 200 len: 695 microversion: 2.1 time: 0.125915 Oct 28 19:12:32.376724 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 701/1397] 10.222.0.44 () {58 vars in 1412 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/os-simple-tenant-usage/a031a8a3ae0e4f38a28c754e94c479e6?start=2022-10-27T19%3A12%3A31.730630&end=2022-10-29T19%3A12%3A31.730630 => generated 695 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:32.381459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.382082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:32.388516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.389055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.389518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.390345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.390842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.391248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.409664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:32.414330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:32.447674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:32.452458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:32.490076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-208ba42d-fc05-4517-bf3d-aa350a066e01 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.789824 Oct 28 19:12:32.491374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 697/1398] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:12:32.497941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.498781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:32.506538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.507129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.507576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.508271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.508720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.509276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.536687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.546529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.548242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.549616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6821e886-fb2d-4679-b71e-840c31043529 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1803 microversion: 2.25 time: 0.171636 Oct 28 19:12:32.550186 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 702/1399] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:32.557375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.558262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:32.565810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.566567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.567266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.568187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.568850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.569484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.591437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:32.770789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.779455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.784542 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-86e489e5-726c-48c4-b9bd-7f7ecbcfca45 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1553 microversion: 2.1 time: 0.291826 Oct 28 19:12:32.785283 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 698/1400] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1553 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:32.801350 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d38c8cd-f4f2-442f-a77a-a31b58f48ed5 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.249758 Oct 28 19:12:32.802962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '.version_select at 0x7f1d77cc33a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.813461 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 703/1401] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:32.820523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.822559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.823287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.824066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.834656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:32.835367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Searching by: {'deleted': False, 'project_id': '6df42e9bda2b4307a800e2a35af177be'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:12:32.851363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.852299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.852800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.853295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.853725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.854173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.855089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.855707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.856288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.880381 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11deae20-44d0-42af-8905-ed24a231c213 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/os-simple-tenant-usage/a031a8a3ae0e4f38a28c754e94c479e6?start=2022-10-27T19%3A12%3A31.730630&end=2022-10-29T19%3A12%3A31.730630" status: 200 len: 695 microversion: 2.1 time: 0.093616 Oct 28 19:12:32.890611 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 699/1402] 10.222.0.44 () {58 vars in 1412 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/os-simple-tenant-usage/a031a8a3ae0e4f38a28c754e94c479e6?start=2022-10-27T19%3A12%3A31.730630&end=2022-10-29T19%3A12%3A31.730630 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:32.890611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:32.890611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:32.896963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.897479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.897916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.899197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:32.899655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:32.900244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:32.962939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:12:33.059505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:33.063760 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-893d80a7-0ec7-44f5-ae15-a12164364303 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.248830 Oct 28 19:12:33.064367 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 704/1403] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/servers => generated 1663 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:33.068754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2dacf2dd-f791-4f95-9b3c-db88826d0d3b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '.version_select at 0x7f1d77f72310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.070033 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5382ae1-eb28-416c-a9b1-108270c8cb66 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.187326 Oct 28 19:12:33.071562 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 700/1404] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:32 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:33.077569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7ff3ea4c-6fdb-4aad-8d01-632a757b321c req-9d8aeef5-b1cc-4c31-89dc-d262bede43b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324b1c83-3221-4bf9-a955-7a49f50b24e3", "name": "network-vif-plugged", "status": "completed", "tag": "71b2e826-c1a1-4a34-bd47-f2c9872f592b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:33.087118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dacf2dd-f791-4f95-9b3c-db88826d0d3b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.087619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dacf2dd-f791-4f95-9b3c-db88826d0d3b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.087732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7ff3ea4c-6fdb-4aad-8d01-632a757b321c req-9d8aeef5-b1cc-4c31-89dc-d262bede43b4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.088060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dacf2dd-f791-4f95-9b3c-db88826d0d3b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.088466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7ff3ea4c-6fdb-4aad-8d01-632a757b321c req-9d8aeef5-b1cc-4c31-89dc-d262bede43b4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.089128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7ff3ea4c-6fdb-4aad-8d01-632a757b321c req-9d8aeef5-b1cc-4c31-89dc-d262bede43b4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.100832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2dacf2dd-f791-4f95-9b3c-db88826d0d3b tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 4470 microversion: 2.25 time: 0.035415 Oct 28 19:12:33.101672 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 705/1405] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/os-migrations => generated 4470 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:33.115379 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7ff3ea4c-6fdb-4aad-8d01-632a757b321c req-9d8aeef5-b1cc-4c31-89dc-d262bede43b4 service nova] Creating event network-vif-plugged:71b2e826-c1a1-4a34-bd47-f2c9872f592b for instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 on n-h1-862769-3 Oct 28 19:12:33.117177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Calling method '.version_select at 0x7f1d77def670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.120597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7ff3ea4c-6fdb-4aad-8d01-632a757b321c req-9d8aeef5-b1cc-4c31-89dc-d262bede43b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047191 Oct 28 19:12:33.121382 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 701/1406] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:33.126110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.126602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.127071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.128599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9aa5a3b7-a6d8-40c9-abed-d356dcf09702 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.130581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9aa5a3b7-a6d8-40c9-abed-d356dcf09702 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.140803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:33.146210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.146720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.147354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.227169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0d00a987-9059-4fa3-a29d-4e1e6d36e58e tempest-TenantUsagesTestJSON-1412427793 tempest-TenantUsagesTestJSON-1412427793-project-admin] 10.222.0.44 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T19%3A12%3A31.730630&end=2022-10-29T19%3A12%3A31.730630&detailed=1" status: 200 len: 15726 microversion: 2.1 time: 0.120614 Oct 28 19:12:33.228767 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 706/1407] 10.222.0.44 () {58 vars in 1335 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T19%3A12%3A31.730630&end=2022-10-29T19%3A12%3A31.730630&detailed=1 => generated 15726 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:12:33.234365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.235275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.241966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.242414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.243084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.243825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.244268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.244641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.260685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9aa5a3b7-a6d8-40c9-abed-d356dcf09702 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:33.272765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9aa5a3b7-a6d8-40c9-abed-d356dcf09702 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1219 microversion: 2.1 time: 0.149900 Oct 28 19:12:33.273908 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 702/1408] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:33.288055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.288780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.297091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.297960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.298464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.299561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.300146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.300883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.447152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 3d7de605-17c2-4004-99c0-2461d81bf4b7 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:33.460682 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee5f98b0-e0cb-4930-8aa9-de35053252a3 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 2420 microversion: 2.25 time: 0.230392 Oct 28 19:12:33.461619 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 707/1409] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 2420 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:33.466662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.467382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.473447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.474087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.474819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.475797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.476415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.476993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.485155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:33.493299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5888319a-fb07-417e-be04-00dc3fe03f2c tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.218017 Oct 28 19:12:33.494196 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 703/1410] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:33.499012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.499728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.505710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.506262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.506859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.507561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.508899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.509835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.522865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:33.582518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:33.591369 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f27cb666-dab4-4128-876a-ad09f46d3ed2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1095 microversion: 2.1 time: 0.095925 Oct 28 19:12:33.592661 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 704/1411] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:33.616232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.617384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.625508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68d639ba-e083-4c5c-b2a0-bc5e309a1da9 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 204 len: 0 microversion: 2.1 time: 0.162435 Oct 28 19:12:33.625705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.626126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.626270 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 708/1412] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:33 2022] DELETE /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:33.627364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.628117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.628578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.629044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.634741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.636043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.642788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.643537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.644168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.645162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.645856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.646470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.830593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 3d7de605-17c2-4004-99c0-2461d81bf4b7 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:33.846140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:33.858114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f5780716-6a85-4d41-b3ea-c9dc793acb17 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1470 microversion: 2.1 time: 0.227410 Oct 28 19:12:33.859198 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 709/1413] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:33.871430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db671640-cf60-460c-8335-424904b1cf33 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 2420 microversion: 2.25 time: 0.255319 Oct 28 19:12:33.884142 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 705/1414] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 2420 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:12:33.885221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.885221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.885407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:33.885407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:33.885592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.885592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.885592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.885592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.886103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.886725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.899333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.909441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.909895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:33.910650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:33.911169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:33.911571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.481998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:34.490272 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77b2b1d4-da7d-42b5-8cad-86c62dab9e03 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1325 microversion: 2.1 time: 0.617134 Oct 28 19:12:34.491644 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 706/1415] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1325 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:34.497215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:34.498006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:34.498619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:34.506047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.506918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.507538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.508460 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0efc371-c07f-46d0-8533-c7b72e2bc3c0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1553 microversion: 2.1 time: 0.647591 Oct 28 19:12:34.508667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.509442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.509802 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 710/1416] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:33 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1553 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:34.510584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.515919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:34.516715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:34.525728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.527409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.528316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.530057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.530980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.532891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.606814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lazy-loading 'services' on Instance uuid 3d7de605-17c2-4004-99c0-2461d81bf4b7 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:34.691120 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c0c97215-65ed-4d56-b7ed-9f1579d816ba tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments/55811ef8-8705-4232-98ed-79a4d7289eab" status: 202 len: 0 microversion: 2.25 time: 0.197842 Oct 28 19:12:34.691810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 707/1417] 10.222.0.44 () {60 vars in 1457 bytes} [Fri Oct 28 19:12:34 2022] DELETE /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments/55811ef8-8705-4232-98ed-79a4d7289eab => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:34.698990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:34.699862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:34.706334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.706844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.707412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.708201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.708565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.708975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.801098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:34.805496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:34.810535 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68eaf575-adf5-4649-8edf-f9e8dade4f86 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1271 microversion: 2.1 time: 0.117522 Oct 28 19:12:34.826037 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 708/1418] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:34 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:34.826037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:34.826037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:34.826037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.826651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.826651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.826651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.826651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.826990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.832912 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72b7af5f-c4c3-4697-a06f-c269e538ee19 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.321784 Oct 28 19:12:34.833764 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 711/1419] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:34 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:34.838560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:34.839444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:34.870077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.870859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.871460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:34.872299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:34.874425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:34.875025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.029947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:35.042842 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-26f1f931-01f5-4a42-a63a-8e54d65c9fbd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1095 microversion: 2.1 time: 0.207754 Oct 28 19:12:35.062453 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 712/1420] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:34 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1095 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:35.069854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.074544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.081153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:35.083771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.084488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.085140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.086053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.086913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.087532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.126515 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6531b88c-47d7-4319-b237-88babdbe18f1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062407 Oct 28 19:12:35.127762 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 713/1421] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:35 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:12:35.132603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:35.136093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.136591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.142940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.143575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.144011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.144722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.145172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.145588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.146967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ff66299-6d54-4af4-914f-3269accca83e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.334708 Oct 28 19:12:35.147552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 709/1422] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:34 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:35.166607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f939cb21-4d5c-4cbe-b0f5-b326940919b2 req-9dfa2cf0-b1d8-4586-888d-bd415442e01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa203d5-e7cb-40c8-9d42-be8413b3abe0", "name": "network-vif-deleted", "tag": "2df9b8bc-b8b3-421b-a072-98080b43b82d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:35.176904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f939cb21-4d5c-4cbe-b0f5-b326940919b2 req-9dfa2cf0-b1d8-4586-888d-bd415442e01f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.177723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f939cb21-4d5c-4cbe-b0f5-b326940919b2 req-9dfa2cf0-b1d8-4586-888d-bd415442e01f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.178146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f939cb21-4d5c-4cbe-b0f5-b326940919b2 req-9dfa2cf0-b1d8-4586-888d-bd415442e01f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.196018 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f939cb21-4d5c-4cbe-b0f5-b326940919b2 req-9dfa2cf0-b1d8-4586-888d-bd415442e01f service nova] Creating event network-vif-deleted:2df9b8bc-b8b3-421b-a072-98080b43b82d for instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 on n-h1-862769-3 Oct 28 19:12:35.201180 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f939cb21-4d5c-4cbe-b0f5-b326940919b2 req-9dfa2cf0-b1d8-4586-888d-bd415442e01f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052275 Oct 28 19:12:35.201834 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 710/1423] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:35.208925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-26a95749-ed37-4084-970e-bf7d2b54d15b req-bf1b4e46-b912-454f-a245-dd04b93f45a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92103fb7-7ca6-44c1-b979-8fabb837a099", "name": "network-vif-plugged", "status": "completed", "tag": "b2e37c0d-763d-4d54-af1f-6ef9a984b09a"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:35.229936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-26a95749-ed37-4084-970e-bf7d2b54d15b req-bf1b4e46-b912-454f-a245-dd04b93f45a6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.230511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-26a95749-ed37-4084-970e-bf7d2b54d15b req-bf1b4e46-b912-454f-a245-dd04b93f45a6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.231030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-26a95749-ed37-4084-970e-bf7d2b54d15b req-bf1b4e46-b912-454f-a245-dd04b93f45a6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.242794 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-26a95749-ed37-4084-970e-bf7d2b54d15b req-bf1b4e46-b912-454f-a245-dd04b93f45a6 service nova] Creating event network-vif-plugged:b2e37c0d-763d-4d54-af1f-6ef9a984b09a for instance 92103fb7-7ca6-44c1-b979-8fabb837a099 on n-h1-862769-3 Oct 28 19:12:35.247898 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-26a95749-ed37-4084-970e-bf7d2b54d15b req-bf1b4e46-b912-454f-a245-dd04b93f45a6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044503 Oct 28 19:12:35.248519 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 711/1424] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:35.296771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:35.306483 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a1b58ba-1ec2-4aa5-80b1-288bef2479b8 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1470 microversion: 2.1 time: 0.174087 Oct 28 19:12:35.307174 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 714/1425] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:35 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:35.515434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.516267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.523383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.524095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.525416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.526712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.527323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.527918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.532447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.533292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.533460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:35.541295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.542260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.557431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.562184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.562964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.563610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.722821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:35.737432 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-159272af-d5d0-4211-933d-c19b26059025 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.210084 Oct 28 19:12:35.738019 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 715/1426] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:35 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:35.770001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:35.785670 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-715f4a83-719a-44b4-8b79-5ab980de8ec9 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1521 microversion: 2.1 time: 0.274301 Oct 28 19:12:35.786259 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 712/1427] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:35 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:35.812449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.813169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.819763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.820496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.821079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.821935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.822523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.823266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.835737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:35.836353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:35.849253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.849745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.855080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.856071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:35.856739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:35.858469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:35.885170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:36.013132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.023282 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d566890-0603-40b8-be62-1c120e9c44a7 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 204 len: 0 microversion: 2.1 time: 0.212157 Oct 28 19:12:36.025079 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d475631-33e9-4e17-a2c4-f1901a057a69 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1271 microversion: 2.1 time: 0.193790 Oct 28 19:12:36.029096 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 716/1428] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:35 2022] DELETE /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:36.042887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.044903 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 713/1429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:35 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:36.045948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.053495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.054379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.058982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.059687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.060286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.061203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.061837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.062440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.065073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.065807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.066354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.067271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.069183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.069702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.085327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:36.355097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.359313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.365542 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5036591b-340b-4757-bfaa-019f7205c973 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.333509 Oct 28 19:12:36.366150 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 717/1430] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:36.368935 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8ad08e1-1ea2-4e2a-ae5d-12b009eb4425 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1527 microversion: 2.1 time: 0.321962 Oct 28 19:12:36.370048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 714/1431] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1527 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:36.375483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.377856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.383091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.383787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.387232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.387878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.388460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.389301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.389879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.390431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.407986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.411217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.411996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.412952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.414264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.414932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.441792 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55a21900-e5e3-4162-abb8-f4aa7258532d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070328 Oct 28 19:12:36.459633 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 715/1432] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:12:36.469529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.470150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.505268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.505764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.506196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.506965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.509525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.510909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.551045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.563883 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1ae51e4a-cd6c-4613-9be7-34e823f7e5a8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1151 microversion: 2.1 time: 0.196666 Oct 28 19:12:36.567140 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 718/1433] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1151 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:36.586744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4c52665f-0584-4422-8212-7a7d86cce330 req-db40aab2-343b-41b3-9c17-fc1152db286e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571ff37-845b-48ca-b2c1-f369f3cc3de6", "name": "network-vif-deleted", "tag": "f9da24c8-10ba-4166-a23f-90efc55c93d0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:36.622185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4c52665f-0584-4422-8212-7a7d86cce330 req-db40aab2-343b-41b3-9c17-fc1152db286e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.628594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4c52665f-0584-4422-8212-7a7d86cce330 req-db40aab2-343b-41b3-9c17-fc1152db286e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.629038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4c52665f-0584-4422-8212-7a7d86cce330 req-db40aab2-343b-41b3-9c17-fc1152db286e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.650218 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4c52665f-0584-4422-8212-7a7d86cce330 req-db40aab2-343b-41b3-9c17-fc1152db286e service nova] Creating event network-vif-deleted:f9da24c8-10ba-4166-a23f-90efc55c93d0 for instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 on n-h2-862769-3 Oct 28 19:12:36.656643 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4c52665f-0584-4422-8212-7a7d86cce330 req-db40aab2-343b-41b3-9c17-fc1152db286e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087757 Oct 28 19:12:36.657251 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 719/1434] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:36.664201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.665150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.672096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.672584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.673003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.673704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.674147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.674561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.732383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.733434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.734827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.735820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lazy-loading 'fault' on Instance uuid c571ff37-845b-48ca-b2c1-f369f3cc3de6 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:36.798572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71684a5c1374e97924b3fce4206907b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a031a8a3ae0e4f38a28c754e94c479e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.811708 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ee77b75-875f-40a9-86fc-3bcf3f61274d tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 200 len: 1304 microversion: 2.1 time: 0.153072 Oct 28 19:12:36.812307 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 720/1435] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:36.813701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.816891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:36.817534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:36.829262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.829758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.830179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-60919bc1-15db-472e-bec1-1ad4eac4c5dd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.365940 Oct 28 19:12:36.830293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.830870 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 716/1436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:36.831008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:36.831388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:36.831814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:36.938018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:36.949466 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-863da923-bddc-4cfd-bd5f-c79fce9f562b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.135550 Oct 28 19:12:36.951365 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 721/1437] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:36 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:37.052186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.052965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.059910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.060540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.061065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.061853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.062398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.062934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.129953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:37.138390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a0ed47c-3540-483c-bbcc-efa2360f43fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1277 microversion: 2.1 time: 0.092216 Oct 28 19:12:37.139244 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 717/1438] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:37.411567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.418014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.418735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.423454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.435441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.436477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.437105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.438077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.438726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.439379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.443750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.453295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.456505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.457252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.457820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.458802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.694539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:37.711531 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e36051a-c567-43e8-a5bb-97ccc749ed9a tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1527 microversion: 2.1 time: 0.296011 Oct 28 19:12:37.712210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 718/1439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1527 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:37.721082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.730288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.750948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.751786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.752409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.754681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.756502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:37.757166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.757608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.765039 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cdb52a12-cd06-4784-9881-04f44324e547 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.365316 Oct 28 19:12:37.778981 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 722/1440] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:37.778981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.778981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.800259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.802549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.803350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.809103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.809900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.810519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.829572 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71c8fc00-69b1-4933-ba64-4265af7ccaf7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111811 Oct 28 19:12:37.829572 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 719/1441] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:12:37.843051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.843757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] [instance: c571ff37-845b-48ca-b2c1-f369f3cc3de6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.852418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.852966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.853788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.855820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.856526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.857163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.874875 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] HTTP exception thrown: Instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 could not be found. Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Request method failure captured: Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 HTTP/1.1 Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCmJY7zA-B9CgFSiSm3g0yc1l03FiQLLug61BAOI9CUiN0WrLurFcDr2k4uZIuYtElKy-zeE7DwLkbWjVCxn356kJ72dnz1q95v6bhkbxk6SnS7f3iQe0tt1i_Zmc6_0h7WmTvQCfOXHsr5udCQWkQ-W_ansa87Gt3HWfYTqBknRfGw Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: a031a8a3ae0e4f38a28c754e94c479e6 Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TenantUsagesTestJSON-1117755089 Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:37.876830 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a031a8a3ae0e4f38a28c754e94c479e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a031a8a3ae0e4f38a28c754e94c479e6", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a031a8a3ae0e4f38a28c754e94c479e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a031a8a3ae0e4f38a28c754e94c479e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TenantUsagesTestJSON-1117755089 Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: a031a8a3ae0e4f38a28c754e94c479e6 Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1117755089 Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TenantUsagesTestJSON-1117755089-project Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c71684a5c1374e97924b3fce4206907b Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TenantUsagesTestJSON-1117755089-project Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 could not be found. Oct 28 19:12:37.878447 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c571ff37-845b-48ca-b2c1-f369f3cc3de6'} Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 could not be found. Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:37.879425 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 could not be found. Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 could not be found. Oct 28 19:12:37.880956 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:37.884899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] Returning 404 to user: Instance c571ff37-845b-48ca-b2c1-f369f3cc3de6 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:37.886237 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a729019-e3b4-4da0-a311-e76bd9c94232 tempest-TenantUsagesTestJSON-1117755089 tempest-TenantUsagesTestJSON-1117755089-project] 10.222.0.44 "GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6" status: 404 len: 111 microversion: 2.1 time: 0.051354 Oct 28 19:12:37.887351 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 720/1442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/c571ff37-845b-48ca-b2c1-f369f3cc3de6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:37.900724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.903999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.920058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.921175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.923470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.925514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.926577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.927365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.928623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:37.938507 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21e4b360-1faa-4c3e-9763-527232b31b79 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1151 microversion: 2.1 time: 0.170641 Oct 28 19:12:37.944396 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 723/1443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1151 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:37.977197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:37.978229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:37.987830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.989417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.990049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:37.992110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:37.993133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:37.995548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.130507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:38.140650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f6403e7a-902a-4c46-a44a-904fc4c9fcce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.167666 Oct 28 19:12:38.141748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 724/1444] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:38.163141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:38.164103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:38.171646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.172435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.173087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.174002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.174665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.175388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.377672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:38.388309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4869e5e1-3225-4e54-a955-28ccf379e349 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1322 microversion: 2.1 time: 0.499683 Oct 28 19:12:38.395383 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 721/1445] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:37 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:38.500909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:38.508869 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4a6ed72b-6716-406f-898a-890e86849ead tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1319 microversion: 2.1 time: 0.350040 Oct 28 19:12:38.509980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 725/1446] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:38 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:38.738476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:38.739126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:38.750081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.755027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.755736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.756734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.759226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.759894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.788669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:38.789286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:38.798033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.798517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.803110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:38.804186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:38.807308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:38.808005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.095837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:39.109293 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1df1194-df29-422c-b7cf-2640abe6f664 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.324769 Oct 28 19:12:39.112534 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 726/1447] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:38 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:39.119279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:39.122495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:39.133327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:39.153928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0a8c2399-ec8b-4135-b6ac-c4585a3b1fd6 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1527 microversion: 2.1 time: 0.419218 Oct 28 19:12:39.162473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.164509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.164951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.167080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.167572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.169241 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 722/1448] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:38 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1527 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:39.172727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.182942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:39.184760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:39.195355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.196508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.197284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.198455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.199141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.200162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.298947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f88a503-7384-4ac8-bdda-588bc809d958 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.183949 Oct 28 19:12:39.307020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 727/1449] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:39 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:12:39.317185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:39.317888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:39.327605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.328159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.329101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.329863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.330386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.330935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.357346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:39.369164 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdbbfd02-8956-41f5-8fe2-f2111d1fb995 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1159 microversion: 2.1 time: 0.193251 Oct 28 19:12:39.388333 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 723/1450] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:39 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1159 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:39.422598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:39.423250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:39.432773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.433295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.433702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.434413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.434882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.435302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.637856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:39.665425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44ced092-c250-4089-b7f9-4aa925f2908c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.339185 Oct 28 19:12:39.666350 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 728/1451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:39 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:39.675574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:39.676404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:39.699971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.710530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.711184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.712107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.712718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.713293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.808953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:39.818957 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8ce861bd-d216-4fb4-8257-7c02117b8606 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1472 microversion: 2.1 time: 0.401073 Oct 28 19:12:39.820158 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 724/1452] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:39 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:39.838096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0d245f0c-4391-4e0d-bdbd-c65835a4cab2 req-e7519f7f-3b93-40b8-bc9c-f7eff130cfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324b1c83-3221-4bf9-a955-7a49f50b24e3", "name": "network-vif-deleted", "tag": "71b2e826-c1a1-4a34-bd47-f2c9872f592b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:39.848301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d245f0c-4391-4e0d-bdbd-c65835a4cab2 req-e7519f7f-3b93-40b8-bc9c-f7eff130cfd5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.849077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d245f0c-4391-4e0d-bdbd-c65835a4cab2 req-e7519f7f-3b93-40b8-bc9c-f7eff130cfd5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.849565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d245f0c-4391-4e0d-bdbd-c65835a4cab2 req-e7519f7f-3b93-40b8-bc9c-f7eff130cfd5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.868818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0d245f0c-4391-4e0d-bdbd-c65835a4cab2 req-e7519f7f-3b93-40b8-bc9c-f7eff130cfd5 service nova] Creating event network-vif-deleted:71b2e826-c1a1-4a34-bd47-f2c9872f592b for instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 on n-h1-862769-3 Oct 28 19:12:39.876664 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0d245f0c-4391-4e0d-bdbd-c65835a4cab2 req-e7519f7f-3b93-40b8-bc9c-f7eff130cfd5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043566 Oct 28 19:12:39.877785 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 725/1453] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:39.884245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a686f4ca-ab06-4bfb-967b-3d908f48388d req-56979d51-1984-451b-aabb-641171039f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb07761-6ab1-4425-8ede-fb2233b545b5", "tag": "d0f956cd-c0fc-4a74-9d86-37bf400e37a4"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:39.897031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a686f4ca-ab06-4bfb-967b-3d908f48388d req-56979d51-1984-451b-aabb-641171039f70 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.898037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a686f4ca-ab06-4bfb-967b-3d908f48388d req-56979d51-1984-451b-aabb-641171039f70 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.898681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a686f4ca-ab06-4bfb-967b-3d908f48388d req-56979d51-1984-451b-aabb-641171039f70 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.912543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a686f4ca-ab06-4bfb-967b-3d908f48388d req-56979d51-1984-451b-aabb-641171039f70 service nova] Creating event network-changed:d0f956cd-c0fc-4a74-9d86-37bf400e37a4 for instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 on n-h2-862769-3 Oct 28 19:12:39.918887 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a686f4ca-ab06-4bfb-967b-3d908f48388d req-56979d51-1984-451b-aabb-641171039f70 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038984 Oct 28 19:12:39.920118 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 726/1454] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:39.927456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:39.928359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:39.935191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.936299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.936996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.937995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:39.938703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:39.939273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:39.945110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:39.956261 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36448a22-290f-463d-97e7-c513271da381 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1319 microversion: 2.1 time: 0.287382 Oct 28 19:12:39.957087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 729/1455] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:39 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:39.993627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lazy-loading 'flavor' on Instance uuid 92103fb7-7ca6-44c1-b979-8fabb837a099 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:40.104185 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69ed3f84-afca-476e-9ba8-93b0cb310b7e tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099/action" status: 202 len: 0 microversion: 2.1 time: 0.182020 Oct 28 19:12:40.104893 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 727/1456] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:39 2022] POST /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:40.113130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.114474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.121588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.122562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.123386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.124453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.125146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.125824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.133766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.135308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.148936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.149828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.150479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.155677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.156496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.157170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.784028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:40.806656 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e837f114-c58e-4978-bac1-33cd92d40328 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.676131 Oct 28 19:12:40.807630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 728/1457] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:40 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:40.819028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:40.819662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:40.851709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.854922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.855650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.857206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.857906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.861626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.872556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:40.935616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:40.936371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:40.936967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:40.937563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lazy-loading 'fault' on Instance uuid 324b1c83-3221-4bf9-a955-7a49f50b24e3 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:41.062332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8222e34ca7794fa686f94cc2b220c4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396065b7b553417d9ad5022d9e57404c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:41.073504 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2ab4ee6-c590-47ab-b01d-cfff639c5081 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 200 len: 1315 microversion: 2.1 time: 0.263798 Oct 28 19:12:41.082731 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 729/1458] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:40 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:41.105483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:41.109154 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e7aecd40-b200-42fc-ada3-0655f2ae156b tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1631 microversion: 2.1 time: 0.998156 Oct 28 19:12:41.111051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:41.111581 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 730/1459] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:40 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1631 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:41.123188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:41.123927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:41.126819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.127310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.127737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.131921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.132424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.132851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.140934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.142809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.143269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.143984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.145424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.146101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.284025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67bde1e1-e2ce-4aa9-a5a3-bfe6e997839b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.202404 Oct 28 19:12:41.287090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 730/1460] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:41 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:12:41.315721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:41.316394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:41.333677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.341844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.342168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.343437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.344054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.346770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.576550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:41.588741 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea0c2adf-5b81-4f3e-a7ea-1e2b2b2e9169 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.294289 Oct 28 19:12:41.589636 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 731/1461] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:41 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:41.616256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:41.618714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:41.631160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.632252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.632252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.635415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.636458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.637337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.736098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:41.747945 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-417e8d12-4419-4104-85bc-315780005205 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.635185 Oct 28 19:12:41.751029 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 731/1462] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:41 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:41.829496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:41.831457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:41.847261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.848356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.854056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.854970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:41.855535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:41.858189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:41.918764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:41.927322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-19467b08-81b2-40ec-b8a8-eea10aef8105 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1319 microversion: 2.1 time: 0.322332 Oct 28 19:12:41.932365 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 732/1463] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:41 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:42.100711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.101394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: 324b1c83-3221-4bf9-a955-7a49f50b24e3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.117116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.117817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.118269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.119038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.119495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.119958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.150392 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 could not be found. Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 HTTP/1.1 Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:42.152143 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 could not be found. Oct 28 19:12:42.153719 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '324b1c83-3221-4bf9-a955-7a49f50b24e3'} Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 could not be found. Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.154632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 could not be found. Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 could not be found. Oct 28 19:12:42.156816 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.158118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance 324b1c83-3221-4bf9-a955-7a49f50b24e3 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.158351 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e24314cb-25f8-4495-88d0-6ea829e2f220 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3" status: 404 len: 111 microversion: 2.1 time: 0.057536 Oct 28 19:12:42.158986 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 733/1464] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/324b1c83-3221-4bf9-a955-7a49f50b24e3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:12:42.165713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.173553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.191547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.192411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.193042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.194012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.194624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.195228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.247832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:42.336968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:42.353642 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa734f74-b750-4d1a-8be9-97513baf28cb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.527993 Oct 28 19:12:42.354585 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 732/1465] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:41 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:42.361290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d24cdb7-999e-4b2b-b995-7cb8e6911571 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '.version_select at 0x7f1d7c44a670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.402030 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0d24cdb7-999e-4b2b-b995-7cb8e6911571 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Image not found. Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d24cdb7-999e-4b2b-b995-7cb8e6911571 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07 HTTP/1.1 Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:42.404381 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd7821d8f-28c4-4f20-8bbe-004631733e07'} Oct 28 19:12:42.405766 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d7821d8f-28c4-4f20-8bbe-004631733e07 to delete Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.406567 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7821d8f-28c4-4f20-8bbe-004631733e07 could not be found. Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.407864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:12:42.409070 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.411533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d24cdb7-999e-4b2b-b995-7cb8e6911571 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.419767 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0d24cdb7-999e-4b2b-b995-7cb8e6911571 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07" status: 404 len: 62 microversion: 2.1 time: 0.063516 Oct 28 19:12:42.421387 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 733/1466] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] DELETE /compute/v2.1/images/d7821d8f-28c4-4f20-8bbe-004631733e07 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:12:42.426814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.434001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.452500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.453544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.454209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.455214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.455885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.456517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.526818 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7c844813-e768-41c0-9d72-8ab2c8bbf5da tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.101447 Oct 28 19:12:42.528148 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 734/1467] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:42.532882 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94c67264-30c1-4f5a-89c3-4070b7641147 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1614 microversion: 2.1 time: 0.372633 Oct 28 19:12:42.539884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 734/1468] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1614 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:42.544612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.545355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.562754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.563268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.563740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.564149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:42.564803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.565007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.565597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.566684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.583412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.583917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.584345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.584737 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.585056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 HTTP/1.1 Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:42.586504 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.587902 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'cf731e0d-b279-4f5a-8942-113c77ac2777'} Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.588750 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.591036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.592293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.592293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.592465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.592465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd9f58c9-dbb4-4a40-8516-6502e951e00e tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 404 len: 111 microversion: 2.1 time: 0.059847 Oct 28 19:12:42.592465 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 735/1469] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:42 2022] DELETE /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:42.598316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.599359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: cf731e0d-b279-4f5a-8942-113c77ac2777] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.605460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.607647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.608154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.608872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.609491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.609913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.615396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:42.627683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 HTTP/1.1 Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:42.630900 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.632278 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'cf731e0d-b279-4f5a-8942-113c77ac2777'} Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.633027 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. Oct 28 19:12:42.634246 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.637594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance cf731e0d-b279-4f5a-8942-113c77ac2777 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.638738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af90a34f-dd29-475f-9cf9-6511a0d727c0 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777" status: 404 len: 111 microversion: 2.1 time: 0.044458 Oct 28 19:12:42.643273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 736/1470] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/cf731e0d-b279-4f5a-8942-113c77ac2777 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:42.650111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.651191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.660639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.663263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.664108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.665149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.665891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.666613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.691242 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] HTTP exception thrown: Cannot 'migrate' instance 92103fb7-7ca6-44c1-b979-8fabb837a099 while it is in vm_state suspended Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Request method failure captured: Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099/action HTTP/1.1 Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 15 Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCl4Ad6bo8zu5uketGQrZDdOvA5dDZY6C3ADBbIZir_drHpfWHjuI1j6RfbaNMpNoIcPG-JlhgCeQQBZrfom9JHWmgXabxS9jCZSuC2srljUjFqPCNCVorHmhSNNxAIdLf_rS-Kx4IpLs9PEl9ecMiWmUTQQN9XOm9BG1h8ygJ8ZCog Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:12:42.693111 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ff03ef747c94ed08f38f06c2c5bd664", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8d7d9855d2bd4df49ed4ecaf9726db5f Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: {"migrate": {}} Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:42.694472 n-d-862769-3 devstack@n-api.service[120629]: exception: Cannot 'migrate' instance 92103fb7-7ca6-44c1-b979-8fabb837a099 while it is in vm_state suspended Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '92103fb7-7ca6-44c1-b979-8fabb837a099', 'body': {'migrate': {}}} Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 in vm_state suspended. Cannot resize while the instance is in this state. Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.695368 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 92103fb7-7ca6-44c1-b979-8fabb837a099 while it is in vm_state suspended Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.697220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 92103fb7-7ca6-44c1-b979-8fabb837a099 while it is in vm_state suspended Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Returning 409 to user: Cannot 'migrate' instance 92103fb7-7ca6-44c1-b979-8fabb837a099 while it is in vm_state suspended {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-136a0f29-a5fc-4571-a68b-3005df0441d0 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099/action" status: 409 len: 148 microversion: 2.1 time: 0.134869 Oct 28 19:12:42.698546 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 735/1471] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:42 2022] POST /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099/action => generated 148 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:12:42.713414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b3bf866-f761-4016-a86e-c6d68860c8ae tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '.version_select at 0x7f1d77c52e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.754378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b3bf866-f761-4016-a86e-c6d68860c8ae tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698654127" status: 202 len: 0 microversion: 2.1 time: 0.053811 Oct 28 19:12:42.759517 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 736/1472] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:12:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698654127 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:42.767433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0aa4337-1151-496b-abeb-3771344be714 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0aa4337-1151-496b-abeb-3771344be714 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Request method failure captured: Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c/action HTTP/1.1 Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 39 Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCl4Ad6bo8zu5uketGQrZDdOvA5dDZY6C3ADBbIZir_drHpfWHjuI1j6RfbaNMpNoIcPG-JlhgCeQQBZrfom9JHWmgXabxS9jCZSuC2srljUjFqPCNCVorHmhSNNxAIdLf_rS-Kx4IpLs9PEl9ecMiWmUTQQN9XOm9BG1h8ygJ8ZCog Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:12:42.775704 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ff03ef747c94ed08f38f06c2c5bd664", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8d7d9855d2bd4df49ed4ecaf9726db5f Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: {"os-resetState": {"state": "invalid"}} Oct 28 19:12:42.777173 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'b01cc84a-8c24-46d3-bba7-37691ccdef7c', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.777995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:12:42.779419 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 19:12:42.780688 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.780688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0aa4337-1151-496b-abeb-3771344be714 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.780688 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e0aa4337-1151-496b-abeb-3771344be714 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c/action" status: 400 len: 144 microversion: 2.1 time: 0.015752 Oct 28 19:12:42.783294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 737/1473] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:42 2022] POST /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:42.789932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.790923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.801461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:42.807944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.809284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.810166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.811216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.812023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.814474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.819620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c3ef6c9-7936-4c69-a114-fb113aa14ba6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.173999 Oct 28 19:12:42.824919 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 737/1474] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:42.831038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5105463e-81f0-4a3a-858f-e22d0478f083 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5105463e-81f0-4a3a-858f-e22d0478f083 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Request method failure captured: Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c/action HTTP/1.1 Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 31 Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCl4Ad6bo8zu5uketGQrZDdOvA5dDZY6C3ADBbIZir_drHpfWHjuI1j6RfbaNMpNoIcPG-JlhgCeQQBZrfom9JHWmgXabxS9jCZSuC2srljUjFqPCNCVorHmhSNNxAIdLf_rS-Kx4IpLs9PEl9ecMiWmUTQQN9XOm9BG1h8ygJ8ZCog Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:12:42.838554 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ff03ef747c94ed08f38f06c2c5bd664", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8d7d9855d2bd4df49ed4ecaf9726db5f Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: {"os-resetState": {"state": 1}} Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:42.840181 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'b01cc84a-8c24-46d3-bba7-37691ccdef7c', 'body': {'os-resetState': {'state': 1}}} Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 1 Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.841143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 19:12:42.844861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.849001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5105463e-81f0-4a3a-858f-e22d0478f083 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.852333 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5105463e-81f0-4a3a-858f-e22d0478f083 tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c/action" status: 400 len: 120 microversion: 2.1 time: 0.023392 Oct 28 19:12:42.860594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 738/1475] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:42 2022] POST /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c/action => generated 120 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:12:42.867272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f281d7d2-c730-46bd-9eb1-a07c5525ec8d tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:42.869068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:42.886477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f281d7d2-c730-46bd-9eb1-a07c5525ec8d tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Failed to fetch instance by id 999 {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:12:42.890392 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f281d7d2-c730-46bd-9eb1-a07c5525ec8d tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f281d7d2-c730-46bd-9eb1-a07c5525ec8d tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Request method failure captured: Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 37 Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCl4Ad6bo8zu5uketGQrZDdOvA5dDZY6C3ADBbIZir_drHpfWHjuI1j6RfbaNMpNoIcPG-JlhgCeQQBZrfom9JHWmgXabxS9jCZSuC2srljUjFqPCNCVorHmhSNNxAIdLf_rS-Kx4IpLs9PEl9ecMiWmUTQQN9XOm9BG1h8ygJ8ZCog Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:12:42.900401 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ff03ef747c94ed08f38f06c2c5bd664", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ff03ef747c94ed08f38f06c2c5bd664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ff03ef747c94ed08f38f06c2c5bd664 Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1735630066 Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8d7d9855d2bd4df49ed4ecaf9726db5f Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1735630066-project-admin Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: {"os-resetState": {"state": "error"}} Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:42.902116 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 999 could not be found. Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:12:42.903083 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 19:12:42.904618 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:42.907330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f281d7d2-c730-46bd-9eb1-a07c5525ec8d tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:42.909225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f281d7d2-c730-46bd-9eb1-a07c5525ec8d tempest-ServersAdminNegativeTestJSON-1735630066 tempest-ServersAdminNegativeTestJSON-1735630066-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.047025 Oct 28 19:12:42.915426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 739/1476] 10.222.0.44 () {60 vars in 1179 bytes} [Fri Oct 28 19:12:42 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:12:42.929323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:42.930195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:42.943611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.944116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.947117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:42.948217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:42.950562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:42.951208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.011806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:43.147970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:43.252944 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e2c5a6e-dbfd-4b74-9a52-a6d032d8db5e tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "DELETE /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 204 len: 0 microversion: 2.1 time: 0.332302 Oct 28 19:12:43.257070 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 740/1477] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:42 2022] DELETE /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:43.266545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=32 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:43.268153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:43.270725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:43.280878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.281870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.282566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.283787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.285755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.286570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.318132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:43.326499 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f2a6e18-b8c9-45cf-93ab-2cebc619c3cc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.540862 Oct 28 19:12:43.330117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 738/1478] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:42 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:43.562840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-59505a92-fe5a-4100-8674-947fe2b139a6 req-3bedfa89-6e52-423c-b9f0-e751210f645b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de6e746-f4fd-4836-aea6-47e0b2a77299", "tag": "32537282-2078-4847-bf75-4c4118af189d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:43.578717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-59505a92-fe5a-4100-8674-947fe2b139a6 req-3bedfa89-6e52-423c-b9f0-e751210f645b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.580060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-59505a92-fe5a-4100-8674-947fe2b139a6 req-3bedfa89-6e52-423c-b9f0-e751210f645b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.580744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-59505a92-fe5a-4100-8674-947fe2b139a6 req-3bedfa89-6e52-423c-b9f0-e751210f645b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.603452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-59505a92-fe5a-4100-8674-947fe2b139a6 req-3bedfa89-6e52-423c-b9f0-e751210f645b service nova] Creating event network-changed:32537282-2078-4847-bf75-4c4118af189d for instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 on n-h1-862769-3 Oct 28 19:12:43.615178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-59505a92-fe5a-4100-8674-947fe2b139a6 req-3bedfa89-6e52-423c-b9f0-e751210f645b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278507 Oct 28 19:12:43.618510 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 739/1479] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:43.624501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:43.629837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:43.642606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.649592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.650129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.651148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.651686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.652175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.697597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:43.707077 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-abc67941-ff73-4a5c-9b17-75828bfb22ea tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1319 microversion: 2.1 time: 0.447788 Oct 28 19:12:43.707661 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 741/1480] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:43 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:43.714324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:43.715366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:43.722613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.723470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.724101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.725156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:43.725798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:43.726407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:43.969804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:43.985027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-376488e9-8bc8-4616-b70f-843ac3dcf3a8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.275264 Oct 28 19:12:44.001752 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 742/1481] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:43 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:44.006064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.006860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:44.007977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:44.016024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.016521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.016955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.017669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.018178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.018604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.020032 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a485ac5-9713-438e-b5de-dff9c5408186 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1469 microversion: 2.1 time: 0.400198 Oct 28 19:12:44.034791 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 740/1482] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:43 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:44.107135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:44.116551 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bbb5bb09-0742-4424-aaaa-4c25f5107667 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.123000 Oct 28 19:12:44.117142 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 743/1483] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:43 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:44.338255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3bcd5947-2869-4ea2-9e3f-f0f9b065c431 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '.version_select at 0x7f1d77bcbca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.362600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.363865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:44.372656 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3bcd5947-2869-4ea2-9e3f-f0f9b065c431 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Image not found. Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3bcd5947-2869-4ea2-9e3f-f0f9b065c431 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/c57ac86c-4263-4922-8a80-da0e80c3f0cd HTTP/1.1 Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:44.374535 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c57ac86c-4263-4922-8a80-da0e80c3f0cd'} Oct 28 19:12:44.375915 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c57ac86c-4263-4922-8a80-da0e80c3f0cd to delete Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.376746 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c57ac86c-4263-4922-8a80-da0e80c3f0cd could not be found. Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:44.377876 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3bcd5947-2869-4ea2-9e3f-f0f9b065c431 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:44.380205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3bcd5947-2869-4ea2-9e3f-f0f9b065c431 tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/images/c57ac86c-4263-4922-8a80-da0e80c3f0cd" status: 404 len: 62 microversion: 2.1 time: 0.042802 Oct 28 19:12:44.382201 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 741/1484] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:44 2022] DELETE /compute/v2.1/images/c57ac86c-4263-4922-8a80-da0e80c3f0cd => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:12:44.383455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.384170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.384414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.384907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:44.385229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.386194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.386927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.387549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.401343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.401846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.402303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.403205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.403660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.404115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.435951 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac HTTP/1.1 Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:44.437769 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.439167 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac'} Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:44.439938 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.441143 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.443754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:44.444787 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0db59ad1-e41d-4869-baa9-5003cee9301f tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 404 len: 111 microversion: 2.1 time: 0.064057 Oct 28 19:12:44.445847 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 742/1485] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:44 2022] DELETE /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:12:44.458126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.458781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] [instance: aba9cd8c-5182-44fc-b42f-b385b586e9ac] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:44.467812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.468675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.469602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.470679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.471437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.472206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.492721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] HTTP exception thrown: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Request method failure captured: Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac HTTP/1.1 Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClCqLp8lAGlP5FE6BYQHWmhWLvAtIzqVPaFnL9ORi2V1O7A5cPA17qDcFdfAoHvxnmHDXmzQEuhFJULsHeZG5eK-RWVvFi3w24WaRJmLAkn4XOOd6_WZVp_xQa7vo3hNfPb_dbVgFJnf0Vwdb_GCN8C41qmAwFpiljDwk-9rc1zdLY Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:44.495214 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_396065b7b553417d9ad5022d9e57404c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/396065b7b553417d9ad5022d9e57404c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 396065b7b553417d9ad5022d9e57404c Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393 Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8222e34ca7794fa686f94cc2b220c4e3 Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2002208393-project Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.496588 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aba9cd8c-5182-44fc-b42f-b385b586e9ac'} Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:44.497436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. Oct 28 19:12:44.498713 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:44.501984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] Returning 404 to user: Instance aba9cd8c-5182-44fc-b42f-b385b586e9ac could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:44.503554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2e2c0e7f-352d-4191-b113-eacdd8e9585c tempest-ImagesOneServerNegativeTestJSON-2002208393 tempest-ImagesOneServerNegativeTestJSON-2002208393-project] 10.222.0.44 "GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac" status: 404 len: 111 microversion: 2.1 time: 0.051458 Oct 28 19:12:44.527122 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 743/1486] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:44 2022] GET /compute/v2.1/servers/aba9cd8c-5182-44fc-b42f-b385b586e9ac => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:44.729513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:44.730165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:44.746622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.747067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.747501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:44.748206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:44.748655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:44.749070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.297927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:45.312349 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc8e874f-991d-4140-b1a1-239d3b1bacb8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.958967 Oct 28 19:12:45.313037 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 744/1487] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:44 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:45.324240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:45.324970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:45.340509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.341063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.341539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.343727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.346425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.346929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.672914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:45.683826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a00ab9da-2f63-4b23-8933-4b716352daea tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.369627 Oct 28 19:12:45.694290 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 745/1488] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:45 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:45.701443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:45.702054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:45.708865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.709447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.709883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:45.710579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:45.711117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:45.711531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.227324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.247480 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e4a8ac5-861f-48ea-8c4c-ca8d65d43801 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1319 microversion: 2.1 time: 1.521567 Oct 28 19:12:46.248761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 744/1489] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:44 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1319 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:46.255498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.256892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.266136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.267152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.267939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.269839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.270511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.271707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.287366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.300760 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87dbab69-b71f-4e62-8a39-0e9fd0332cd8 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1469 microversion: 2.1 time: 0.610251 Oct 28 19:12:46.301922 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 746/1490] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:45 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:46.339831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.340488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.347066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.347554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.347981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.348685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.349127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.349538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.623175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.644695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8d5001c-4af5-4700-aac1-e1962be6923d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.394374 Oct 28 19:12:46.648167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 745/1491] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:46 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:46.711369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:46.712508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:46.730762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.735916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.736775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.737811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:46.738521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:46.739225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:46.860572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:46.875057 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-16eb0ebd-9b93-449c-80fe-1cf3b6d2fbe3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.539368 Oct 28 19:12:46.875656 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 747/1492] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:46 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:47.037285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-abb965c5-c9f3-47ab-bfd3-ee8401469554 req-d623739e-9256-4997-8d47-c2b5e3be7195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb07761-6ab1-4425-8ede-fb2233b545b5", "name": "network-vif-plugged", "status": "completed", "tag": "d0f956cd-c0fc-4a74-9d86-37bf400e37a4"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:47.056614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-abb965c5-c9f3-47ab-bfd3-ee8401469554 req-d623739e-9256-4997-8d47-c2b5e3be7195 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.057169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-abb965c5-c9f3-47ab-bfd3-ee8401469554 req-d623739e-9256-4997-8d47-c2b5e3be7195 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.057604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-abb965c5-c9f3-47ab-bfd3-ee8401469554 req-d623739e-9256-4997-8d47-c2b5e3be7195 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.088983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-abb965c5-c9f3-47ab-bfd3-ee8401469554 req-d623739e-9256-4997-8d47-c2b5e3be7195 service nova] Creating event network-vif-plugged:d0f956cd-c0fc-4a74-9d86-37bf400e37a4 for instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 on n-h2-862769-3 Oct 28 19:12:47.098627 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-abb965c5-c9f3-47ab-bfd3-ee8401469554 req-d623739e-9256-4997-8d47-c2b5e3be7195 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066568 Oct 28 19:12:47.099281 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 748/1493] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:47.154611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-1e9215ce-54bb-4dee-a5b2-32b8279a6d69 req-4cad9fa2-7bac-4326-9d70-69b870187c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92103fb7-7ca6-44c1-b979-8fabb837a099", "name": "network-vif-deleted", "tag": "b2e37c0d-763d-4d54-af1f-6ef9a984b09a"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:47.207926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1e9215ce-54bb-4dee-a5b2-32b8279a6d69 req-4cad9fa2-7bac-4326-9d70-69b870187c2e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.208574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1e9215ce-54bb-4dee-a5b2-32b8279a6d69 req-4cad9fa2-7bac-4326-9d70-69b870187c2e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.209018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1e9215ce-54bb-4dee-a5b2-32b8279a6d69 req-4cad9fa2-7bac-4326-9d70-69b870187c2e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.259291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-1e9215ce-54bb-4dee-a5b2-32b8279a6d69 req-4cad9fa2-7bac-4326-9d70-69b870187c2e service nova] Creating event network-vif-deleted:b2e37c0d-763d-4d54-af1f-6ef9a984b09a for instance 92103fb7-7ca6-44c1-b979-8fabb837a099 on n-h1-862769-3 Oct 28 19:12:47.266297 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-1e9215ce-54bb-4dee-a5b2-32b8279a6d69 req-4cad9fa2-7bac-4326-9d70-69b870187c2e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128443 Oct 28 19:12:47.269326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 749/1494] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:47.284868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:47.286145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:47.294763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.295707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.297461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.298484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.299389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.300077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.535488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:47.547852 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-541d6e82-637d-4ba9-9483-b332b66c8790 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.841149 Oct 28 19:12:47.549057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 746/1495] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:46 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:47.555589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:47.556381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:47.584105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.584999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.586130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.587845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.588569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.589229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.636444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.636948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.637387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.637833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lazy-loading 'fault' on Instance uuid 92103fb7-7ca6-44c1-b979-8fabb837a099 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:47.801485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:47.813494 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b147fd63-92f3-4811-8e42-2f93d7f447b5 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 200 len: 1312 microversion: 2.1 time: 0.263121 Oct 28 19:12:47.845642 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 747/1496] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:47 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:47.894639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:47.898607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:47.900431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:47.908794 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec96be99-1ad0-4be4-a8f3-a693b4f011ca tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1319 microversion: 2.1 time: 0.630598 Oct 28 19:12:47.916512 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 750/1497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:47 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:47.927614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:47.928245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:47.933390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.933926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.935273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.938046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.939925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.940325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.940825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.941259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.941581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:47.942123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:47.942578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:47.947200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.271405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:48.281211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-da40db43-70af-4814-882f-063b549492ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 200 len: 1345 microversion: 2.1 time: 0.433352 Oct 28 19:12:48.286992 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 748/1498] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:47 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 1345 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:48.578424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:48.580247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:48.592660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:48.593305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:48.593738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.594437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:48.596066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:48.601934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.618611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:48.635547 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c222a605-1950-4a50-8111-3479911c6297 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.717621 Oct 28 19:12:48.638577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 751/1499] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:47 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:48.847683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:48.848342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: 92103fb7-7ca6-44c1-b979-8fabb837a099] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:48.858475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:48.858950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:48.860010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.860107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:48.860492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:48.860913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] HTTP exception thrown: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 could not be found. Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Request method failure captured: Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 HTTP/1.1 Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCl3gqOK_HnjqzWJ_BujVcgtw0nC0FV_S51C_bt3lLLhMDNRyvb_j25fG7U7fVMKO_BH2-2mSaX5s3Hu6GJ38hbAihOVQv7ruTohitseBiTkQzsMVp91cCe9mURLZunr1rUarlNOPj_Jh-d2JIgQphK84Egbvexv2Gk2wivkDzjHtC8 Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 4246174ea1a24221850252a2e73d0dcf Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1734047640 Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:48.927532 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4246174ea1a24221850252a2e73d0dcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4246174ea1a24221850252a2e73d0dcf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4246174ea1a24221850252a2e73d0dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4246174ea1a24221850252a2e73d0dcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1734047640 Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 4246174ea1a24221850252a2e73d0dcf Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1734047640 Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminNegativeTestJSON-1734047640-project Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 1f35fe0054554a7c9a3f38521ac107f6 Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1734047640-project Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 could not be found. Oct 28 19:12:48.929668 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '92103fb7-7ca6-44c1-b979-8fabb837a099'} Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 could not be found. Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:48.933825 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 could not be found. Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 could not be found. Oct 28 19:12:48.936010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:48.937654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Returning 404 to user: Instance 92103fb7-7ca6-44c1-b979-8fabb837a099 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:48.937654 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e199183-5e58-4930-9367-68b9ed28d6f6 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099" status: 404 len: 111 microversion: 2.1 time: 0.085409 Oct 28 19:12:48.937654 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 752/1500] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:48 2022] GET /compute/v2.1/servers/92103fb7-7ca6-44c1-b979-8fabb837a099 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:48.942770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:48.943253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:48.956885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:48.957585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:48.960328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:48.961919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:48.962560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:48.963174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.030435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:49.208828 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-997c628c-2f37-4a88-84bd-8a81f2f73edd tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 204 len: 0 microversion: 2.1 time: 0.278929 Oct 28 19:12:49.216413 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 753/1501] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:48 2022] DELETE /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:49.228211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.229233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.245716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.250936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.251674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.267201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.268005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.268976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.288601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:49.467368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:49.482335 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b1545bce-27ec-4e3d-b61f-465d9c60d506 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.908952 Oct 28 19:12:49.484700 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 749/1502] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:48 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:49.600644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5ca614f4-6c90-4f1d-b40e-c2f621aba005 req-f5b47b2f-f37d-41ce-a8da-43e2bb56f51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a412528-3bbb-4ab8-993b-00d4c77c9fe1", "tag": "dac36a45-a172-4703-aeea-984a465ff156"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:49.611725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5ca614f4-6c90-4f1d-b40e-c2f621aba005 req-f5b47b2f-f37d-41ce-a8da-43e2bb56f51e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.612227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5ca614f4-6c90-4f1d-b40e-c2f621aba005 req-f5b47b2f-f37d-41ce-a8da-43e2bb56f51e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.612652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5ca614f4-6c90-4f1d-b40e-c2f621aba005 req-f5b47b2f-f37d-41ce-a8da-43e2bb56f51e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.665551 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5ca614f4-6c90-4f1d-b40e-c2f621aba005 req-f5b47b2f-f37d-41ce-a8da-43e2bb56f51e service nova] Creating event network-changed:dac36a45-a172-4703-aeea-984a465ff156 for instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 on n-h1-862769-3 Oct 28 19:12:49.681706 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5ca614f4-6c90-4f1d-b40e-c2f621aba005 req-f5b47b2f-f37d-41ce-a8da-43e2bb56f51e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194477 Oct 28 19:12:49.683775 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 750/1503] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:49.696057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.700632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.712931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:49.715625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.717030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.718313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.720829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.722194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.723483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.775546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:49.789208 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf07b7f7-0df1-40c1-8057-0d765372a0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1469 microversion: 2.1 time: 0.573134 Oct 28 19:12:49.802774 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 754/1504] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:49 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1469 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:49.802774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.802774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.820013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.821544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.823022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.824618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.825934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.827188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.861012 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 HTTP/1.1 Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:49.862674 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:49.864017 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7aa203d5-e7cb-40c8-9d42-be8413b3abe0'} Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:49.864781 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:49.866237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:49.867356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:49.867356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b049068-ce6f-4d23-ac88-b603900d595b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 404 len: 111 microversion: 2.1 time: 0.069562 Oct 28 19:12:49.884490 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 755/1505] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:49 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:49.897739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:49.898391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:49.919287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:49.920843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.921386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.921964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:49.922706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:49.932623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:49.933284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.776381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:50.779245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:50.787440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-05cf2dc3-3edd-4eef-91a8-102d24800b05 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1476 microversion: 2.1 time: 1.102273 Oct 28 19:12:50.789807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:50.790301 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 751/1506] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:49 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1476 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:50.796165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.796966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:50.803547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.804224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.804794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.805724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.810940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.811720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.820825 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6eb07a53-315a-4824-b8f3-b47f1c69739f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.934724 Oct 28 19:12:50.832243 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 756/1507] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:49 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:50.846446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.852887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:50.864052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.872400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.873008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.873516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.873985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.874440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.893777 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0/os-volume_attachments HTTP/1.1 Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:50.901203 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:50.902869 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '7aa203d5-e7cb-40c8-9d42-be8413b3abe0'} Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:50.903774 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:12:50.905143 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:50.907450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:50.908650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0518d80-ecc1-4344-834a-a38ab4bbf2f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074863 Oct 28 19:12:50.910857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 757/1508] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:12:50 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:50.921271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:50.922231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:50.929154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.929871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.931123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:50.932063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:50.932673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:50.933680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:51.496022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:51.505056 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c990f229-688d-4f74-a882-38e0ea1f2444 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.712423 Oct 28 19:12:51.505488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 752/1509] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:50 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:51.514139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:51.525906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1540922118", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:51.531264 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0b0c6b4-7282-4b77-99c2-d0bd898ad5f0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 0.615275 Oct 28 19:12:51.533264 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 758/1510] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:50 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:51.657840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:51.759507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-02e3028f-05f4-4b42-98ae-14e162f297e9 req-a22dc94a-0490-44e8-b8f0-f8f85b8faf1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01cc84a-8c24-46d3-bba7-37691ccdef7c", "name": "network-vif-deleted", "tag": "36c7031c-029a-48fb-b8b7-8ec16f837c5e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:51.773553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-02e3028f-05f4-4b42-98ae-14e162f297e9 req-a22dc94a-0490-44e8-b8f0-f8f85b8faf1b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:51.774127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-02e3028f-05f4-4b42-98ae-14e162f297e9 req-a22dc94a-0490-44e8-b8f0-f8f85b8faf1b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:51.774622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-02e3028f-05f4-4b42-98ae-14e162f297e9 req-a22dc94a-0490-44e8-b8f0-f8f85b8faf1b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:51.787639 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-02e3028f-05f4-4b42-98ae-14e162f297e9 req-a22dc94a-0490-44e8-b8f0-f8f85b8faf1b service nova] Creating event network-vif-deleted:36c7031c-029a-48fb-b8b7-8ec16f837c5e for instance b01cc84a-8c24-46d3-bba7-37691ccdef7c on n-h1-862769-3 Oct 28 19:12:51.794323 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-02e3028f-05f4-4b42-98ae-14e162f297e9 req-a22dc94a-0490-44e8-b8f0-f8f85b8faf1b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040540 Oct 28 19:12:51.795544 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 759/1511] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:51.823060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:51.824270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:51.834447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:51.835907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:51.836524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:51.837723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:51.845075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:51.846577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:51.982081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:51.990884 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-306b3dd2-91c5-4876-8202-e1042a9a0a84 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1434 microversion: 2.1 time: 0.173820 Oct 28 19:12:51.991457 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 760/1512] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:51 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1434 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:52.003762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:52.004729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:52.020035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.020803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.022119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.023725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.025325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.026754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.354136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:52.367932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59d6f14c-b8c8-43b9-804c-1a44a6055211 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.372803 Oct 28 19:12:52.377537 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 761/1513] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:51 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:52.533873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:52.535470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:52.547676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.550026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.552286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:52.553581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:52.557945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:52.558648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.265348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:53.275231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:53.275678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:53.276203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:53.276615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:53.277023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:53.293936 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a943a2b-01f9-4a87-a0cb-af7732f19f1d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.765924 Oct 28 19:12:53.295022 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 762/1514] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:52 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:53.299761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:53.301151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:53.308122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.308746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.309281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.310092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.310652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.311195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.335921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.336432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.336872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.337619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.338044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.350916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.431320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:53.446447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:53.462011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:53.468636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:53.549614 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-30a908b7-c6e6-4256-bf33-9ef09cb03789 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.040307 Oct 28 19:12:53.563093 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 753/1515] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:12:53.569762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:53.571195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:53.580016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.581221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.581927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.583009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.583735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.584381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.647384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.648362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.649195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.649923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lazy-loading 'fault' on Instance uuid b01cc84a-8c24-46d3-bba7-37691ccdef7c {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:12:53.797397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f35fe0054554a7c9a3f38521ac107f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4246174ea1a24221850252a2e73d0dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:53.810663 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b3f7b270-3f1b-47e5-938e-c35c6229ae4f tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 200 len: 1311 microversion: 2.1 time: 0.245702 Oct 28 19:12:53.813623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 754/1516] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:53 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:53.830406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:53.832652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:53.895086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.898837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.903893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:53.905428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:53.915198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:53.916714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:54.396191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:54.405417 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2cb022a3-47d9-48e1-86f4-99fa92d626a7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1476 microversion: 2.1 time: 1.109242 Oct 28 19:12:54.429053 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 763/1517] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:53 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1476 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:54.438811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ac61e935-37be-4504-b8a0-a86819450e57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:54.452339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ac61e935-37be-4504-b8a0-a86819450e57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:54.627105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:54.635793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88db6030-fea7-45d1-9429-c2941f315862 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.821059 Oct 28 19:12:54.651214 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 755/1518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:53 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:54.659302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ac61e935-37be-4504-b8a0-a86819450e57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:54.680063 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ac61e935-37be-4504-b8a0-a86819450e57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db" status: 200 len: 1215 microversion: 2.1 time: 0.246675 Oct 28 19:12:54.680664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 764/1519] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:54 2022] GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:54.687068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:54.691284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:54.707817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:54.708310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:54.708736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:54.714749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8310ff6-9b6a-4e6a-87ea-69aeb3be21c7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:54.715296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8310ff6-9b6a-4e6a-87ea-69aeb3be21c7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:54.732130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:54.732731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:54.733173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:54.767908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8310ff6-9b6a-4e6a-87ea-69aeb3be21c7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:12:55.370645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:55.385242 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a110128f-637e-4ae8-b162-d9fe344eca3b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.698698 Oct 28 19:12:55.386812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 756/1520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:54 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:55.396603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:55.406101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] [instance: b01cc84a-8c24-46d3-bba7-37691ccdef7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:55.422176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.423189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.423814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:55.424718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.425322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.425923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:55.474558 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] HTTP exception thrown: Instance b01cc84a-8c24-46d3-bba7-37691ccdef7c could not be found. Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Request method failure captured: Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c HTTP/1.1 Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCl3gqOK_HnjqzWJ_BujVcgtw0nC0FV_S51C_bt3lLLhMDNRyvb_j25fG7U7fVMKO_BH2-2mSaX5s3Hu6GJ38hbAihOVQv7ruTohitseBiTkQzsMVp91cCe9mURLZunr1rUarlNOPj_Jh-d2JIgQphK84Egbvexv2Gk2wivkDzjHtC8 Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 4246174ea1a24221850252a2e73d0dcf Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1734047640 Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:12:55.487253 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4246174ea1a24221850252a2e73d0dcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4246174ea1a24221850252a2e73d0dcf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4246174ea1a24221850252a2e73d0dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4246174ea1a24221850252a2e73d0dcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1734047640 Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 4246174ea1a24221850252a2e73d0dcf Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1734047640 Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersAdminNegativeTestJSON-1734047640-project Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1f35fe0054554a7c9a3f38521ac107f6 Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1734047640-project Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance b01cc84a-8c24-46d3-bba7-37691ccdef7c could not be found. Oct 28 19:12:55.488677 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'b01cc84a-8c24-46d3-bba7-37691ccdef7c'} Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01cc84a-8c24-46d3-bba7-37691ccdef7c could not be found. Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:55.489530 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01cc84a-8c24-46d3-bba7-37691ccdef7c could not be found. Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01cc84a-8c24-46d3-bba7-37691ccdef7c could not be found. Oct 28 19:12:55.490846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:12:55.497344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] Returning 404 to user: Instance b01cc84a-8c24-46d3-bba7-37691ccdef7c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:55.499855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d375eec-ecca-4ae5-a6bf-59d4387806d7 tempest-ServersAdminNegativeTestJSON-1734047640 tempest-ServersAdminNegativeTestJSON-1734047640-project] 10.222.0.44 "GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c" status: 404 len: 111 microversion: 2.1 time: 0.110635 Oct 28 19:12:55.503704 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 757/1521] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:55 2022] GET /compute/v2.1/servers/b01cc84a-8c24-46d3-bba7-37691ccdef7c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:55.514585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "name": "network-vif-unplugged", "status": "completed", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:55.528515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.529359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.529996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:55.545449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] Creating event network-vif-unplugged:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h2-862769-3 Oct 28 19:12:55.555272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:12:55.569875 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d7425208-1b13-4a1a-a122-6e6f732ffeb5 req-b8bc3f85-81d3-4d4a-b4c9-1c85fa6663f6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063327 Oct 28 19:12:55.575784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 758/1522] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:55.582084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:55.583904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:55.604052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.607569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.608450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:55.609498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.610270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.610932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:55.636117 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.scheduler.client.report [None req-e8310ff6-9b6a-4e6a-87ea-69aeb3be21c7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Deleted allocations for instance 17d7e582-bee3-4782-9f53-bb1672c825db Oct 28 19:12:55.671241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8310ff6-9b6a-4e6a-87ea-69aeb3be21c7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db" status: 204 len: 0 microversion: 2.1 time: 0.960426 Oct 28 19:12:55.675179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 765/1523] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:12:54 2022] DELETE /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db => generated 0 bytes in 965 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:12:55.686426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:55.688738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:55.696997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.698052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.698623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:55.699630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:55.700326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:55.700955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.273714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:56.293273 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79386a2b-8f6b-4cd2-8aad-7d211dbc637a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1211 microversion: 2.1 time: 0.616837 Oct 28 19:12:56.294167 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 766/1524] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:55 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1211 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:56.314162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:56.315167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:56.330978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.332492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.338332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.342053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.342747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.343371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.355320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:56.370904 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f3b79072-21de-4ead-944f-7aa06861159b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1475 microversion: 2.1 time: 0.793354 Oct 28 19:12:56.372088 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 759/1525] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:55 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1475 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:56.380835 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db HTTP/1.1 Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:12:56.385867 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:12:56.387244 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '17d7e582-bee3-4782-9f53-bb1672c825db'} Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:12:56.387984 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:12:56.389188 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:12:56.402100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:12:56.403357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9060c38-0d23-4bd2-9f01-4f1b367d1366 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db" status: 404 len: 111 microversion: 2.1 time: 0.107940 Oct 28 19:12:56.415007 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 767/1526] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:56 2022] GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:12:56.415438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:56.416051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:56.427385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.427882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.428308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.429029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.429474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.431827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.649828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-196698797", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:56.703086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:56.735444 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6560fa17-39a8-4de1-8902-c7fe3b4177cf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.322854 Oct 28 19:12:56.739135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 760/1527] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:56 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:56.777489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:12:57.328604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:57.330638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:57.344546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:57.345446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:57.346069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:57.347873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:57.355116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:57.356009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:57.664912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:57.673345 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-002bd443-f2ad-44ea-b9e0-dcce992fda9b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.356967 Oct 28 19:12:57.676552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 761/1528] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:57 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:57.697180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:57.698012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:57.707180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:57.707976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:57.714315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:57.715383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:57.716013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:57.716597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.170954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:58.185087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e876fa20-57c7-4d09-90e2-52725a167013 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1475 microversion: 2.1 time: 0.507294 Oct 28 19:12:58.187176 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 762/1529] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:57 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1475 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:58.205967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:58.207844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:58.215652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.216543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.217260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.218291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.219042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.219613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.432434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:12:58.432979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:12:58.433826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:12:58.434433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:12:58.435023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:12:58.449821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.450341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.450831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.452822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.455428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.457226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:58.458416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.467940 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22aa52de-4332-4c98-8501-610fbc96f566 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.279303 Oct 28 19:12:58.468536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 763/1530] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:58 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:58.507814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:12:58.518132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:12:58.535829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:12:58.539348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:12:58.625295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb1818e8-facb-42e4-91a8-1777ff5d2e5c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979378 Oct 28 19:12:58.630425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 768/1531] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:12:58.642453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3feab0eb-74cb-4445-b58e-d2e1a4441a55 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:58.643822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3feab0eb-74cb-4445-b58e-d2e1a4441a55 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:58.699574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:58.699574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:58.701889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3feab0eb-74cb-4445-b58e-d2e1a4441a55 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:58.710567 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3feab0eb-74cb-4445-b58e-d2e1a4441a55 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1214 microversion: 2.1 time: 0.072337 Oct 28 19:12:58.717063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.719233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.719689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.720416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.721778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 764/1532] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:58 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:58.726014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.726519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.955223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-37aea039-c394-4128-b61b-8d69de747ec9 req-88f25b82-78c9-4768-8ff4-e4afaa47dc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a412528-3bbb-4ab8-993b-00d4c77c9fe1", "name": "network-vif-plugged", "status": "completed", "tag": "dac36a45-a172-4703-aeea-984a465ff156"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:58.995766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37aea039-c394-4128-b61b-8d69de747ec9 req-88f25b82-78c9-4768-8ff4-e4afaa47dc95 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.998053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37aea039-c394-4128-b61b-8d69de747ec9 req-88f25b82-78c9-4768-8ff4-e4afaa47dc95 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.998521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37aea039-c394-4128-b61b-8d69de747ec9 req-88f25b82-78c9-4768-8ff4-e4afaa47dc95 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.032854 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-37aea039-c394-4128-b61b-8d69de747ec9 req-88f25b82-78c9-4768-8ff4-e4afaa47dc95 service nova] Creating event network-vif-plugged:dac36a45-a172-4703-aeea-984a465ff156 for instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 on n-h1-862769-3 Oct 28 19:12:59.053698 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-37aea039-c394-4128-b61b-8d69de747ec9 req-88f25b82-78c9-4768-8ff4-e4afaa47dc95 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104681 Oct 28 19:12:59.058642 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 765/1533] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:12:59.211985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:59.213158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:59.225196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.225706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.226139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.226898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.227339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.227769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.234737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:59.251225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61c56020-b334-49cb-8423-c2e9f063aeed tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.553234 Oct 28 19:12:59.255676 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 769/1534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:58 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:12:59.454376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:59.476656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.477910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.478436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.522621 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] Creating event network-changed:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h2-862769-3 Oct 28 19:12:59.539552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:12:59.554476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:59.564588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-991fd122-2831-469c-bf4a-ccd5120d5d9f req-f3e269c4-76d7-4214-be8e-c18c2b6e8433 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116027 Oct 28 19:12:59.565909 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 770/1535] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:59.566096 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7cd51b04-2c78-44c9-9a2f-b11ee3a9faf6 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1475 microversion: 2.1 time: 0.358884 Oct 28 19:12:59.587964 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 766/1536] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:59 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:59.589773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:59.593275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:59.608942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.616157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.617494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.618025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.618727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.620199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.737628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:59.739342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:12:59.752284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.754790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.756154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.759012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.761247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.763442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.912737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:59.931893 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27efac01-480f-4364-b118-fdef48451620 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1218 microversion: 2.1 time: 0.201652 Oct 28 19:12:59.944069 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 767/1537] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:59 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:59.961457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:59.977565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01cd4302-29bf-473e-80e8-e2695f664c61 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.406006 Oct 28 19:12:59.978824 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 771/1538] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:59 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:00.283211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:00.283814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:00.295630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.298625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.301413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.302531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.303806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.305111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.591934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:00.592697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:00.600631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.602794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.603101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:00.604874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.606222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.608453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.610040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.616173 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3da0848c-ee02-48f9-948d-262a8fb46743 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.337110 Oct 28 19:13:00.631619 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 768/1539] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:00 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:00.944258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:00.954919 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-571a739b-9619-4b76-89ba-ce53e60a3f01 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1475 microversion: 2.1 time: 0.367127 Oct 28 19:13:00.965823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:00.966906 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 772/1540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:00 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:00.967036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:00.981799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.982767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.983931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.984830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.985701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.988335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:01.005196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:01.006030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:01.016880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:01.019346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:01.020899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:01.024108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:01.024659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:01.025093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:01.171459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:01.193535 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ebb10f63-3314-40e4-b48b-c7826e182954 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1266 microversion: 2.1 time: 0.231818 Oct 28 19:13:01.199693 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 769/1541] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:00 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:01.903423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:01.921812 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1ce2970-3dd9-46a0-838e-72b6b76d42ac tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1319 microversion: 2.1 time: 0.921604 Oct 28 19:13:01.922656 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 773/1542] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:00 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1319 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:01.996953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:01.998225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:02.016190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.016452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:02.016907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.017865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:02.019801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.022173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.023888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.025525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.026720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.027387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.027969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.028868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.029465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.030034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.589891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:02.607260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-179eaae0-8be9-48ff-8e4b-7990c69c4c31 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.969705 Oct 28 19:13:02.608881 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 770/1543] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:01 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:02.632057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:02.637300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:02.638160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:02.644107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4a57b5a-c671-4c82-a6d4-103332b52943 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1473 microversion: 2.1 time: 0.658895 Oct 28 19:13:02.649599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 774/1544] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:01 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1473 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:02.653440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.658558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.659120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.659877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.660339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.660951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.707762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:02.817592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:02.828842 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d1a352f-8ab8-4f99-9d9b-ea859f44f68a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1272 microversion: 2.1 time: 0.218698 Oct 28 19:13:02.832592 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 771/1545] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:02 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:02.947814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:02.948251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:02.957387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.958152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.959001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.960126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:02.961034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:02.961863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.356642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:03.385227 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d488eb45-ae7d-40e4-a635-8ea6fa85e919 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1468 microversion: 2.1 time: 0.441214 Oct 28 19:13:03.408726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 775/1546] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:02 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:03.422363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:03.442718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:03.445348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Searching by: {'reservation_id': 'r-p4i0hdna', 'deleted': False, 'project_id': '6df42e9bda2b4307a800e2a35af177be'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:13:03.447922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:03.457230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.457647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.462613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.463566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.464031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.464458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.631323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:03.632170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:03.647787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.649725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.655032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.656983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.660863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.661996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.681973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:13:03.700865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:03.837617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:03.846257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.848053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.850070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.419046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:04.426433 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2c016ae-5295-42d5-8200-a4bb22df2c3e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/detail?reservation_id=r-p4i0hdna" status: 200 len: 2930 microversion: 2.1 time: 1.012913 Oct 28 19:13:04.427594 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 772/1547] 10.222.0.44 () {58 vars in 1197 bytes} [Fri Oct 28 19:13:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-p4i0hdna => generated 2930 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:04.447320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:04.447908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:04.454962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.455451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.455877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.459203 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f65afdd6-f123-4be1-8ea6-f6766ea5b946 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.833086 Oct 28 19:13:04.462087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 776/1548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:03 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:04.466092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.466674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.467137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.475185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:04.479092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:04.494779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.500225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.501037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.504362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.505074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.506300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.730669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:04.743562 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3af9ec7-3bb3-45bf-ac3b-2396704d86a2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1272 microversion: 2.1 time: 0.279223 Oct 28 19:13:04.744207 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 777/1549] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:04 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:04.748791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8904065-c7d0-483e-95cb-fb9ecd7be212 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:04.787264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.server_groups [None req-e8904065-c7d0-483e-95cb-fb9ecd7be212 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Querying cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) for 2 instances {{(pid=120628) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 19:13:04.787972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8904065-c7d0-483e-95cb-fb9ecd7be212 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.792742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8904065-c7d0-483e-95cb-fb9ecd7be212 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.793408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8904065-c7d0-483e-95cb-fb9ecd7be212 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.858142 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8904065-c7d0-483e-95cb-fb9ecd7be212 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups/5cf9e50c-5469-4246-bd0b-60b48b60870d" status: 200 len: 271 microversion: 2.1 time: 0.112849 Oct 28 19:13:04.859100 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 778/1550] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:13:04 2022] GET /compute/v2.1/os-server-groups/5cf9e50c-5469-4246-bd0b-60b48b60870d => generated 271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:04.870162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:04.870886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:04.886287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.886808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.887237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:04.887947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:04.891476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:04.892025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.131336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:05.142575 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f6c61c3-0fa8-42de-b85a-49739d3f570b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1470 microversion: 2.1 time: 0.711523 Oct 28 19:13:05.146019 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 773/1551] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:04 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1470 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:05.169436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:05.170368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:05.179387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.180717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.181657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.182751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.183792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.184619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.354080 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-42582daa-a060-4a08-8fc6-2000dfd747c3 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1619 microversion: 2.1 time: 0.488132 Oct 28 19:13:05.373841 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 779/1552] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:04 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1619 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:05.379753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:05.380372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:05.406722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.407568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.408420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.410188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.412470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.413097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.509108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-713b79ee-e2d7-4dfa-b821-ce159f8beb67 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "POST /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab/action" status: 202 len: 0 microversion: 2.1 time: 0.343522 Oct 28 19:13:05.512252 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 774/1553] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:05 2022] POST /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:13:05.526332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:05.530127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:05.550218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.552406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.553448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:05.555357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:05.557006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:05.560786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:06.221278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:06.229678 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdc7d666-1e7b-438b-9cc3-29db9608ea5a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.713088 Oct 28 19:13:06.230266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 775/1554] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:05 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:06.236812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:06.242814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:06.256789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:06.257277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:06.257707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:06.258421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:06.259077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:06.259763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:06.395876 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2135d6de-2d54-436d-9f24-afda36d555c2 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1620 microversion: 2.1 time: 1.020570 Oct 28 19:13:06.413769 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 780/1555] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:05 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1620 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:06.438416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:06.439642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:06.454155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:06.454998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:06.455628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:06.456520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:06.457141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:06.457879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:06.625606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:06.660483 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40ac1884-a2b7-4895-95b4-28c8b6917663 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 0.428913 Oct 28 19:13:06.665597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 776/1556] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:06 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:06.678500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-835718819", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "0bea25a8-c910-4c3a-87a0-715a4885c7c8"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:06.827892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:13:07.409438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:07.424936 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c947e45-18e1-494c-a1b0-de4bbf25f28b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 1.002804 Oct 28 19:13:07.427343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 781/1557] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:06 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:07.434113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:07.434966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:07.455119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:07.457865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:07.460025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:07.462345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:07.465225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:07.467356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.481763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:08.521943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:08.522669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:08.523822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:08.524476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:08.525132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:08.527075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:08.569759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:08.571036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:08.572707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.574976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:08.589642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:08.592624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.636240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:08.649213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:08.687144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:13:08.689725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:13:08.855148 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c16a1c13-9d64-4f4a-9d62-c9c2de53c3d7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187460 Oct 28 19:13:08.856485 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 777/1558] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:13:08.861763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:08.863792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:08.880373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:08.881207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:08.881850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.883505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:08.884161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:08.884838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:08.907127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:08.936271 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8572dfc-2017-4748-8b40-34b004682bdd tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 1.507607 Oct 28 19:13:08.968604 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 782/1559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:07 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:08.975593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:08.976906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:08.988347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:09.017828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:09.024919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:09.032804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:09.033546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:09.034229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:09.990317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:10.003587 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f0cb2d5-7e06-4584-996e-8220c47c206a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 1.145650 Oct 28 19:13:10.006891 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 778/1560] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:08 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:10.025236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:10.028682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:10.043419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.049873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.050542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.051590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.052198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.052794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.086044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:10.146451 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2330b3dc-09e3-4e31-8d6b-20474e436c25 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 1.176170 Oct 28 19:13:10.157492 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 783/1561] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:08 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:10.178813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:10.181128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:10.208319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.210282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.214943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.216905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.220273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.224655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.228343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:10.250422 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53617daf-e9ff-4e58-81f7-58ba7c2dec14 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1220 microversion: 2.1 time: 0.238071 Oct 28 19:13:10.270718 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 779/1562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:10 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:10.523064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-77f3bef1-c293-415f-823f-53d6923116bf req-2db335c0-cbcf-42b8-96e1-79de5dd310df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de6e746-f4fd-4836-aea6-47e0b2a77299", "name": "network-vif-plugged", "status": "completed", "tag": "32537282-2078-4847-bf75-4c4118af189d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:10.539378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77f3bef1-c293-415f-823f-53d6923116bf req-2db335c0-cbcf-42b8-96e1-79de5dd310df service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:10.539857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77f3bef1-c293-415f-823f-53d6923116bf req-2db335c0-cbcf-42b8-96e1-79de5dd310df service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:10.540280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77f3bef1-c293-415f-823f-53d6923116bf req-2db335c0-cbcf-42b8-96e1-79de5dd310df service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:10.573364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-77f3bef1-c293-415f-823f-53d6923116bf req-2db335c0-cbcf-42b8-96e1-79de5dd310df service nova] Creating event network-vif-plugged:32537282-2078-4847-bf75-4c4118af189d for instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 on n-h1-862769-3 Oct 28 19:13:10.581881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-77f3bef1-c293-415f-823f-53d6923116bf req-2db335c0-cbcf-42b8-96e1-79de5dd310df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220875 Oct 28 19:13:10.582507 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 780/1563] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:10.898786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:10.907882 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6788e211-b824-44e4-8ccb-7ec01c205da1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.749071 Oct 28 19:13:10.912066 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 784/1564] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:10 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:11.064179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:11.065458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:11.080903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.081388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.082293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.083495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.086499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.087122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.181758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:11.186960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:11.199749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.208788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.209681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.210603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.211235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.211827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.708671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:11.727758 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-268e540e-eff1-4057-83fb-17d533082d8e tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 0.692658 Oct 28 19:13:11.730841 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 781/1565] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:11 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:11.757256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:11.757972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:11.772823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:11.774734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.775325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.775935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:11.776792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:11.777398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:11.779884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:12.023146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:12.038754 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3249ff13-1c58-4534-843e-d34f253133ee tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1286 microversion: 2.1 time: 0.304403 Oct 28 19:13:12.042818 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 782/1566] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:11 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1286 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:12.049038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:12.065733 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-32920bfc-97de-477a-a9ad-a16faf6eca3a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 0.887077 Oct 28 19:13:12.067494 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 785/1567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:11 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:12.069922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:12.074196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:12.093500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:12.094539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:12.096184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:12.099756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:12.100478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:12.101114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:12.479198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:12.496477 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ea445c9-c945-4dc6-bd88-2dbd0ffa4517 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1199 microversion: 2.1 time: 0.451688 Oct 28 19:13:12.510591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 783/1568] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:12 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1199 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:12.715852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "name": "network-vif-plugged", "status": "completed", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:12.750820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:12.753158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:12.753884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:12.774698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:12.778209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:12.806157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:12.806713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:12.807152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:12.807877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:12.813284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:12.819687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:12.833128 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] Creating event network-vif-plugged:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h2-862769-3 Oct 28 19:13:12.848664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:13:12.888409 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-eefb9815-b211-4142-8d3e-43831397b3f4 req-ecfd3dce-a4c6-4c0d-8861-3cc9d7eeefe4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177402 Oct 28 19:13:12.889522 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 786/1569] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:13.055949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-838166368", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "7a58ac5b-5454-4d41-ba04-839f867ccf04"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:13.183865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:13.205821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] validate_networks() for [('7a58ac5b-5454-4d41-ba04-839f867ccf04', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:13:13.216627 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc5cda5d-3860-409f-a51d-0c636defcebb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 0.449528 Oct 28 19:13:13.234264 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 784/1570] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:12 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:13.257147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:13.260234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:13.272531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.273032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.273469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:13.274183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.274629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.275227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:13.394302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:13.405441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7888e552-23e5-4403-88eb-fd2a34e517a7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1274 microversion: 2.1 time: 0.168875 Oct 28 19:13:13.406034 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 785/1571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:13 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:13.421558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:13.422565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:13.434379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.434952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.435642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:13.436671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.437311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.437983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:13.899579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:13.903644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:13.915618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-136d5cc2-9c21-4c87-af46-773600991049 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 0.504941 Oct 28 19:13:13.930717 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 786/1572] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:13 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:13.930717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7d127615-4832-4d41-a219-962a22c72390 req-90884149-19f1-419e-a246-aef6decc3fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f286edc2-7e69-481a-a2c7-f5810c8a2a5c", "tag": "a7efed17-e04b-40d8-b859-92e742e29b8d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:13.962814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7d127615-4832-4d41-a219-962a22c72390 req-90884149-19f1-419e-a246-aef6decc3fee service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:13.963338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7d127615-4832-4d41-a219-962a22c72390 req-90884149-19f1-419e-a246-aef6decc3fee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:13.965254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7d127615-4832-4d41-a219-962a22c72390 req-90884149-19f1-419e-a246-aef6decc3fee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.007616 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7d127615-4832-4d41-a219-962a22c72390 req-90884149-19f1-419e-a246-aef6decc3fee service nova] Creating event network-changed:a7efed17-e04b-40d8-b859-92e742e29b8d for instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c on n-h1-862769-3 Oct 28 19:13:14.025396 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7d127615-4832-4d41-a219-962a22c72390 req-90884149-19f1-419e-a246-aef6decc3fee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104864 Oct 28 19:13:14.026905 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 787/1573] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:14.041184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:14.045469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:14.075437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.076530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.078430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.081663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.082312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.084561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.651324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:14.666652 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a31f1f61-9bf1-41d2-8324-e1497aab26ff tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1381 microversion: 2.1 time: 0.636292 Oct 28 19:13:14.672311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 788/1574] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:14 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1381 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:14.682470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:14.683674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:14.699190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.699689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.700122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:14.700839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:14.701286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:14.701708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.597995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:15.598491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:15.604780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:15.605333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:15.605763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:15.622268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.622782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:15.623219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.623948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.628310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:15.628993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.677124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Getting quotas for project 2f724cbeaab34c56bd952bff01078b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:15.683680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:15.688375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Getting quotas for user 0a61d398929c482da48baf1f7ec1c2f4 and project 2f724cbeaab34c56bd952bff01078b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:15.718433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:13:15.723865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:13:15.832314 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-387c7fbe-02c0-48f3-94c6-048f6c4d4e2a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.940130 Oct 28 19:13:15.833688 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 787/1575] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:13:15.844113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:15.845367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:15.865494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.876533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:15.877180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.878972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.879442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:15.880468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:15.946367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:15.959530 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f8236ee-8546-4f4c-beb3-e8674eba72d8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 1.285345 Oct 28 19:13:15.960028 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 789/1576] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:14 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:15.972852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:15.976117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:15.993207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:15.998665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.005039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.006060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.006772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.008621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.841461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:16.852267 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0eb26214-3009-413b-8bd3-fb6be34806ba tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 1.017269 Oct 28 19:13:16.874849 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 788/1577] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:15 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:16.884401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:16.887481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:16.900882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.907506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.908480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:16.909982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:16.910715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:16.911656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:17.451392 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f1b8dac-ae4b-4983-9724-612e5f1d662b tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1532 microversion: 2.1 time: 1.489524 Oct 28 19:13:17.472013 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 790/1578] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:15 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1532 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:17.478857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:17.483809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:17.497390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:17.498155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:17.498947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:17.499828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:17.500466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:17.501039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:17.756759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:17.766854 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48638a4d-5f7a-40dc-a07a-fc1e6c9871fd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 0.888253 Oct 28 19:13:17.767692 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 789/1579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:16 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:17.790806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:17.803683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:17.810893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:17.811700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:17.816506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:17.817646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:17.818323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:17.819318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:17.934842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:17.943605 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5cb0e146-708a-457a-a408-c5e8cb9f8f59 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1269 microversion: 2.1 time: 0.470360 Oct 28 19:13:17.949393 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 791/1580] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:17 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1269 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:17.954983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "name": "network-vif-unplugged", "status": "completed", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:17.981427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:17.999160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:17.999799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:18.039558 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] Creating event network-vif-unplugged:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h1-862769-3 Oct 28 19:13:18.073300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:13:18.120900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-454b4fd3-4b86-473f-a106-f471f17c4bda req-1fe3cb0a-ec77-43de-a22b-aace4b1d8160 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170059 Oct 28 19:13:18.121694 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 792/1581] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:18.136333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:18.150298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:18.168717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:18.175055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:18.176017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:18.177056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:18.177736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:18.179202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:18.606364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:18.670363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:18.965936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:18.989013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd0658dd-51af-4791-87a9-22f1d6bdbbf9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 1.203075 Oct 28 19:13:18.989962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 790/1582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:17 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:19.003004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:19.006389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:19.024400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:19.024978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:19.027134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:19.033285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:19.034295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:19.037168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:19.317191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a5ae71c-6b55-42f6-963a-7ea86c6d61ae tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1532 microversion: 2.1 time: 1.192651 Oct 28 19:13:19.333695 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 793/1583] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:18 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1532 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:19.333695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:19.333695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:19.343512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:19.344005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:19.344875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:19.345813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:19.346273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:19.346704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:19.940375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:19.954487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4dd3a896-3c88-4832-819c-38751bc14e56 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 0.625808 Oct 28 19:13:19.956528 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 794/1584] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:19 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:19.974876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:19.975871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:19.986856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:19.989233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:19.989940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:19.993945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:19.999102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.000815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.171020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:20.186309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-baf97af7-8ca3-4e45-a830-e20166b4b942 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1275 microversion: 2.1 time: 0.228277 Oct 28 19:13:20.206359 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 795/1585] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:19 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:20.214715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:20.235567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:20.236354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.237005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.238032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:20.238727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.239532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.292157 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e5efbef-2a7d-41bf-9734-bd98d2ece06a tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084427 Oct 28 19:13:20.293574 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 796/1586] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:13:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:20.299240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:20.300238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:20.315806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:20.316740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.316963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.317797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:20.318938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.319455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.363911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:20.381959 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c509273-ec61-4fce-975f-ff6ae1bdfb73 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 1.386475 Oct 28 19:13:20.389006 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 791/1587] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:18 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:20.398449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-3", "block_migration": false, "disk_over_commit": false}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:20.408323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:20.435989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:20.436887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.438960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.439611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:20.441203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:20.441631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:20.506379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lazy-loading 'flavor' on Instance uuid 6de6e746-f4fd-4836-aea6-47e0b2a77299 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:20.540783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Going to try to live migrate instance to n-h2-862769-3 {{(pid=120628) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:13:20.650952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:21.366024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:21.382326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62220e99-ed06-44f8-993e-d28091498c2a tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 1.086105 Oct 28 19:13:21.420302 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 797/1588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:20 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:21.437756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:21.481694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:21.482342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:21.483131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:21.522575 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] Creating event network-changed:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h1-862769-3 Oct 28 19:13:21.540570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:13:21.555941 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f19464e1-7b05-4280-93e1-ce74c90705a6 req-599c2f1e-2c1e-47d1-8e21-65b9455fddda service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133746 Oct 28 19:13:21.557195 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 798/1589] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:21.565108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:21.566412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:21.589747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:21.593014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:21.600288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:21.605186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:21.607124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:21.608317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:22.570512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:22.580665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7de7246-cb54-45e5-998e-9b9b4897cec0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 1.021483 Oct 28 19:13:22.581221 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 799/1590] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:21 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:22.594715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:22.595604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:22.603934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:22.604809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:22.605251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:22.605959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:22.606402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:22.607048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:22.868208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:22.886673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3bb2b7cd-8ec0-455d-95aa-345cebee5922 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1317 microversion: 2.1 time: 0.297579 Oct 28 19:13:22.892200 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 800/1591] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:22 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:22.902760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:22.903617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:22.914683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:22.915646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:22.916301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:22.917260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:22.917925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:22.918558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:23.225722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:23.243524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5810b14-1794-4901-a3a1-ee928aa43d41 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.349992 Oct 28 19:13:23.264114 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 801/1592] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:22 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:23.273958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-318428552", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "aa325377-9337-4f1f-b1f3-a267b86ca8bc"}], "block_device_mapping_v2": [{"uuid": "027e0077-551b-4b6b-a9e1-9b4efcc6c161", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:23.413356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] validate_networks() for [('aa325377-9337-4f1f-b1f3-a267b86ca8bc', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:13:24.162160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:24.162802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:24.163071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:24.163479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:24.163906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:24.174858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:24.176080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:24.176971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:24.177860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:24.178473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:24.179085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:24.197291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:24.202474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Getting quotas for user 1b1defe0b46f45fc8ff3d354bb4d361e and project df69faab58094a56ba4ecf152625b366. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:24.275419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:13:24.277787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='027e0077-551b-4b6b-a9e1-9b4efcc6c161',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:13:24.514638 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cdf5d9be-a90c-46e1-87f1-29c051c972c6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.248930 Oct 28 19:13:24.528207 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 802/1593] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:13:24.542622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:24.545743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:24.565031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:24.572431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:24.572906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:24.580702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:24.581198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:24.581640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:25.185750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:25.196064 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f293b4f1-9c7c-4176-9a45-0935336c5498 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1469 microversion: 2.1 time: 0.666533 Oct 28 19:13:25.237324 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 803/1594] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:24 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1469 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:25.249986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-01c30edc-cf67-49b6-9f83-796928a29f76 req-9b1e5c30-ecff-4141-bade-c2855d92ffdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e978d56-5e55-4a0b-8b4d-69686209277f", "tag": "505938d7-987c-4b49-a515-c963a680cd35"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:25.285650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01c30edc-cf67-49b6-9f83-796928a29f76 req-9b1e5c30-ecff-4141-bade-c2855d92ffdd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:25.289077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01c30edc-cf67-49b6-9f83-796928a29f76 req-9b1e5c30-ecff-4141-bade-c2855d92ffdd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:25.289761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01c30edc-cf67-49b6-9f83-796928a29f76 req-9b1e5c30-ecff-4141-bade-c2855d92ffdd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:25.339671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-01c30edc-cf67-49b6-9f83-796928a29f76 req-9b1e5c30-ecff-4141-bade-c2855d92ffdd service nova] Creating event network-changed:505938d7-987c-4b49-a515-c963a680cd35 for instance 5e978d56-5e55-4a0b-8b4d-69686209277f on n-h1-862769-3 Oct 28 19:13:25.355808 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-01c30edc-cf67-49b6-9f83-796928a29f76 req-9b1e5c30-ecff-4141-bade-c2855d92ffdd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116884 Oct 28 19:13:25.359812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 804/1595] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:25.385538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:25.395840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:25.402835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:25.405423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:25.408409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:25.409554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:25.415708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:25.423479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:25.650366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:25.701878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:26.107779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-98467a77-765f-447f-98b7-e60ebfe9a401 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299/action" status: 202 len: 0 microversion: 2.1 time: 5.716299 Oct 28 19:13:26.111351 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 792/1596] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:20 2022] POST /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299/action => generated 0 bytes in 5719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:13:26.115139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8adbd56b-cb47-4c29-b8a5-0566f60515d6 req-bd9fa932-c559-48bb-9ee6-81e40836bd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f286edc2-7e69-481a-a2c7-f5810c8a2a5c", "name": "network-vif-plugged", "status": "completed", "tag": "a7efed17-e04b-40d8-b859-92e742e29b8d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:26.163282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8adbd56b-cb47-4c29-b8a5-0566f60515d6 req-bd9fa932-c559-48bb-9ee6-81e40836bd6f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:26.167102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8adbd56b-cb47-4c29-b8a5-0566f60515d6 req-bd9fa932-c559-48bb-9ee6-81e40836bd6f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:26.169613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8adbd56b-cb47-4c29-b8a5-0566f60515d6 req-bd9fa932-c559-48bb-9ee6-81e40836bd6f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:26.211701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8adbd56b-cb47-4c29-b8a5-0566f60515d6 req-bd9fa932-c559-48bb-9ee6-81e40836bd6f service nova] Creating event network-vif-plugged:a7efed17-e04b-40d8-b859-92e742e29b8d for instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c on n-h1-862769-3 Oct 28 19:13:26.234972 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8adbd56b-cb47-4c29-b8a5-0566f60515d6 req-bd9fa932-c559-48bb-9ee6-81e40836bd6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121742 Oct 28 19:13:26.237146 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 793/1597] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:26.246683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:26.261943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:26.263636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:26.266849 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f2a36ed-cabc-4dc5-836d-1c9ead801085 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 0.904123 Oct 28 19:13:26.270479 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 805/1598] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:25 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:26.290463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:26.293421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:26.298469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:26.300117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:26.300799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:26.303289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:26.303970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:26.304927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:26.317786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:26.318644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:26.322244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:26.324529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:26.326150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:26.328106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:26.894930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:26.898845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:26.922873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-60c32ea2-022b-45a0-945e-a43f1d8e20e9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.649986 Oct 28 19:13:26.931809 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 806/1599] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:26 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:27.184283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:27.200410 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f7590e4-9676-4af0-ab52-50bcd67e2309 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1317 microversion: 2.1 time: 0.959144 Oct 28 19:13:27.211969 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 794/1600] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:26 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:27.388405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:27.389029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:27.398144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:27.400870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:27.401762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:27.403503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:27.404946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:27.406835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:27.459756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e658380-b39c-4016-a531-c00f56d9e867 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Calling method '.version_select at 0x7f1d779ec550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:27.510496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:27.527656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:27.537205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:27.540683 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b7ae955-8582-4f56-8344-caf2824dbdd4 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1232 microversion: 2.25 time: 0.586984 Oct 28 19:13:27.553186 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 807/1601] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:26 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1232 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:27.563052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:27.569630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:27.598869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:27.603869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:27.606223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:27.607199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:27.614998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:27.615823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:27.882681 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e658380-b39c-4016-a531-c00f56d9e867 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.669279 Oct 28 19:13:27.883624 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 795/1602] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:13:27 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:13:27.888785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:27.889898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:27.912678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:27.916527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:27.917256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:27.920021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:27.921395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:27.922991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:28.816332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:28.827258 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e47e98ff-5aa9-4277-bb5b-30eaa10b54f3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 1.279114 Oct 28 19:13:28.850428 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 808/1603] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:27 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:28.855567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:28.856184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:28.872478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:28.873018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:28.875195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:28.875955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:28.876423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:28.876857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:29.024160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:29.033932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-86cab278-2c7a-40f2-ad6a-73b0b5be73da tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1462 microversion: 2.1 time: 1.148926 Oct 28 19:13:29.035376 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 796/1604] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:27 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1462 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:29.042068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ecd96389-2fdb-4df4-ba25-f282a8fdbf25 req-2cb7c127-45b0-4b8d-82e1-562e81044a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ab6041-2ed9-40e8-a8fc-809d5022a310", "tag": "4be4fe9c-069f-4b82-8ca7-2e2951f437c7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:29.064371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ecd96389-2fdb-4df4-ba25-f282a8fdbf25 req-2cb7c127-45b0-4b8d-82e1-562e81044a26 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:29.069529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ecd96389-2fdb-4df4-ba25-f282a8fdbf25 req-2cb7c127-45b0-4b8d-82e1-562e81044a26 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:29.070001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ecd96389-2fdb-4df4-ba25-f282a8fdbf25 req-2cb7c127-45b0-4b8d-82e1-562e81044a26 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:29.087495 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ecd96389-2fdb-4df4-ba25-f282a8fdbf25 req-2cb7c127-45b0-4b8d-82e1-562e81044a26 service nova] Creating event network-changed:4be4fe9c-069f-4b82-8ca7-2e2951f437c7 for instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 on n-h2-862769-3 Oct 28 19:13:29.093678 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ecd96389-2fdb-4df4-ba25-f282a8fdbf25 req-2cb7c127-45b0-4b8d-82e1-562e81044a26 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056991 Oct 28 19:13:29.095003 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 797/1605] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:29.101347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3689455b-d7f9-4c16-86a5-24a361ef6c48 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Action: 'create', calling method: .version_select at 0x7f1d77f71d30>, body: {"pool": "non_exist_pool"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:29.223046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-3689455b-d7f9-4c16-86a5-24a361ef6c48 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] HTTP exception thrown: Floating IP pool not found. Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3689455b-d7f9-4c16-86a5-24a361ef6c48 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Request method failure captured: Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 26 Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCnVhECpXIYCfn4aw17KpxZPmlqh45xBjo2CkQHuvpOOceJ11cq6hFS6AV0PLQ_14DEBKH65pZSbpLE8PVIsYSrxi97mLh0FTdJEYiXceQj79P9Caz0MAooZG--xLVZmK4u0H9twaQI4XTi0oXmS6d9fVSHXju3jmRI0qAmVxoXiWHI Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: caf3e58336684ec38bc0efb2d34b462f Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-316363990 Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:13:29.225395 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/caf3e58336684ec38bc0efb2d34b462f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_caf3e58336684ec38bc0efb2d34b462f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/caf3e58336684ec38bc0efb2d34b462f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/caf3e58336684ec38bc0efb2d34b462f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-316363990 Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: caf3e58336684ec38bc0efb2d34b462f Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-316363990 Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsNegativeTestJSON-316363990-project Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c153424f8c8f446dbb7ac25b9f2359cb Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-316363990-project Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: {"pool": "non_exist_pool"} Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: exception: Floating IP pool not found. Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 28 19:13:29.226975 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:29.228105 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 28 19:13:29.229464 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:29.232129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3689455b-d7f9-4c16-86a5-24a361ef6c48 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Returning 404 to user: Floating IP pool not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:29.233978 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3689455b-d7f9-4c16-86a5-24a361ef6c48 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.136949 Oct 28 19:13:29.235206 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 798/1606] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:13:29 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:29.243694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:29.246928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:29.255079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:29.255917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:29.256640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:29.257602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:29.258310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:29.259120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:29.279854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:29.293696 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cfa208fd-ef06-4af3-8435-cd071a0f35ef tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1314 microversion: 2.1 time: 0.441946 Oct 28 19:13:29.302874 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 809/1607] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:28 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:29.324478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:29.325384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:29.339757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:29.341779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:29.342734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:29.346598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:29.347818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:29.348509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:30.217178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:30.232844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea1b4c11-50d5-46d1-8217-27b5d4f99cb9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.992547 Oct 28 19:13:30.234151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 799/1608] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:29 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:30.254778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:30.256779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:30.285536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:30.286367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:30.286828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:30.287552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:30.305634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:30.314080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:30.333316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:30.420341 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02c24cb7-23be-49ef-874f-d524b043a0ce tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1317 microversion: 2.1 time: 1.105585 Oct 28 19:13:30.432539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 810/1609] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:29 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1317 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:30.670000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:30.671004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:30.689613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:30.692826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:30.693440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:30.694389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:30.695901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:30.698351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:30.919371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:30.936007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:30.950781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:30.952867 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a408164-b82c-4bc7-b8ae-2d2cd6b6f8c7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1250 microversion: 2.25 time: 0.717222 Oct 28 19:13:30.954888 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 800/1610] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:30 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1250 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:30.973875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8e4a972-62cd-4a36-84b1-1a122b132b73 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Calling method '.version_select at 0x7f1d77c64e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:31.565853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-b8e4a972-62cd-4a36-84b1-1a122b132b73 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5f877a76-d878-47db-b323-01c9232ab6b6 could not be found", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:13:31.568241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b8e4a972-62cd-4a36-84b1-1a122b132b73 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] HTTP exception thrown: Floating IP not found for ID 5f877a76-d878-47db-b323-01c9232ab6b6 Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8e4a972-62cd-4a36-84b1-1a122b132b73 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Request method failure captured: Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-floating-ips/5f877a76-d878-47db-b323-01c9232ab6b6 HTTP/1.1 Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCnVhECpXIYCfn4aw17KpxZPmlqh45xBjo2CkQHuvpOOceJ11cq6hFS6AV0PLQ_14DEBKH65pZSbpLE8PVIsYSrxi97mLh0FTdJEYiXceQj79P9Caz0MAooZG--xLVZmK4u0H9twaQI4XTi0oXmS6d9fVSHXju3jmRI0qAmVxoXiWHI Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: caf3e58336684ec38bc0efb2d34b462f Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-316363990 Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:13:31.571792 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/caf3e58336684ec38bc0efb2d34b462f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_caf3e58336684ec38bc0efb2d34b462f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/caf3e58336684ec38bc0efb2d34b462f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/caf3e58336684ec38bc0efb2d34b462f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-316363990 Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: caf3e58336684ec38bc0efb2d34b462f Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-316363990 Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsNegativeTestJSON-316363990-project Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c153424f8c8f446dbb7ac25b9f2359cb Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-316363990-project Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: exception: Floating IP not found for ID 5f877a76-d878-47db-b323-01c9232ab6b6 Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '5f877a76-d878-47db-b323-01c9232ab6b6'} Oct 28 19:13:31.573727 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:13:31.574730 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5f877a76-d878-47db-b323-01c9232ab6b6 could not be found Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eeb6df9-dc43-4231-97c0-2cf1eb532f17'] Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5f877a76-d878-47db-b323-01c9232ab6b6. Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:31.576439 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5f877a76-d878-47db-b323-01c9232ab6b6 Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:31.578180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:31.579861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5f877a76-d878-47db-b323-01c9232ab6b6 Oct 28 19:13:31.579861 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:31.581943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8e4a972-62cd-4a36-84b1-1a122b132b73 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] Returning 404 to user: Floating IP not found for ID 5f877a76-d878-47db-b323-01c9232ab6b6 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:31.583029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8e4a972-62cd-4a36-84b1-1a122b132b73 tempest-FloatingIPsNegativeTestJSON-316363990 tempest-FloatingIPsNegativeTestJSON-316363990-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/5f877a76-d878-47db-b323-01c9232ab6b6" status: 404 len: 111 microversion: 2.1 time: 0.625866 Oct 28 19:13:31.583802 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 801/1611] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:13:30 2022] DELETE /compute/v2.1/os-floating-ips/5f877a76-d878-47db-b323-01c9232ab6b6 => generated 111 bytes in 627 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:13:31.593027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:31.597932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:31.626886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:31.627767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:31.628534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:31.630421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:31.632487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:31.633124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:31.962177 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4aae8eb-eb28-4a53-bc20-104f544c1b94 tempest-MigrationsAdminTest-5721115 tempest-MigrationsAdminTest-5721115-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1613 microversion: 2.1 time: 1.517335 Oct 28 19:13:31.965194 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 811/1612] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:30 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1613 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:31.973456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f52584a9-1a14-4015-8d97-b57438f97fcb req-84c3298b-3ff1-4e6c-a78a-5c9127e6ac4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "name": "network-vif-plugged", "status": "completed", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:32.037793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f52584a9-1a14-4015-8d97-b57438f97fcb req-84c3298b-3ff1-4e6c-a78a-5c9127e6ac4a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:32.039339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f52584a9-1a14-4015-8d97-b57438f97fcb req-84c3298b-3ff1-4e6c-a78a-5c9127e6ac4a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:32.040584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f52584a9-1a14-4015-8d97-b57438f97fcb req-84c3298b-3ff1-4e6c-a78a-5c9127e6ac4a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:32.071398 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f52584a9-1a14-4015-8d97-b57438f97fcb req-84c3298b-3ff1-4e6c-a78a-5c9127e6ac4a service nova] Creating event network-vif-plugged:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h1-862769-3 Oct 28 19:13:32.083113 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f52584a9-1a14-4015-8d97-b57438f97fcb req-84c3298b-3ff1-4e6c-a78a-5c9127e6ac4a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116372 Oct 28 19:13:32.089899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 812/1613] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:32.110601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:32.112684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:32.131015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:32.133051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:32.137351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:32.138609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:32.139589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:32.140306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.029792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:34.049423 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4a7f0cc-7647-4687-80fb-6a37d5804792 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 2.461957 Oct 28 19:13:34.050125 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 802/1614] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:31 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:34.065017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:34.073482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:34.083316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:34.086171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:34.086884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.087798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:34.094947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:34.096078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.119292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:34.147760 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17891a21-18a4-4288-aac9-eb2a2eb512d9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1501 microversion: 2.1 time: 2.054807 Oct 28 19:13:34.149712 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 813/1615] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:32 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1501 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:34.169944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:34.174584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:34.188899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:34.208852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:34.209786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:34.210469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.211826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:34.212514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:34.213190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.215843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:34.553681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:34.564688 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6cd9cf6-0096-4d30-8a69-e3e239c21525 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1317 microversion: 2.1 time: 0.409620 Oct 28 19:13:34.569113 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 814/1616] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:34 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:34.577542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:34.581022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:34.593528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:34.597192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:34.597863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.598825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:34.599446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:34.603189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:34.914816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:34.930774 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5946524c-cb3b-4c84-b075-6d6e48c83a09 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.871320 Oct 28 19:13:34.931938 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 803/1617] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:34 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:34.977760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:34.981355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:35.024297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.026034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.026597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.031781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.032445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.034990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.162516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:13:35.192122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:35.206040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:35.237329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:35.247662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a27d58fd-a584-41d7-b2f3-fc73a95e6c4d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1292 microversion: 2.25 time: 0.676883 Oct 28 19:13:35.251385 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 815/1618] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:34 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1292 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:35.261688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:35.268891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:35.303932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.304751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.305396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.306285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.306945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.309031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.552062 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d7a241c-ccac-428e-8e1f-8b5ad9c59836 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 204 len: 0 microversion: 2.1 time: 0.595864 Oct 28 19:13:35.552941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 804/1619] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:13:34 2022] DELETE /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:13:35.568730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:35.569512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:35.602450 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b818699d-aa24-445c-9221-197a7fdb4f91 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c/action" status: 202 len: 0 microversion: 2.1 time: 0.331766 Oct 28 19:13:35.605893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.606469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.609374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 816/1620] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:35 2022] POST /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:13:35.610225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.611058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.611534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.611964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.617047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:35.618230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:35.626993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.629605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.631013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:35.635257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:35.648201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:35.651023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.189548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:36.207446 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bb8672a-19c6-417d-b768-386ff2c558bc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.653159 Oct 28 19:13:36.209795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 805/1621] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:35 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:36.215785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:36.216721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:36.227677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:36.236230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:36.237163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.238180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:36.238939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:36.239702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.276447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:36.298745 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2177af8f-48f5-466d-96ac-95d6a82347f9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1468 microversion: 2.1 time: 0.687730 Oct 28 19:13:36.309135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 817/1622] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:35 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1468 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:36.334269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:36.334269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:36.338651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:36.338651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:36.340720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.341733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:36.342160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:36.344910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:36.969039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.001106 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b79b32aa-728d-476a-8b53-199784995418 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1506 microversion: 2.1 time: 0.690624 Oct 28 19:13:37.001709 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 818/1623] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:36 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:37.045347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:37.046004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:37.093159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.093869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.094312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.095081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.103055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.103918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.292780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.303103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-124b0789-ebc0-4ddd-b3d1-4edece999155 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1317 microversion: 2.1 time: 1.091695 Oct 28 19:13:37.303704 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 806/1624] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:36 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:37.313318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:37.313933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:37.334527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.335068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.336319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.343124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.343719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.344175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.827761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.846656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.853098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.854826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:37.856068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bfce62cd-35ea-4d90-9e1d-383b53be380d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1292 microversion: 2.25 time: 0.551340 Oct 28 19:13:37.856626 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 807/1625] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:37 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1292 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:37.862471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c4caa46-0224-4eaf-a3ad-718f1a85e603 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.833109 Oct 28 19:13:37.863311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 819/1626] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:37 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:37.877253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-05c8b17f-7b67-4d5a-ac51-1f4602851693 req-34d8106c-c6a8-4e3b-af7d-7521a796ed4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0abe1-71b4-4c47-b0b3-649546da2bab", "tag": "9c4fabf6-c437-4527-ab25-99f7ecf2bd44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:37.879972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-32e580c0-86cb-4a91-96e1-8773194ffbef req-c3b35c3d-8a0a-4d40-ac55-ab5f42fc98e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ab6041-2ed9-40e8-a8fc-809d5022a310", "name": "network-vif-plugged", "status": "completed", "tag": "4be4fe9c-069f-4b82-8ca7-2e2951f437c7"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:37.912643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-32e580c0-86cb-4a91-96e1-8773194ffbef req-c3b35c3d-8a0a-4d40-ac55-ab5f42fc98e7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.913609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-32e580c0-86cb-4a91-96e1-8773194ffbef req-c3b35c3d-8a0a-4d40-ac55-ab5f42fc98e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.914217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-32e580c0-86cb-4a91-96e1-8773194ffbef req-c3b35c3d-8a0a-4d40-ac55-ab5f42fc98e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.918746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05c8b17f-7b67-4d5a-ac51-1f4602851693 req-34d8106c-c6a8-4e3b-af7d-7521a796ed4b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:37.919730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05c8b17f-7b67-4d5a-ac51-1f4602851693 req-34d8106c-c6a8-4e3b-af7d-7521a796ed4b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:37.920609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05c8b17f-7b67-4d5a-ac51-1f4602851693 req-34d8106c-c6a8-4e3b-af7d-7521a796ed4b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:37.941686 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-32e580c0-86cb-4a91-96e1-8773194ffbef req-c3b35c3d-8a0a-4d40-ac55-ab5f42fc98e7 service nova] Creating event network-vif-plugged:4be4fe9c-069f-4b82-8ca7-2e2951f437c7 for instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 on n-h2-862769-3 Oct 28 19:13:37.944704 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-05c8b17f-7b67-4d5a-ac51-1f4602851693 req-34d8106c-c6a8-4e3b-af7d-7521a796ed4b service nova] Creating event network-changed:9c4fabf6-c437-4527-ab25-99f7ecf2bd44 for instance 02f0abe1-71b4-4c47-b0b3-649546da2bab on n-h2-862769-3 Oct 28 19:13:37.952202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-32e580c0-86cb-4a91-96e1-8773194ffbef req-c3b35c3d-8a0a-4d40-ac55-ab5f42fc98e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087298 Oct 28 19:13:37.954090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 820/1627] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:37.956823 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-05c8b17f-7b67-4d5a-ac51-1f4602851693 req-34d8106c-c6a8-4e3b-af7d-7521a796ed4b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089468 Oct 28 19:13:37.958926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 808/1628] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:37.993870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:38.003686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:38.005173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:38.009637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:38.022171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.025892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.027623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.028207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.029436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.033315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.034190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.035699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.036234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.037217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.043146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.043595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.490058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:38.504667 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0613f07-b31b-4da4-ab46-ffaca3cf5410 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1468 microversion: 2.1 time: 0.540099 Oct 28 19:13:38.511134 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 809/1629] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:37 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1468 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:38.523208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:38.530124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:38.547791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.552131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.552767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:38.553787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:38.554600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:38.555310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:39.093609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:39.108752 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f057dcf-5363-4811-ac70-326c4c9226ce tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1486 microversion: 2.1 time: 0.595161 Oct 28 19:13:39.123455 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 810/1630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:38 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1486 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:39.152808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:39.161981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:39.202192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:39.208821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:39.215524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:39.227996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:39.230817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:39.232061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:39.329409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:39.353011 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14042a8c-925b-49f7-8838-93d0d91c3d8a tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 1.396083 Oct 28 19:13:39.357482 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 821/1631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:37 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:39.387535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:39.388093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:39.414131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:39.415059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:39.418331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:39.419405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:39.419933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:39.420799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:39.937242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:39.952361 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2eb0c832-af29-4fa5-8405-e33d05c7232c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1317 microversion: 2.1 time: 0.826133 Oct 28 19:13:39.954396 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 811/1632] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:39 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1317 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:39.972168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:39.978111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:40.000093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.001755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.002235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.004812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.006784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.007419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.063087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:40.171103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.181791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.183300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.184471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2aa57b64-7219-45c5-ad78-a3c6444f9a10 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1292 microversion: 2.25 time: 0.825205 Oct 28 19:13:40.189476 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 822/1633] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:39 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1292 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:40.198828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:40.203337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:40.215975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.216548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.218565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.219347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.219815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.220282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.281249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:13:40.290465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:40.371980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.382084 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80e54611-a3f8-42fc-9fda-4a8d34a1fe7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.425295 Oct 28 19:13:40.386278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 812/1634] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:39 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:40.393231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:40.405018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:40.405798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:40.409952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-60256669-d7dd-4578-83b5-e0cc25eda88d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 204 len: 0 microversion: 2.1 time: 0.218716 Oct 28 19:13:40.412065 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 823/1635] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:13:40 2022] DELETE /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:13:40.412390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.412882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.413319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.414024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.414601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.415067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.420144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-01ea13f9-58bc-4d45-82a3-23510a9f14fc req-a1739855-9187-4702-9798-b1bd21a97617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e978d56-5e55-4a0b-8b4d-69686209277f", "name": "network-vif-plugged", "status": "completed", "tag": "505938d7-987c-4b49-a515-c963a680cd35"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:40.446089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01ea13f9-58bc-4d45-82a3-23510a9f14fc req-a1739855-9187-4702-9798-b1bd21a97617 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.450389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01ea13f9-58bc-4d45-82a3-23510a9f14fc req-a1739855-9187-4702-9798-b1bd21a97617 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.451177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01ea13f9-58bc-4d45-82a3-23510a9f14fc req-a1739855-9187-4702-9798-b1bd21a97617 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.474420 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-01ea13f9-58bc-4d45-82a3-23510a9f14fc req-a1739855-9187-4702-9798-b1bd21a97617 service nova] Creating event network-vif-plugged:505938d7-987c-4b49-a515-c963a680cd35 for instance 5e978d56-5e55-4a0b-8b4d-69686209277f on n-h1-862769-3 Oct 28 19:13:40.497376 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-01ea13f9-58bc-4d45-82a3-23510a9f14fc req-a1739855-9187-4702-9798-b1bd21a97617 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079141 Oct 28 19:13:40.500103 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 824/1636] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:40.519133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.519691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a2070d2c-dc10-4807-a05a-1826aae764f7 req-8ac6555d-d5a9-422b-a12e-143b6b94763a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb600cf-a95a-4ff7-ac17-5988a5e10eab", "name": "network-vif-deleted", "tag": "e80b4534-90cf-4507-bab1-26498824dbae"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:40.519857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.520635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.523326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lazy-loading 'fault' on Instance uuid 0bb600cf-a95a-4ff7-ac17-5988a5e10eab {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:40.557180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a2070d2c-dc10-4807-a05a-1826aae764f7 req-8ac6555d-d5a9-422b-a12e-143b6b94763a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.557637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a2070d2c-dc10-4807-a05a-1826aae764f7 req-8ac6555d-d5a9-422b-a12e-143b6b94763a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.558747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a2070d2c-dc10-4807-a05a-1826aae764f7 req-8ac6555d-d5a9-422b-a12e-143b6b94763a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.572626 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a2070d2c-dc10-4807-a05a-1826aae764f7 req-8ac6555d-d5a9-422b-a12e-143b6b94763a service nova] Creating event network-vif-deleted:e80b4534-90cf-4507-bab1-26498824dbae for instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab on n-h1-862769-3 Oct 28 19:13:40.579900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a2070d2c-dc10-4807-a05a-1826aae764f7 req-8ac6555d-d5a9-422b-a12e-143b6b94763a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076592 Oct 28 19:13:40.581211 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 825/1637] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:40.588837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:40.589828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:40.609477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.610953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.611188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.612017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.613729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.614727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.615671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.619497 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1efdf93a-29f9-45b4-bdd2-4973f7c1b5a5 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1303 microversion: 2.1 time: 0.231852 Oct 28 19:13:40.620080 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 813/1638] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:40 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:40.634945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:40.635860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:40.642621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.643357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.644127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.660048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.661992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.662874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.888825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.898452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e7e7f25f-a597-4346-bcc6-a7bc893f21bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1492 microversion: 2.1 time: 0.273288 Oct 28 19:13:40.901546 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 814/1639] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:40 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1492 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:40.970113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:40.983531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:40.984895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:40.994062 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd3329d3-d902-42fb-a896-c2a62287cb36 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.411611 Oct 28 19:13:40.995582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 826/1640] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:40 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:40.997203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:40.997953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:40.998639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:40.999884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.000503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.001086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.213341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:41.214532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:41.222509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.230366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.242799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.243589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.244770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.247804 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f43a8156-689e-4bfa-8553-8760a52b59f0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1506 microversion: 2.1 time: 0.268318 Oct 28 19:13:41.249513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.250004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.255106 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 815/1641] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:40 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:41.278466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:41.279369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:41.288851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.293574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.294091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.295057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.295655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.296330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.489045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.498328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.502170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.512526 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-888e7a05-f7d7-4e61-aeea-7d25a89e4ba9 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1292 microversion: 2.25 time: 0.303373 Oct 28 19:13:41.518729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 827/1642] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:41 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:13:41.615582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.626639 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-81430fd6-0dfa-4ebc-bcf0-3461bb316d7f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1506 microversion: 2.1 time: 0.352488 Oct 28 19:13:41.628170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 816/1643] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:41 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:41.633762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:41.634611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:41.642060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.643920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.645268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.646344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.647222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.647907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.717414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fc5b824-a41a-4b9f-bada-d239574ca60e tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Calling method '.version_select at 0x7f1d8001b8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:41.744333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0fc5b824-a41a-4b9f-bada-d239574ca60e tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] HTTP exception thrown: Image not found. Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fc5b824-a41a-4b9f-bada-d239574ca60e tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Request method failure captured: Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/486af130-7b5c-4f7f-b45c-66f19d389c64/metadata/os_distro HTTP/1.1 Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnlZpwF0MiTZxGqPlZHbuaDwUrzDLZHOhwLSTJB6Pgpr98xVHAiFablUjCWzG5Cqcu3l957Ko3_GLe_hqyzseW2YBWx4gfcIRIojG4rXVnlwlJ2Lupv_qaXpSWWg_O4QdV_TQ0KmNzF4pPcZZcLwOtMxLpxzK4XnpcoObBmWk-Qf3I Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:41.749434 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b9d287b92764f43ad531d81a8a3c6f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42584e3b86604699b9372e57a24d218d Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'image_id': '486af130-7b5c-4f7f-b45c-66f19d389c64', 'id': 'os_distro'} Oct 28 19:13:41.751358 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:41.752585 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 486af130-7b5c-4f7f-b45c-66f19d389c64 Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:41.755663 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 486af130-7b5c-4f7f-b45c-66f19d389c64 could not be found. Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:41.757339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:41.758918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fc5b824-a41a-4b9f-bada-d239574ca60e tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:41.760444 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0fc5b824-a41a-4b9f-bada-d239574ca60e tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] 10.222.0.44 "DELETE /compute/v2.1/images/486af130-7b5c-4f7f-b45c-66f19d389c64/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.236469 Oct 28 19:13:41.760444 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 828/1644] 10.222.0.44 () {58 vars in 1293 bytes} [Fri Oct 28 19:13:41 2022] DELETE /compute/v2.1/images/486af130-7b5c-4f7f-b45c-66f19d389c64/metadata/os_distro => generated 62 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:41.760444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:41.760444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:41.765056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.765546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.765975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.766922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.767370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.767787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.815635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.816500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.817196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.818433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lazy-loading 'fault' on Instance uuid 0bb600cf-a95a-4ff7-ac17-5988a5e10eab {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:41.901357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:41.920214 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8037a1a1-93a2-479b-a14f-42e1d0d7a435 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.290445 Oct 28 19:13:41.942577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 817/1645] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:41 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:41.953809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:41.959797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:41.979975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.980389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.980824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.981531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:41.981987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:41.982405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:41.992136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:42.011872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b2cc541-d24b-420c-ba37-4e59a0b7c5eb tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 200 len: 1303 microversion: 2.1 time: 0.258971 Oct 28 19:13:42.020665 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 829/1646] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:41 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:42.029775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44746428-95fc-4df8-8f41-2275106823bf tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Calling method '.version_select at 0x7f1d77df5b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:42.063459 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-44746428-95fc-4df8-8f41-2275106823bf tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] HTTP exception thrown: Image not found. Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44746428-95fc-4df8-8f41-2275106823bf tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Request method failure captured: Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/images/d303bc66-79b3-4791-9cd3-18b9d9b1d140/metadata/os_version HTTP/1.1 Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnlZpwF0MiTZxGqPlZHbuaDwUrzDLZHOhwLSTJB6Pgpr98xVHAiFablUjCWzG5Cqcu3l957Ko3_GLe_hqyzseW2YBWx4gfcIRIojG4rXVnlwlJ2Lupv_qaXpSWWg_O4QdV_TQ0KmNzF4pPcZZcLwOtMxLpxzK4XnpcoObBmWk-Qf3I Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:42.070164 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b9d287b92764f43ad531d81a8a3c6f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42584e3b86604699b9372e57a24d218d Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'image_id': 'd303bc66-79b3-4791-9cd3-18b9d9b1d140', 'id': 'os_version'} Oct 28 19:13:42.071785 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:42.072671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d303bc66-79b3-4791-9cd3-18b9d9b1d140 Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:42.073852 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d303bc66-79b3-4791-9cd3-18b9d9b1d140 could not be found. Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:42.075178 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:13:42.076365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.079549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44746428-95fc-4df8-8f41-2275106823bf tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:42.083679 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44746428-95fc-4df8-8f41-2275106823bf tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] 10.222.0.44 "GET /compute/v2.1/images/d303bc66-79b3-4791-9cd3-18b9d9b1d140/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.061562 Oct 28 19:13:42.084624 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 830/1647] 10.222.0.44 () {58 vars in 1293 bytes} [Fri Oct 28 19:13:42 2022] GET /compute/v2.1/images/d303bc66-79b3-4791-9cd3-18b9d9b1d140/metadata/os_version => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:42.090953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:42.096581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:42.111888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.115149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.115696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.116492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.117026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.118713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.138842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:42.139953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:42.140598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:42.141161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:42.141728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:42.253864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:42.266912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.267399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.270860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.274176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.274712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.275140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.359051 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5c177e2-3c0e-4196-ac5f-d56fe397f415 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "POST /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310/action" status: 202 len: 1108 microversion: 2.1 time: 0.404946 Oct 28 19:13:42.371509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 818/1648] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:41 2022] POST /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310/action => generated 1108 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 19:13:42.388851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:42.390619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:42.404451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.404944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.405533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.406476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.406958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.407422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.845825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:42.864461 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4097e7c-794c-406e-8546-30e69c8a1fd0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1492 microversion: 2.1 time: 0.778654 Oct 28 19:13:42.868639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 831/1649] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:42 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1492 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:42.876137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4fe92df6-55fe-48ad-9a58-d7107ca496ab tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Calling method '.version_select at 0x7f1d800550d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:42.909088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-4fe92df6-55fe-48ad-9a58-d7107ca496ab tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] HTTP exception thrown: Image not found. Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4fe92df6-55fe-48ad-9a58-d7107ca496ab tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Request method failure captured: Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/images/679358f2-643c-4ac1-a01f-e7c607835a10/metadata HTTP/1.1 Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnlZpwF0MiTZxGqPlZHbuaDwUrzDLZHOhwLSTJB6Pgpr98xVHAiFablUjCWzG5Cqcu3l957Ko3_GLe_hqyzseW2YBWx4gfcIRIojG4rXVnlwlJ2Lupv_qaXpSWWg_O4QdV_TQ0KmNzF4pPcZZcLwOtMxLpxzK4XnpcoObBmWk-Qf3I Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:42.911521 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b9d287b92764f43ad531d81a8a3c6f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42584e3b86604699b9372e57a24d218d Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'image_id': '679358f2-643c-4ac1-a01f-e7c607835a10'} Oct 28 19:13:42.913016 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:42.913902 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 679358f2-643c-4ac1-a01f-e7c607835a10 Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:42.915731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 679358f2-643c-4ac1-a01f-e7c607835a10 could not be found. Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:42.920352 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:42.923090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4fe92df6-55fe-48ad-9a58-d7107ca496ab tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:42.928768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4fe92df6-55fe-48ad-9a58-d7107ca496ab tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] 10.222.0.44 "GET /compute/v2.1/images/679358f2-643c-4ac1-a01f-e7c607835a10/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044009 Oct 28 19:13:42.928768 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 832/1650] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:13:42 2022] GET /compute/v2.1/images/679358f2-643c-4ac1-a01f-e7c607835a10/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:42.928768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:42.928768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:42.942425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.944789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.945248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:42.946473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:42.946583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:42.947038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.014515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.032782 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07995237-933e-4750-b016-768a5d1d7701 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.657934 Oct 28 19:13:43.057163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 819/1651] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:42 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:43.069539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.070456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.079751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.080460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.081766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.083959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.084594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.085467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.277796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.291075 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef3cc636-54e7-4193-bf3e-daef4b2e876d tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.375154 Oct 28 19:13:43.291650 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 833/1652] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:42 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:43.296339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c880f2e-5635-4ea1-a549-d20e7bb5f48b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Action: 'update_all', calling method: .version_select at 0x7f1d800770d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:43.340987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9c880f2e-5635-4ea1-a549-d20e7bb5f48b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] HTTP exception thrown: Image not found. Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c880f2e-5635-4ea1-a549-d20e7bb5f48b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Request method failure captured: Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/images/f0f4f868-2ba4-4674-b788-a60d77ce02e0/metadata HTTP/1.1 Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 57 Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnlZpwF0MiTZxGqPlZHbuaDwUrzDLZHOhwLSTJB6Pgpr98xVHAiFablUjCWzG5Cqcu3l957Ko3_GLe_hqyzseW2YBWx4gfcIRIojG4rXVnlwlJ2Lupv_qaXpSWWg_O4QdV_TQ0KmNzF4pPcZZcLwOtMxLpxzK4XnpcoObBmWk-Qf3I Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:43.343101 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b9d287b92764f43ad531d81a8a3c6f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42584e3b86604699b9372e57a24d218d Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:13:43.344826 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'image_id': 'f0f4f868-2ba4-4674-b788-a60d77ce02e0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:43.345907 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0f4f868-2ba4-4674-b788-a60d77ce02e0 Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:43.347417 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0f4f868-2ba4-4674-b788-a60d77ce02e0 could not be found. Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:43.348731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:13:43.350123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.356159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c880f2e-5635-4ea1-a549-d20e7bb5f48b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:43.356159 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c880f2e-5635-4ea1-a549-d20e7bb5f48b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] 10.222.0.44 "PUT /compute/v2.1/images/f0f4f868-2ba4-4674-b788-a60d77ce02e0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051880 Oct 28 19:13:43.356159 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 834/1653] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:13:43 2022] PUT /compute/v2.1/images/f0f4f868-2ba4-4674-b788-a60d77ce02e0/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:43.356159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.356159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.374515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.375031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.376020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.376150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.376604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.377284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.512695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.527314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.532051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.535604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1887991-3b99-4cb4-a6c3-2b5dab268eef tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1292 microversion: 2.25 time: 0.474604 Oct 28 19:13:43.572539 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 820/1654] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:43 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1292 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:43.572539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.572539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 0bb600cf-a95a-4ff7-ac17-5988a5e10eab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.585236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.586022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.586655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.587690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.588362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.588944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.610232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] HTTP exception thrown: Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab could not be found. Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Request method failure captured: Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab HTTP/1.1 Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChvEuQJ-Ko4EFauiyfaEonjHwZSQqGOQFegn7iGoHKaUcCHvMGA_dX4kyx7s2CwHViGi1EvGHzI2RvaBI2LB3Da2BN4jDUb2sRKADwKdeBBJFslwt0f8pZmI3RDxcESUiGxwjErEsNq41bgHFAko6qHv1wdxEO_YSevlKULQtxMxrw Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:13:43.612258 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f4d9bdca05341e38e62618cfe5b9690", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-MigrationsAdminTest-137638495-project Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3142fd0059aa4b658c2cea015b1f3d93 Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-MigrationsAdminTest-137638495-project Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab could not be found. Oct 28 19:13:43.613990 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '0bb600cf-a95a-4ff7-ac17-5988a5e10eab'} Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab could not be found. Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:43.615100 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab could not be found. Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab could not be found. Oct 28 19:13:43.617417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.620359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Returning 404 to user: Instance 0bb600cf-a95a-4ff7-ac17-5988a5e10eab could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:43.621412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1f6fd50-5248-42bc-b198-cc2eb1379c97 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab" status: 404 len: 111 microversion: 2.1 time: 0.067607 Oct 28 19:13:43.622575 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 821/1655] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:43 2022] GET /compute/v2.1/servers/0bb600cf-a95a-4ff7-ac17-5988a5e10eab => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:13:43.629494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49d235cd-7684-44b1-b13c-cd18b3987e49 tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Action: 'update', calling method: .version_select at 0x7f1d779875e0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:43.665859 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-49d235cd-7684-44b1-b13c-cd18b3987e49 tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] HTTP exception thrown: Image not found. Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49d235cd-7684-44b1-b13c-cd18b3987e49 tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Request method failure captured: Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/images/58d638ec-acd1-45e9-8a1e-ab957b8891b5/metadata/os_distro HTTP/1.1 Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 30 Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCnlZpwF0MiTZxGqPlZHbuaDwUrzDLZHOhwLSTJB6Pgpr98xVHAiFablUjCWzG5Cqcu3l957Ko3_GLe_hqyzseW2YBWx4gfcIRIojG4rXVnlwlJ2Lupv_qaXpSWWg_O4QdV_TQ0KmNzF4pPcZZcLwOtMxLpxzK4XnpcoObBmWk-Qf3I Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:13:43.669578 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b9d287b92764f43ad531d81a8a3c6f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 42584e3b86604699b9372e57a24d218d Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: {"meta": {"os_distro": "alt"}} Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:13:43.671408 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'image_id': '58d638ec-acd1-45e9-8a1e-ab957b8891b5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:43.672847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58d638ec-acd1-45e9-8a1e-ab957b8891b5 Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:43.674219 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58d638ec-acd1-45e9-8a1e-ab957b8891b5 could not be found. Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:43.676413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:13:43.677888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.682440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49d235cd-7684-44b1-b13c-cd18b3987e49 tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:43.683943 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49d235cd-7684-44b1-b13c-cd18b3987e49 tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] 10.222.0.44 "PUT /compute/v2.1/images/58d638ec-acd1-45e9-8a1e-ab957b8891b5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.059461 Oct 28 19:13:43.685047 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 822/1656] 10.222.0.44 () {60 vars in 1310 bytes} [Fri Oct 28 19:13:43 2022] PUT /compute/v2.1/images/58d638ec-acd1-45e9-8a1e-ab957b8891b5/metadata/os_distro => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:43.692701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2d1831c4-9171-4689-a7f0-854774216600 req-96a8be01-83a1-4bb6-b0fb-0f1f9865a27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f286edc2-7e69-481a-a2c7-f5810c8a2a5c", "name": "network-vif-deleted", "tag": "a7efed17-e04b-40d8-b859-92e742e29b8d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:43.707024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2d1831c4-9171-4689-a7f0-854774216600 req-96a8be01-83a1-4bb6-b0fb-0f1f9865a27c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.707884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2d1831c4-9171-4689-a7f0-854774216600 req-96a8be01-83a1-4bb6-b0fb-0f1f9865a27c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.708466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2d1831c4-9171-4689-a7f0-854774216600 req-96a8be01-83a1-4bb6-b0fb-0f1f9865a27c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.722219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2d1831c4-9171-4689-a7f0-854774216600 req-96a8be01-83a1-4bb6-b0fb-0f1f9865a27c service nova] Creating event network-vif-deleted:a7efed17-e04b-40d8-b859-92e742e29b8d for instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c on n-h1-862769-3 Oct 28 19:13:43.725853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:43.727812 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2d1831c4-9171-4689-a7f0-854774216600 req-96a8be01-83a1-4bb6-b0fb-0f1f9865a27c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041408 Oct 28 19:13:43.729204 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 823/1657] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:43.736237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.737315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8abf2bc-7d08-42c5-b295-8a8e1ec6320a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1316 microversion: 2.1 time: 0.384307 Oct 28 19:13:43.737467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.737941 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 835/1658] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:43 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:43.745603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.746261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.746888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.747738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.748356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.748923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.760550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eeefb1df-1f3c-4d92-bae9-f78b2d14c32b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Action: 'create', calling method: .version_select at 0x7f1d80077670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:43.787253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:13:43.795698 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-eeefb1df-1f3c-4d92-bae9-f78b2d14c32b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] HTTP exception thrown: Image not found. Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eeefb1df-1f3c-4d92-bae9-f78b2d14c32b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Request method failure captured: Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/images/a953e97d-71ef-4de9-989d-6c33a7bbedfc/metadata HTTP/1.1 Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 57 Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnlZpwF0MiTZxGqPlZHbuaDwUrzDLZHOhwLSTJB6Pgpr98xVHAiFablUjCWzG5Cqcu3l957Ko3_GLe_hqyzseW2YBWx4gfcIRIojG4rXVnlwlJ2Lupv_qaXpSWWg_O4QdV_TQ0KmNzF4pPcZZcLwOtMxLpxzK4XnpcoObBmWk-Qf3I Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:43.798588 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2b9d287b92764f43ad531d81a8a3c6f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2b9d287b92764f43ad531d81a8a3c6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2b9d287b92764f43ad531d81a8a3c6f2 Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393 Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42584e3b86604699b9372e57a24d218d Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1518161393-project Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:13:43.800505 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'image_id': 'a953e97d-71ef-4de9-989d-6c33a7bbedfc', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:43.801578 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a953e97d-71ef-4de9-989d-6c33a7bbedfc Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:13:43.803112 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a953e97d-71ef-4de9-989d-6c33a7bbedfc could not be found. Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:43.804444 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:13:43.805685 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:43.809165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eeefb1df-1f3c-4d92-bae9-f78b2d14c32b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:43.809165 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eeefb1df-1f3c-4d92-bae9-f78b2d14c32b tempest-ImagesMetadataNegativeTestJSON-1518161393 tempest-ImagesMetadataNegativeTestJSON-1518161393-project] 10.222.0.44 "POST /compute/v2.1/images/a953e97d-71ef-4de9-989d-6c33a7bbedfc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055544 Oct 28 19:13:43.809165 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 836/1659] 10.222.0.44 () {60 vars in 1281 bytes} [Fri Oct 28 19:13:43 2022] POST /compute/v2.1/images/a953e97d-71ef-4de9-989d-6c33a7bbedfc/metadata => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:13:43.901114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.902514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.914060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.921518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.922308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.925255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.927882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.928573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.947032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82b12d77-9d2f-4282-9620-e2c61e5c4f30 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "DELETE /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 204 len: 0 microversion: 2.1 time: 0.215040 Oct 28 19:13:43.949946 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 824/1660] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:13:43 2022] DELETE /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:13:43.963460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:43.964443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:43.973122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.973907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.974504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:43.975483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:43.976233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:43.976892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.020177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.021766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.025276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.027289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lazy-loading 'fault' on Instance uuid f286edc2-7e69-481a-a2c7-f5810c8a2a5c {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:44.126070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:44.137332 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48d20a48-0cfc-486e-88b5-8d44aedddf05 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1304 microversion: 2.1 time: 0.243396 Oct 28 19:13:44.165309 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 837/1661] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:43 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1304 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:44.173769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:44.174641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:44.192054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.192915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.202242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.203022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.204548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.206619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.373772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:44.382749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6c6804e-1e2b-4e9e-8392-b41c5aacbf94 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1535 microversion: 2.1 time: 0.424454 Oct 28 19:13:44.383457 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 825/1662] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:43 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1535 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:44.401355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:44.408164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:44.440681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.441305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.441741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.442511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.444867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.445387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.690046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:44.702495 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5edd1caa-a914-453f-ab9b-9547058c3533 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.544687 Oct 28 19:13:44.704530 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 838/1663] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:44 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:44.716502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:44.719618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:44.733037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.736935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.741522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.742746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.743472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.749651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.752975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:44.768659 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-219a90a3-053e-47c4-a62f-ac9cf64aed50 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.383985 Oct 28 19:13:44.770230 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 826/1664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:44 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:44.778439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:44.780374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:44.796126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:44.801135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.802217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.802993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.804355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:44.805542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:44.807040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:44.922474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:45.115330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:45.134505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:45.140125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:45.144793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65fda1db-c85f-47c1-9ce1-210ba7f00be0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1292 microversion: 2.25 time: 0.438329 Oct 28 19:13:45.147448 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 839/1665] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:44 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1292 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:45.169884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:45.171485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:45.189807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.190317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.200829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.203115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.203915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.204521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.207619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:45.231046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5fb8b70-d9b6-499b-b0ad-ed20f9ff5cf2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1466 microversion: 2.1 time: 0.446696 Oct 28 19:13:45.239298 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 827/1666] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:44 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1466 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:45.256128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:45.261058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:45.279224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.279882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.280420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.283158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.285249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.286431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.297662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.298414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.299045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.299670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lazy-loading 'fault' on Instance uuid f286edc2-7e69-481a-a2c7-f5810c8a2a5c {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:45.495018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:45.503321 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aaf4464e-de63-4358-8e60-7a7ca50483a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 200 len: 1304 microversion: 2.1 time: 0.338536 Oct 28 19:13:45.506158 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 840/1667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:45 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 1304 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:45.516484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:45.517349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:45.534742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.535535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.536497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.537446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.537897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.538428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.847815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-985babba-22b2-4638-82ce-845bf6b0a43b tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1617 microversion: 2.1 time: 0.589439 Oct 28 19:13:45.848877 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 828/1668] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:45 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1617 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:45.865315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:45.865930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:45.872498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.872985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.875730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:45.876483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:45.876946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:45.877371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.009071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:46.023221 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d9492c9-6a65-49e9-ad18-2ed90fafe1e0 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1535 microversion: 2.1 time: 0.515354 Oct 28 19:13:46.025240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 841/1669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:45 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1535 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:46.034480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:46.037354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:46.055280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:46.056084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:46.057207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.060543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:46.061610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:46.064154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.397053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:46.408721 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e99fde43-12f4-41cc-95b5-a89fb6a31b51 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.556855 Oct 28 19:13:46.429749 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 829/1670] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:45 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:46.437085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2047806638", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["0bea25a8-c910-4c3a-87a0-715a4885c7c8"]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:46.479386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:46.495233 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a1dcd33-7a3c-4c3e-baab-52cc17e50017 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.466948 Oct 28 19:13:46.496019 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 842/1671] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:46 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:46.504747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:46.505366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:46.516921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:46.525350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:46.525945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.526988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:46.531137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:46.531633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:46.549945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:13:47.196453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:47.214434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:47.215540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:47.216600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b24cfa2f-c475-49fc-9b3f-8e9ca445be19 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 0.717072 Oct 28 19:13:47.237607 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 843/1672] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:46 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:47.242607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:47.243237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.275195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.275953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.291859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.292742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.296819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.297451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.312510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:47.372035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:47.372521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:47.372920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:47.373326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:47.373793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:47.381258 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c HTTP/1.1 Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:47.390155 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:13:47.391701 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f286edc2-7e69-481a-a2c7-f5810c8a2a5c'} Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:47.392551 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:13:47.393946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:47.397827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:47.397827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17fb0fd1-2d8e-47d6-a3e0-817a9e1a0a75 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 404 len: 111 microversion: 2.1 time: 0.158726 Oct 28 19:13:47.399197 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 844/1673] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:47 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:13:47.412506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.413230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.414626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.417135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.418875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.419522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.424548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:47.428127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.439927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.441919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.445223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.448957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.449711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.451666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.473476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:47.487860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:47.527411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:13:47.541683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:13:47.571728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.572304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.577342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.577880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lazy-loading 'fault' on Instance uuid 73968331-d034-4594-8fa9-67a317e9b7bb {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:47.721645 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6565c8bb-73a0-42ad-b62a-308648b28025 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285688 Oct 28 19:13:47.723425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 830/1674] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:13:47.740419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a06e783b-a883-4461-b853-b3b15f37c40c req-49e39246-b119-4109-8aea-6604546bb86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73968331-d034-4594-8fa9-67a317e9b7bb", "name": "network-vif-deleted", "tag": "21b7ddce-77fe-4004-b516-28036c722c4e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:47.762555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a06e783b-a883-4461-b853-b3b15f37c40c req-49e39246-b119-4109-8aea-6604546bb86c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.763067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a06e783b-a883-4461-b853-b3b15f37c40c req-49e39246-b119-4109-8aea-6604546bb86c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.764780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a06e783b-a883-4461-b853-b3b15f37c40c req-49e39246-b119-4109-8aea-6604546bb86c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.790319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a06e783b-a883-4461-b853-b3b15f37c40c req-49e39246-b119-4109-8aea-6604546bb86c service nova] Creating event network-vif-deleted:21b7ddce-77fe-4004-b516-28036c722c4e for instance 73968331-d034-4594-8fa9-67a317e9b7bb on n-h2-862769-3 Oct 28 19:13:47.803543 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a06e783b-a883-4461-b853-b3b15f37c40c req-49e39246-b119-4109-8aea-6604546bb86c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078763 Oct 28 19:13:47.806330 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 831/1675] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:47.819928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:47.821000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.828276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:47.837327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.837835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.840357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.841041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.841267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2e9568b-9b3f-45a0-8f67-e04b2b94e189 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 200 len: 1369 microversion: 2.1 time: 0.428306 Oct 28 19:13:47.841497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.841922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.863026 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 845/1676] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:47 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 1369 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:47.868789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:47.870881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:47.887951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.890552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.891472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:47.892591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:47.894868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:47.895873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.188761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.205305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc328f72-14d1-4dee-905c-b0eee609a913 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.396476 Oct 28 19:13:48.208241 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 832/1677] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:47 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:48.214364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02b3c04e-ad0e-4ff5-8cb4-667c83c48875 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:48.215519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02b3c04e-ad0e-4ff5-8cb4-667c83c48875 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:48.224407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.234323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-90a825a5-55fc-4bf1-a3ff-09f1b5bccc90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.369552 Oct 28 19:13:48.239357 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 846/1678] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:47 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:48.250114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-663817695", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:48.340030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02b3c04e-ad0e-4ff5-8cb4-667c83c48875 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.349398 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02b3c04e-ad0e-4ff5-8cb4-667c83c48875 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1217 microversion: 2.1 time: 0.139771 Oct 28 19:13:48.349629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:13:48.352920 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 833/1679] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:48 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:48.367030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:48.368036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:48.391217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:48.392012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:48.393895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.397898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:48.399064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:48.400223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.722840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.732229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.744373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:48.745786 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70297d7d-60c7-4c5a-8017-23647126ce48 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 0.391757 Oct 28 19:13:48.746480 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 834/1680] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:48 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:48.870584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:48.871590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 73968331-d034-4594-8fa9-67a317e9b7bb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:48.883494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:48.887356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:48.888222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.890492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:48.892302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:48.894106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:48.933294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] HTTP exception thrown: Instance 73968331-d034-4594-8fa9-67a317e9b7bb could not be found. Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Request method failure captured: Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb HTTP/1.1 Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXChvEuQJ-Ko4EFauiyfaEonjHwZSQqGOQFegn7iGoHKaUcCHvMGA_dX4kyx7s2CwHViGi1EvGHzI2RvaBI2LB3Da2BN4jDUb2sRKADwKdeBBJFslwt0f8pZmI3RDxcESUiGxwjErEsNq41bgHFAko6qHv1wdxEO_YSevlKULQtxMxrw Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:13:48.935292 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f4d9bdca05341e38e62618cfe5b9690", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-MigrationsAdminTest-137638495-project Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3142fd0059aa4b658c2cea015b1f3d93 Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-MigrationsAdminTest-137638495-project Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 73968331-d034-4594-8fa9-67a317e9b7bb could not be found. Oct 28 19:13:48.936953 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '73968331-d034-4594-8fa9-67a317e9b7bb'} Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73968331-d034-4594-8fa9-67a317e9b7bb could not be found. Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:48.938193 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73968331-d034-4594-8fa9-67a317e9b7bb could not be found. Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73968331-d034-4594-8fa9-67a317e9b7bb could not be found. Oct 28 19:13:48.939970 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:13:48.943427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Returning 404 to user: Instance 73968331-d034-4594-8fa9-67a317e9b7bb could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:48.944645 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e29cbb13-16b0-42f9-85d4-9e39fc247b9c tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb" status: 404 len: 111 microversion: 2.1 time: 0.078885 Oct 28 19:13:48.949064 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 835/1681] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:48 2022] GET /compute/v2.1/servers/73968331-d034-4594-8fa9-67a317e9b7bb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:13:48.955587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2f16adf-9e5c-4488-aef0-6fc8170ef3e8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '.version_select at 0x7f1d77c46a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:48.985086 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2f16adf-9e5c-4488-aef0-6fc8170ef3e8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411543595" status: 202 len: 0 microversion: 2.1 time: 0.032434 Oct 28 19:13:48.986224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 836/1682] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:13:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411543595 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:13:49.187858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:13:49.189116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:13:49.189755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:13:49.190322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:13:49.190930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:13:49.208492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.208997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.209805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.213302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.213976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.214418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.235301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:49.235917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:49.255082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.255789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.256379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.257061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.257434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.257591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.296436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:49.317774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:49.349919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:13:49.356020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:13:49.443385 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f66edbc3-788d-4250-af3d-c310d9654a37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198611 Oct 28 19:13:49.445010 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 847/1683] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:13:49.473463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:49.479811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:49.520127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.520696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.522361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.523311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:49.528247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:49.528738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:49.953887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:49.976776 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-048534c4-221d-4c78-bf86-1fa74db932a0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.745137 Oct 28 19:13:49.997599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 837/1684] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:49 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:50.010186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:50.013117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:50.032810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:50.034355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:50.035193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:50.039107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:50.040804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:50.042596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:50.199568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.231961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2e718e4b-0bb6-4945-9b08-080860e08faa tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1275 microversion: 2.1 time: 0.228129 Oct 28 19:13:50.236893 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 838/1685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:49 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:50.245451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11a64f99-eecb-463e-87ff-be8c747ee3b3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:50.246461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11a64f99-eecb-463e-87ff-be8c747ee3b3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:50.323928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.339543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7edc8f16-57dd-46b3-ba82-e94e8dfa2eef tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.884826 Oct 28 19:13:50.340217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 848/1686] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:49 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:50.355022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:50.357004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:50.375009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:50.378216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:50.378737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:50.382178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:50.382663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:50.383205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:50.446269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-11a64f99-eecb-463e-87ff-be8c747ee3b3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.460311 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11a64f99-eecb-463e-87ff-be8c747ee3b3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1214 microversion: 2.1 time: 0.218597 Oct 28 19:13:50.462898 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 839/1687] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:50 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:50.875113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.888611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.892966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:50.896725 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d8e1a97-7f1a-46ba-bae4-a3d2953c648e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 0.552671 Oct 28 19:13:50.902158 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 849/1688] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:50 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:51.012070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.012748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.033284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.034057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.037499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.038775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.040747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.043820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.171760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.172617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.184736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.185666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.188903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.190141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.191244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.191980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.269819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:13:51.414130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:51.429306 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-40b2d4b6-809c-4063-8be7-7e730c5d0279 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.422449 Oct 28 19:13:51.433629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 840/1689] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:51 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:51.438368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.441722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.454710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.455516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.458606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.459754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.460384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.461045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.483377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17fe30d2-405a-4924-9257-651b452c8bb7 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "DELETE /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 204 len: 0 microversion: 2.1 time: 0.315672 Oct 28 19:13:51.485529 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 850/1690] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:13:51 2022] DELETE /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:13:51.492117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.493378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.523099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.524132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.525150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.526473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.527243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.528140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.740581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:51.761469 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8b7366a-9094-47ea-99fb-c2dc8ca3f943 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1275 microversion: 2.1 time: 0.326924 Oct 28 19:13:51.774713 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 841/1691] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:51 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1275 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:51.774713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.774713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.774713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.774713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.775440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.775440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.785426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.786367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.831150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:51.842972 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cbf7765c-ce22-48ac-bf2a-aa1cabe1c7e9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.355723 Oct 28 19:13:51.849374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 851/1692] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:51 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:51.854347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:51.855242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:51.866166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.867122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.867796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:51.868504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:51.869109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:51.869699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:52.079063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:52.089578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91056d60-870a-44d2-9df3-adfc30444e78 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1266 microversion: 2.1 time: 0.238990 Oct 28 19:13:52.103213 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 852/1693] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:51 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:52.124416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:52.127807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:52.141007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:52.141756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:52.144093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:52.145034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:52.147257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:52.147979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:52.362331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:52.378496 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-466370f4-e9b9-40e5-b3ef-3d4693b03bb8 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1469 microversion: 2.1 time: 0.614954 Oct 28 19:13:52.379416 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 842/1694] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:51 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:52.459251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:52.460189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:52.482776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:52.489717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:52.494617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:52.495716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:52.497064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:52.500731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.408688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:53.427333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:53.431779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:53.432957 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b96c96c0-626c-4035-a5cf-9a75bfdb8b11 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 1.327975 Oct 28 19:13:53.456490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 853/1695] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:52 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:53.469549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:53.470180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:53.485633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:53.486756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:53.486756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.487362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:53.492212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:53.492808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.607848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:53.618481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-461f1630-962f-45c3-a45b-9cc48f16c8b2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 1.165176 Oct 28 19:13:53.630961 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 843/1696] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:52 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:53.639303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:53.639989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:53.646591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:53.648846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:53.660272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.661542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:53.662104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:53.662830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:53.973902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:53.993596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c1ad98e-5e51-4082-9d47-aa3268ebed8c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.533615 Oct 28 19:13:53.994192 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 854/1697] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:53 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:53.999098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:53.999879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:54.011293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.013139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.013740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.019283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.019761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.020380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.340622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:54.346569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:54.355223 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e35aa15d-57b8-46c5-9e74-763db7e56e30 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.717088 Oct 28 19:13:54.366592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d41a83c1-3e6c-424b-b065-90cf04482082 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1272 microversion: 2.1 time: 0.371044 Oct 28 19:13:54.373533 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 844/1698] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:53 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:54.377090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 855/1699] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:53 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:54.386044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:54.386930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:54.393817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.394550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.395174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.396025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.396631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.397202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.398807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4e83e35a-92e0-4fa6-a04f-48ea477b92a6 req-e25fa00a-e051-4e55-abaa-57a1e49e0b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b9d8c7-fd45-4793-8005-48a329af61fc", "name": "network-vif-deleted", "tag": "acb14376-c9d5-489b-91db-914a95c06be3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:54.412120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e83e35a-92e0-4fa6-a04f-48ea477b92a6 req-e25fa00a-e051-4e55-abaa-57a1e49e0b7f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.413360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e83e35a-92e0-4fa6-a04f-48ea477b92a6 req-e25fa00a-e051-4e55-abaa-57a1e49e0b7f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.413938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e83e35a-92e0-4fa6-a04f-48ea477b92a6 req-e25fa00a-e051-4e55-abaa-57a1e49e0b7f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.442349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.446543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.447216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.448042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lazy-loading 'fault' on Instance uuid 98b9d8c7-fd45-4793-8005-48a329af61fc {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:54.452601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4e83e35a-92e0-4fa6-a04f-48ea477b92a6 req-e25fa00a-e051-4e55-abaa-57a1e49e0b7f service nova] Creating event network-vif-deleted:acb14376-c9d5-489b-91db-914a95c06be3 for instance 98b9d8c7-fd45-4793-8005-48a329af61fc on n-h1-862769-3 Oct 28 19:13:54.464805 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4e83e35a-92e0-4fa6-a04f-48ea477b92a6 req-e25fa00a-e051-4e55-abaa-57a1e49e0b7f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077000 Oct 28 19:13:54.468633 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 856/1700] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:54.474335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:54.475361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:54.482828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.483316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.483890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.484443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.484891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.485423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.697501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:54.713266 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-986b88c3-1622-442f-97c7-b587aa5273a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 200 len: 1303 microversion: 2.1 time: 0.337588 Oct 28 19:13:54.714976 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 845/1701] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:54 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 1303 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:54.746428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:54.747466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:54.783162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.786536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.788264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:54.790205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:54.792138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:54.793599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.155664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:55.168656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:55.170929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:55.172308 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec66ded4-417b-45dd-ba62-898fb56a296a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 0.702180 Oct 28 19:13:55.189792 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 857/1702] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:54 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:55.200271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:55.201330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:55.210163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.211289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.211907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.212822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.213702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.214290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.486933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:55.502070 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d678b556-cfe2-4b4a-b31b-749cb60ed6e2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.767212 Oct 28 19:13:55.504096 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 846/1703] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:54 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:55.546611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:55.548358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:55.579640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.582421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.583632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.586884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.589694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.590877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.802225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:55.813436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba231272-19d6-472e-be6e-51a839713556 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.622096 Oct 28 19:13:55.815369 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 858/1704] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:55 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:55.820814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:55.821708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:55.829852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.830727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.832330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:55.833576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:55.834290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:55.835098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.326300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:56.344942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-604a1c22-90bf-457e-bda4-62d78660a716 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1272 microversion: 2.1 time: 0.528207 Oct 28 19:13:56.347438 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 859/1705] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:55 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1272 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:56.362192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:56.363620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: 98b9d8c7-fd45-4793-8005-48a329af61fc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:56.371827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.372644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.373702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.374944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.375469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.375962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.394492 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] HTTP exception thrown: Instance 98b9d8c7-fd45-4793-8005-48a329af61fc could not be found. Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Request method failure captured: Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc HTTP/1.1 Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChvEuQJ-Ko4EFauiyfaEonjHwZSQqGOQFegn7iGoHKaUcCHvMGA_dX4kyx7s2CwHViGi1EvGHzI2RvaBI2LB3Da2BN4jDUb2sRKADwKdeBBJFslwt0f8pZmI3RDxcESUiGxwjErEsNq41bgHFAko6qHv1wdxEO_YSevlKULQtxMxrw Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:13:56.396647 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f4d9bdca05341e38e62618cfe5b9690", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MigrationsAdminTest-137638495-project Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3142fd0059aa4b658c2cea015b1f3d93 Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MigrationsAdminTest-137638495-project Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 98b9d8c7-fd45-4793-8005-48a329af61fc could not be found. Oct 28 19:13:56.398652 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '98b9d8c7-fd45-4793-8005-48a329af61fc'} Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b9d8c7-fd45-4793-8005-48a329af61fc could not be found. Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:13:56.399632 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b9d8c7-fd45-4793-8005-48a329af61fc could not be found. Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b9d8c7-fd45-4793-8005-48a329af61fc could not be found. Oct 28 19:13:56.402986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:13:56.406624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Returning 404 to user: Instance 98b9d8c7-fd45-4793-8005-48a329af61fc could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:13:56.407689 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fbe937df-add9-44ce-a6b2-27e44a3dc8a9 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc" status: 404 len: 111 microversion: 2.1 time: 0.059007 Oct 28 19:13:56.408269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 860/1706] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:56 2022] GET /compute/v2.1/servers/98b9d8c7-fd45-4793-8005-48a329af61fc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:13:56.414251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:56.415151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:56.426785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.427554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.428163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.429139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.429822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.430572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.457635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:56.467553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:56.482018 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a42405a-db6f-4a08-b797-da6de754fef3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.975936 Oct 28 19:13:56.482549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 847/1707] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:55 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:56.488903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:56.489394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:56.513368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.518128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.518940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.519929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.520616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.521263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.569478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:13:56.574980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:56.795697 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c3d96c43-25f0-4dfa-a2aa-f348533187cd tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 204 len: 0 microversion: 2.1 time: 0.311679 Oct 28 19:13:56.803156 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 848/1708] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:13:56 2022] DELETE /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:13:56.810218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:56.811089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:56.846921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.858952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.859619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.864701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.865647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.866286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.440625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:57.793021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:57.808170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:57.809776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:57.811197 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-38bb5382-1165-4f93-b4ee-639fa3eeb313 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 1.401651 Oct 28 19:13:57.812105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 861/1709] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:56 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:13:57.839653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-15ff1247-9561-4585-b4ed-a6259a1942a1 req-01a53c6a-a0a5-4105-a035-99b2c0943aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de6e746-f4fd-4836-aea6-47e0b2a77299", "name": "network-vif-unplugged", "status": "completed", "tag": "32537282-2078-4847-bf75-4c4118af189d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:57.852122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:57.871428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-15ff1247-9561-4585-b4ed-a6259a1942a1 req-01a53c6a-a0a5-4105-a035-99b2c0943aaa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:57.872155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-15ff1247-9561-4585-b4ed-a6259a1942a1 req-01a53c6a-a0a5-4105-a035-99b2c0943aaa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:57.872743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-15ff1247-9561-4585-b4ed-a6259a1942a1 req-01a53c6a-a0a5-4105-a035-99b2c0943aaa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.903291 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-15ff1247-9561-4585-b4ed-a6259a1942a1 req-01a53c6a-a0a5-4105-a035-99b2c0943aaa service nova] Creating event network-vif-unplugged:32537282-2078-4847-bf75-4c4118af189d for instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 on n-h1-862769-3 Oct 28 19:13:57.916185 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-15ff1247-9561-4585-b4ed-a6259a1942a1 req-01a53c6a-a0a5-4105-a035-99b2c0943aaa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091638 Oct 28 19:13:57.918623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 862/1710] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:57.930462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:57.931694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:57.942175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:57.943055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:57.943703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.944809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:57.945657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:57.946411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.972161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:57.981598 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7eecdcf1-9944-4077-a81a-77dfb1402b6b tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 1.179792 Oct 28 19:13:57.983745 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 849/1711] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:56 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:57.991464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:57.992414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:58.010479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.013803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.015494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.017332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.021641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.023451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.201278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3142fd0059aa4b658c2cea015b1f3d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d9bdca05341e38e62618cfe5b9690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:58.218256 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a3ec52c-1239-49b9-8e37-c829c0223338 tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 200 len: 1425 microversion: 2.1 time: 0.296954 Oct 28 19:13:58.226881 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 863/1712] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:57 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 1425 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:58.233538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:58.234655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:58.254267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.255200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.256407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.257537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.258189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.259999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.730889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:58.740234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ecdc83a-4e0d-4bca-a469-f538b56b688d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.753767 Oct 28 19:13:58.746049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 850/1713] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:57 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:58.756146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:58.757347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:58.767764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.768516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:58.769192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.769890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.770894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.772051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.773151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.783500 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-23bf21af-1e94-4fb0-a4dd-958932def016 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.554495 Oct 28 19:13:58.784094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 864/1714] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:58 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:58.789023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7c2cea8b-c425-48a0-93a7-971bf44b6502 req-7ea823a1-5546-4fdd-94f6-00f829705174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495986a-5fdf-462a-8a27-4cae25051f67", "name": "network-vif-deleted", "tag": "7a6fb0d8-3d62-43fe-ba26-7f441e053865"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:58.808812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7c2cea8b-c425-48a0-93a7-971bf44b6502 req-7ea823a1-5546-4fdd-94f6-00f829705174 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.817451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7c2cea8b-c425-48a0-93a7-971bf44b6502 req-7ea823a1-5546-4fdd-94f6-00f829705174 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.818150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7c2cea8b-c425-48a0-93a7-971bf44b6502 req-7ea823a1-5546-4fdd-94f6-00f829705174 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.831935 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7c2cea8b-c425-48a0-93a7-971bf44b6502 req-7ea823a1-5546-4fdd-94f6-00f829705174 service nova] Creating event network-vif-deleted:7a6fb0d8-3d62-43fe-ba26-7f441e053865 for instance b495986a-5fdf-462a-8a27-4cae25051f67 on n-h2-862769-3 Oct 28 19:13:58.848542 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7c2cea8b-c425-48a0-93a7-971bf44b6502 req-7ea823a1-5546-4fdd-94f6-00f829705174 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063047 Oct 28 19:13:58.853610 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 865/1715] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:59.103038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-618ca3cb-b81f-4ede-8e45-bb65a20f043e tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Action: 'create', calling method: .version_select at 0x7f1d80005e50>, body: {"keypair": {"name": "tempest-keypair-288376368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfX1MvCuj9NGoxpN30Xdl0Sl/CHIVVi0RId2TCQY9NdIRgJpprEztXmOhvMs3nrJRPfN6GGbZs0In69XwreI/NR2oc2xfPCOqRUc23X0wviwiVmoa2BGHUBt2ysAgRVYQ=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:59.123192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-618ca3cb-b81f-4ede-8e45-bb65a20f043e tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Getting quotas for project af309e15479e445c98da964d87177c25. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:13:59.129834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-618ca3cb-b81f-4ede-8e45-bb65a20f043e tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Getting quotas for user a4f4271240a440e9951810577142f269 and project af309e15479e445c98da964d87177c25. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:13:59.161785 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-618ca3cb-b81f-4ede-8e45-bb65a20f043e tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.306160 Oct 28 19:13:59.163288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 866/1716] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:13:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:59.168549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-218b9037-2420-4716-a92e-4b4e78dfe233 req-efd80a25-43df-4384-8b05-941308c3e080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0abe1-71b4-4c47-b0b3-649546da2bab", "name": "network-vif-plugged", "status": "completed", "tag": "9c4fabf6-c437-4527-ab25-99f7ecf2bd44"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:59.199049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-218b9037-2420-4716-a92e-4b4e78dfe233 req-efd80a25-43df-4384-8b05-941308c3e080 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.209778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-218b9037-2420-4716-a92e-4b4e78dfe233 req-efd80a25-43df-4384-8b05-941308c3e080 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.210512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-218b9037-2420-4716-a92e-4b4e78dfe233 req-efd80a25-43df-4384-8b05-941308c3e080 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:59.229777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-218b9037-2420-4716-a92e-4b4e78dfe233 req-efd80a25-43df-4384-8b05-941308c3e080 service nova] Creating event network-vif-plugged:9c4fabf6-c437-4527-ab25-99f7ecf2bd44 for instance 02f0abe1-71b4-4c47-b0b3-649546da2bab on n-h2-862769-3 Oct 28 19:13:59.241025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-218b9037-2420-4716-a92e-4b4e78dfe233 req-efd80a25-43df-4384-8b05-941308c3e080 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076106 Oct 28 19:13:59.247941 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 867/1717] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:59.252898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:59.260825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:59.261941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:59.270209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.271099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.271647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:59.272589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.274510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.275606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:59.331507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:59.345723 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4b8789b-7938-4e86-967a-ca7e42117612 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.592576 Oct 28 19:13:59.346794 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 851/1718] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:58 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:59.356876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:59.357504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:59.365722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.366650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.367409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:59.368705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.369352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.369992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.201644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.211332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.212832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.214058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d9af902-4b05-4a3e-97fe-973c31541e54 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1280 microversion: 2.25 time: 0.963216 Oct 28 19:14:00.215006 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 868/1719] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:13:59 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1280 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:00.239351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:00.240591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] [instance: b495986a-5fdf-462a-8a27-4cae25051f67] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:00.246174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.246725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.247193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.247929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.248382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.248784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.266167 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] HTTP exception thrown: Instance b495986a-5fdf-462a-8a27-4cae25051f67 could not be found. Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Request method failure captured: Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 HTTP/1.1 Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXChvEuQJ-Ko4EFauiyfaEonjHwZSQqGOQFegn7iGoHKaUcCHvMGA_dX4kyx7s2CwHViGi1EvGHzI2RvaBI2LB3Da2BN4jDUb2sRKADwKdeBBJFslwt0f8pZmI3RDxcESUiGxwjErEsNq41bgHFAko6qHv1wdxEO_YSevlKULQtxMxrw Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:00.268531 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f4d9bdca05341e38e62618cfe5b9690", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f4d9bdca05341e38e62618cfe5b9690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MigrationsAdminTest-137638495 Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3f4d9bdca05341e38e62618cfe5b9690 Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MigrationsAdminTest-137638495 Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MigrationsAdminTest-137638495-project Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3142fd0059aa4b658c2cea015b1f3d93 Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MigrationsAdminTest-137638495-project Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance b495986a-5fdf-462a-8a27-4cae25051f67 could not be found. Oct 28 19:14:00.270404 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'b495986a-5fdf-462a-8a27-4cae25051f67'} Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b495986a-5fdf-462a-8a27-4cae25051f67 could not be found. Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:00.271426 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b495986a-5fdf-462a-8a27-4cae25051f67 could not be found. Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b495986a-5fdf-462a-8a27-4cae25051f67 could not be found. Oct 28 19:14:00.273075 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:00.274322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] Returning 404 to user: Instance b495986a-5fdf-462a-8a27-4cae25051f67 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:00.274322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9372f44d-1cbd-4e2c-bf79-0bb3839a9d1b tempest-MigrationsAdminTest-137638495 tempest-MigrationsAdminTest-137638495-project] 10.222.0.44 "GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67" status: 404 len: 111 microversion: 2.1 time: 0.053590 Oct 28 19:14:00.274322 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 869/1720] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:00 2022] GET /compute/v2.1/servers/b495986a-5fdf-462a-8a27-4cae25051f67 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:00.281093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:00.281785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:00.289201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.289698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.290128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.290925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.291323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.291746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.339359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.350593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-16db7953-e860-46c8-b42d-6523f5141df7 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 1.002625 Oct 28 19:14:00.351278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 852/1721] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:59 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:00.372745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:00.373563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:00.380664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.381151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.381601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.382298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.382852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.383269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.454641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:00.744167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.752584 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4eb48a63-3364-4ed0-8d48-7d435b5bcf81 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.480285 Oct 28 19:14:00.753217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 870/1722] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:00 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:00.759220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9c88252f-8961-445d-880a-009222a26b08 req-ca0a50eb-60b2-44b3-aee2-861ea7ef53c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf9329d-77e2-41f2-9c79-f8721fb3d1bd", "tag": "edf346f5-72f0-4784-ab1e-524a89e16046"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:00.769295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c88252f-8961-445d-880a-009222a26b08 req-ca0a50eb-60b2-44b3-aee2-861ea7ef53c4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.769812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c88252f-8961-445d-880a-009222a26b08 req-ca0a50eb-60b2-44b3-aee2-861ea7ef53c4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.770201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c88252f-8961-445d-880a-009222a26b08 req-ca0a50eb-60b2-44b3-aee2-861ea7ef53c4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.787495 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9c88252f-8961-445d-880a-009222a26b08 req-ca0a50eb-60b2-44b3-aee2-861ea7ef53c4 service nova] Creating event network-changed:edf346f5-72f0-4784-ab1e-524a89e16046 for instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd on n-h1-862769-3 Oct 28 19:14:00.794849 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9c88252f-8961-445d-880a-009222a26b08 req-ca0a50eb-60b2-44b3-aee2-861ea7ef53c4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040152 Oct 28 19:14:00.796450 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 871/1723] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:00.803113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:00.804096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:00.815175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.817378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.817889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.818863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.819279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.820210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.881118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.901759 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9e10602-ab89-4b2b-9a89-e891b2d030a4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.536583 Oct 28 19:14:00.915026 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 853/1724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:00 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:01.235533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:01.242051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:01.242804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:01.248362 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce1a3b3b-7c32-4b9d-96ca-df54f02a10d7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.450506 Oct 28 19:14:01.252961 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 872/1725] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:00 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:01.255984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.256483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.260229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.262261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.262862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.264086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.378744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:01.379494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:01.388679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.390337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.391651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.392810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.394538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.395120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.568000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:01.577285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:01.578721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:01.580132 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a6828dd-0c1a-42cc-ad1d-292f4b6aef68 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1477 microversion: 2.25 time: 0.342433 Oct 28 19:14:01.595580 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 854/1726] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:01 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1477 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:14:01.875635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:01.887780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f4efa9b-0bf1-42c2-a583-bea26f86547c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.513649 Oct 28 19:14:01.889677 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 873/1727] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:01 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:01.904901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:01.906535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:01.920870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.921737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.923668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.929554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:01.929998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.930643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.931098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:01.931244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.940017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.941843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.942376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.943229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.943788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.944458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.449441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:02.457377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d096838a-9925-4b2f-81ef-e7f1063e827e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.566525 Oct 28 19:14:02.458047 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 874/1728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:01 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:02.462644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:02.463343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:02.470815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:02.471432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:02.471953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.472735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:02.473268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:02.475178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.506587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 02f0abe1-71b4-4c47-b0b3-649546da2bab {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:02.521831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6efd5c34-2077-4323-908e-1163a7b51d99 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1969 microversion: 2.25 time: 0.919785 Oct 28 19:14:02.522414 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 855/1729] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:01 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1969 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:14:02.528465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:02.529390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:02.554988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:02.555577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:02.556244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.557183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:02.557855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:02.558449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.959679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:02.970160 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b696b72-9a38-4bd2-b958-cc114d740162 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.510975 Oct 28 19:14:02.971529 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 875/1730] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:02 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:02.982417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1844038775", "imageRef": "9d577c3f-6ec5-4dc1-958d-2b56ca1f1cd4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "69a2700f-4064-47c2-a2ad-9528ea862684"}], "security_groups": [{"name": "tempest-securitygroup--1124284208"}], "key_name": "tempest-keypair-288376368", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:02.996497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:03.007733 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-270e11e2-65e1-41a9-a3f0-c1e1ed5f80d9 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.483586 Oct 28 19:14:03.009329 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 856/1731] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:02 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:03.016255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:03.016871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:03.034787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:03.035302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:03.036050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:03.036759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:03.037217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:03.044072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:03.653513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] validate_networks() for [('69a2700f-4064-47c2-a2ad-9528ea862684', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:14:03.822440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 02f0abe1-71b4-4c47-b0b3-649546da2bab {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:03.846812 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a56b092c-8344-482e-bd0b-55882555f4e2 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1969 microversion: 2.25 time: 0.836312 Oct 28 19:14:03.855400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 857/1732] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:03 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1969 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:03.863389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de6e746-f4fd-4836-aea6-47e0b2a77299", "tag": "32537282-2078-4847-bf75-4c4118af189d"}, {"name": "network-changed", "server_uuid": "9908d12e-78a2-487f-b024-6b70458c31bf", "tag": "e4a459cf-63b3-4d25-b574-d0e73c54b919"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:03.881414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:03.882164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:03.882863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:03.897125 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] Creating event network-changed:32537282-2078-4847-bf75-4c4118af189d for instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 on n-h1-862769-3 Oct 28 19:14:03.897957 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] Creating event network-changed:e4a459cf-63b3-4d25-b574-d0e73c54b919 for instance 9908d12e-78a2-487f-b024-6b70458c31bf on n-h1-862769-3 Oct 28 19:14:03.906118 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-92947ad4-1c92-4fd7-9867-a4248408251a req-6b46be62-279f-463a-bc29-4c59dac412ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049411 Oct 28 19:14:03.907417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 858/1733] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:03.915395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:03.916166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:03.931287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:03.932136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:03.932813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:03.933772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:03.934435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:03.935173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.192077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:04.200557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a107040a-5f8b-415e-add0-647d983d6fc3 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.291303 Oct 28 19:14:04.201292 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 859/1734] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:03 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:04.292176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:14:04.292596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:14:04.293066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:14:04.293522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:14:04.293911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:14:04.303834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.304681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.305282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.306202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.306654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.307263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.324928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Getting quotas for project af309e15479e445c98da964d87177c25. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:04.329964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Getting quotas for user a4f4271240a440e9951810577142f269 and project af309e15479e445c98da964d87177c25. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:04.342225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:14:04.344593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d577c3f-6ec5-4dc1-958d-2b56ca1f1cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:14:04.403031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2b0d43-4212-484e-be1b-2405c426a889 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d77965670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2016468402", "description": "tempest-description-1970855209"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:04.420197 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cab0f018-8e72-422e-b549-c75907d5d1b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.445509 Oct 28 19:14:04.422682 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 876/1735] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:14:04.427887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:04.429449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:04.439393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.440194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.440798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.441666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.442292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.442905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.667996 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc2b0d43-4212-484e-be1b-2405c426a889 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.465380 Oct 28 19:14:04.669010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 860/1736] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:04.681072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:04.685702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.686632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.687169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.689146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.689988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.691044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.735313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:04.745834 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b51d6fc-0777-45d1-b750-6b025a89d9da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.321692 Oct 28 19:14:04.747174 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 877/1737] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:04 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:04.752793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:04.753481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e76dbac-1b98-47e0-b587-c5f829eb7bc6 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.083270 Oct 28 19:14:04.754293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:04.761865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.762941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 861/1738] 10.222.0.44 () {60 vars in 1217 bytes} [Fri Oct 28 19:14:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:14:04.763295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.764342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.765462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.766197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.767130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.771922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:04.772651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:04.793076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.793583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.795067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.795807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.796269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.796695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.090953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:05.101146 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0888a45c-67a1-4234-b4c0-3cd1644c2a93 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.336975 Oct 28 19:14:05.105241 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 862/1739] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:04 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:05.157032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:05.178026 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac68206a-f995-4517-8a5a-ebe7f63b996e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.429276 Oct 28 19:14:05.179493 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 878/1740] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:04 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:05.190421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:05.192480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:05.210379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.211394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.215425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.216456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.217175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.218157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:05.219272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.221964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.222469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.222933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.223684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.229022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.229475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.272226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:05.296411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-564520da-82c9-430c-bd1e-80cc9d98327f tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.189702 Oct 28 19:14:05.297358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 863/1741] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:14:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:05.302704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7fa9093-46f0-4027-9e24-4b8180810f11 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d77964040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-730296321", "description": "tempest-description-563430796"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:05.336927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:05.352358 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-829f9d0d-79b8-4c09-ba7e-70182510e471 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1249 microversion: 2.1 time: 0.170408 Oct 28 19:14:05.369449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 879/1742] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:05 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1249 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:05.377964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-3", "block_migration": "auto"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:05.381394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:05.389987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.390869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.391591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.392656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.393341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.394029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.458356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'flavor' on Instance uuid 02f0abe1-71b4-4c47-b0b3-649546da2bab {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:05.482818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Going to try to live migrate instance to n-h1-862769-3 {{(pid=120629) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:14:06.039663 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7fa9093-46f0-4027-9e24-4b8180810f11 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.741199 Oct 28 19:14:06.040776 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 864/1743] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:06.045741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:06.046679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:06.060617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.061629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.062294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.063408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.064061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.064754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.313659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:06.322872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad8e5434-43eb-4242-a79c-2e05a4cb1fdc tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.280805 Oct 28 19:14:06.323735 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 865/1744] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:06 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:06.329977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:06.335538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.336200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.336619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.337789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.338611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.339245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.370306 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c24f8a1-de65-4c5e-8a06-1d52aeeca6fc tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?host=n-d-862769-3" status: 200 len: 578 microversion: 2.1 time: 0.044100 Oct 28 19:14:06.371323 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 866/1745] 10.222.0.44 () {58 vars in 1172 bytes} [Fri Oct 28 19:14:06 2022] GET /compute/v2.1/os-services?host=n-d-862769-3 => generated 578 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:06.379579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d1a40feb-5491-4b6a-8dcb-e07a905a7593 req-19f79ad6-d1c5-4160-b05b-23a63e4a860b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf9329d-77e2-41f2-9c79-f8721fb3d1bd", "name": "network-vif-plugged", "status": "completed", "tag": "edf346f5-72f0-4784-ab1e-524a89e16046"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:06.392530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d1a40feb-5491-4b6a-8dcb-e07a905a7593 req-19f79ad6-d1c5-4160-b05b-23a63e4a860b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.393200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d1a40feb-5491-4b6a-8dcb-e07a905a7593 req-19f79ad6-d1c5-4160-b05b-23a63e4a860b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.393871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d1a40feb-5491-4b6a-8dcb-e07a905a7593 req-19f79ad6-d1c5-4160-b05b-23a63e4a860b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.409084 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d1a40feb-5491-4b6a-8dcb-e07a905a7593 req-19f79ad6-d1c5-4160-b05b-23a63e4a860b service nova] Creating event network-vif-plugged:edf346f5-72f0-4784-ab1e-524a89e16046 for instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd on n-h1-862769-3 Oct 28 19:14:06.417279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d1a40feb-5491-4b6a-8dcb-e07a905a7593 req-19f79ad6-d1c5-4160-b05b-23a63e4a860b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044228 Oct 28 19:14:06.422642 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 867/1746] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:06.429757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:06.430769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:06.438326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.440096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.440715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.441620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.442530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.443188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.463251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:06.937979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:06.947635 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f562443-fe0f-4017-b7df-51e8b4d0b485 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1317 microversion: 2.1 time: 0.523405 Oct 28 19:14:06.959548 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 868/1747] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:06 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:06.971658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:06.972757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:06.979914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.980663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.981275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.982146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.983128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.983886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:07.266839 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35403dce-38a8-47c7-86f0-bbafae151c54 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab/action" status: 202 len: 0 microversion: 2.25 time: 1.895206 Oct 28 19:14:07.270866 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 880/1748] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:14:05 2022] POST /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab/action => generated 0 bytes in 1900 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:07.278224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1473748497", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "bdb913ed-e7b6-4e44-9fae-837a1dea66c0"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:07.401078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] validate_networks() for [('bdb913ed-e7b6-4e44-9fae-837a1dea66c0', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:14:07.698052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:07.719347 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-881795f9-4c43-48ee-9d48-fd84ec19d2c1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.753231 Oct 28 19:14:07.721917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 869/1749] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:06 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:07.745249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:07.747389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:07.771328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:07.779580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:07.780021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:07.781480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:07.782005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:07.782607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.205539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:08.215883 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5668f401-fed4-4494-95c9-97ec4830516f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.490969 Oct 28 19:14:08.230757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 870/1750] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:07 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:08.242565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:08.243442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:08.250677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.251656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.252468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.253496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.254232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.254954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.409804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:08.421635 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e16f5b0-7128-4cb3-a62f-e92a52a9fc8a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1303 microversion: 2.1 time: 0.187297 Oct 28 19:14:08.425816 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 871/1751] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:08 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:08.444464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:08.467605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.468177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.468678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.469532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.470047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.470497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.556054 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c4d7fc0f-a825-4093-957b-d3eb9276334d tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.128659 Oct 28 19:14:08.556996 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 872/1752] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:14:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:08.568314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:08.577221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:08.584018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.584777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.592307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.593333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.594611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.595259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.566623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:09.581794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:09.586011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:09.592379 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a489da37-7eba-45e9-af46-9b005f2021d7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 1.032653 Oct 28 19:14:09.594980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 873/1753] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:08 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:09.611962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:09.612853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:09.626097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.626912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.629948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.630924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.631549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.632134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.664528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:14:09.665061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:14:09.666586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:14:09.667296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:14:09.668403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:14:09.683590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.684164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.687080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.689689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.690280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.691860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.713824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:09.761104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Getting quotas for project 9c5ba6ddbf324d7f86f14da325613bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:09.775102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Getting quotas for user 54eb9513374c415bb4744578d640b888 and project 9c5ba6ddbf324d7f86f14da325613bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:09.805486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:14:09.810379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:14:09.927453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-347e7ba5-5c46-4a7b-a505-bc01f42519c8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.655052 Oct 28 19:14:09.928536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 881/1754] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:14:09.935791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:09.945940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:09.960337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.961777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.965494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.968198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:09.968911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:09.969564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.030644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:10.045515 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f0c2224-7afc-4526-b010-05da9d66555e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.449049 Oct 28 19:14:10.046380 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 874/1755] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:09 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:10.059781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:10.078176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.078176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.078176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.078176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.079524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.096161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.159375 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bf47423-88f8-41a4-b662-cc2af9061233 tempest-ServicesAdminTestJSON-803840143 tempest-ServicesAdminTestJSON-803840143-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.101274 Oct 28 19:14:10.160201 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 875/1756] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:14:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:10.172099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:10.175112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:10.187885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.189933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.190668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.191612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.192391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.196754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.720799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:10.738759 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e58d9e6-2346-49e9-802e-7f9bd6b06e7f tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1467 microversion: 2.1 time: 0.807135 Oct 28 19:14:10.744884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 882/1757] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:09 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1467 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:10.770224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:10.787799 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5addde6b-c0e9-4263-aac9-30dcb4cf6366 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.626116 Oct 28 19:14:10.792385 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 876/1758] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:10 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:10.793903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:10.797819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:10.814243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:10.816604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:10.817553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.818044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.818472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.819204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.819667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.824633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.835553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.837240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.849790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.852822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.853595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.856246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.367753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:11.376655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d185408-0bcc-428c-bce0-04ffacf27121 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.617838 Oct 28 19:14:11.377229 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 883/1759] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:10 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:11.397054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-80f671ba-fb60-4b3c-91e9-eadf63c4be55 req-25b38dc2-72ba-4c8a-bf8a-6428d316d06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9908d12e-78a2-487f-b024-6b70458c31bf", "name": "network-vif-plugged", "status": "completed", "tag": "e4a459cf-63b3-4d25-b574-d0e73c54b919"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:11.426284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-80f671ba-fb60-4b3c-91e9-eadf63c4be55 req-25b38dc2-72ba-4c8a-bf8a-6428d316d06f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.427837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-80f671ba-fb60-4b3c-91e9-eadf63c4be55 req-25b38dc2-72ba-4c8a-bf8a-6428d316d06f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.431024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-80f671ba-fb60-4b3c-91e9-eadf63c4be55 req-25b38dc2-72ba-4c8a-bf8a-6428d316d06f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.475600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-80f671ba-fb60-4b3c-91e9-eadf63c4be55 req-25b38dc2-72ba-4c8a-bf8a-6428d316d06f service nova] Creating event network-vif-plugged:e4a459cf-63b3-4d25-b574-d0e73c54b919 for instance 9908d12e-78a2-487f-b024-6b70458c31bf on n-h1-862769-3 Oct 28 19:14:11.483421 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-80f671ba-fb60-4b3c-91e9-eadf63c4be55 req-25b38dc2-72ba-4c8a-bf8a-6428d316d06f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099534 Oct 28 19:14:11.484062 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 884/1760] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:11.490346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:11.503382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.516043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.516474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:11.517237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.517797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.518579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.531367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.535182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.548540 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-adf66921-92e0-44c0-8244-33bde70d84e5 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.742768 Oct 28 19:14:11.549211 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 877/1761] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:10 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:11.604408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:11.605142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.627686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.632710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.633458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.635946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.636598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.638370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.813281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:11.858513 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e487334-8c0b-4a6c-a966-90d04d9e1e5a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1268 microversion: 2.1 time: 0.373135 Oct 28 19:14:11.859419 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 885/1762] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:11 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1268 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:11.867014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:11.875713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.886502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.892443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.893329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.894416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.896031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.900001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.375077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:12.393613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:12.394912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:12.406853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-713509d2-d08d-4a88-b513-7f5bbf37c1d3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.856499 Oct 28 19:14:12.411427 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 878/1763] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:11 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:12.416563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:12.430048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:12.453539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.461332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.463215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.466431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.468565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.476469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.840042 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c640310-ab3d-49a5-aae0-932cc69677af tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1618 microversion: 2.1 time: 0.978821 Oct 28 19:14:12.847670 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 886/1764] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:11 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1618 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:12.854145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:12.862006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:12.888006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.917162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.917533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.920774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.922386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.931665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.123827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:13.141736 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f17d342-0464-4113-94f0-ebf8903cc87c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.727097 Oct 28 19:14:13.164663 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 879/1765] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:12 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:13.200380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:13.205266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:13.237014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.241716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.242740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.244513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.248076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.249892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.404358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:13.418011 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ae3f8b3-f09d-4b8e-ae39-ea09612b6020 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.568710 Oct 28 19:14:13.423871 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 887/1766] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:12 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:13.434628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:13.438346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:13.456672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.458105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.458954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.461878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.463314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.464694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.927880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:13.941532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06b4218e-7432-4478-b1e7-8f3413b766c3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1314 microversion: 2.1 time: 0.765311 Oct 28 19:14:13.945697 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 880/1767] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:13 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:13.965067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:13.966366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:13.977659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.979880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.981809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.983793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.985968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.988103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.141857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.153711 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-158848ec-5d78-4708-a6c5-8916570dac36 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1274 microversion: 2.1 time: 0.206548 Oct 28 19:14:14.157385 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 881/1768] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:13 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:14.162813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-801135", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0bea25a8-c910-4c3a-87a0-715a4885c7c8"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:14.185057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.199680 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2483d45e-cc4d-4401-9611-42602d712846 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.774314 Oct 28 19:14:14.212586 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 888/1769] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:13 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:14.229658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:14.232480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:14.288985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.295461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.296712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.304706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.305608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.310870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.354935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:14:14.667363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.688234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.692881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.697258 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4bcc6dc1-2245-4468-92b2-89c296d4696d tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.489110 Oct 28 19:14:14.712126 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 889/1770] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:14 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:14.728210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-21912c3f-6101-4d4f-aa1c-22d42aca0f00 req-57ce19dd-0a42-4d8a-832b-84c6c5485668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efddd30-6dca-454a-b51b-f74fe8f42bd1", "tag": "bfde1a01-62ff-4eba-94c2-3c93da12384f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:14.738999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:14.747094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-21912c3f-6101-4d4f-aa1c-22d42aca0f00 req-57ce19dd-0a42-4d8a-832b-84c6c5485668 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.751598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-21912c3f-6101-4d4f-aa1c-22d42aca0f00 req-57ce19dd-0a42-4d8a-832b-84c6c5485668 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.752773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-21912c3f-6101-4d4f-aa1c-22d42aca0f00 req-57ce19dd-0a42-4d8a-832b-84c6c5485668 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.779250 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-21912c3f-6101-4d4f-aa1c-22d42aca0f00 req-57ce19dd-0a42-4d8a-832b-84c6c5485668 service nova] Creating event network-changed:bfde1a01-62ff-4eba-94c2-3c93da12384f for instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 on n-h2-862769-3 Oct 28 19:14:14.789734 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-21912c3f-6101-4d4f-aa1c-22d42aca0f00 req-57ce19dd-0a42-4d8a-832b-84c6c5485668 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074006 Oct 28 19:14:14.790541 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 890/1771] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:14.800907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:14.801879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:14.815200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.816052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.816638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.817466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.818081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.818702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.970324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:14:14.973687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:14:14.975325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:14:14.978095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:14:14.978498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:14:15.006328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.007320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.007950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.008903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.019420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.020139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.060963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:15.067887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Getting quotas for user 1a3dbfbf41424e6382c532c4af5f8a01 and project 6df42e9bda2b4307a800e2a35af177be. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:15.102323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:14:15.104894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:14:15.113000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:15.130073 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0adada8-c4de-4ac3-8070-dbcb6c093aa2 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.336124 Oct 28 19:14:15.132334 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 891/1772] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:14 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:15.137839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.139303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.154066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.155182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.156222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.158734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.161920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.163723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.186274 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d20ca3b-0b33-4599-9344-f1a2d3d98087 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.027516 Oct 28 19:14:15.194003 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 882/1773] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:14:15.199515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.200266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.209218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.211211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.211871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.212855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.213567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.232898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.765660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:15.775118 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-782f7599-d746-48c4-9f55-312e16bb3de2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1513 microversion: 2.1 time: 0.641358 Oct 28 19:14:15.791071 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 892/1774] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1513 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:15.791071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.791071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.807174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:15.815664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf33c285-810b-4482-aad0-8d7b8e10fb8c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1501 microversion: 2.1 time: 0.620313 Oct 28 19:14:15.830725 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 883/1775] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1501 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:15.830725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e35ceaa-86fa-4145-8ef0-ef1a73bd0116 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.830725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e35ceaa-86fa-4145-8ef0-ef1a73bd0116 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.832481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.833210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.834930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.837432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.840437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.843261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.948910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9e35ceaa-86fa-4145-8ef0-ef1a73bd0116 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:15.956292 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e35ceaa-86fa-4145-8ef0-ef1a73bd0116 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1213 microversion: 2.1 time: 0.136448 Oct 28 19:14:15.956867 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 884/1776] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:15.971968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.979629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.988100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.003578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.004298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.005262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.005902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.006476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.331800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:16.340128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e00e4ed-32e4-4d79-9292-c401ab002b41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.559041 Oct 28 19:14:16.359819 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 893/1777] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:16.371554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:16.372447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:16.403318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.415167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.415861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.416835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.418312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.423345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.533756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:16.542430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-719115bd-82c8-4ee2-9f02-4cd520fea18d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.574360 Oct 28 19:14:16.547562 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 885/1778] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:16.577420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:16.578257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:16.599428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.599923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.600356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.601154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.601611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.602027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.665070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lazy-loading 'flavor' on Instance uuid 9908d12e-78a2-487f-b024-6b70458c31bf {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:16.812457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:16.835622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:16.847037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:16.852902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:16.860543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-20e68b8c-35d3-4dd9-95c4-2f007e05ba93 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.494892 Oct 28 19:14:16.861821 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 894/1779] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:16 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:16.877437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3b76a60c-bae7-4e85-a191-85aec9067bfb req-8bffee71-807b-4801-aa88-e90afda0ad2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398", "tag": "1f58cb5b-d4e4-41ca-81ac-f3589733aedf"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:16.889922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3b76a60c-bae7-4e85-a191-85aec9067bfb req-8bffee71-807b-4801-aa88-e90afda0ad2b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.895758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3b76a60c-bae7-4e85-a191-85aec9067bfb req-8bffee71-807b-4801-aa88-e90afda0ad2b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.896656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3b76a60c-bae7-4e85-a191-85aec9067bfb req-8bffee71-807b-4801-aa88-e90afda0ad2b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.948639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3b76a60c-bae7-4e85-a191-85aec9067bfb req-8bffee71-807b-4801-aa88-e90afda0ad2b service nova] Creating event network-changed:1f58cb5b-d4e4-41ca-81ac-f3589733aedf for instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 on n-h1-862769-3 Oct 28 19:14:16.955145 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3b76a60c-bae7-4e85-a191-85aec9067bfb req-8bffee71-807b-4801-aa88-e90afda0ad2b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091782 Oct 28 19:14:16.962210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 895/1780] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:16.984176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:16.985219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:16.999718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.000592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.002156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.003324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.004002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.004787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.236411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd3c0f46-23aa-455c-8b61-d9ca2545ead7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf/action" status: 202 len: 0 microversion: 2.1 time: 0.686734 Oct 28 19:14:17.245734 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 886/1781] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:14:16 2022] POST /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:17.265055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:17.265791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:17.298600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.299368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.299824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.304552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.305132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.305581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.634635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:17.666639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f16f038-8d34-4237-a7e6-b5922ecf505d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.702670 Oct 28 19:14:17.677256 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 896/1782] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:16 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:17.688315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:17.690346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:17.709591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.710425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.711252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.712301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.712964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.713617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.836940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:17.857894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1456eda9-3ca3-4502-83ff-5e471a5e39d8 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1531 microversion: 2.1 time: 0.609737 Oct 28 19:14:17.875559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 887/1783] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:17 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1531 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:17.881942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:17.884573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:17.887663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:17.891211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59de4418-841a-4cab-888f-7381826a01bd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1209 microversion: 2.1 time: 0.212187 Oct 28 19:14:17.894486 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 897/1784] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:17 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1209 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:17.903955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.905014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.905785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.906966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.915129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.917708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.064188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.068134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.068312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.068710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.069520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.069974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.070392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.084479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.092452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d181707a-0048-4197-afab-04e3be7164c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.215559 Oct 28 19:14:18.093372 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 888/1785] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:17 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:18.097987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.098587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.104800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.105281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.105696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.106274 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b746d72a-c4b5-428f-aa01-138a840787f4 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.210647 Oct 28 19:14:18.106412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.106864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.107398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.113440 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 898/1786] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:14:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:18.121582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.122482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.130084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.130572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.131031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.131717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.132419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.132859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.318663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.323460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.327141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e154aba-2dd6-4af4-92bd-60411bdcc5c5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.232488 Oct 28 19:14:18.327726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 889/1787] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:18.332149 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eca1b363-ccda-4599-bd96-9c83951ad481 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.217307 Oct 28 19:14:18.332730 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 899/1788] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:18.337360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.341416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.342131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.342814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.343804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.344406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.345001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.347916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.348532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.355240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.355732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.356158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.356866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.357314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.357726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.372291 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce5d4aef-50b4-4ac2-b8d2-96e5e7208efb tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.038414 Oct 28 19:14:18.372924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 900/1789] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:18.387947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.391467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.392575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.393013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.393780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.394234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.394715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.420462 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f6d3a66-ece6-4257-814e-a67b5859bfaa tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.036915 Oct 28 19:14:18.421081 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 901/1790] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:18.433482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.437130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.437706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.438149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.438909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.439363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.439784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.464992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3918dbe-7e2f-485e-953d-452caf9f6235 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?host=n-d-862769-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.035406 Oct 28 19:14:18.466858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 902/1791] 10.222.0.44 () {58 vars in 1194 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/os-services?host=n-d-862769-3&binary=xxx => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:14:18.479554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.483638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.484535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.485079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.485930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.486484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.487034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.501816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:18.515665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.527437 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88be1bf3-e1fe-4c39-a68f-54bc1abda67e tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051727 Oct 28 19:14:18.536695 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 903/1792] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:14:18.539745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.542600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.545298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.547721 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58756ded-9cdf-49e4-b2bd-807aac002e23 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.207489 Oct 28 19:14:18.547852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.548338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.549288 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 890/1793] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:18.550791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.551847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.552818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.553485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.595389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fbcc02b6-5d82-45a0-84cd-2088d6e05d0d req-132d119a-a6eb-4541-ae56-677e52620ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ab6041-2ed9-40e8-a8fc-809d5022a310", "name": "network-vif-unplugged", "status": "completed", "tag": "4be4fe9c-069f-4b82-8ca7-2e2951f437c7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:18.603669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-669d3121-b16c-48d5-8865-2cb0512bbdc8 tempest-ServicesAdminNegativeTestJSON-731792620 tempest-ServicesAdminNegativeTestJSON-731792620-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.049052 Oct 28 19:14:18.605145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 904/1794] 10.222.0.44 () {58 vars in 1198 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:14:18.611153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fbcc02b6-5d82-45a0-84cd-2088d6e05d0d req-132d119a-a6eb-4541-ae56-677e52620ed6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.612025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fbcc02b6-5d82-45a0-84cd-2088d6e05d0d req-132d119a-a6eb-4541-ae56-677e52620ed6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.622185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fbcc02b6-5d82-45a0-84cd-2088d6e05d0d req-132d119a-a6eb-4541-ae56-677e52620ed6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.637153 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fbcc02b6-5d82-45a0-84cd-2088d6e05d0d req-132d119a-a6eb-4541-ae56-677e52620ed6 service nova] Creating event network-vif-unplugged:4be4fe9c-069f-4b82-8ca7-2e2951f437c7 for instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 on n-h2-862769-3 Oct 28 19:14:18.644085 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fbcc02b6-5d82-45a0-84cd-2088d6e05d0d req-132d119a-a6eb-4541-ae56-677e52620ed6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053338 Oct 28 19:14:18.645588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 891/1795] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:18.715139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.716769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.727274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.728025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.729337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.730509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.731411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.732059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.741789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdf4874c-18a6-4137-8190-b9d54c421bcd tempest-ServicesAdminNegativeTestJSON-1265015203 tempest-ServicesAdminNegativeTestJSON-1265015203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.745312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fdf4874c-18a6-4137-8190-b9d54c421bcd tempest-ServicesAdminNegativeTestJSON-1265015203 tempest-ServicesAdminNegativeTestJSON-1265015203-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c0e0f866d9b04ac3bf30d1178597e671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df912c2799964c56a64191f6570b7748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdf4874c-18a6-4137-8190-b9d54c421bcd tempest-ServicesAdminNegativeTestJSON-1265015203 tempest-ServicesAdminNegativeTestJSON-1265015203-project] Request method failure captured: Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCoHgB98dHPYRrZZvv-2Bp-8iMsA8oWt4mrcnW8I9CuB8ALGBnbdeR3j-oUUZkP7I2tZ4Mj6jDfLIfEGqxuqZYOyii0CO3vy0YTI9oJ81y79XMNj0EubzO2llmzSal-51KGTswfn87l1EgA0tT5jF3hVWWkz-Q3Fnq34_DByRLpb0HU Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: df912c2799964c56a64191f6570b7748 Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1265015203 Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:18.747074 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df912c2799964c56a64191f6570b7748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df912c2799964c56a64191f6570b7748", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df912c2799964c56a64191f6570b7748"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df912c2799964c56a64191f6570b7748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1265015203 Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: df912c2799964c56a64191f6570b7748 Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1265015203 Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServicesAdminNegativeTestJSON-1265015203-project Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c0e0f866d9b04ac3bf30d1178597e671 Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1265015203-project Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 19:14:18.748697 n-d-862769-3 devstack@n-api.service[120629]: action_args: {} Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:14:18.749817 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 19:14:18.752421 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:18.755713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdf4874c-18a6-4137-8190-b9d54c421bcd tempest-ServicesAdminNegativeTestJSON-1265015203 tempest-ServicesAdminNegativeTestJSON-1265015203-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:18.755713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdf4874c-18a6-4137-8190-b9d54c421bcd tempest-ServicesAdminNegativeTestJSON-1265015203 tempest-ServicesAdminNegativeTestJSON-1265015203-project] 10.222.0.44 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.135043 Oct 28 19:14:18.755713 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 905/1796] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/os-services => generated 112 bytes in 136 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:18.887743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.888423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.897761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.898261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.898716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.913845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.914288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.914762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.987766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.000294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35edaafc-f784-49aa-b00c-4d786a9caf74 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.292415 Oct 28 19:14:19.001326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 892/1797] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:14:19.010153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:19.023566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:19.040621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.041417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.042017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.042951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.043774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.044374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.176668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.186950 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38704ffa-c275-4201-a046-ac13aed345da tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1265 microversion: 2.1 time: 0.183311 Oct 28 19:14:19.193651 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 893/1798] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:19 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:19.201249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:19.203293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:19.231248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.234337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.235021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.239707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.241049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.244559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.291960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.301672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b53982a3-1bc1-4273-bff2-f8b254d0997a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1519 microversion: 2.1 time: 0.417694 Oct 28 19:14:19.319591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 906/1799] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1519 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:14:19.352869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:19.357424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:19.369799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.371305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.372412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.374936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.375832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.376615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.437365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.446311 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24043958-3088-49b8-9e03-5c5a68742f6b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.251004 Oct 28 19:14:19.449748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 894/1800] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:19 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:19.462244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:19.463191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:19.477819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.478682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.479357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.480380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.481021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.481611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.744931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.755210 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-248144ef-c0a6-432b-827f-f9bc5461c4b3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.303932 Oct 28 19:14:19.756343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 895/1801] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:19 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:19.757342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.762503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:19.763251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:19.765257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c633d43-52a6-4e8c-bc7c-e18c13be39f7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.417074 Oct 28 19:14:19.773145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.773764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.783086 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 907/1802] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:19 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:14:19.785035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.786407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:19.787247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:19.787796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.993876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.008562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.010428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.011637 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-96ad3440-f6eb-4558-a323-22907ddc2ba6 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.254185 Oct 28 19:14:20.012202 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 896/1803] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:19 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:20.026288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.027031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.029023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=22 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:20.035058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.035849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.036269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.036961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.037401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.037807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.172083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.180488 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7bcc30c8-704d-4302-a6f9-c8cdf5276149 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.158554 Oct 28 19:14:20.181135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 908/1804] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:20.219577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.220733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.227356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.228400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.229115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.229824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.230281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.230731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.296832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.304565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37571629-a13f-4e51-aefc-0d71710cbaab tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1265 microversion: 2.1 time: 0.089122 Oct 28 19:14:20.305136 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 897/1805] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:20.326517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.327275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.333916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.334478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.335059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.335819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.336339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.336820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.474004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.474630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.480866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.481351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.481778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.482542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.483035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.483516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.525802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.561653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1d98875c-2bca-4dbe-a085-17c26e79ba46 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1519 microversion: 2.1 time: 0.239104 Oct 28 19:14:20.568240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 909/1806] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:20.783474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.784235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.794990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.798454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.800392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.802119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.805133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.807010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.926168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.937725 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88254490-807d-4e44-abeb-9cf2357a18d6 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.467622 Oct 28 19:14:20.950049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 898/1807] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:14:20.962006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.963209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.969591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.970370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.970835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.971659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.972115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.972712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.456846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.464721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4c8b697-6fb5-4254-9983-a27d049f37dd tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.685955 Oct 28 19:14:21.470454 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 910/1808] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:21.473948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.475283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:21.476312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:21.485138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.485546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.485924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.486648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.487208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.487650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.488860 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-55deac04-5d18-480f-a7df-91c9b7b78c61 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.531329 Oct 28 19:14:21.490317 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 899/1809] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:21.500918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:21.502286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:21.519660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.520343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.521158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.521890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.522567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.523093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.738410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.744028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.757267 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c59b5d5-baf4-4e14-9182-2da206774614 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1391 microversion: 2.1 time: 0.265622 Oct 28 19:14:21.760033 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 900/1810] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:21 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:21.760811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.762554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.763931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f26a98b-cd63-411c-b1ff-89b8b045443e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.296957 Oct 28 19:14:21.774717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:21.774717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:21.775954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 911/1811] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:21 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:21.783990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.783990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.783990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.783990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.784458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.784458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.790072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:21.790916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:21.801008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.801971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.802464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.803410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.804037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.804461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.866461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.876361 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36e8076c-258e-4651-bc27-88e5ecfa92b9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1273 microversion: 2.1 time: 0.115026 Oct 28 19:14:21.877075 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 901/1812] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:21 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:21.963937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:21.964542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:21.964695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.967771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:21.971888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.972366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.972797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.973603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.974191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.974659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.975401 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89f3f420-1afa-4ffb-8643-75eacddca6da tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1519 microversion: 2.1 time: 0.197893 Oct 28 19:14:21.990583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 912/1813] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:21 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:22.142175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:22.151646 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ed755ce-efee-4d72-8e3f-5a4be92e9caa tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.191233 Oct 28 19:14:22.152714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 902/1814] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:21 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:22.489531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:22.490166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:22.497082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.497568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.498482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.499217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.499676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.500097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.514594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:22.515907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:22.524573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.525821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.526478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.527382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.528079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.532895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.556751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:22.868142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:22.883774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73474dba-5b72-4931-a121-c9530a8c6d52 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.396436 Oct 28 19:14:22.890529 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 913/1815] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:22 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:22.893663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:22.905403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:22.906190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:22.918526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8bf1b521-8426-4db9-ae87-73d3a9fb9e82 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.408064 Oct 28 19:14:22.920980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 903/1816] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:22 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:22.924301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.925579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.927515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.928394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.931578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.932195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.934913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:22.940454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:22.954648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.955696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.956918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.957862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.958620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.959445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.270274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.273992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.280507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.282021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.282700 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-983c13da-e9d6-4d1a-a8fa-52304782ce24 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1381 microversion: 2.1 time: 0.390597 Oct 28 19:14:23.283459 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99e4984f-adba-459a-8c8d-fb98a688b219 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.360785 Oct 28 19:14:23.284113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 904/1817] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:22 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:23.289375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c2d21372-51f2-4248-bfe9-79ac362f70c6 req-bfe3cbc0-7f0b-4b27-bc92-6427c7e3f755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ab6041-2ed9-40e8-a8fc-809d5022a310", "name": "network-vif-plugged", "status": "completed", "tag": "4be4fe9c-069f-4b82-8ca7-2e2951f437c7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:23.300165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c2d21372-51f2-4248-bfe9-79ac362f70c6 req-bfe3cbc0-7f0b-4b27-bc92-6427c7e3f755 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.301598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c2d21372-51f2-4248-bfe9-79ac362f70c6 req-bfe3cbc0-7f0b-4b27-bc92-6427c7e3f755 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.302208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c2d21372-51f2-4248-bfe9-79ac362f70c6 req-bfe3cbc0-7f0b-4b27-bc92-6427c7e3f755 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.302659 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 914/1818] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:22 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1381 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.308382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.308998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:23.314492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c2d21372-51f2-4248-bfe9-79ac362f70c6 req-bfe3cbc0-7f0b-4b27-bc92-6427c7e3f755 service nova] Creating event network-vif-plugged:4be4fe9c-069f-4b82-8ca7-2e2951f437c7 for instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 on n-h2-862769-3 Oct 28 19:14:23.315016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.315489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.315909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.316648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.317250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.318568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.319697 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c2d21372-51f2-4248-bfe9-79ac362f70c6 req-bfe3cbc0-7f0b-4b27-bc92-6427c7e3f755 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034207 Oct 28 19:14:23.320295 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 905/1819] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:23.330798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.331814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:23.340749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.340749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.341297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.343298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.343298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.347039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.406551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.419132 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7a892be9-01d4-4910-9b40-f44a81bb413c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1271 microversion: 2.1 time: 0.115187 Oct 28 19:14:23.419924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 915/1820] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.589480 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-96a43029-d284-423b-8196-c6ac4a31dc61 tempest-TenantUsagesNegativeTestJSON-835557139 tempest-TenantUsagesNegativeTestJSON-835557139-project-admin] 10.222.0.44 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T19%3A14%3A23.142990&end=2022-10-29T19%3A14%3A23.142990" status: 404 len: 112 microversion: - time: 0.168102 Oct 28 19:14:23.590963 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 916/1821] 10.222.0.44 () {58 vars in 1316 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T19%3A14%3A23.142990&end=2022-10-29T19%3A14%3A23.142990 => generated 112 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 19:14:23.597680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.600205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.601180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:23.608188 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f66a2542-42bd-477c-92d4-07cadab1a9c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1519 microversion: 2.1 time: 0.286511 Oct 28 19:14:23.608787 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 906/1822] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.621002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.622681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b72f3cf6-cfc0-4523-80cb-295c92028d26 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '.version_select at 0x7f1d77951ca0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.624422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.625116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.630291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.631069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.631844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.631972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b72f3cf6-cfc0-4523-80cb-295c92028d26 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.632520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b72f3cf6-cfc0-4523-80cb-295c92028d26 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.633005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b72f3cf6-cfc0-4523-80cb-295c92028d26 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.652609 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b72f3cf6-cfc0-4523-80cb-295c92028d26 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 3088 microversion: 2.1 time: 0.039263 Oct 28 19:14:23.654204 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 907/1823] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/os-migrations => generated 3088 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.668605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7da47a5e-06b9-4a43-b9d5-a62d040a053f tempest-TenantUsagesNegativeTestJSON-835557139 tempest-TenantUsagesNegativeTestJSON-835557139-project-admin] Calling method '.version_select at 0x7f1d77900670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.675076 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-7da47a5e-06b9-4a43-b9d5-a62d040a053f tempest-TenantUsagesNegativeTestJSON-835557139 tempest-TenantUsagesNegativeTestJSON-835557139-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7da47a5e-06b9-4a43-b9d5-a62d040a053f tempest-TenantUsagesNegativeTestJSON-835557139 tempest-TenantUsagesNegativeTestJSON-835557139-project-admin] Request method failure captured: Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-simple-tenant-usage/62e7cd44e5ba465a8b49b1d60c38c51b?start=2022-10-29T19%3A14%3A23.142990&end=2022-10-27T19%3A14%3A23.142990 HTTP/1.1 Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCoPqOYMNIsy0OwVcpBU8WKlcJ7d27KnAe6UH7ewre41btuqyoNFQ2nKFbvgHgbhH3dXzIh2TH4fwxU_ya_bJjydDclbQZLjlY4NvSeQj4f_9BLRVObSZG56Zmk7_IoUl-CNg6krmvkPecZqmEp1ycNYewdnGG-FONNxru3NdhIK6ME Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 253e70ce109c4729a4fbefba8c7a966e Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-835557139 Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:14:23.682905 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/253e70ce109c4729a4fbefba8c7a966e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_253e70ce109c4729a4fbefba8c7a966e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/253e70ce109c4729a4fbefba8c7a966e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/253e70ce109c4729a4fbefba8c7a966e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-835557139 Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 253e70ce109c4729a4fbefba8c7a966e Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-835557139 Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TenantUsagesNegativeTestJSON-835557139-project-admin Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f8ac4e55157b416eb3821ecf219e2050 Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-835557139-project-admin Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid start time. The start time cannot occur after the end time. Oct 28 19:14:23.685001 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '62e7cd44e5ba465a8b49b1d60c38c51b'} Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 19:14:23.686098 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 28 19:14:23.687928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:23.690211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7da47a5e-06b9-4a43-b9d5-a62d040a053f tempest-TenantUsagesNegativeTestJSON-835557139 tempest-TenantUsagesNegativeTestJSON-835557139-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:23.691803 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7da47a5e-06b9-4a43-b9d5-a62d040a053f tempest-TenantUsagesNegativeTestJSON-835557139 tempest-TenantUsagesNegativeTestJSON-835557139-project-admin] 10.222.0.44 "GET /compute/v2.1/os-simple-tenant-usage/62e7cd44e5ba465a8b49b1d60c38c51b?start=2022-10-29T19%3A14%3A23.142990&end=2022-10-27T19%3A14%3A23.142990" status: 400 len: 111 microversion: 2.1 time: 0.036132 Oct 28 19:14:23.692824 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 908/1824] 10.222.0.44 () {58 vars in 1412 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/os-simple-tenant-usage/62e7cd44e5ba465a8b49b1d60c38c51b?start=2022-10-29T19%3A14%3A23.142990&end=2022-10-27T19%3A14%3A23.142990 => generated 111 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:14:23.699726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.700416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:23.708153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.708716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.709227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.710343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.711192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.711637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.875367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:23.895136 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75f044ce-433a-4898-a48e-8e21865478ee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.302893 Oct 28 19:14:23.898545 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 917/1825] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.952006 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-183e2a07-ef17-4562-85c7-5c87cd356ea2 tempest-LiveMigrationTest-1487608010 tempest-LiveMigrationTest-1487608010-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1532 microversion: 2.1 time: 0.257641 Oct 28 19:14:23.958840 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 909/1826] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1532 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.968563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.969487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:23.990122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.990881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.991946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.992869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.994485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.995238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.100797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c13f75b4-a8e4-4d9d-a193-0691ff0b0050 tempest-TenantUsagesNegativeTestJSON-1724991674 tempest-TenantUsagesNegativeTestJSON-1724991674-project] Calling method '.version_select at 0x7f1d800018b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.105100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c13f75b4-a8e4-4d9d-a193-0691ff0b0050 tempest-TenantUsagesNegativeTestJSON-1724991674 tempest-TenantUsagesNegativeTestJSON-1724991674-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '20c1d5399f3c403c80e26365d7e0f07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e7cd44e5ba465a8b49b1d60c38c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c13f75b4-a8e4-4d9d-a193-0691ff0b0050 tempest-TenantUsagesNegativeTestJSON-1724991674 tempest-TenantUsagesNegativeTestJSON-1724991674-project] Request method failure captured: Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T19%3A14%3A23.142990&end=2022-10-29T19%3A14%3A23.142990&detailed=1 HTTP/1.1 Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCoOc3nrLdEvXDhT_3CHfnLezEpWgLnpidMA342ZgNmN1nl3xEJibEnsuUkrHuTAwmNRSicJUlkY8dFpTN9qhoip9uz--gMDmAu3Mt4L-0TRdkb6nM2EFPsJPnzHi0xTvTh1UqGHIRcncnOo5bfe1ehyt2UMJPprpbo9e8PIUnDm_g0 Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 62e7cd44e5ba465a8b49b1d60c38c51b Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1724991674 Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:24.107052 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/62e7cd44e5ba465a8b49b1d60c38c51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_62e7cd44e5ba465a8b49b1d60c38c51b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/62e7cd44e5ba465a8b49b1d60c38c51b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/62e7cd44e5ba465a8b49b1d60c38c51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1724991674 Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 62e7cd44e5ba465a8b49b1d60c38c51b Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1724991674 Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TenantUsagesNegativeTestJSON-1724991674-project Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 20c1d5399f3c403c80e26365d7e0f07a Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1724991674-project Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: action_args: {} Oct 28 19:14:24.108552 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 19:14:24.109563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 19:14:24.110999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 19:14:24.112460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 19:14:24.112460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:24.112460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c13f75b4-a8e4-4d9d-a193-0691ff0b0050 tempest-TenantUsagesNegativeTestJSON-1724991674 tempest-TenantUsagesNegativeTestJSON-1724991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:24.112460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c13f75b4-a8e4-4d9d-a193-0691ff0b0050 tempest-TenantUsagesNegativeTestJSON-1724991674 tempest-TenantUsagesNegativeTestJSON-1724991674-project] 10.222.0.44 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T19%3A14%3A23.142990&end=2022-10-29T19%3A14%3A23.142990&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.206593 Oct 28 19:14:24.114439 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 918/1827] 10.222.0.44 () {58 vars in 1335 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T19%3A14%3A23.142990&end=2022-10-29T19%3A14%3A23.142990&detailed=1 => generated 123 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:24.119262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.119869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:24.131237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.133652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.135091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.135857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.136321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.136746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.240339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.248447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2dca89d-b1ae-43b8-a942-033fef690c5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.293143 Oct 28 19:14:24.263145 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 910/1828] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:24.269916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.270928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:24.278295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.279331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.280006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.281028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.281704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.282337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.313229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:24.395213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.407648 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81cab150-f148-4b83-9109-bdfa93742c24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.291772 Oct 28 19:14:24.408533 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 919/1829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:24 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:24.418981 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99cd5748-a7e1-41a7-b3c0-07c442b7d18e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 204 len: 0 microversion: 2.1 time: 0.152518 Oct 28 19:14:24.418981 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 911/1830] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:24 2022] DELETE /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:24.427905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.429819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:24.437643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.439814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.440398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.441301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.441786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.442212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.457158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.461311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:24.477993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.479943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.480814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.484468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.486934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.487470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.747429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.759495 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2dd7706-ac50-4a6c-afd1-1d1795e9198e tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1387 microversion: 2.1 time: 0.332082 Oct 28 19:14:24.779669 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 920/1831] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:24 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1387 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:24.784918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.794678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:24.804596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.808134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.808848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.811383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.814764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.815447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.816192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.820772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.822504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.823849 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53c2e64c-3d01-4cda-a347-0f13d64d6a9e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.404565 Oct 28 19:14:24.828186 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 912/1832] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:24 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:24.840777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:24.844167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:24.855855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.856669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.857277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:24.858300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:24.859787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:24.860386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.027932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:25.075995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:25.084797 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5285315-96e0-42d8-bbce-75c175d97cc6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1313 microversion: 2.1 time: 0.303796 Oct 28 19:14:25.085730 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 921/1833] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:24 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:25.092605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:25.092809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:25.093588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:25.101791 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ed6a2a9-cccb-4473-86bc-2435e33e802a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1519 microversion: 2.1 time: 0.272123 Oct 28 19:14:25.104383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.105371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.106078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.107239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.107879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.108739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.115427 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 913/1834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:24 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:25.279847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:25.280465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:25.289406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.289888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.290318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.291372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.292595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.296763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.356188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:25.364284 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c05b0384-c9b2-440a-ad7d-bde9b31af011 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.277026 Oct 28 19:14:25.372456 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 922/1835] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:25 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:25.381036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5944b592-7c1f-4b44-b8e3-91b45ac56486 req-8f422af1-ec29-4831-bbca-035d553bc645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398", "name": "network-vif-plugged", "status": "completed", "tag": "1f58cb5b-d4e4-41ca-81ac-f3589733aedf"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:25.391796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5944b592-7c1f-4b44-b8e3-91b45ac56486 req-8f422af1-ec29-4831-bbca-035d553bc645 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.392269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5944b592-7c1f-4b44-b8e3-91b45ac56486 req-8f422af1-ec29-4831-bbca-035d553bc645 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.392694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5944b592-7c1f-4b44-b8e3-91b45ac56486 req-8f422af1-ec29-4831-bbca-035d553bc645 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.406452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5944b592-7c1f-4b44-b8e3-91b45ac56486 req-8f422af1-ec29-4831-bbca-035d553bc645 service nova] Creating event network-vif-plugged:1f58cb5b-d4e4-41ca-81ac-f3589733aedf for instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 on n-h1-862769-3 Oct 28 19:14:25.416481 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5944b592-7c1f-4b44-b8e3-91b45ac56486 req-8f422af1-ec29-4831-bbca-035d553bc645 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042309 Oct 28 19:14:25.417830 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 923/1836] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:25.433684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:25.434674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:25.441169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.441853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.442291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.443022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.443475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.443888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.678789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:25.691821 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec83922e-933a-43e5-b25d-2d6f60064c00 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.416706 Oct 28 19:14:25.708904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 914/1837] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:25 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:25.713437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-82642c8c-6ea3-4268-8f70-ad3271c9b83b req-af5a3633-fea5-40bb-8b2f-808883aadc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55107fac-94c3-4870-8fe9-58bef2796ac5", "tag": "d04b6525-6b58-472e-a6cf-3e3f194b4781"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:25.726044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-82642c8c-6ea3-4268-8f70-ad3271c9b83b req-af5a3633-fea5-40bb-8b2f-808883aadc4d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.726892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-82642c8c-6ea3-4268-8f70-ad3271c9b83b req-af5a3633-fea5-40bb-8b2f-808883aadc4d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.727550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-82642c8c-6ea3-4268-8f70-ad3271c9b83b req-af5a3633-fea5-40bb-8b2f-808883aadc4d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.744807 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-82642c8c-6ea3-4268-8f70-ad3271c9b83b req-af5a3633-fea5-40bb-8b2f-808883aadc4d service nova] Creating event network-changed:d04b6525-6b58-472e-a6cf-3e3f194b4781 for instance 55107fac-94c3-4870-8fe9-58bef2796ac5 on n-h2-862769-3 Oct 28 19:14:25.750131 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-82642c8c-6ea3-4268-8f70-ad3271c9b83b req-af5a3633-fea5-40bb-8b2f-808883aadc4d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047391 Oct 28 19:14:25.751788 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 915/1838] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:25.760898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:25.773686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:25.783397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-712abbd7-7041-4006-bf28-581b54aaa789 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.353783 Oct 28 19:14:25.784654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 924/1839] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:25 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:14:25.813193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:25.814166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:25.821791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.822279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.822738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.823732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.824183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.824596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.849883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:25.850555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:25.857946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.858636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.859235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.860657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.862990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.864094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.955786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:26.158992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.168996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.170765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.173404 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9efa8ec-03a9-4612-a455-b31536fb7158 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.327866 Oct 28 19:14:26.174037 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 925/1840] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:25 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:26.179791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.180461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.186535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.187105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.187735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.188481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.188977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.189559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.204451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.217733 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d250e944-3144-4536-9508-6275aa41619c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1387 microversion: 2.1 time: 0.429048 Oct 28 19:14:26.231337 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 916/1841] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:25 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1387 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:26.252758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.252758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.258823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.259543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.260150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.261205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.261930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.262500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.527711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.533766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.537749 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78ac8b12-ed65-4ded-b113-5ec88a52e41d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1313 microversion: 2.1 time: 0.362437 Oct 28 19:14:26.542899 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ec78c98-eb52-4113-9add-d1906c8a35a0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1504 microversion: 2.1 time: 0.309290 Oct 28 19:14:26.551040 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 926/1842] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:26.556539 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 917/1843] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:26.559635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bdf865fd-3e9f-4d1b-b646-39f07f17d959 req-c4d107d0-9e41-41ca-895d-210ae4ed0785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de6e746-f4fd-4836-aea6-47e0b2a77299", "name": "network-vif-deleted", "tag": "32537282-2078-4847-bf75-4c4118af189d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:26.566749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.567757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.575550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.576223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.576736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.578416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.579269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.579766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.579896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bdf865fd-3e9f-4d1b-b646-39f07f17d959 req-c4d107d0-9e41-41ca-895d-210ae4ed0785 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.580549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bdf865fd-3e9f-4d1b-b646-39f07f17d959 req-c4d107d0-9e41-41ca-895d-210ae4ed0785 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.581026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bdf865fd-3e9f-4d1b-b646-39f07f17d959 req-c4d107d0-9e41-41ca-895d-210ae4ed0785 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.603444 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bdf865fd-3e9f-4d1b-b646-39f07f17d959 req-c4d107d0-9e41-41ca-895d-210ae4ed0785 service nova] Creating event network-vif-deleted:32537282-2078-4847-bf75-4c4118af189d for instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 on n-h2-862769-3 Oct 28 19:14:26.613214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bdf865fd-3e9f-4d1b-b646-39f07f17d959 req-c4d107d0-9e41-41ca-895d-210ae4ed0785 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060584 Oct 28 19:14:26.614163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 927/1844] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:26.623513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.624225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.641261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.641751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.642197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.642919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.644410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.645006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.906171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.919541 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f2a9f32-ef0d-4f38-8dcc-b715c4f815b9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.361995 Oct 28 19:14:26.920434 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 918/1845] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:26.926056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.926595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.946677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.947536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.947943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.948647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.949093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.949506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.960698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.973828 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64072c49-0427-4990-8344-10940a7694b1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 200 len: 1504 microversion: 2.1 time: 0.358399 Oct 28 19:14:26.978731 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 928/1846] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:26.984812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.985610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.998646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.999150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.999591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.000325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.000775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.001197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.328111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.330720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.337152 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d545ef57-b9b4-4bd2-8529-bdac97f57b5a tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.415540 Oct 28 19:14:27.338240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 919/1847] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:27.340858 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2b11351-4f2e-440f-b758-01c624f0469b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1316 microversion: 2.1 time: 0.365046 Oct 28 19:14:27.356036 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 929/1848] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:27.357641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:27.358252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:27.359320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:27.359932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:27.367239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.368161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.368815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.369742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.370389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.370909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.371333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.371827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.372023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.372660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.374436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.375295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.413627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:27.446216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:27.510894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-edc69ca7-2062-4d91-82ee-49ee0c4f5689 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 204 len: 0 microversion: 2.1 time: 0.170838 Oct 28 19:14:27.512196 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 920/1849] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:27 2022] DELETE /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:27.518090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:27.519197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:27.530959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.532184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.532906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.535085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.536085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.536757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.645454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.656075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2e2798bb-a51b-4e35-971f-9041681d42df tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1184 microversion: 2.1 time: 0.142412 Oct 28 19:14:27.656949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 921/1850] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:27 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1184 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:27.663588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:27.665076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:27.672572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.673198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.673712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.674532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.675134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.675640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.781878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.795218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.797175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.798729 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe8faf35-919f-4ee3-8f06-3fb4e7b59cc7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.455973 Oct 28 19:14:27.800116 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 930/1851] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:27 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:27.806081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1442380506", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "7a58ac5b-5454-4d41-ba04-839f867ccf04"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:27.903217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.914482 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b206b0bd-fe4f-4d68-8374-0870b2597b33 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1313 microversion: 2.1 time: 0.256090 Oct 28 19:14:27.922637 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 922/1852] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:27 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:27.954846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:27.956642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:27.966926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.967614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.968238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.969159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.970550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.971462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.984321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] validate_networks() for [('7a58ac5b-5454-4d41-ba04-839f867ccf04', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:14:28.515298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:28.525411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6f7f17e-4bf7-47b5-ba0e-740687cbf1e9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.581190 Oct 28 19:14:28.526015 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 923/1853] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:27 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:28.539291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:28.539906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:28.551580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:28.556782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:28.557370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:28.558825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:28.560020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:28.562142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:28.566857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:28.940838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:28.950479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc1dc15a-4b4c-4cf7-a2bf-2f0eec80f633 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.421903 Oct 28 19:14:28.951659 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 924/1854] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:28 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:28.970157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:28.972019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:28.986374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:28.990007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:28.990785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:28.991945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:28.992638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:28.993680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.222721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:14:29.223641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:14:29.224288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:14:29.224870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:14:29.225523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:14:29.240401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.242505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.244618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.245556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.249964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.250633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.290359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Getting quotas for project 2f724cbeaab34c56bd952bff01078b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:29.295644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:29.304232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4803255b-a7ae-4758-a3a0-50fde239b3fe tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1503 microversion: 2.1 time: 0.351518 Oct 28 19:14:29.326407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Getting quotas for user 0a61d398929c482da48baf1f7ec1c2f4 and project 2f724cbeaab34c56bd952bff01078b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:29.326641 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 925/1855] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:28 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:29.332962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0abe1-71b4-4c47-b0b3-649546da2bab", "name": "network-vif-unplugged", "status": "completed", "tag": "9c4fabf6-c437-4527-ab25-99f7ecf2bd44"}, {"name": "network-changed", "server_uuid": "02f0abe1-71b4-4c47-b0b3-649546da2bab", "tag": "9c4fabf6-c437-4527-ab25-99f7ecf2bd44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:29.343764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.344624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.345212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.356953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:14:29.358305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] Creating event network-vif-unplugged:9c4fabf6-c437-4527-ab25-99f7ecf2bd44 for instance 02f0abe1-71b4-4c47-b0b3-649546da2bab on n-h2-862769-3 Oct 28 19:14:29.359151 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] Creating event network-changed:9c4fabf6-c437-4527-ab25-99f7ecf2bd44 for instance 02f0abe1-71b4-4c47-b0b3-649546da2bab on n-h2-862769-3 Oct 28 19:14:29.359962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:14:29.367478 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-098e13bc-3487-4354-ab6b-a97257d74b7d req-84c2b62c-81bb-43f4-8a8d-04dc7957b96a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.043157 Oct 28 19:14:29.380305 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 926/1856] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:29.387846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:29.396037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:29.397585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:29.414606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.415325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.417205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.418227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.420128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.420637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.479505 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-631ad584-8d30-4d7f-aa63-4789db565179 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677015 Oct 28 19:14:29.489921 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 931/1857] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:14:29.496474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:29.501779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:29.513640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.514408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.515115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.516810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.517708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.518307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.578860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:29.588185 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d116452-329e-4327-b6ad-e99538778166 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1184 microversion: 2.1 time: 0.206087 Oct 28 19:14:29.592921 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 927/1858] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:29 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1184 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:29.597857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:29.603484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:29.616877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.619214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.620332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.622301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.622934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.623870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:30.608941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:30.628089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:30.634910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:30.637685 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bbc3f09-2605-4f81-8db2-8090b119fa4a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 1.144448 Oct 28 19:14:30.641223 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 932/1859] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:29 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:30.656971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:30.669608 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee446042-b93c-4f59-a7d2-526830541c7b tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1313 microversion: 2.1 time: 1.075461 Oct 28 19:14:30.672347 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 928/1860] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:29 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1313 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:30.683526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2016468402"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:30.684123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:30.687885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:30.691034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:30.703646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:30.707457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:30.709227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:30.710356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:30.711210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:30.712542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:30.713031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:30.713193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:30.713471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:30.714099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:30.715759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:30.717331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:30.924489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:30.937289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c38ef6ac-dec3-48da-952c-5ec1bfa3f882 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1270 microversion: 2.1 time: 0.263066 Oct 28 19:14:30.942368 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 929/1861] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:30 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1270 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:30.955070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:30.958655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:30.996525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:30.998812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.003194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.004332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.004966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.005581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.255591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.security_group_api [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Adding security group e3c83714-afe4-4401-9630-68c7f65f8ceb to port 1f58cb5b-d4e4-41ca-81ac-f3589733aedf Oct 28 19:14:31.399130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:31.410411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fdeefbcd-9b68-4074-a596-0ed78608a7e4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.465610 Oct 28 19:14:31.413902 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 930/1862] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:30 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:31.422134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-edfdd581-ab63-4c72-9f90-3fb496ccccfd req-de070e43-75cf-49dc-9565-2dabdcd5ba62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efddd30-6dca-454a-b51b-f74fe8f42bd1", "name": "network-vif-plugged", "status": "completed", "tag": "bfde1a01-62ff-4eba-94c2-3c93da12384f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:31.434993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-edfdd581-ab63-4c72-9f90-3fb496ccccfd req-de070e43-75cf-49dc-9565-2dabdcd5ba62 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.435692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-edfdd581-ab63-4c72-9f90-3fb496ccccfd req-de070e43-75cf-49dc-9565-2dabdcd5ba62 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.436296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-edfdd581-ab63-4c72-9f90-3fb496ccccfd req-de070e43-75cf-49dc-9565-2dabdcd5ba62 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.452556 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-edfdd581-ab63-4c72-9f90-3fb496ccccfd req-de070e43-75cf-49dc-9565-2dabdcd5ba62 service nova] Creating event network-vif-plugged:bfde1a01-62ff-4eba-94c2-3c93da12384f for instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 on n-h2-862769-3 Oct 28 19:14:31.464008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-edfdd581-ab63-4c72-9f90-3fb496ccccfd req-de070e43-75cf-49dc-9565-2dabdcd5ba62 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048773 Oct 28 19:14:31.468804 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 931/1863] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:31.474482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:31.475582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:31.502293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.503043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.503673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.504560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.505243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.505843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.817149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:31.863470 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8a728ffd-78b8-485c-832c-27efc61edfb2 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1371 microversion: 2.1 time: 0.393108 Oct 28 19:14:31.865046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 932/1864] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:31 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:31.870806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:31.875791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:31.896067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.896926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.897645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.898554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.899230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.899856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.026969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.043338 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71555399-58f2-4626-92ff-a17c12136beb tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1184 microversion: 2.1 time: 0.176797 Oct 28 19:14:32.045360 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 933/1865] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:31 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1184 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:32.059466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-126e13a3-f123-4772-8082-7abbcaf1d6c6 req-eaaef396-003a-4d14-8d27-53bd1a1d0023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ab6041-2ed9-40e8-a8fc-809d5022a310", "name": "network-vif-deleted", "tag": "4be4fe9c-069f-4b82-8ca7-2e2951f437c7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:32.096763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-126e13a3-f123-4772-8082-7abbcaf1d6c6 req-eaaef396-003a-4d14-8d27-53bd1a1d0023 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.098774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-126e13a3-f123-4772-8082-7abbcaf1d6c6 req-eaaef396-003a-4d14-8d27-53bd1a1d0023 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.104563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-126e13a3-f123-4772-8082-7abbcaf1d6c6 req-eaaef396-003a-4d14-8d27-53bd1a1d0023 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.151991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-126e13a3-f123-4772-8082-7abbcaf1d6c6 req-eaaef396-003a-4d14-8d27-53bd1a1d0023 service nova] Creating event network-vif-deleted:4be4fe9c-069f-4b82-8ca7-2e2951f437c7 for instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 on n-h2-862769-3 Oct 28 19:14:32.169747 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-126e13a3-f123-4772-8082-7abbcaf1d6c6 req-eaaef396-003a-4d14-8d27-53bd1a1d0023 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121372 Oct 28 19:14:32.173703 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 934/1866] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:32.193755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:32.215620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:32.237429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.238142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.238651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.240804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.244610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.246417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.302506 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29bfe474-6c03-4bb8-a336-a63782842f35 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398/action" status: 202 len: 0 microversion: 2.1 time: 1.659714 Oct 28 19:14:32.304272 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 933/1867] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:14:30 2022] POST /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398/action => generated 0 bytes in 1662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:32.310975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:32.311712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:32.324770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.326323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.327721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.328712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.330597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.331253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.686993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.696997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.707454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.709129 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c5dcf00-f489-4371-acfd-42f725de8ef8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.531895 Oct 28 19:14:32.710130 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 935/1868] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:32 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:32.718961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:32.731797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:32.739454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.739944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.740377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.741242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.741695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.742119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.836550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.856679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.857266 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a97b08f8-d946-4cd3-82a6-530534a573fc tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1313 microversion: 2.1 time: 0.551644 Oct 28 19:14:32.859549 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 934/1869] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:32 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:32.872927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-730296321"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:32.873837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:32.878671 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-52033d8d-7b54-44a7-af31-2b1411c4bba0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1276 microversion: 2.1 time: 0.163611 Oct 28 19:14:32.897201 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 936/1870] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:32 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:32.897201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-dea67dec-9e7d-4f9a-b41a-9a68a75c9e2e req-c9e6de7b-fd39-4185-9736-6856ab2e92fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398", "tag": "1f58cb5b-d4e4-41ca-81ac-f3589733aedf"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:32.901027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.901349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.902847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.903809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.904790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.918744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dea67dec-9e7d-4f9a-b41a-9a68a75c9e2e req-c9e6de7b-fd39-4185-9736-6856ab2e92fc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.919229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dea67dec-9e7d-4f9a-b41a-9a68a75c9e2e req-c9e6de7b-fd39-4185-9736-6856ab2e92fc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.919663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dea67dec-9e7d-4f9a-b41a-9a68a75c9e2e req-c9e6de7b-fd39-4185-9736-6856ab2e92fc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.924307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.944232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-dea67dec-9e7d-4f9a-b41a-9a68a75c9e2e req-c9e6de7b-fd39-4185-9736-6856ab2e92fc service nova] Creating event network-changed:1f58cb5b-d4e4-41ca-81ac-f3589733aedf for instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 on n-h1-862769-3 Oct 28 19:14:32.961666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-dea67dec-9e7d-4f9a-b41a-9a68a75c9e2e req-c9e6de7b-fd39-4185-9736-6856ab2e92fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072754 Oct 28 19:14:32.962949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 937/1871] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:32.971038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:32.972062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:32.988528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.999472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.000202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.000944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:33.001399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.001988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.402920 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.security_group_api [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Adding security group 0d04cea0-7439-4d3f-bf08-0a280e423aa8 to port 1f58cb5b-d4e4-41ca-81ac-f3589733aedf Oct 28 19:14:33.818295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:33.829698 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3732e592-3f95-4f66-b7e3-0e89250c1fd9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.865320 Oct 28 19:14:33.831884 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 938/1872] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:32 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:33.845246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:33.847243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:33.863718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:33.865048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.866779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.868705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:33.869388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.870939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.885619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:34.505855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:34.518608 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b76d0f8-dc2a-4476-8480-f1538068eec9 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1558 microversion: 2.1 time: 0.682729 Oct 28 19:14:34.519353 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 939/1873] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:33 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1558 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:34.532245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:34.533282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:34.549073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:34.550565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:34.553881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:34.555344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:34.556047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:34.558605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.057780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:35.068345 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc4ee1c9-8283-426c-8d42-6addde191ea1 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 200 len: 1138 microversion: 2.1 time: 0.545470 Oct 28 19:14:35.072572 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 940/1874] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:34 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 1138 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:35.084715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a0017bbf-321e-4da1-8883-a9e5b445e158 req-fad32131-d730-44ae-aec4-a103e125282f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55107fac-94c3-4870-8fe9-58bef2796ac5", "name": "network-vif-plugged", "status": "completed", "tag": "d04b6525-6b58-472e-a6cf-3e3f194b4781"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:35.114332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a0017bbf-321e-4da1-8883-a9e5b445e158 req-fad32131-d730-44ae-aec4-a103e125282f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.115815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a0017bbf-321e-4da1-8883-a9e5b445e158 req-fad32131-d730-44ae-aec4-a103e125282f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.119177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a0017bbf-321e-4da1-8883-a9e5b445e158 req-fad32131-d730-44ae-aec4-a103e125282f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.133465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a0017bbf-321e-4da1-8883-a9e5b445e158 req-fad32131-d730-44ae-aec4-a103e125282f service nova] Creating event network-vif-plugged:d04b6525-6b58-472e-a6cf-3e3f194b4781 for instance 55107fac-94c3-4870-8fe9-58bef2796ac5 on n-h2-862769-3 Oct 28 19:14:35.143201 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a0017bbf-321e-4da1-8883-a9e5b445e158 req-fad32131-d730-44ae-aec4-a103e125282f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069303 Oct 28 19:14:35.144090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 941/1875] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:35.157602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:35.158604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:35.168392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.169345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.170387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.182481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.184581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.185260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.274168 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7a3d3ae-7866-4ffc-94ec-f06b23f4aa9c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398/action" status: 202 len: 0 microversion: 2.1 time: 2.413142 Oct 28 19:14:35.274864 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 935/1876] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:14:32 2022] POST /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398/action => generated 0 bytes in 2415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:35.282889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:35.283499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:35.296404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.300283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.301091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.301837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.302287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.303566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.757739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:35.769073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:35.775405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:35.777061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d5188e5-451b-4f69-b6b6-b60b9b8c9522 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 0.631732 Oct 28 19:14:35.778166 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 942/1877] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:35 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:35.784517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:35.785719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:35.796569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.797731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.798794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.799733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.800384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.801319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.883101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:35.896495 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9331c454-99a1-4d12-8262-66173059be05 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1313 microversion: 2.1 time: 0.620358 Oct 28 19:14:35.899079 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 936/1878] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:35 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:35.910348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:35.913423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:35.925263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.926007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.927206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.929536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.930190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.932875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:36.254658 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4817f04e-4b24-4bdf-be29-4421063b8095 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.354224 Oct 28 19:14:36.255592 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 937/1879] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:14:35 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:36.260879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:36.261701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:36.274838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:36.277210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:36.281524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:36.287652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:36.288579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:36.289155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:36.289697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:36.295766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e34d9da-3dc2-4e2e-924f-c1e8ce79e50a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1318 microversion: 2.1 time: 0.515644 Oct 28 19:14:36.296885 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 943/1880] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:35 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:36.309863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:36.310573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:36.331792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:36.332558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:36.334615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:36.335539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:36.336190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:36.336841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.415736 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fff15ea0-49b5-49f1-b6c8-76fd97fa0bc3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.113853 Oct 28 19:14:37.436510 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 944/1881] 10.222.0.44 () {58 vars in 1293 bytes} [Fri Oct 28 19:14:36 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398/os-security-groups => generated 1157 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:37.436725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:37.452503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5b44c12f-4136-401f-9247-98cfd148475a req-41cec129-35b9-4255-b4be-072811d40b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398", "tag": "1f58cb5b-d4e4-41ca-81ac-f3589733aedf"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:37.456985 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c773d7e4-cd0c-4c6d-8f45-13c78c148457 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 1.199953 Oct 28 19:14:37.462662 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 938/1882] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:36 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:37.470482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:37.479614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 6de6e746-f4fd-4836-aea6-47e0b2a77299] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:37.486821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.487230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.487651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.488347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.488810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.489214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.490803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5b44c12f-4136-401f-9247-98cfd148475a req-41cec129-35b9-4255-b4be-072811d40b04 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.491952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5b44c12f-4136-401f-9247-98cfd148475a req-41cec129-35b9-4255-b4be-072811d40b04 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.493303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5b44c12f-4136-401f-9247-98cfd148475a req-41cec129-35b9-4255-b4be-072811d40b04 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.512875 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5b44c12f-4136-401f-9247-98cfd148475a req-41cec129-35b9-4255-b4be-072811d40b04 service nova] Creating event network-changed:1f58cb5b-d4e4-41ca-81ac-f3589733aedf for instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 on n-h1-862769-3 Oct 28 19:14:37.518121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] HTTP exception thrown: Instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 could not be found. Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Request method failure captured: Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 HTTP/1.1 Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCiGmxRxgOaLXC4IF-Fu3_OYTnl42timpcaMSRSGuG2pWvIA961oEmAKtWM0rkj6-UN2S3WzY9KeDUFs2Smu9-7etkZg-_j1qVsFZjqQsLrQUZBsGvyyZrAxXxBhwRLARZ5sfsHZpfgOqYZV7IycLs4FQrBC-1f6MOoj_LDEp_Wkb3A Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:37.519833 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fcadf83882374e8d93bbf699425e501b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-LiveMigrationTest-340510936 Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-LiveMigrationTest-340510936-project Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6e2ff64ca72649d3ac2e8912da76c9af Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-LiveMigrationTest-340510936-project Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 could not be found. Oct 28 19:14:37.521553 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '6de6e746-f4fd-4836-aea6-47e0b2a77299'} Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 could not be found. Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:37.522627 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 could not be found. Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 could not be found. Oct 28 19:14:37.524559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:37.526179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Returning 404 to user: Instance 6de6e746-f4fd-4836-aea6-47e0b2a77299 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:37.526179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7ac10bd-e7eb-45bf-9c2a-1a476b8e8be4 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299" status: 404 len: 111 microversion: 2.1 time: 0.057208 Oct 28 19:14:37.527441 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 939/1883] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:37 2022] GET /compute/v2.1/servers/6de6e746-f4fd-4836-aea6-47e0b2a77299 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:37.567270 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5b44c12f-4136-401f-9247-98cfd148475a req-41cec129-35b9-4255-b4be-072811d40b04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115211 Oct 28 19:14:37.572691 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 945/1884] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:37.592866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:37.601346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:37.632468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.633745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.638111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.641205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.645034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.646478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.786133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-23eb35dd-b101-4160-928f-7c44cd364b31 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Action: 'create', calling method: .version_select at 0x7f1d7ff9a8b0>, body: {"pool": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:38.932850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:38.966825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:38.969429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:38.972472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b70c42d4-b138-40d2-965b-c1d0a0d94b7a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1487 microversion: 2.25 time: 1.395601 Oct 28 19:14:38.990095 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 946/1885] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:37 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1487 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:39.010379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:39.011167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:39.025439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:39.026056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:39.026977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:39.028418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:39.029173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:39.029914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:39.266476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:39.340838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:39.411147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:39.422528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5665ae50-0b62-4636-81e8-0461c5320bf5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1462 microversion: 2.1 time: 0.427735 Oct 28 19:14:39.423339 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 947/1886] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:38 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1462 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:39.435424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:39.437597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:39.442636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:39.459328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:39.460043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:39.460570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:39.461354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:39.461876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:39.462365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:39.868246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:39.884336 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0574ec60-02e9-4165-b73b-5d4d70770332 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1318 microversion: 2.1 time: 0.458072 Oct 28 19:14:39.885894 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 948/1887] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:39 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:39.896348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b05d0cff-b5aa-44e0-bbfa-829107a49378 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d77900940>, body: {"security_group": {"name": " tempest-securitygroup -2069244362 ", "description": "tempest-description-738752838"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:40.740119 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b05d0cff-b5aa-44e0-bbfa-829107a49378 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.852711 Oct 28 19:14:40.740763 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 949/1888] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:39 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:40.745385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:40.746005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:40.768400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:40.768895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:40.769545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:40.770268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:40.771803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:40.772246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.000930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:42.013968 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56424246-ff30-4791-8ca2-19518fbc61b1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 1.272147 Oct 28 19:14:42.027855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 950/1889] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:40 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:42.039179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:42.040758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:42.048876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.049598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.050228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.051105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.051964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.053247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.363227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-23eb35dd-b101-4160-928f-7c44cd364b31 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.834620 Oct 28 19:14:42.366462 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 940/1890] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:14:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:42.377961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-95b32e7c-46d1-4e03-a551-cd543d2a49ce req-566f3f42-05bc-418a-8a76-d4acf6c2c4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eaaefac-41cf-4e4b-bd0a-264f86c0e163", "tag": "ff4e29a2-9a0e-414c-8644-26eb9a8322df"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:42.399430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b41244ed-89fe-43c8-b44b-0419c99b5fd1 tempest-ServersOnMultiNodesTest-319068005 tempest-ServersOnMultiNodesTest-319068005-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1613 microversion: 2.1 time: 0.370061 Oct 28 19:14:42.415008 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 951/1891] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:42 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1613 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:42.415146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-95b32e7c-46d1-4e03-a551-cd543d2a49ce req-566f3f42-05bc-418a-8a76-d4acf6c2c4b7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.415146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-95b32e7c-46d1-4e03-a551-cd543d2a49ce req-566f3f42-05bc-418a-8a76-d4acf6c2c4b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.415146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-95b32e7c-46d1-4e03-a551-cd543d2a49ce req-566f3f42-05bc-418a-8a76-d4acf6c2c4b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.425592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:42.426228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:42.433021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-95b32e7c-46d1-4e03-a551-cd543d2a49ce req-566f3f42-05bc-418a-8a76-d4acf6c2c4b7 service nova] Creating event network-changed:ff4e29a2-9a0e-414c-8644-26eb9a8322df for instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 on n-h1-862769-3 Oct 28 19:14:42.443487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-95b32e7c-46d1-4e03-a551-cd543d2a49ce req-566f3f42-05bc-418a-8a76-d4acf6c2c4b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075421 Oct 28 19:14:42.445011 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 941/1892] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:42.452090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.453260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.453910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.454828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.455451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.456082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.470105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5c9361bb-334e-4265-ad8a-0b4e4998b461 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7ffd65e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:42.699727 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5c9361bb-334e-4265-ad8a-0b4e4998b461 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48" status: 200 len: 223 microversion: 2.1 time: 0.252506 Oct 28 19:14:42.700340 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 942/1893] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:14:42 2022] GET /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48 => generated 223 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:42.714349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:42.716559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:42.740564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.745371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.745371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.745371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.745371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.746044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.791116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:42.807041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:42.810079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:42.811344 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de000347-cbca-46e5-bba4-dfa31efe41a1 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1477 microversion: 2.25 time: 0.402340 Oct 28 19:14:42.824024 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 952/1894] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:42 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:42.839715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:42.840509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:42.848260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.849084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.850549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.851699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.852335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.852998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.885456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:43.038071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5de77986-8966-4f33-8766-7d9db115face tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 204 len: 0 microversion: 2.1 time: 0.212499 Oct 28 19:14:43.042954 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 953/1895] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:42 2022] DELETE /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:43.054992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f78fadc-b887-430b-af37-be0ece5de0c0 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Calling method '.version_select at 0x7f1d778a09d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.152006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:43.166549 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7524528e-e7d9-429e-9c02-dda47936c677 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1318 microversion: 2.1 time: 0.465145 Oct 28 19:14:43.182531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 943/1896] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:42 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:43.187843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.188608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:43.195508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.196260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.196883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.197814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.198497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.199144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.225343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:43.315038 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-755f3f99-b122-432a-8e9c-1a18d5afede9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 204 len: 0 microversion: 2.1 time: 0.130133 Oct 28 19:14:43.316045 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 944/1897] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:43 2022] DELETE /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:43.325701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1084f006-2f9f-4ec3-98dc-f012c8fd77a5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7ff66550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.457112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f78fadc-b887-430b-af37-be0ece5de0c0 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips/fa26e1f1-835c-497c-8eee-cc279eba3e5d" status: 200 len: 142 microversion: 2.1 time: 0.412824 Oct 28 19:14:43.458046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 954/1898] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:14:43 2022] GET /compute/v2.1/os-floating-ips/fa26e1f1-835c-497c-8eee-cc279eba3e5d => generated 142 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:43.462959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04e651b0-2913-45e1-b4dc-8efb10069443 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '.version_select at 0x7f1d7794a430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.470141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04e651b0-2913-45e1-b4dc-8efb10069443 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.471605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04e651b0-2913-45e1-b4dc-8efb10069443 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.478759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04e651b0-2913-45e1-b4dc-8efb10069443 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.507893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04e651b0-2913-45e1-b4dc-8efb10069443 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/os-migrations" status: 200 len: 3203 microversion: 2.25 time: 0.048473 Oct 28 19:14:43.508874 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 955/1899] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Oct 28 19:14:43 2022] GET /compute/v2.1/os-migrations => generated 3203 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:43.513547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.514272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:43.536264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.536863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.539243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.540226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.540685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.541111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.775248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:43.784652 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cbb9253d-7c31-49e3-92ac-e76811f88c85 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.274686 Oct 28 19:14:43.785834 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 956/1900] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:43 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:43.791199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.791964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:43.799244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.800117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.800720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.801202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1084f006-2f9f-4ec3-98dc-f012c8fd77a5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48" status: 202 len: 0 microversion: 2.1 time: 0.483377 Oct 28 19:14:43.802122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.802764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.803488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.805234 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 945/1901] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:14:43 2022] DELETE /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:43.813994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.815765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:43.826823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.828843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.829292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.830028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.830522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.830960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.850624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:44.025101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:44.034762 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2c0be90-06d5-41e9-b131-9e9adefe1316 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1668 microversion: 2.1 time: 0.247355 Oct 28 19:14:44.035750 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 957/1902] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:43 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:44.041925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:44.051067 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec6145be-c9a2-4391-b930-508323627cf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1468 microversion: 2.1 time: 0.243943 Oct 28 19:14:44.051701 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 946/1903] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:43 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1468 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:44.055143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca4d03ec-7356-45c6-aaef-9c87fe670114 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Calling method '.version_select at 0x7f1d77898c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:44.062286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:44.065275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:44.072245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:44.072739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:44.073167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:44.073870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:44.074347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:44.074799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:44.303279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] Lazy-loading 'services' on Instance uuid 02f0abe1-71b4-4c47-b0b3-649546da2bab {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:44.318849 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71bfae21-a4a6-4e38-b073-4a159d44dd60 tempest-LiveAutoBlockMigrationV225Test-716274142 tempest-LiveAutoBlockMigrationV225Test-716274142-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1969 microversion: 2.25 time: 0.265719 Oct 28 19:14:44.319427 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 947/1904] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:44 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1969 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:44.319764 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca4d03ec-7356-45c6-aaef-9c87fe670114 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.282545 Oct 28 19:14:44.320402 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 958/1905] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:14:44 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:44.325980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:44.326579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:44.332489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7ffd6c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:44.332938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:44.333423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:44.333849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:44.334535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:44.335298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:44.335715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:44.352013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:44.360900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:14:44.361568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:14:44.362122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.362122 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48 HTTP/1.1 Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:44.364134 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] Oct 28 19:14:44.366020 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0e2586a0-c3e0-489c-a1a8-8aaaced56e48'} Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:44.371508 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:14:44.373020 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.374462 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-1fd067ac-d7a9-4099-9f5f-d4ff8e9a8824'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ae939b3-4fbe-4459-8e3e-bb1b337b640a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48" status: 404 len: 194 microversion: 2.1 time: 0.045173 Oct 28 19:14:44.376223 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 948/1906] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:14:44 2022] GET /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:44.377151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81e163af-f077-4ccb-9f1c-c72d6f98e2d4 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Calling method '.version_select at 0x7f1d8004b040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:44.584743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:44.592985 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-acf0d1a1-1050-40d7-bb88-140e53f2e2ac tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1318 microversion: 2.1 time: 0.271339 Oct 28 19:14:44.593639 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 959/1907] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:44 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:44.598409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:44.599126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:44.605008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:44.605680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:44.606283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:44.606993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:44.607607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:44.608185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:44.637184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:44.774616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e86e3dd-1b76-408c-93f3-0e8db934ca7e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "DELETE /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 204 len: 0 microversion: 2.25 time: 0.178305 Oct 28 19:14:44.779521 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 960/1908] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:14:44 2022] DELETE /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:14:44.786948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec2e0cdb-e0ba-4293-83aa-40e2e9f5507c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d778cbaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-294400835", "description": "tempest-description-704613524"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:45.174049 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec2e0cdb-e0ba-4293-83aa-40e2e9f5507c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.392107 Oct 28 19:14:45.186134 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 961/1909] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:44 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:45.193132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0b6879b5-a178-4c76-9ec0-3218828963f5 req-0905b4a3-cbe5-4f9b-9ad4-e9af11b8b886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efddd30-6dca-454a-b51b-f74fe8f42bd1", "tag": "bfde1a01-62ff-4eba-94c2-3c93da12384f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:45.216433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0b6879b5-a178-4c76-9ec0-3218828963f5 req-0905b4a3-cbe5-4f9b-9ad4-e9af11b8b886 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.218481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0b6879b5-a178-4c76-9ec0-3218828963f5 req-0905b4a3-cbe5-4f9b-9ad4-e9af11b8b886 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.219196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0b6879b5-a178-4c76-9ec0-3218828963f5 req-0905b4a3-cbe5-4f9b-9ad4-e9af11b8b886 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.234295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0b6879b5-a178-4c76-9ec0-3218828963f5 req-0905b4a3-cbe5-4f9b-9ad4-e9af11b8b886 service nova] Creating event network-changed:bfde1a01-62ff-4eba-94c2-3c93da12384f for instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 on n-h2-862769-3 Oct 28 19:14:45.239753 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0b6879b5-a178-4c76-9ec0-3218828963f5 req-0905b4a3-cbe5-4f9b-9ad4-e9af11b8b886 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051423 Oct 28 19:14:45.240782 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 962/1910] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:45.246853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6961348f-53f9-42a3-bed7-c6030d8293e0 req-d0087051-459d-4707-a266-b63aff7baf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaefac-41cf-4e4b-bd0a-264f86c0e163", "name": "network-vif-plugged", "status": "completed", "tag": "ff4e29a2-9a0e-414c-8644-26eb9a8322df"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:45.257289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6961348f-53f9-42a3-bed7-c6030d8293e0 req-d0087051-459d-4707-a266-b63aff7baf23 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.258360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6961348f-53f9-42a3-bed7-c6030d8293e0 req-d0087051-459d-4707-a266-b63aff7baf23 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.259045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6961348f-53f9-42a3-bed7-c6030d8293e0 req-d0087051-459d-4707-a266-b63aff7baf23 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.272311 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6961348f-53f9-42a3-bed7-c6030d8293e0 req-d0087051-459d-4707-a266-b63aff7baf23 service nova] Creating event network-vif-plugged:ff4e29a2-9a0e-414c-8644-26eb9a8322df for instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 on n-h1-862769-3 Oct 28 19:14:45.289481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6961348f-53f9-42a3-bed7-c6030d8293e0 req-d0087051-459d-4707-a266-b63aff7baf23 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046933 Oct 28 19:14:45.297777 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 963/1911] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:45.305379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:45.306229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:45.316490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.317409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.318204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.319899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.320920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.323573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.607306 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81e163af-f077-4ccb-9f1c-c72d6f98e2d4 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/fa26e1f1-835c-497c-8eee-cc279eba3e5d" status: 202 len: 0 microversion: 2.1 time: 1.239828 Oct 28 19:14:45.621241 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 949/1912] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:14:44 2022] DELETE /compute/v2.1/os-floating-ips/fa26e1f1-835c-497c-8eee-cc279eba3e5d => generated 0 bytes in 1254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:45.639069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:45.644347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:45.668381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.669881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.673910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.676454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.682833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.684725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.864009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:45.873955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:45.878975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:45.885356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6021463b-cf28-4630-89a2-f6896554ed60 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1483 microversion: 2.25 time: 0.585573 Oct 28 19:14:45.886556 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 964/1913] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:45 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1483 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:45.901403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:45.903435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:45.911510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.916026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.916733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:45.918050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:45.924424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:45.925153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.126460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:46.143378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d4b9a99-9757-4fe3-b651-457982d2737f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 200 len: 1601 microversion: 2.1 time: 0.255292 Oct 28 19:14:46.144483 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 965/1914] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:45 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 1601 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:46.150807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:46.151431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:46.166488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.167240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.171318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.172396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.176408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.177548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.259693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.260553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.264380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.265288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lazy-loading 'fault' on Instance uuid 55107fac-94c3-4870-8fe9-58bef2796ac5 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:46.660927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:46.669970 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-064d435f-0114-4b8b-861c-57075cf2e53e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 200 len: 1303 microversion: 2.1 time: 0.524439 Oct 28 19:14:46.671279 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 966/1915] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:46 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 1303 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:46.676159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a37f110d-d65d-49df-bba6-9be031bcbe05 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d77951dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-729426829", "description": "tempest-description-549971184"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:46.865797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:46.874754 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff6e9544-5389-4d80-8db9-cdd6719123c8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 1.252040 Oct 28 19:14:46.876266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 950/1916] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:45 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:46.881609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:46.882476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:46.888967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.889904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.890833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.891802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.892226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.892964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.229304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:47.246593 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-184c7e55-cae3-42f6-ba8b-23856095b7af tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1318 microversion: 2.1 time: 0.368957 Oct 28 19:14:47.259691 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 951/1917] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:46 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:47.269924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d25832ef-0ae2-457a-95b5-399a89afea1d tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Action: 'create', calling method: .version_select at 0x7f1d7c11c3a0>, body: {"pool": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:47.420241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a37f110d-d65d-49df-bba6-9be031bcbe05 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.744911 Oct 28 19:14:47.421657 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 967/1918] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:47.436201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-974b5fa1-2256-4eaa-8c5c-15b99a531dda req-98eeb87d-c552-493d-9d05-b8562fe399a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55107fac-94c3-4870-8fe9-58bef2796ac5", "name": "network-vif-deleted", "tag": "d04b6525-6b58-472e-a6cf-3e3f194b4781"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:47.484973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-974b5fa1-2256-4eaa-8c5c-15b99a531dda req-98eeb87d-c552-493d-9d05-b8562fe399a4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.485759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-974b5fa1-2256-4eaa-8c5c-15b99a531dda req-98eeb87d-c552-493d-9d05-b8562fe399a4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.486351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-974b5fa1-2256-4eaa-8c5c-15b99a531dda req-98eeb87d-c552-493d-9d05-b8562fe399a4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.507476 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-974b5fa1-2256-4eaa-8c5c-15b99a531dda req-98eeb87d-c552-493d-9d05-b8562fe399a4 service nova] Creating event network-vif-deleted:d04b6525-6b58-472e-a6cf-3e3f194b4781 for instance 55107fac-94c3-4870-8fe9-58bef2796ac5 on n-h2-862769-3 Oct 28 19:14:47.516958 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-974b5fa1-2256-4eaa-8c5c-15b99a531dda req-98eeb87d-c552-493d-9d05-b8562fe399a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084946 Oct 28 19:14:47.523367 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 968/1919] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:47.540941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:47.542983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:47.563275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.566836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.567501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.568522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.569001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.569409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.691748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:47.701329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:47.702805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:47.703983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae42ce39-f302-4a6f-8f9c-766547e4d2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1265 microversion: 2.25 time: 0.178850 Oct 28 19:14:47.728529 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 969/1920] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:47 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:47.740006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:47.742941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: e97e4371-c171-43ac-8520-da07711dcbb1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:47.760861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.763061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.763704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.764632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.771608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.772345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.794993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] HTTP exception thrown: Instance e97e4371-c171-43ac-8520-da07711dcbb1 could not be found. Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Request method failure captured: Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 HTTP/1.1 Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCiGmxRxgOaLXC4IF-Fu3_OYTnl42timpcaMSRSGuG2pWvIA961oEmAKtWM0rkj6-UN2S3WzY9KeDUFs2Smu9-7etkZg-_j1qVsFZjqQsLrQUZBsGvyyZrAxXxBhwRLARZ5sfsHZpfgOqYZV7IycLs4FQrBC-1f6MOoj_LDEp_Wkb3A Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:47.796926 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fcadf83882374e8d93bbf699425e501b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveMigrationTest-340510936 Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveMigrationTest-340510936-project Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6e2ff64ca72649d3ac2e8912da76c9af Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveMigrationTest-340510936-project Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e97e4371-c171-43ac-8520-da07711dcbb1 could not be found. Oct 28 19:14:47.798680 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e97e4371-c171-43ac-8520-da07711dcbb1'} Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97e4371-c171-43ac-8520-da07711dcbb1 could not be found. Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:47.799711 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97e4371-c171-43ac-8520-da07711dcbb1 could not be found. Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97e4371-c171-43ac-8520-da07711dcbb1 could not be found. Oct 28 19:14:47.801358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:47.803654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Returning 404 to user: Instance e97e4371-c171-43ac-8520-da07711dcbb1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:47.804748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf06b471-320e-46ea-93c1-80b08cecbac8 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1" status: 404 len: 111 microversion: 2.1 time: 0.075063 Oct 28 19:14:47.805873 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 970/1921] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:47 2022] GET /compute/v2.1/servers/e97e4371-c171-43ac-8520-da07711dcbb1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:47.810790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9f69bb84-a5fa-456a-ade9-d39705ff20db req-da20d5cf-e1ef-41f0-898a-9ee15bb7e28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0abe1-71b4-4c47-b0b3-649546da2bab", "name": "network-vif-deleted", "tag": "9c4fabf6-c437-4527-ab25-99f7ecf2bd44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:47.833047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9f69bb84-a5fa-456a-ade9-d39705ff20db req-da20d5cf-e1ef-41f0-898a-9ee15bb7e28f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.833551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9f69bb84-a5fa-456a-ade9-d39705ff20db req-da20d5cf-e1ef-41f0-898a-9ee15bb7e28f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.834070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9f69bb84-a5fa-456a-ade9-d39705ff20db req-da20d5cf-e1ef-41f0-898a-9ee15bb7e28f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.849279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9f69bb84-a5fa-456a-ade9-d39705ff20db req-da20d5cf-e1ef-41f0-898a-9ee15bb7e28f service nova] Creating event network-vif-deleted:9c4fabf6-c437-4527-ab25-99f7ecf2bd44 for instance 02f0abe1-71b4-4c47-b0b3-649546da2bab on n-h1-862769-3 Oct 28 19:14:47.854589 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9f69bb84-a5fa-456a-ade9-d39705ff20db req-da20d5cf-e1ef-41f0-898a-9ee15bb7e28f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047270 Oct 28 19:14:47.855645 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 971/1922] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:47.860985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-08802c10-ad53-48a7-8e73-a78782d4b7ce tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d779ec5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1509495418", "description": "tempest-description-807515407"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:48.166191 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-08802c10-ad53-48a7-8e73-a78782d4b7ce tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.309278 Oct 28 19:14:48.166819 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 972/1923] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:48.171341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:48.172059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 55107fac-94c3-4870-8fe9-58bef2796ac5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:48.194508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:48.195353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:48.196023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:48.196966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:48.197657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:48.198297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:48.213013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 55107fac-94c3-4870-8fe9-58bef2796ac5 could not be found. Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 HTTP/1.1 Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:48.215017 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 55107fac-94c3-4870-8fe9-58bef2796ac5 could not be found. Oct 28 19:14:48.216882 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '55107fac-94c3-4870-8fe9-58bef2796ac5'} Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55107fac-94c3-4870-8fe9-58bef2796ac5 could not be found. Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:48.217919 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55107fac-94c3-4870-8fe9-58bef2796ac5 could not be found. Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55107fac-94c3-4870-8fe9-58bef2796ac5 could not be found. Oct 28 19:14:48.220704 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:48.225530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 55107fac-94c3-4870-8fe9-58bef2796ac5 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:48.226741 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7581b6d-24fb-46cc-9f5c-c3c00ab06821 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5" status: 404 len: 111 microversion: 2.1 time: 0.058959 Oct 28 19:14:48.227510 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 973/1924] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:48 2022] GET /compute/v2.1/servers/55107fac-94c3-4870-8fe9-58bef2796ac5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:48.234982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f715bb1-892a-4b04-aa4b-e34ce09e41f0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '.version_select at 0x7f1d7c2be0d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:48.259927 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1f715bb1-892a-4b04-aa4b-e34ce09e41f0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002794543" status: 202 len: 0 microversion: 2.1 time: 0.031075 Oct 28 19:14:48.261245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 974/1925] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:14:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002794543 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:48.271735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:48.272618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:48.280823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:48.282011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:48.282011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:48.282930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:48.283493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:48.284018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:48.607974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:48.619120 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e7c25ab-dfba-430c-8771-c9f99a983348 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1507 microversion: 2.1 time: 0.356441 Oct 28 19:14:48.619759 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 975/1926] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:48 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:48.624480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f846c62-2bde-4c47-9bdf-fad7d157aab8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77898940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.198968 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f846c62-2bde-4c47-9bdf-fad7d157aab8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.577714 Oct 28 19:14:49.201728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 976/1927] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:14:48 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:49.215789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.216280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:49.231627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.234501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.235062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.235783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.236195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.236789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.265246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:49.356040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1f965791-723e-4cb8-9c5b-0afffd3d796a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 204 len: 0 microversion: 2.1 time: 0.143276 Oct 28 19:14:49.356432 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 977/1928] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:49 2022] DELETE /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:49.362042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.362767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:49.369178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.369663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.370088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.370821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.371285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.371684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.456694 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d25832ef-0ae2-457a-95b5-399a89afea1d tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.195462 Oct 28 19:14:49.464837 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 952/1929] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:14:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:49.470106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.471609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:49.479704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.480186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.480800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.482132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.482950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.483532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.564333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:49.572778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:49.574343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:49.575536 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b274a73-ffd8-42b1-bfb0-5e400272e392 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1265 microversion: 2.25 time: 0.109605 Oct 28 19:14:49.576086 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 953/1930] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:49 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:49.580914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a99e700-e1e0-42be-b960-87a0cce3015e tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d800029d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.581327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:49.590183 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ffd126ae-29d9-4fdb-8639-7a288bb7aa87 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1507 microversion: 2.1 time: 0.232556 Oct 28 19:14:49.591000 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 978/1931] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:49 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:49.603304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.604149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:49.610806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.611409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.611638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.612383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.612822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.613420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.814299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:49.822401 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2392a153-7b1f-4fa8-b7e4-e0707fdc04c0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1473 microversion: 2.1 time: 0.222912 Oct 28 19:14:49.822997 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 979/1932] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:49 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:49.827999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7cc9eedc-24a7-42ec-a0c9-7bb8bb564395 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Calling method '.version_select at 0x7f1d77c46a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.876366 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a99e700-e1e0-42be-b960-87a0cce3015e tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d" status: 202 len: 0 microversion: 2.1 time: 0.298645 Oct 28 19:14:49.877024 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 954/1933] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:14:49 2022] DELETE /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:49.882882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:49.883608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:49.890422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.890955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.891712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.892511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.892921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.893388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.925932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:50.010703 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68a50ab1-5fbe-456c-8bfd-54b0389cf21d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 204 len: 0 microversion: 2.1 time: 0.132172 Oct 28 19:14:50.011497 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 955/1934] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:49 2022] DELETE /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:50.018999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9f61fc58-53f2-4501-a9b1-2b6762165592 req-283515ad-d403-4001-8589-716a58f3f433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e4371-c171-43ac-8520-da07711dcbb1", "name": "network-vif-deleted", "tag": "2da3baa2-5257-4f18-bfd0-e9e9e09faf0f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:50.028570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9f61fc58-53f2-4501-a9b1-2b6762165592 req-283515ad-d403-4001-8589-716a58f3f433 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.029035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9f61fc58-53f2-4501-a9b1-2b6762165592 req-283515ad-d403-4001-8589-716a58f3f433 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.029452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9f61fc58-53f2-4501-a9b1-2b6762165592 req-283515ad-d403-4001-8589-716a58f3f433 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.041662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9f61fc58-53f2-4501-a9b1-2b6762165592 req-283515ad-d403-4001-8589-716a58f3f433 service nova] Creating event network-vif-deleted:2da3baa2-5257-4f18-bfd0-e9e9e09faf0f for instance e97e4371-c171-43ac-8520-da07711dcbb1 on n-h2-862769-3 Oct 28 19:14:50.046488 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9f61fc58-53f2-4501-a9b1-2b6762165592 req-283515ad-d403-4001-8589-716a58f3f433 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Oct 28 19:14:50.047118 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 956/1935] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:50.052025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.052776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:50.058955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.059432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.059852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.060542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.061055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.061715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.318184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:50.326637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fec4fcb-ce0e-4cb0-9b53-e125457e0a8b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1507 microversion: 2.1 time: 0.278385 Oct 28 19:14:50.335391 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 957/1936] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:50 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:50.335391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.335391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:50.342390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.343381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.344612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.345404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.345859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.346285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.553681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:50.565128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f6d2b11-7c04-4745-a455-af8027a2c8a3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1528 microversion: 2.1 time: 0.236854 Oct 28 19:14:50.567365 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 958/1937] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:50 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1528 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:50.573418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7ff9aca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.640059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:14:50.641101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 30c75112-e5ad-4b96-91a5-1a39971f081d not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:14:50.642109 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.642109 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d HTTP/1.1 Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:50.646894 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] Oct 28 19:14:50.648528 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '30c75112-e5ad-4b96-91a5-1a39971f081d'} Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:50.649435 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:14:50.650717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.652479 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-b5b2b454-8e92-4294-916c-9f6e03d47ece'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:50.654242 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40873b02-7ebd-4442-a16e-ffeb564499b9 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d" status: 404 len: 194 microversion: 2.1 time: 0.080552 Oct 28 19:14:50.655239 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 959/1938] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:14:50 2022] GET /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:50.660562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.661223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:50.672192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.672869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.678145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.679033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.680841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.681349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.773170 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7cc9eedc-24a7-42ec-a0c9-7bb8bb564395 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef" status: 202 len: 0 microversion: 2.1 time: 0.948769 Oct 28 19:14:50.774271 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 980/1939] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:14:49 2022] DELETE /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef => generated 0 bytes in 950 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:50.779977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:50.786794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:50.796410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.797264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.801116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.804080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.804822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.806377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.875239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:50.884339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:50.893748 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71d58115-43fb-4164-be37-caff19f6cf8d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1483 microversion: 2.1 time: 0.237678 Oct 28 19:14:50.894894 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 960/1940] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:50 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1483 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:50.899014 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0dcb291-8a9c-4b94-8f18-e6c2f6ee4eda tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "PUT /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1079 microversion: 2.1 time: 0.123515 Oct 28 19:14:50.899581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.900178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:50.906520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.907100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.907533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.908225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.908674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.909147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.911158 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 981/1941] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:14:50 2022] PUT /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1079 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:50.916964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1a39617-5ca5-41be-b966-e9ce3a586131 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77887ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:51.337322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:51.345626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:51.347531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:51.348666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fceff7e6-773d-4c67-a4d6-19339fd51fe8 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 200 len: 1265 microversion: 2.25 time: 0.452863 Oct 28 19:14:51.349182 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 961/1942] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:50 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 1265 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:14:51.355725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94f41086-c830-4cae-bb61-321fb1881eb8 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Calling method '.version_select at 0x7f1d8000adc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:51.451404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-94f41086-c830-4cae-bb61-321fb1881eb8 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef could not be found", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:14:51.452095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-94f41086-c830-4cae-bb61-321fb1881eb8 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] HTTP exception thrown: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94f41086-c830-4cae-bb61-321fb1881eb8 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Request method failure captured: Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef HTTP/1.1 Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCocSZg-pV5lu6-t3q2dDMz2a_UJN71Z5LWIjxnVGpSxdnfvwWmbIeQ3C4UuplNGzdupc61K9TLbscD6QRdrKCcoZtXgA0fOu45B_GLcaaOhrRKpj3z5EfNnLGTBng0YPFIuSczfzQ4-9WPQINFYVYp_Tt0mbwVSVRwX9RcGK1hAw3I Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 4bde25aa347546de806d02a2ad33a40e Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FloatingIPsTestJSON-1759267848 Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:14:51.453888 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4bde25aa347546de806d02a2ad33a40e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4bde25aa347546de806d02a2ad33a40e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4bde25aa347546de806d02a2ad33a40e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4bde25aa347546de806d02a2ad33a40e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FloatingIPsTestJSON-1759267848 Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 4bde25aa347546de806d02a2ad33a40e Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1759267848 Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FloatingIPsTestJSON-1759267848-project Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 24d3ce193cf64401b5cac8917e878664 Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FloatingIPsTestJSON-1759267848-project Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: exception: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef'} Oct 28 19:14:51.455442 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:14:51.456490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef could not be found Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-122c447a-561a-4285-ae49-7a27ae35c8bf'] Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef. Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:51.459093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:51.462259 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94f41086-c830-4cae-bb61-321fb1881eb8 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Returning 404 to user: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94f41086-c830-4cae-bb61-321fb1881eb8 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef" status: 404 len: 111 microversion: 2.1 time: 0.103887 Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 962/1943] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:14:51 2022] GET /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:51.467067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:51.476747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:51.477625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:51.478347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:51.480372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:51.481708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:51.482404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:51.884902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:51.906767 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e47f59f-2887-4d62-b73b-414b046d423e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1473 microversion: 2.1 time: 0.449063 Oct 28 19:14:51.910534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 963/1944] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:51 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1473 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:51.926359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:51.926823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:51.931577 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1a39617-5ca5-41be-b966-e9ce3a586131 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf" status: 202 len: 0 microversion: 2.1 time: 1.018826 Oct 28 19:14:51.935459 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 982/1945] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:14:50 2022] DELETE /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:51.935627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:51.935725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:51.936122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:51.936825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:51.937987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:51.938114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1644396-1169-4852-837b-ee2a7f1f9a86 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Calling method '.version_select at 0x7f1d778b7940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:51.938220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:52.069746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-a1644396-1169-4852-837b-ee2a7f1f9a86 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef could not be found", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:14:52.070436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a1644396-1169-4852-837b-ee2a7f1f9a86 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] HTTP exception thrown: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1644396-1169-4852-837b-ee2a7f1f9a86 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Request method failure captured: Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef HTTP/1.1 Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCocSZg-pV5lu6-t3q2dDMz2a_UJN71Z5LWIjxnVGpSxdnfvwWmbIeQ3C4UuplNGzdupc61K9TLbscD6QRdrKCcoZtXgA0fOu45B_GLcaaOhrRKpj3z5EfNnLGTBng0YPFIuSczfzQ4-9WPQINFYVYp_Tt0mbwVSVRwX9RcGK1hAw3I Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 4bde25aa347546de806d02a2ad33a40e Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsTestJSON-1759267848 Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:52.072427 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4bde25aa347546de806d02a2ad33a40e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4bde25aa347546de806d02a2ad33a40e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4bde25aa347546de806d02a2ad33a40e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4bde25aa347546de806d02a2ad33a40e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsTestJSON-1759267848 Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 4bde25aa347546de806d02a2ad33a40e Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1759267848 Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsTestJSON-1759267848-project Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 24d3ce193cf64401b5cac8917e878664 Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsTestJSON-1759267848-project Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: exception: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef'} Oct 28 19:14:52.073905 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:14:52.074851 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef could not be found Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbbffcd6-f311-4782-8a50-1e8810e9bc55'] Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef. Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:52.076182 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:52.077542 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:52.080533 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef Oct 28 19:14:52.080533 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:52.080533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1644396-1169-4852-837b-ee2a7f1f9a86 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] Returning 404 to user: Floating IP not found for ID c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:52.080533 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1644396-1169-4852-837b-ee2a7f1f9a86 tempest-FloatingIPsTestJSON-1759267848 tempest-FloatingIPsTestJSON-1759267848-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef" status: 404 len: 111 microversion: 2.1 time: 0.140348 Oct 28 19:14:52.080533 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 983/1946] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:14:51 2022] DELETE /compute/v2.1/os-floating-ips/c59e2ad7-8cb2-4ad2-8025-cfc5103f55ef => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:52.082615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:52.082615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:52.099427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:52.099998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:52.102026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:52.103494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:52.104211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:52.104992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:52.906536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:52.918505 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8cffff3-c8be-4a43-95ef-f1e94703e8a6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1505 microversion: 2.1 time: 1.008507 Oct 28 19:14:52.924362 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 964/1947] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:51 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:52.952200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:52.956894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:52.986216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:52.990999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:52.994135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.008797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.009285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.009717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.073669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:53.092378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ef743d9-5ff3-41ed-a761-948de1b13f31 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 1.015310 Oct 28 19:14:53.093853 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 984/1948] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:52 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:53.112086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d778b70d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:53.353213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:14:53.354650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.security_group_api [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf not found {{(pid=120628) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:14:53.355450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.355450 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf HTTP/1.1 Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:53.357609 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: exception: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] Oct 28 19:14:53.359561 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7d65a79d-6489-4f23-ae2b-cfac0e95a8bf'} Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:53.360633 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:14:53.362502 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.364759 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] Oct 28 19:14:53.367683 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.371046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:14:53.371046 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-a854eb99-0a0c-4ae5-91d5-70e2ffa12b97'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:53.372283 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-870c2ee6-47b9-4f3b-8047-59177433630d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf" status: 404 len: 194 microversion: 2.1 time: 0.275894 Oct 28 19:14:53.376643 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 985/1949] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:14:53 2022] GET /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf => generated 194 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:53.404045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:53.411118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 02f0abe1-71b4-4c47-b0b3-649546da2bab] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:53.424127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.428168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.429011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.430620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.431403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.436388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.468352 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] HTTP exception thrown: Instance 02f0abe1-71b4-4c47-b0b3-649546da2bab could not be found. Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Request method failure captured: Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab HTTP/1.1 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCiWux0DTGQWCa2sS8vKswvQNaovqg9ixK1ijhWIorxXIwNlLBqEkvjIOi40--vXrEu_bXOYuytC2NVX5OkfWUEcyoJeZImyBP1teOoT-ilPz_6ig3cxtOl-ViiLRPKljT6I0RhoP4jT0gfVN9yXsCyoQiHAu-dYPN0RU0IP5sZkqL0 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:53.476852 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df69faab58094a56ba4ecf152625b366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df69faab58094a56ba4ecf152625b366", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 1b1defe0b46f45fc8ff3d354bb4d361e Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 02f0abe1-71b4-4c47-b0b3-649546da2bab could not be found. Oct 28 19:14:53.478678 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '02f0abe1-71b4-4c47-b0b3-649546da2bab'} Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f0abe1-71b4-4c47-b0b3-649546da2bab could not be found. Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:53.479687 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f0abe1-71b4-4c47-b0b3-649546da2bab could not be found. Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f0abe1-71b4-4c47-b0b3-649546da2bab could not be found. Oct 28 19:14:53.481175 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:53.484580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Returning 404 to user: Instance 02f0abe1-71b4-4c47-b0b3-649546da2bab could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:53.485701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-83938491-246c-483a-8700-2a0d010e46e7 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab" status: 404 len: 111 microversion: 2.25 time: 0.107815 Oct 28 19:14:53.487246 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 986/1950] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:14:53 2022] GET /compute/v2.1/servers/02f0abe1-71b4-4c47-b0b3-649546da2bab => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:14:53.512622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:53.514681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:53.530369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.532989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.537763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.538779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.541373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.545188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.632312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.633170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.633840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.634549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lazy-loading 'fault' on Instance uuid 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:53.859028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:53.872228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf900a74-5d43-491c-898b-a7b8dbb8d40a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 200 len: 1307 microversion: 2.1 time: 0.383240 Oct 28 19:14:53.872715 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 987/1951] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:53 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 1307 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:53.883830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:53.892695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:53.905154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.907297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.912455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.913778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:53.916967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:53.918345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:53.956198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:53.973916 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-96381749-e28c-44f2-a7b9-368ee3b0a33f tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1483 microversion: 2.1 time: 1.043389 Oct 28 19:14:54.004387 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 965/1952] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:52 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1483 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:54.033941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-431c9fdd-29af-4058-9c64-1514f6a9c875 req-c0efe945-ac29-46c1-ba70-f4764e67b908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf9329d-77e2-41f2-9c79-f8721fb3d1bd", "name": "network-vif-deleted", "tag": "edf346f5-72f0-4784-ab1e-524a89e16046"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:54.099222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-431c9fdd-29af-4058-9c64-1514f6a9c875 req-c0efe945-ac29-46c1-ba70-f4764e67b908 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:54.102327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-431c9fdd-29af-4058-9c64-1514f6a9c875 req-c0efe945-ac29-46c1-ba70-f4764e67b908 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:54.103405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-431c9fdd-29af-4058-9c64-1514f6a9c875 req-c0efe945-ac29-46c1-ba70-f4764e67b908 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:54.158282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-431c9fdd-29af-4058-9c64-1514f6a9c875 req-c0efe945-ac29-46c1-ba70-f4764e67b908 service nova] Creating event network-vif-deleted:edf346f5-72f0-4784-ab1e-524a89e16046 for instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd on n-h1-862769-3 Oct 28 19:14:54.175387 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-431c9fdd-29af-4058-9c64-1514f6a9c875 req-c0efe945-ac29-46c1-ba70-f4764e67b908 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168917 Oct 28 19:14:54.181823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 966/1953] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:54.204888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43088e54-b96e-4c77-8b22-dcfd084951b1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7ffa0b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:54.498728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:54.507360 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4331532c-983f-4700-b2bf-ded68bc6039f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1505 microversion: 2.1 time: 0.627439 Oct 28 19:14:54.512929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 988/1954] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:53 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:54.530568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:54.534481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:54.552966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:54.557825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:54.558475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:54.560865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:54.561338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:54.561745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:54.646154 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43088e54-b96e-4c77-8b22-dcfd084951b1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe" status: 202 len: 0 microversion: 2.1 time: 0.461261 Oct 28 19:14:54.647479 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 967/1955] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:14:54 2022] DELETE /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:54.653777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0913c7e6-10c5-4d8c-ab27-4d0ab8fc987a req-e788093b-9fb6-412e-98a5-95e89e26d557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9908d12e-78a2-487f-b024-6b70458c31bf", "name": "network-vif-plugged", "status": "completed", "tag": "e4a459cf-63b3-4d25-b574-d0e73c54b919"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:54.695539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0913c7e6-10c5-4d8c-ab27-4d0ab8fc987a req-e788093b-9fb6-412e-98a5-95e89e26d557 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:54.696068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0913c7e6-10c5-4d8c-ab27-4d0ab8fc987a req-e788093b-9fb6-412e-98a5-95e89e26d557 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:54.700941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0913c7e6-10c5-4d8c-ab27-4d0ab8fc987a req-e788093b-9fb6-412e-98a5-95e89e26d557 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:54.752039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0913c7e6-10c5-4d8c-ab27-4d0ab8fc987a req-e788093b-9fb6-412e-98a5-95e89e26d557 service nova] Creating event network-vif-plugged:e4a459cf-63b3-4d25-b574-d0e73c54b919 for instance 9908d12e-78a2-487f-b024-6b70458c31bf on n-h1-862769-3 Oct 28 19:14:54.770072 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0913c7e6-10c5-4d8c-ab27-4d0ab8fc987a req-e788093b-9fb6-412e-98a5-95e89e26d557 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121018 Oct 28 19:14:54.781312 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 968/1956] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:54.796067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:54.814172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:54.838622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:54.839138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:54.845931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:54.846965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:54.847439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:54.847864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.056863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:55.072249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:14:55.073071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:14:55.073416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:14:55.073550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:14:55.073914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:14:55.078872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f44cadbc-059e-4d4d-b54a-86457201010a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.554282 Oct 28 19:14:55.087943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 989/1957] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:54 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:55.096907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:55.106152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7c2be700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:55.141734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:14:55.142335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.security_group_api [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 7c2940ce-e224-48d5-bed0-b7c3294965fe not found {{(pid=120628) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:14:55.142897 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.142897 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe HTTP/1.1 Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:55.144702 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: exception: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] Oct 28 19:14:55.146398 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7c2940ce-e224-48d5-bed0-b7c3294965fe'} Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:55.147605 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:14:55.149116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.150997 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-03c39c51-d89a-439d-b19c-023b703c88d4'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd559230-0128-4b95-93d9-bda9e84eee24 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe" status: 404 len: 194 microversion: 2.1 time: 0.057245 Oct 28 19:14:55.152675 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 990/1958] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:14:55 2022] GET /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:55.160904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:55.161513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:55.193877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.194639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.195161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.197032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.199003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.200774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.248441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd could not be found. Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd HTTP/1.1 Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:55.250434 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd could not be found. Oct 28 19:14:55.252337 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '3bf9329d-77e2-41f2-9c79-f8721fb3d1bd'} Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd could not be found. Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:55.253325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd could not be found. Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd could not be found. Oct 28 19:14:55.254939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:55.257745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 3bf9329d-77e2-41f2-9c79-f8721fb3d1bd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:55.259094 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3add2467-9927-4aea-a4b2-960fd15c1a62 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd" status: 404 len: 111 microversion: 2.1 time: 0.111099 Oct 28 19:14:55.259843 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 991/1959] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:55 2022] GET /compute/v2.1/servers/3bf9329d-77e2-41f2-9c79-f8721fb3d1bd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:55.271602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:55.272867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:55.289419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.289910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.290343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.293848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.295430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.297637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.318605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:55.350072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.350563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.351014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.351733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.352182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.352598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.418726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.419230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.419656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.420105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lazy-loading 'fault' on Instance uuid c725ea7f-facb-47c1-94c4-15b43b75fcd5 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:55.468995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b7c41327-c901-4d66-bcb2-f0391ad81e6b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "POST /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163/action" status: 202 len: 1111 microversion: 2.1 time: 0.676866 Oct 28 19:14:55.469281 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 969/1960] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:14:54 2022] POST /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163/action => generated 1111 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 19:14:55.510773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e815b2f8-dcdd-4481-ba39-1ee9a1995620 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d80001d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:55.562706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:55.572944 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a762530d-1e1d-49c7-acd3-cd6f4e7146ad tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 200 len: 1300 microversion: 2.1 time: 0.309770 Oct 28 19:14:55.585123 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 992/1961] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:55 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 1300 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:55.596463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:55.597250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:55.603996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.604740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.605327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.606262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.606952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.607523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.647233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:55.780312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f073725f-242d-4833-b594-8d9b24ee816a tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 204 len: 0 microversion: 2.1 time: 0.195933 Oct 28 19:14:55.783411 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 993/1962] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:55 2022] DELETE /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:55.800067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:55.803227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:55.817503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.818833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.820830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:55.821741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:55.828042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:55.828766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:56.117967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e815b2f8-dcdd-4481-ba39-1ee9a1995620 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.623749 Oct 28 19:14:56.129628 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 970/1963] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:14:55 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:56.135207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:56.137004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:56.187188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:56.189900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:56.190454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:56.191327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:56.192097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:56.192621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:56.445989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:56.481245 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51d4c4f9-05ce-4db2-824b-ca7903732371 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.688120 Oct 28 19:14:56.482413 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 994/1964] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:55 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:56.501318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:56.501922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:56.533916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:56.545106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:56.545992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:56.548544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:56.549376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:56.549836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:56.550262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:56.644593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:56.659605 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-45d4f5bd-1e38-4f2e-99c1-1483c059ced5 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1472 microversion: 2.1 time: 0.528287 Oct 28 19:14:56.660886 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 971/1965] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:56 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:56.665872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50c6cecf-e303-466f-9d87-ddfec7773c9b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d7ffa01f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1684793271", "description": "tempest-description-140140885"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:56.963799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:56.976759 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11f3cda7-1893-4e5f-a9de-b73488f2dd72 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.492582 Oct 28 19:14:56.979262 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 995/1966] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:56 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:56.990232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4b4bbbf1-c2b3-47f3-9922-493b95422e1e req-dff7654c-06c7-4d1e-a0a2-f5a2ebbd0d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c725ea7f-facb-47c1-94c4-15b43b75fcd5", "name": "network-vif-deleted", "tag": "ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:57.017320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b4bbbf1-c2b3-47f3-9922-493b95422e1e req-dff7654c-06c7-4d1e-a0a2-f5a2ebbd0d4c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.018492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b4bbbf1-c2b3-47f3-9922-493b95422e1e req-dff7654c-06c7-4d1e-a0a2-f5a2ebbd0d4c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.020458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b4bbbf1-c2b3-47f3-9922-493b95422e1e req-dff7654c-06c7-4d1e-a0a2-f5a2ebbd0d4c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.054823 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4b4bbbf1-c2b3-47f3-9922-493b95422e1e req-dff7654c-06c7-4d1e-a0a2-f5a2ebbd0d4c service nova] Creating event network-vif-deleted:ca4fe8ab-64ec-4a48-9cb3-cee1f090d7a0 for instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 on n-h1-862769-3 Oct 28 19:14:57.071187 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4b4bbbf1-c2b3-47f3-9922-493b95422e1e req-dff7654c-06c7-4d1e-a0a2-f5a2ebbd0d4c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088364 Oct 28 19:14:57.075522 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 996/1967] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:57.095106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:57.097466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: c725ea7f-facb-47c1-94c4-15b43b75fcd5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:57.119447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.120100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.122498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.125092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.125834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.127083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.160717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] HTTP exception thrown: Instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 could not be found. Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Request method failure captured: Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 HTTP/1.1 Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCiGmxRxgOaLXC4IF-Fu3_OYTnl42timpcaMSRSGuG2pWvIA961oEmAKtWM0rkj6-UN2S3WzY9KeDUFs2Smu9-7etkZg-_j1qVsFZjqQsLrQUZBsGvyyZrAxXxBhwRLARZ5sfsHZpfgOqYZV7IycLs4FQrBC-1f6MOoj_LDEp_Wkb3A Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:14:57.165898 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fcadf83882374e8d93bbf699425e501b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveMigrationTest-340510936 Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveMigrationTest-340510936-project Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6e2ff64ca72649d3ac2e8912da76c9af Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveMigrationTest-340510936-project Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 could not be found. Oct 28 19:14:57.167698 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c725ea7f-facb-47c1-94c4-15b43b75fcd5'} Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 could not be found. Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:57.168543 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 could not be found. Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 could not be found. Oct 28 19:14:57.169882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:14:57.181727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Returning 404 to user: Instance c725ea7f-facb-47c1-94c4-15b43b75fcd5 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:57.182861 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61c40154-86df-4ee1-9103-f5ed456c9452 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5" status: 404 len: 111 microversion: 2.1 time: 0.104244 Oct 28 19:14:57.191278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 997/1968] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:57 2022] GET /compute/v2.1/servers/c725ea7f-facb-47c1-94c4-15b43b75fcd5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:57.200470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:57.201315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:57.209550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.210039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.210467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.211696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.212356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.213016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.261677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:14:57.290489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50c6cecf-e303-466f-9d87-ddfec7773c9b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.628241 Oct 28 19:14:57.292205 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 972/1969] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:57.305191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af4d05b6-d70b-4c7f-9512-e6912bdcdb28 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d7ff67280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2066002514", "description": "tempest-description-231161339"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:57.392609 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d5a16d2f-7e82-4af9-91fc-2c6df13b521c tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "DELETE /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 204 len: 0 microversion: 2.1 time: 0.196698 Oct 28 19:14:57.394424 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 998/1970] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:57 2022] DELETE /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:57.410307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:57.411356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:57.445573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.446311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.446953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.447841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.448600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.449181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.831427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:57.841448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0f97d71-bec3-477f-a551-c7ff962f81da tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1499 microversion: 2.1 time: 0.442729 Oct 28 19:14:57.845766 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 999/1971] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:57 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1499 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:57.856472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:57.860701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:57.874632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.875877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.876541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:57.877474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:57.878558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:57.883149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:58.682943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:58.696543 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd875c54-5e9a-4c3e-8813-932163147f38 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.849247 Oct 28 19:14:58.697663 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1000/1972] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:57 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:58.701258 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af4d05b6-d70b-4c7f-9512-e6912bdcdb28 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.400317 Oct 28 19:14:58.710720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 973/1973] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:14:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:58.710720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:58.710720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:58.722151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:58.722882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:58.723557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:58.724430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:58.728731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:58.729291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:58.745977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:58.746409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:58.767058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:58.794769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:58.795324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:58.796080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:58.796549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:58.796960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:58.802965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:59.281053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:59.289680 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a21be60-3700-4e30-9c68-32c5de667a0a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.586337 Oct 28 19:14:59.292228 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 974/1974] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:58 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:59.314813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:59.318140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:59.348656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:59.350878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:59.353731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:59.357406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:59.358020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:59.361301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:59.381906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:59.396508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70ae519a-94c4-439c-9750-6d904fed8d37 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 200 len: 1472 microversion: 2.1 time: 0.695630 Oct 28 19:14:59.412797 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1001/1975] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:58 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:59.427096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-903724447", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "bdb913ed-e7b6-4e44-9fae-837a1dea66c0"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:59.547257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] validate_networks() for [('bdb913ed-e7b6-4e44-9fae-837a1dea66c0', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:00.311089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:00.339203 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd79bb2d-3fcf-426c-b0ca-6d8c2d60aca0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1499 microversion: 2.1 time: 1.035999 Oct 28 19:15:00.341482 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 975/1976] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:59 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1499 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:00.368017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:00.370834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:00.381413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:00.384784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:00.388447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:00.389116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:00.390053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:00.392225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:00.392841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.313214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:01.324035 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fcf0707-6dbc-4dc3-8b1c-c4e223cc52ca tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.979842 Oct 28 19:15:01.339228 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 976/1977] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:00 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:01.345098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:01.346010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:01.352602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.353354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.353946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.355087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.355713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.356294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.892928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:15:01.894011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:15:01.894647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:15:01.895251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:15:01.895815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:15:01.906039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.906796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.907413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.908320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.908927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.909500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.934871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:01.943904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Getting quotas for project 9c5ba6ddbf324d7f86f14da325613bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:01.950047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Getting quotas for user 54eb9513374c415bb4744578d640b888 and project 9c5ba6ddbf324d7f86f14da325613bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:01.952874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-513aab2f-f4d2-4bfb-94c3-d238dfde8259 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.608666 Oct 28 19:15:01.954528 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 977/1978] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:01 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:01.965569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:01.972978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 5e978d56-5e55-4a0b-8b4d-69686209277f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:01.979650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:15:01.985419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.987459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:15:01.988385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.989180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.990404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.991237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.992820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.039696 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 5e978d56-5e55-4a0b-8b4d-69686209277f could not be found. Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f HTTP/1.1 Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:02.043275 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 5e978d56-5e55-4a0b-8b4d-69686209277f could not be found. Oct 28 19:15:02.045100 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5e978d56-5e55-4a0b-8b4d-69686209277f'} Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e978d56-5e55-4a0b-8b4d-69686209277f could not be found. Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:02.046147 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e978d56-5e55-4a0b-8b4d-69686209277f could not be found. Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e978d56-5e55-4a0b-8b4d-69686209277f could not be found. Oct 28 19:15:02.047799 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:02.052449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 5e978d56-5e55-4a0b-8b4d-69686209277f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:02.053562 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c37e78d5-7ae3-4608-9ebd-227a08b34cda tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f" status: 404 len: 111 microversion: 2.1 time: 0.097838 Oct 28 19:15:02.060448 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 978/1979] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:01 2022] GET /compute/v2.1/servers/5e978d56-5e55-4a0b-8b4d-69686209277f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:02.071418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d7acd366-ee5c-4410-8215-c980f58aef3f req-a1ce7173-75d7-46be-b4ec-e89331432e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e978d56-5e55-4a0b-8b4d-69686209277f", "name": "network-vif-deleted", "tag": "505938d7-987c-4b49-a515-c963a680cd35"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:02.087579 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-371da61e-8cb6-40e9-b936-e2b2ef16c7e8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.673362 Oct 28 19:15:02.088998 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1002/1980] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:15:02.095001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.095833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:02.103594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.103847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7acd366-ee5c-4410-8215-c980f58aef3f req-a1ce7173-75d7-46be-b4ec-e89331432e86 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.104601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.105235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.106136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.106778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7acd366-ee5c-4410-8215-c980f58aef3f req-a1ce7173-75d7-46be-b4ec-e89331432e86 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.107131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.107750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.108757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7acd366-ee5c-4410-8215-c980f58aef3f req-a1ce7173-75d7-46be-b4ec-e89331432e86 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.131238 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d7acd366-ee5c-4410-8215-c980f58aef3f req-a1ce7173-75d7-46be-b4ec-e89331432e86 service nova] Creating event network-vif-deleted:505938d7-987c-4b49-a515-c963a680cd35 for instance 5e978d56-5e55-4a0b-8b4d-69686209277f on n-h1-862769-3 Oct 28 19:15:02.150815 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d7acd366-ee5c-4410-8215-c980f58aef3f req-a1ce7173-75d7-46be-b4ec-e89331432e86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086816 Oct 28 19:15:02.153591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 979/1981] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:02.164761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.166859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:02.199216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.199708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.199968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.200509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.201255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.201800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lazy-loading 'fault' on Instance uuid 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:02.204430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.205720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.206367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.208194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.289175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:02.325406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:02.336527 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9605b538-ed27-417b-b89b-e6f305d3ff67 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1300 microversion: 2.1 time: 0.246112 Oct 28 19:15:02.338569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1003/1982] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:02 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:02.352740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.353097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:02.371162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.372286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.372962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.374280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.375012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.375980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.458120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:02.472214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9340d4ad-7081-47d3-a3d3-280a0305e33f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 204 len: 0 microversion: 2.25 time: 0.312271 Oct 28 19:15:02.475980 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 980/1983] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:15:02 2022] DELETE /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:15:02.481999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73e7546b-abca-4d85-973a-2a7cfd6b7180 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.482790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73e7546b-abca-4d85-973a-2a7cfd6b7180 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:02.545211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73e7546b-abca-4d85-973a-2a7cfd6b7180 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:02.552451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73e7546b-abca-4d85-973a-2a7cfd6b7180 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1215 microversion: 2.1 time: 0.074795 Oct 28 19:15:02.555366 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 981/1984] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:02 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:02.579271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.582231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:02.590540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.591415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.602943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.604203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.608036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.608768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.668985 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c212cb43-e59a-45a9-bc05-3bacccfb09a3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 204 len: 0 microversion: 2.1 time: 0.327945 Oct 28 19:15:02.673923 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1004/1985] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:02 2022] DELETE /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:02.683607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.684332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:02.722956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.726474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.727779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.730425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.730941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.740234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.000019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.011830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8b6ac58-e41f-4d6e-8f14-5285d8a3c54a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.453760 Oct 28 19:15:03.012496 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 982/1986] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:02 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:03.021242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:03.024867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:03.041944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.042987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.046016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.047696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.048868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.049982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.100591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.116161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.127584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:03.138993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.139718 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3b5cfb4-32ad-4041-b90a-3948e91f2e00 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1731 microversion: 2.25 time: 0.464365 Oct 28 19:15:03.140317 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1005/1987] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:02 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1731 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:03.162632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:03.163633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:03.186601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.187134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.187799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.188693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.189149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.189570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.333517 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-989e83d4-cfeb-4829-a3cf-8d9b9d926009 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 204 len: 0 microversion: 2.1 time: 0.316544 Oct 28 19:15:03.337566 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 983/1988] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:03 2022] DELETE /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:03.345591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:03.346679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:03.353705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.354497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.355192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.356468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.357146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.357791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.524309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.533490 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30cdf3a9-e534-4ffe-b341-125f99321d22 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.388805 Oct 28 19:15:03.534099 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1006/1989] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:03 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:03.568195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:03.571112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:03.589646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.590202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.590854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.592250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.593750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.597688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.671888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.672577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.673459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.677367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lazy-loading 'fault' on Instance uuid 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:03.823314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2ff64ca72649d3ac2e8912da76c9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcadf83882374e8d93bbf699425e501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.855633 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d762215c-cd1c-4aa9-b0c6-f2cfa45a2c2d tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 200 len: 1300 microversion: 2.1 time: 0.297068 Oct 28 19:15:03.857732 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1007/1990] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:03 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 1300 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:03.866631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:03.872760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:03.889087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.889950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.893208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.895929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.897329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.898012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.949381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.959253 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5d863da4-13e0-44c4-bcdc-6931923fcccf tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1474 microversion: 2.1 time: 0.619459 Oct 28 19:15:03.959841 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 984/1991] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:03 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1474 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:04.038488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:04.039367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:04.045428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:04.048492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.051336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.055043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.056071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.056745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.057394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.059803 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f359bcac-67f1-4f73-9731-b72b62f859d5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1211 microversion: 2.1 time: 0.197803 Oct 28 19:15:04.076657 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1008/1992] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:03 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1211 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:04.169669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:04.170304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:04.182068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.182747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.183184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.184164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.185952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.187220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.707956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:04.716120 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c37cabee-419a-442b-bc3a-0cf23beba382 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.682557 Oct 28 19:15:04.723067 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 985/1993] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:04 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:04.734663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d814c254-e3c7-4c2b-949e-4c7f1ead6443 req-8c2d2bf0-d6d2-4d95-9fcd-2ecc8e125f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6353c-9ddc-4f2d-9fb4-c487c851cdc6", "name": "network-vif-deleted", "tag": "0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:04.746452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d814c254-e3c7-4c2b-949e-4c7f1ead6443 req-8c2d2bf0-d6d2-4d95-9fcd-2ecc8e125f03 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.746933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d814c254-e3c7-4c2b-949e-4c7f1ead6443 req-8c2d2bf0-d6d2-4d95-9fcd-2ecc8e125f03 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.747349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d814c254-e3c7-4c2b-949e-4c7f1ead6443 req-8c2d2bf0-d6d2-4d95-9fcd-2ecc8e125f03 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.769972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:04.788559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:04.800382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:04.801630 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69ac9883-c626-41ed-8f29-df8464ccbc1f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1731 microversion: 2.25 time: 0.636616 Oct 28 19:15:04.802226 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1009/1994] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:04 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1731 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:15:04.805888 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d814c254-e3c7-4c2b-949e-4c7f1ead6443 req-8c2d2bf0-d6d2-4d95-9fcd-2ecc8e125f03 service nova] Creating event network-vif-deleted:0a8ca01a-a1b8-45c8-b556-a5dc15e0b0cb for instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 on n-h1-862769-3 Oct 28 19:15:04.821453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:04.822063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:04.826219 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d814c254-e3c7-4c2b-949e-4c7f1ead6443 req-8c2d2bf0-d6d2-4d95-9fcd-2ecc8e125f03 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101669 Oct 28 19:15:04.827357 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 986/1995] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:04.839809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.840304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.840743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.841427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.842068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.842640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.882993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:04.883701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] [instance: 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:04.898031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.898529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.903165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.913154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.913649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.914092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.953039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] HTTP exception thrown: Instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 could not be found. Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Request method failure captured: Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 HTTP/1.1 Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCiGmxRxgOaLXC4IF-Fu3_OYTnl42timpcaMSRSGuG2pWvIA961oEmAKtWM0rkj6-UN2S3WzY9KeDUFs2Smu9-7etkZg-_j1qVsFZjqQsLrQUZBsGvyyZrAxXxBhwRLARZ5sfsHZpfgOqYZV7IycLs4FQrBC-1f6MOoj_LDEp_Wkb3A Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:04.954778 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fcadf83882374e8d93bbf699425e501b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fcadf83882374e8d93bbf699425e501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-LiveMigrationTest-340510936 Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fcadf83882374e8d93bbf699425e501b Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-LiveMigrationTest-340510936 Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-LiveMigrationTest-340510936-project Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6e2ff64ca72649d3ac2e8912da76c9af Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-LiveMigrationTest-340510936-project Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 could not be found. Oct 28 19:15:04.956478 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '00a6353c-9ddc-4f2d-9fb4-c487c851cdc6'} Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 could not be found. Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:04.957463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 could not be found. Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 could not be found. Oct 28 19:15:04.958914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:04.960238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] Returning 404 to user: Instance 00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:04.960238 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97edaa7f-b8ee-4589-87e0-c5d04d7faac0 tempest-LiveMigrationTest-340510936 tempest-LiveMigrationTest-340510936-project] 10.222.0.44 "GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6" status: 404 len: 111 microversion: 2.1 time: 0.078569 Oct 28 19:15:04.967007 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 987/1996] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:04 2022] GET /compute/v2.1/servers/00a6353c-9ddc-4f2d-9fb4-c487c851cdc6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:15:04.989066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:04.994664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:05.012093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.012582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.013015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.013719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.014172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.014589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.137700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:05.479903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:05.497632 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91a08879-21a6-4bdd-ae0e-98dbc1276b6a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.693120 Oct 28 19:15:05.500713 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1010/1997] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:04 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:05.516563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:05.519057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:05.538230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.541159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.547180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.549845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.550481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.552797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.795473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:05.797039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:05.807452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7961ec09-1fe8-4bee-a39f-844cf831dbf7 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1474 microversion: 2.1 time: 0.822302 Oct 28 19:15:05.808888 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 988/1998] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:04 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1474 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:05.811862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ff72f18-d5d1-41ee-b8e3-aea7025b8295 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1275 microversion: 2.1 time: 0.307664 Oct 28 19:15:05.812454 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1011/1999] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:05 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:05.828594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:05.829458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:05.837065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:05.837684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:05.839408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.842243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.844602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.845534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.847693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.848298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.876198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.876808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.878791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.879540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:05.879996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:05.884438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:06.045972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:06.066311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:06.068593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:06.070308 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc331554-29f5-4357-ad88-d74201d80c35 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1663 microversion: 2.25 time: 0.237100 Oct 28 19:15:06.071397 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1012/2000] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:05 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1663 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:15:06.527495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:06.528154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:06.539751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:06.540118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:06.541382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:06.541382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:06.542312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:06.542312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:06.940463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:06.952825 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77420ed5-c45f-456b-a65a-d89730c0d5c3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 1.141479 Oct 28 19:15:06.971210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 989/2001] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:05 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:06.984765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:06.985590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:07.003401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.004082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.005581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.007524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.009376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.011025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.352512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.360294 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d7c2d60-de89-4d4e-99e4-2e9f5f75fb58 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1432 microversion: 2.1 time: 0.384795 Oct 28 19:15:07.360871 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 990/2002] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:06 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1432 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:07.377727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:07.383668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:07.402868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.408876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.419679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.421323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.421976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.423231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.423747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.438726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba653c90-d71f-4912-9c07-acd27244f531 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.913119 Oct 28 19:15:07.457722 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1013/2003] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:06 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:07.477182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:07.479781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:07.493637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.494586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.495369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.496391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.497515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.498518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.807823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.824704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.847186 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b933663-7c9c-4c26-9e49-995bd0209bb7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1273 microversion: 2.1 time: 0.483804 Oct 28 19:15:07.850219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.850730 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 991/2004] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:07 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1273 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:07.872512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.873811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6edabe61-e4ce-4c7d-a35f-4434cd91e3ca tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 200 len: 1663 microversion: 2.25 time: 0.409109 Oct 28 19:15:07.874408 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1014/2005] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:07 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 1663 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:07.900604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e1999767-482c-4134-9fc8-a8641d9ba496 req-3c25a9cd-6fa5-4de4-b69e-ddd1d066ab9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a412528-3bbb-4ab8-993b-00d4c77c9fe1", "name": "network-vif-deleted", "tag": "dac36a45-a172-4703-aeea-984a465ff156"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:07.927616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e1999767-482c-4134-9fc8-a8641d9ba496 req-3c25a9cd-6fa5-4de4-b69e-ddd1d066ab9e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.933137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e1999767-482c-4134-9fc8-a8641d9ba496 req-3c25a9cd-6fa5-4de4-b69e-ddd1d066ab9e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.948057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e1999767-482c-4134-9fc8-a8641d9ba496 req-3c25a9cd-6fa5-4de4-b69e-ddd1d066ab9e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.958465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ea13e1b8-0242-4e5f-9b3e-c8050ae03712 req-4956a411-2c9b-4aca-8a1f-153a296a37a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb07761-6ab1-4425-8ede-fb2233b545b5", "name": "network-vif-deleted", "tag": "d0f956cd-c0fc-4a74-9d86-37bf400e37a4"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:08.012331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ea13e1b8-0242-4e5f-9b3e-c8050ae03712 req-4956a411-2c9b-4aca-8a1f-153a296a37a8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.013289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ea13e1b8-0242-4e5f-9b3e-c8050ae03712 req-4956a411-2c9b-4aca-8a1f-153a296a37a8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.014269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ea13e1b8-0242-4e5f-9b3e-c8050ae03712 req-4956a411-2c9b-4aca-8a1f-153a296a37a8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.025180 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e1999767-482c-4134-9fc8-a8641d9ba496 req-3c25a9cd-6fa5-4de4-b69e-ddd1d066ab9e service nova] Creating event network-vif-deleted:dac36a45-a172-4703-aeea-984a465ff156 for instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 on n-h1-862769-3 Oct 28 19:15:08.057603 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ea13e1b8-0242-4e5f-9b3e-c8050ae03712 req-4956a411-2c9b-4aca-8a1f-153a296a37a8 service nova] Creating event network-vif-deleted:d0f956cd-c0fc-4a74-9d86-37bf400e37a4 for instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 on n-h2-862769-3 Oct 28 19:15:08.059177 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e1999767-482c-4134-9fc8-a8641d9ba496 req-3c25a9cd-6fa5-4de4-b69e-ddd1d066ab9e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197663 Oct 28 19:15:08.060044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 992/2006] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:08.083923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:08.086500 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ea13e1b8-0242-4e5f-9b3e-c8050ae03712 req-4956a411-2c9b-4aca-8a1f-153a296a37a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130961 Oct 28 19:15:08.088890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1015/2007] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:15:08.090043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:08.111417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.111853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.112289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.112999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.113441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.120866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.388736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:08.390408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:08.422672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.423357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.424101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.425062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.425726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.426372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.536742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.537351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.538950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.541607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lazy-loading 'fault' on Instance uuid 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:08.594548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:08.800409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:08.809794 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8db7a8aa-2f14-43ca-8d58-b2006c83bae9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 200 len: 1309 microversion: 2.1 time: 0.429215 Oct 28 19:15:08.827848 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1016/2008] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:08 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:08.844691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:08.845308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:08.881066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.885328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.885966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.886733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.903307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.903754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.953563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:08.966773 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc7d71b0-7200-4b36-8908-e82b2fef9d91 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.900616 Oct 28 19:15:08.968664 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 993/2009] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:08 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:08.995291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.003873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:09.032599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.035536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.040343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.046520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.047549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.052342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.777795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:09.787717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f95c8f3-21ed-476d-87d3-45fcf776735b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.958642 Oct 28 19:15:09.788279 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1017/2010] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:08 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:09.807480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.808126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 3d7de605-17c2-4004-99c0-2461d81bf4b7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:09.814171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.814660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.815107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.815810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.816259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.816677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.827070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:09.841361 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41cab375-f009-4958-aea6-093824f18db7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 0.866855 Oct 28 19:15:09.854727 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 994/2011] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:08 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:09.854727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.854727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3a412528-3bbb-4ab8-993b-00d4c77c9fe1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:09.873199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.873688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.875955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] HTTP exception thrown: Instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 could not be found. Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Request method failure captured: Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 HTTP/1.1 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCiWux0DTGQWCa2sS8vKswvQNaovqg9ixK1ijhWIorxXIwNlLBqEkvjIOi40--vXrEu_bXOYuytC2NVX5OkfWUEcyoJeZImyBP1teOoT-ilPz_6ig3cxtOl-ViiLRPKljT6I0RhoP4jT0gfVN9yXsCyoQiHAu-dYPN0RU0IP5sZkqL0 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:15:09.877666 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df69faab58094a56ba4ecf152625b366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df69faab58094a56ba4ecf152625b366", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 1b1defe0b46f45fc8ff3d354bb4d361e Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 could not be found. Oct 28 19:15:09.879578 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '3d7de605-17c2-4004-99c0-2461d81bf4b7'} Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 could not be found. Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:09.880697 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 could not be found. Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 could not be found. Oct 28 19:15:09.882288 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.883782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Returning 404 to user: Instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:09.883782 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d90ed49-7b2f-4923-b8c9-0c9bf90bd2ee tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7" status: 404 len: 111 microversion: 2.25 time: 0.089855 Oct 28 19:15:09.883782 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1018/2012] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:09 2022] GET /compute/v2.1/servers/3d7de605-17c2-4004-99c0-2461d81bf4b7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:15:09.887957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.888901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.889497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.890006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.904982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49bf0fc9-3d77-4b74-9070-ca84a925a4f0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '.version_select at 0x7f1d7786c310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.931163 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 could not be found. Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 HTTP/1.1 Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:09.932855 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 could not be found. Oct 28 19:15:09.934604 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '3a412528-3bbb-4ab8-993b-00d4c77c9fe1'} Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 could not be found. Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:09.935601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 could not be found. Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 could not be found. Oct 28 19:15:09.937924 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:09.939433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 3a412528-3bbb-4ab8-993b-00d4c77c9fe1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:09.947503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec63799a-6886-4c7a-a61b-e0449baa7df6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1" status: 404 len: 111 microversion: 2.1 time: 0.104045 Oct 28 19:15:09.948083 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 995/2013] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:09 2022] GET /compute/v2.1/servers/3a412528-3bbb-4ab8-993b-00d4c77c9fe1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:09.968848 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49bf0fc9-3d77-4b74-9070-ca84a925a4f0 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124424176" status: 204 len: 0 microversion: 2.25 time: 0.073832 Oct 28 19:15:09.969704 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1019/2014] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124424176 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:15:09.975297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.976480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:09.993794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.994730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:09.997027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.999149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.003199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.004194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.006414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.008241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.014577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.016796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.018128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.022858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.023339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.023770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.092916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.095023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.095663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.097429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lazy-loading 'fault' on Instance uuid 3cb07761-6ab1-4425-8ede-fb2233b545b5 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:10.170677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:10.181219 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-142e658b-3a4f-4bf7-b7d9-36ca798319cd tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 200 len: 1309 microversion: 2.1 time: 0.228129 Oct 28 19:15:10.194720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 996/2015] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:09 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:10.194720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-177969c2-54d0-476c-a299-8a9f3b39ce15 req-598e1142-c876-4a5f-93e0-10195f740acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b282fb-2903-4a72-bc09-9f4892b692c1", "tag": "b64f4261-a7a1-4df5-ba16-4d9c7679af79"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:10.216215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-177969c2-54d0-476c-a299-8a9f3b39ce15 req-598e1142-c876-4a5f-93e0-10195f740acb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.221811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-177969c2-54d0-476c-a299-8a9f3b39ce15 req-598e1142-c876-4a5f-93e0-10195f740acb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.222789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-177969c2-54d0-476c-a299-8a9f3b39ce15 req-598e1142-c876-4a5f-93e0-10195f740acb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.251845 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-177969c2-54d0-476c-a299-8a9f3b39ce15 req-598e1142-c876-4a5f-93e0-10195f740acb service nova] Creating event network-changed:b64f4261-a7a1-4df5-ba16-4d9c7679af79 for instance 74b282fb-2903-4a72-bc09-9f4892b692c1 on n-h2-862769-3 Oct 28 19:15:10.262289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-177969c2-54d0-476c-a299-8a9f3b39ce15 req-598e1142-c876-4a5f-93e0-10195f740acb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077487 Oct 28 19:15:10.265213 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 997/2016] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:10.303193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-951e2e61-8f22-42cf-aba5-935465ec47e2 req-3e71e5c5-8201-49cc-8615-f7821a74e326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7de605-17c2-4004-99c0-2461d81bf4b7", "name": "network-vif-deleted", "tag": "2ba7e6ec-b446-4804-ac52-5db82ecf7f7f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:10.320782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-951e2e61-8f22-42cf-aba5-935465ec47e2 req-3e71e5c5-8201-49cc-8615-f7821a74e326 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.323752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-951e2e61-8f22-42cf-aba5-935465ec47e2 req-3e71e5c5-8201-49cc-8615-f7821a74e326 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.324435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-951e2e61-8f22-42cf-aba5-935465ec47e2 req-3e71e5c5-8201-49cc-8615-f7821a74e326 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.350922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-951e2e61-8f22-42cf-aba5-935465ec47e2 req-3e71e5c5-8201-49cc-8615-f7821a74e326 service nova] Creating event network-vif-deleted:2ba7e6ec-b446-4804-ac52-5db82ecf7f7f for instance 3d7de605-17c2-4004-99c0-2461d81bf4b7 on n-h2-862769-3 Oct 28 19:15:10.369744 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-951e2e61-8f22-42cf-aba5-935465ec47e2 req-3e71e5c5-8201-49cc-8615-f7821a74e326 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070528 Oct 28 19:15:10.374052 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 998/2017] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:15:10.607196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:10.620742 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54d1e687-f107-44fd-9992-0a176b3db485 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.630897 Oct 28 19:15:10.637553 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1020/2018] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:09 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:10.815003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:10.815701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:10.829403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.829888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.830322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.839698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.843379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.843864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.871454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:10.872379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:10.919617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.920290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.929713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.935804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.937246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.942461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.253778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:11.265130 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9405ff84-a99a-4f74-81a4-b957af9caeee tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.454849 Oct 28 19:15:11.267469 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 999/2019] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:10 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:11.278040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:11.279477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 3cb07761-6ab1-4425-8ede-fb2233b545b5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:11.294045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.294879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.296907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.297840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.299081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.303195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.332304 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 could not be found. Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 HTTP/1.1 Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:11.343256 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 could not be found. Oct 28 19:15:11.345190 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '3cb07761-6ab1-4425-8ede-fb2233b545b5'} Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 could not be found. Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:11.346301 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 could not be found. Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 could not be found. Oct 28 19:15:11.348053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:11.350541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 3cb07761-6ab1-4425-8ede-fb2233b545b5 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:11.351953 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fb8ee8c-97f1-4862-9a81-41f3f8f120f2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5" status: 404 len: 111 microversion: 2.1 time: 0.083144 Oct 28 19:15:11.352933 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1000/2020] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:11 2022] GET /compute/v2.1/servers/3cb07761-6ab1-4425-8ede-fb2233b545b5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:11.363107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a135e14-f82e-42f3-8760-ea5668e9cbd6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:11.434638 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a135e14-f82e-42f3-8760-ea5668e9cbd6 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/5cf9e50c-5469-4246-bd0b-60b48b60870d" status: 204 len: 0 microversion: 2.1 time: 0.075760 Oct 28 19:15:11.438954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1001/2021] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:15:11 2022] DELETE /compute/v2.1/os-server-groups/5cf9e50c-5469-4246-bd0b-60b48b60870d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:11.452121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:11.452730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:11.469983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.470497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.470963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.471716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.472168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.472587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.531874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:11.729826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:11.737118 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f1ea4f0-0119-4a6e-ada0-4174b0cd4c15 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 204 len: 0 microversion: 2.1 time: 0.294527 Oct 28 19:15:11.740752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1002/2022] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:11 2022] DELETE /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:11.746938 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d44d836-e78f-4778-b46d-9bbc57d1cd6d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 0.880755 Oct 28 19:15:11.747157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:11.747888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:11.751814 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1021/2023] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:10 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:11.766074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.766605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.767059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.767986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.768424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.768837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.769219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:11.769702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:11.788571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.789012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.789428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.790138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:11.790584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:11.799400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:11.853596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:12.204475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:12.212986 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3705953e-8ded-4b2e-85ff-a7a6496f8db5 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.473550 Oct 28 19:15:12.216091 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1003/2024] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:11 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:12.264203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:12.265147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:12.289609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:12.290947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:12.301176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.305023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.305650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.306588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.307224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.307814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.419971 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a33eaaf4-e659-4b70-bed6-25560640094e tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 204 len: 0 microversion: 2.1 time: 0.659963 Oct 28 19:15:12.423462 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1022/2025] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:11 2022] DELETE /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:12.443453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:12.444230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:12.452568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.453169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.453703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.454670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.460138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.465602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.552581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:12.578308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:12.730470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:12.731282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:12.742078 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb073da1-109d-4b9f-b5f3-f7f5cdafb03f tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "DELETE /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 204 len: 0 microversion: 2.25 time: 0.314707 Oct 28 19:15:12.743956 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3237508-9c06-4ab1-bf89-0645c68beb7e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.459958 Oct 28 19:15:12.758876 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1023/2026] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:15:12 2022] DELETE /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:15:12.760848 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1004/2027] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:12 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:12.767006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:12.768045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:12.768658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:12.769417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:12.788891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.789539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.790119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.799430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.800026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.800510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.808972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.811344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.813621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.819422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.823315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.824178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:13.963251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:13.982808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:13.990720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:13.997151 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c76b842-7045-4f9f-8cc0-89a27445eb73 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1548 microversion: 2.25 time: 1.234023 Oct 28 19:15:14.020194 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1005/2028] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:12 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1548 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:14.031230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:14.040169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:14.066161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.068733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.069363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.070262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.076880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.077749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.140073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:14.148526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b591624-33b6-43dc-8c15-0066eea83d87 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1474 microversion: 2.1 time: 1.400887 Oct 28 19:15:14.168636 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1024/2029] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:12 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1474 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:14.173560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:14.182642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:14.210134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.210637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.211098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.211817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.212267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.212689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.897825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:14.906301 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-32f1516e-fe2f-4791-9a32-c5c9a26405d1 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 0.736506 Oct 28 19:15:14.906908 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1025/2030] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:14 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:14.932740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:14.933357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:14.984677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.989786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.991999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.995448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.999421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:15.003367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:15.249095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:15.266003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cac91008-2820-4b3a-ae1a-8d8d70b2f164 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 1.240716 Oct 28 19:15:15.267324 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1006/2031] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:14 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:15.278131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:15.280198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:15.295527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:15.296447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:15.299957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:15.301145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:15.301853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:15.302537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:15.331906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:16.329454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:16.342171 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebfa9efd-8a0f-4073-92f6-96f965939098 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 1.415903 Oct 28 19:15:16.342821 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1026/2032] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:14 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:16.352662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:16.369026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:16.374683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:16.383010 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2b2fda3e-5952-4167-b2ed-7418801f176e tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1548 microversion: 2.25 time: 1.111530 Oct 28 19:15:16.386539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1007/2033] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:15 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1548 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:16.387562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:16.388195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:16.397667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:16.403127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:16.417347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:16.418590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:16.419315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:16.424253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:16.424817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:16.425406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:16.425533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:16.426537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:16.427152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:16.427541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:16.428176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:16.428425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:17.392519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:17.424014 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2279a369-06ab-43a9-9fcd-15689e269d9c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1516 microversion: 2.1 time: 1.032259 Oct 28 19:15:17.429976 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1008/2034] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:16 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1516 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:17.469566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:17.477188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:17.495241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:17.496124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:17.501817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:17.505053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:17.506002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:17.507048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:17.520661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:17.533439 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eaa35657-e874-49fc-89b5-b9e1d517c74c tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1474 microversion: 2.1 time: 1.181607 Oct 28 19:15:17.543063 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1027/2035] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:16 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1474 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:17.567996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d3065550-ccec-4adf-9317-d837ac33c8cc req-fa387af0-e609-43c0-a2ac-3fde09ba689c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f520592c-588f-4e76-a134-d81ef8aad774", "name": "network-vif-deleted", "tag": "09d15e14-ddee-47ff-8099-0abf5316a6c5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:17.634964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d3065550-ccec-4adf-9317-d837ac33c8cc req-fa387af0-e609-43c0-a2ac-3fde09ba689c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:17.636819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d3065550-ccec-4adf-9317-d837ac33c8cc req-fa387af0-e609-43c0-a2ac-3fde09ba689c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:17.638909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d3065550-ccec-4adf-9317-d837ac33c8cc req-fa387af0-e609-43c0-a2ac-3fde09ba689c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:17.675568 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d3065550-ccec-4adf-9317-d837ac33c8cc req-fa387af0-e609-43c0-a2ac-3fde09ba689c service nova] Creating event network-vif-deleted:09d15e14-ddee-47ff-8099-0abf5316a6c5 for instance f520592c-588f-4e76-a134-d81ef8aad774 on n-h2-862769-3 Oct 28 19:15:17.682860 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d3065550-ccec-4adf-9317-d837ac33c8cc req-fa387af0-e609-43c0-a2ac-3fde09ba689c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135041 Oct 28 19:15:17.684088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1028/2036] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:17.693852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:17.695123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:17.702610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:17.703473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:17.704173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:17.705052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:17.705665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:17.706247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.138779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:18.237484 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89e7bc7f-98ef-47c6-8a69-d91381596b57 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 0.805944 Oct 28 19:15:18.238984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:18.241575 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1009/2037] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:17 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:18.267124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:18.267864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:18.288205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c1dd76b-3981-4a51-beec-7b9a3161a25b tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1523 microversion: 2.1 time: 0.593141 Oct 28 19:15:18.295309 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1029/2038] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:17 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1523 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:18.329329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.329840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.330287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.359345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e3566893-29bd-42fd-8014-354dd7f19214 req-5caf0399-b243-406d-bbb2-c330e17558da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e779b9-4e72-4124-838a-8e428fc2bd29", "name": "network-vif-deleted", "tag": "1fa7cc0b-ccb9-4372-b67c-befe8c316492"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:18.363096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.363631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.364082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.437872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e3566893-29bd-42fd-8014-354dd7f19214 req-5caf0399-b243-406d-bbb2-c330e17558da service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.438358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e3566893-29bd-42fd-8014-354dd7f19214 req-5caf0399-b243-406d-bbb2-c330e17558da service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.445200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e3566893-29bd-42fd-8014-354dd7f19214 req-5caf0399-b243-406d-bbb2-c330e17558da service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.502130 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e3566893-29bd-42fd-8014-354dd7f19214 req-5caf0399-b243-406d-bbb2-c330e17558da service nova] Creating event network-vif-deleted:1fa7cc0b-ccb9-4372-b67c-befe8c316492 for instance 37e779b9-4e72-4124-838a-8e428fc2bd29 on n-h2-862769-3 Oct 28 19:15:18.516040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e3566893-29bd-42fd-8014-354dd7f19214 req-5caf0399-b243-406d-bbb2-c330e17558da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218959 Oct 28 19:15:18.521153 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1030/2039] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:18.545159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0e900d1-cf83-4c88-97fc-3cf4bdb40941"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:18.555289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:18.562228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.565614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.566260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.568137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.571325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.572009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.681603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:18.696634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:18.707247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:18.714149 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-857343b4-5a3f-4c36-89ea-fb6eea238e2a tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 200 len: 1506 microversion: 2.25 time: 0.469321 Oct 28 19:15:18.718301 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1010/2040] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:18 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:19.288306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1150654852", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "380c844d-030f-4c3a-b35e-5e685ce1c280"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:19.314366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:19.407837 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-137ffa50-f2cd-4f22-8962-92263c1cbebc tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "POST /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873491 Oct 28 19:15:19.413323 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1031/2041] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:15:18 2022] POST /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:19.445173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:19.457089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] validate_networks() for [('380c844d-030f-4c3a-b35e-5e685ce1c280', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:19.463352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:19.503540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:19.512684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:19.514268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:19.515711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:19.523176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:19.530535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.142124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:20.155824 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ba872b1-df67-42af-bcb4-c70d640ce356 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.737966 Oct 28 19:15:20.164698 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1032/2042] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:19 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:20.179948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:20.180868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:20.207363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.207919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.209139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.210053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.232257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.234793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.350810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.351306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.351740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.352204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lazy-loading 'fault' on Instance uuid 190716fd-7f95-4596-b6ca-7e21ce4ab687 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:20.455047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:20.467292 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1bcef913-3527-4af6-a92e-b64eb0ed622d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 200 len: 1308 microversion: 2.1 time: 0.299554 Oct 28 19:15:20.471851 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1033/2043] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:20 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:20.486762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:20.495547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:20.510554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.511078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.511518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.519841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.520464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.520762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.654135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:15:21.654542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:15:21.654720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:15:21.655325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:15:21.655921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:15:21.662059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:21.678513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.679486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.684643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.686124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.686947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.687887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.718825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Getting quotas for project 2db7df5a30b741e5922edcb7ae29b2d7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:21.725333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Getting quotas for user a82493f4265b487fb0a2437c24c2b777 and project 2db7df5a30b741e5922edcb7ae29b2d7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:21.750359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:15:21.764913 n-d-862769-3 devstack@n-api.service[120629]: WARNING nova.utils [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1150654852 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-115065485 Oct 28 19:15:21.773166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:15:21.846534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:21.855283 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a4f6bbf-39dc-4f17-9b25-89d8a93e97b7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 1.382124 Oct 28 19:15:21.855867 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1034/2044] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:20 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:21.884487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-323b4486-18cb-48a5-8aa1-d214e9c66579 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.164979 Oct 28 19:15:21.889862 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1011/2045] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:15:21.902716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:21.903594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: 37e779b9-4e72-4124-838a-8e428fc2bd29] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:21.911163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.911557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:21.912117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.912738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.912885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:21.913750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.914367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.915099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.925671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.925799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.926196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.926988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.934489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.955003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] HTTP exception thrown: Instance 37e779b9-4e72-4124-838a-8e428fc2bd29 could not be found. Oct 28 19:15:21.956586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Request method failure captured: Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 HTTP/1.1 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCiWux0DTGQWCa2sS8vKswvQNaovqg9ixK1ijhWIorxXIwNlLBqEkvjIOi40--vXrEu_bXOYuytC2NVX5OkfWUEcyoJeZImyBP1teOoT-ilPz_6ig3cxtOl-ViiLRPKljT6I0RhoP4jT0gfVN9yXsCyoQiHAu-dYPN0RU0IP5sZkqL0 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:21.957200 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df69faab58094a56ba4ecf152625b366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df69faab58094a56ba4ecf152625b366", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1b1defe0b46f45fc8ff3d354bb4d361e Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 37e779b9-4e72-4124-838a-8e428fc2bd29 could not be found. Oct 28 19:15:21.959214 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '37e779b9-4e72-4124-838a-8e428fc2bd29'} Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e779b9-4e72-4124-838a-8e428fc2bd29 could not be found. Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:21.960292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e779b9-4e72-4124-838a-8e428fc2bd29 could not be found. Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e779b9-4e72-4124-838a-8e428fc2bd29 could not be found. Oct 28 19:15:21.962905 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:21.966939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Returning 404 to user: Instance 37e779b9-4e72-4124-838a-8e428fc2bd29 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:21.968096 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43837e9e-314e-45ac-847b-022fc8ead89b tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29" status: 404 len: 111 microversion: 2.25 time: 0.070290 Oct 28 19:15:21.968910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1012/2046] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:21 2022] GET /compute/v2.1/servers/37e779b9-4e72-4124-838a-8e428fc2bd29 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:15:21.973952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4a122399-2059-4c4a-b935-965ae1d99449 req-2c74cdcf-2e66-41e9-985b-4d09db4bc96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190716fd-7f95-4596-b6ca-7e21ce4ab687", "name": "network-vif-deleted", "tag": "a5d8621b-f95c-435e-8cf4-d6a0b29518bd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:21.993148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4a122399-2059-4c4a-b935-965ae1d99449 req-2c74cdcf-2e66-41e9-985b-4d09db4bc96b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.994044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4a122399-2059-4c4a-b935-965ae1d99449 req-2c74cdcf-2e66-41e9-985b-4d09db4bc96b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.994742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4a122399-2059-4c4a-b935-965ae1d99449 req-2c74cdcf-2e66-41e9-985b-4d09db4bc96b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.012777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4a122399-2059-4c4a-b935-965ae1d99449 req-2c74cdcf-2e66-41e9-985b-4d09db4bc96b service nova] Creating event network-vif-deleted:a5d8621b-f95c-435e-8cf4-d6a0b29518bd for instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 on n-h2-862769-3 Oct 28 19:15:22.026345 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4a122399-2059-4c4a-b935-965ae1d99449 req-2c74cdcf-2e66-41e9-985b-4d09db4bc96b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055925 Oct 28 19:15:22.027725 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1013/2047] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:22.034028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.036595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:22.048189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.052740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.054087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.055153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.055839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.056508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.530796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:22.548871 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d98fa97-cf27-4be2-9245-2a1eb174fef0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.519586 Oct 28 19:15:22.583401 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1014/2048] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:22.589839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.591027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 190716fd-7f95-4596-b6ca-7e21ce4ab687] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:22.598616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.599897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.600597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.601596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.602310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.603026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.625195 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 could not be found. Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 HTTP/1.1 Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:22.627462 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 could not be found. Oct 28 19:15:22.629119 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '190716fd-7f95-4596-b6ca-7e21ce4ab687'} Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 could not be found. Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:22.630077 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 could not be found. Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 could not be found. Oct 28 19:15:22.631603 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.635271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 190716fd-7f95-4596-b6ca-7e21ce4ab687 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:22.636586 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04f5f352-8bb4-4293-9d19-224587b064d9 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687" status: 404 len: 111 microversion: 2.1 time: 0.051699 Oct 28 19:15:22.641015 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1015/2049] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/190716fd-7f95-4596-b6ca-7e21ce4ab687 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:22.649203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f852e183-15f6-4579-9a97-ab1a65f42776 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.650567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f852e183-15f6-4579-9a97-ab1a65f42776 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:22.676146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:22.685945 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-97e49264-abf7-4538-b76c-07b9594579f1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1505 microversion: 2.1 time: 0.817405 Oct 28 19:15:22.703775 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1035/2050] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:21 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:22.716040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.719436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:22.731582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.732237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.732681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.733535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.734191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.734841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.810333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f852e183-15f6-4579-9a97-ab1a65f42776 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:22.816763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:22.826661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f852e183-15f6-4579-9a97-ab1a65f42776 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1232 microversion: 2.1 time: 0.183884 Oct 28 19:15:22.827036 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1016/2051] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1232 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:22.843909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.844531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: f520592c-588f-4e76-a134-d81ef8aad774] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:22.865412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.865908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.866349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.872896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.873402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.874032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.916872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance f520592c-588f-4e76-a134-d81ef8aad774 could not be found. Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 HTTP/1.1 Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:22.923032 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f520592c-588f-4e76-a134-d81ef8aad774 could not be found. Oct 28 19:15:22.924637 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f520592c-588f-4e76-a134-d81ef8aad774'} Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f520592c-588f-4e76-a134-d81ef8aad774 could not be found. Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:22.925518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f520592c-588f-4e76-a134-d81ef8aad774 could not be found. Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f520592c-588f-4e76-a134-d81ef8aad774 could not be found. Oct 28 19:15:22.927954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:22.943143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance f520592c-588f-4e76-a134-d81ef8aad774 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:22.946131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-209f3bb2-1589-482e-9774-82acf2222ff2 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774" status: 404 len: 111 microversion: 2.1 time: 0.118022 Oct 28 19:15:22.947249 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1017/2052] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/f520592c-588f-4e76-a134-d81ef8aad774 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:22.959393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.960028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:22.978084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.979022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.979022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.979741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.980182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.986251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.089745 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2151b6f6-3749-47b5-884a-e2f9606fb558 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 204 len: 0 microversion: 2.25 time: 0.383961 Oct 28 19:15:23.092160 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1036/2053] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:15:22 2022] DELETE /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:15:23.098749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-76d961a7-5f1a-44a4-819d-a56ccc8f1f9b req-c5170339-a6d4-4ae2-9d0a-161d252b69d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b282fb-2903-4a72-bc09-9f4892b692c1", "name": "network-vif-plugged", "status": "completed", "tag": "b64f4261-a7a1-4df5-ba16-4d9c7679af79"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:23.120752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-76d961a7-5f1a-44a4-819d-a56ccc8f1f9b req-c5170339-a6d4-4ae2-9d0a-161d252b69d0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.121536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-76d961a7-5f1a-44a4-819d-a56ccc8f1f9b req-c5170339-a6d4-4ae2-9d0a-161d252b69d0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.122430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-76d961a7-5f1a-44a4-819d-a56ccc8f1f9b req-c5170339-a6d4-4ae2-9d0a-161d252b69d0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.154438 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-76d961a7-5f1a-44a4-819d-a56ccc8f1f9b req-c5170339-a6d4-4ae2-9d0a-161d252b69d0 service nova] Creating event network-vif-plugged:b64f4261-a7a1-4df5-ba16-4d9c7679af79 for instance 74b282fb-2903-4a72-bc09-9f4892b692c1 on n-h2-862769-3 Oct 28 19:15:23.163082 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-76d961a7-5f1a-44a4-819d-a56ccc8f1f9b req-c5170339-a6d4-4ae2-9d0a-161d252b69d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067777 Oct 28 19:15:23.167680 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1037/2054] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:23.198949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8846b072-9878-4e86-bfe4-7707a10ae041 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.273206 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8846b072-9878-4e86-bfe4-7707a10ae041 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/c84d4e94-dee6-4c81-98f1-e911bfc0fb35" status: 204 len: 0 microversion: 2.1 time: 0.104218 Oct 28 19:15:23.274468 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1038/2055] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:15:23 2022] DELETE /compute/v2.1/os-server-groups/c84d4e94-dee6-4c81-98f1-e911bfc0fb35 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:23.284697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.285989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:23.304428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.305811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.306351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.310485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.311278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.313221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.680785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.695312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf263fce-70d2-4374-8548-84c2291adc8d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 0.743320 Oct 28 19:15:23.696240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1018/2056] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:23.711653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.712361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:23.722756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.723576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.728549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.730601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.730601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.731898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.801275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.801991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:23.810449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.821272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.829006 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a7644c2d-aaa2-441a-a893-4f6636579e91 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1564 microversion: 2.25 time: 0.553235 Oct 28 19:15:23.832162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1039/2057] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:23 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1564 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:23.848927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.849716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:23.866092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.867255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.867679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.871151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.873199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.873799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.943317 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a9d8238-ed35-4c38-b196-848788d77fa0 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 204 len: 0 microversion: 2.1 time: 0.242821 Oct 28 19:15:23.946057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1019/2058] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:23 2022] DELETE /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:23.989097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.992667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:24.007260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.008358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.009841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.011975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.012630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.016727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.262465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:24.274744 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9be81dfa-af9d-411b-b929-79978ac7a1c0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.440996 Oct 28 19:15:24.275962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1040/2059] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:23 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:24.279073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:24.281551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:24.284172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:24.291694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.292187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.292622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.293675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.294443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.295020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.297479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-101c7bde-0f02-48e8-99ea-c49b1b7f77eb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1505 microversion: 2.1 time: 0.334322 Oct 28 19:15:24.298639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1020/2060] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:23 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:24.317411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:24.320278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:24.331342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.333528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.333974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.335044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.335975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.336798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.394353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:24.404438 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-401de6a6-3482-42ca-a497-68b27a60eb56 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1302 microversion: 2.1 time: 0.126941 Oct 28 19:15:24.405980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1041/2061] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:24 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:24.546203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:24.556269 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6ec41928-ae1d-4eea-893f-8f5662e9ac50 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1472 microversion: 2.1 time: 0.256278 Oct 28 19:15:24.557930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1021/2062] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:24 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:24.723384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:24.724469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:24.746778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.747680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.750522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.752519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.753308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.755127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.863813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:24.864823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:24.876587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.877393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.878037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.878995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.882261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.883774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.941885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:24.952717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22e56b33-0111-48b4-9674-83afcda6894b tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1315 microversion: 2.1 time: 0.235911 Oct 28 19:15:24.953862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1042/2063] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:24 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:24.959456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-69450589-c6d2-4620-9485-37332bbba5f7 req-712b9b61-821d-419f-9fe0-6ee82427f653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56da196-1ce9-4bb4-948b-785ea839bff8", "name": "network-vif-deleted", "tag": "aa11e10c-a6e1-475a-84a9-49088e29ced3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:24.974649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-69450589-c6d2-4620-9485-37332bbba5f7 req-712b9b61-821d-419f-9fe0-6ee82427f653 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.975376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-69450589-c6d2-4620-9485-37332bbba5f7 req-712b9b61-821d-419f-9fe0-6ee82427f653 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.976672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-69450589-c6d2-4620-9485-37332bbba5f7 req-712b9b61-821d-419f-9fe0-6ee82427f653 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.995696 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-69450589-c6d2-4620-9485-37332bbba5f7 req-712b9b61-821d-419f-9fe0-6ee82427f653 service nova] Creating event network-vif-deleted:aa11e10c-a6e1-475a-84a9-49088e29ced3 for instance e56da196-1ce9-4bb4-948b-785ea839bff8 on n-h1-862769-3 Oct 28 19:15:25.003107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-69450589-c6d2-4620-9485-37332bbba5f7 req-712b9b61-821d-419f-9fe0-6ee82427f653 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047723 Oct 28 19:15:25.004050 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1043/2064] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:25.033490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:25.042590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:25.044025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b1defe0b46f45fc8ff3d354bb4d361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df69faab58094a56ba4ecf152625b366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:25.045202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3fda9d41-6ef4-4760-b7f5-f784ba907e63 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 200 len: 1522 microversion: 2.25 time: 0.188313 Oct 28 19:15:25.045850 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1022/2065] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:24 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:15:25.280693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-402ace91-1ace-4981-bd9b-ada693de5d7b req-7047ddc5-b423-444d-bd8b-bc034e57053c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaefac-41cf-4e4b-bd0a-264f86c0e163", "name": "network-vif-unplugged", "status": "completed", "tag": "ff4e29a2-9a0e-414c-8644-26eb9a8322df"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:25.295676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-402ace91-1ace-4981-bd9b-ada693de5d7b req-7047ddc5-b423-444d-bd8b-bc034e57053c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:25.296459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-402ace91-1ace-4981-bd9b-ada693de5d7b req-7047ddc5-b423-444d-bd8b-bc034e57053c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:25.297094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-402ace91-1ace-4981-bd9b-ada693de5d7b req-7047ddc5-b423-444d-bd8b-bc034e57053c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:25.299418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:25.300232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:25.312538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:25.313345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:25.313995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:25.315021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:25.316110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:25.318553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:25.349870 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-402ace91-1ace-4981-bd9b-ada693de5d7b req-7047ddc5-b423-444d-bd8b-bc034e57053c service nova] Creating event network-vif-unplugged:ff4e29a2-9a0e-414c-8644-26eb9a8322df for instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 on n-h1-862769-3 Oct 28 19:15:25.373514 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-402ace91-1ace-4981-bd9b-ada693de5d7b req-7047ddc5-b423-444d-bd8b-bc034e57053c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085997 Oct 28 19:15:25.374510 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1044/2066] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:25.398309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:25.399072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:25.419413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:25.419913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:25.420353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:25.421066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:25.426850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:25.427550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.217962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:26.233749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e32899ce-ff7f-4d8e-8027-43e4d7d61da9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1505 microversion: 2.1 time: 0.853016 Oct 28 19:15:26.236498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1045/2067] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:25 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:26.243117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:26.259560 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65884612-7a25-4739-8bae-8c7403c910e0 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.957092 Oct 28 19:15:26.260254 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1023/2068] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:25 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:26.280865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:26.281587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:26.306846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:26.307827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:26.314807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.319926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.320458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.325167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.327666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.328125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.329842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.331841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.333167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.334113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.334809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.335476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.566401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:26.578277 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-045597d3-bd49-4181-a03d-65446896ccd1 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1290 microversion: 2.1 time: 0.340447 Oct 28 19:15:26.584895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1046/2069] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:26 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1290 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:26.594946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:26.597753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:26.613567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.615961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.617358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.619067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.620739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.621513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.782118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a3dbfbf41424e6382c532c4af5f8a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df42e9bda2b4307a800e2a35af177be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:26.798027 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eca8757c-6bd4-4a0e-9c19-b1ef53551d4d tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 200 len: 1472 microversion: 2.1 time: 0.520222 Oct 28 19:15:26.798616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1024/2070] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:26 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:26.808059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:26.808670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] [instance: e56da196-1ce9-4bb4-948b-785ea839bff8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:26.822736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.823292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.823727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.824677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:26.825126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:26.827364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:26.858006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] HTTP exception thrown: Instance e56da196-1ce9-4bb4-948b-785ea839bff8 could not be found. Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Request method failure captured: Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 HTTP/1.1 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCiWux0DTGQWCa2sS8vKswvQNaovqg9ixK1ijhWIorxXIwNlLBqEkvjIOi40--vXrEu_bXOYuytC2NVX5OkfWUEcyoJeZImyBP1teOoT-ilPz_6ig3cxtOl-ViiLRPKljT6I0RhoP4jT0gfVN9yXsCyoQiHAu-dYPN0RU0IP5sZkqL0 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:26.859736 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df69faab58094a56ba4ecf152625b366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df69faab58094a56ba4ecf152625b366", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df69faab58094a56ba4ecf152625b366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: df69faab58094a56ba4ecf152625b366 Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485 Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1b1defe0b46f45fc8ff3d354bb4d361e Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1393822485-project Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e56da196-1ce9-4bb4-948b-785ea839bff8 could not be found. Oct 28 19:15:26.861701 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e56da196-1ce9-4bb4-948b-785ea839bff8'} Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56da196-1ce9-4bb4-948b-785ea839bff8 could not be found. Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:26.863407 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56da196-1ce9-4bb4-948b-785ea839bff8 could not be found. Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56da196-1ce9-4bb4-948b-785ea839bff8 could not be found. Oct 28 19:15:26.865476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:26.876270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] Returning 404 to user: Instance e56da196-1ce9-4bb4-948b-785ea839bff8 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:26.881062 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fd44241-3d0e-4e08-aa35-9a8de9fcf3b3 tempest-LiveAutoBlockMigrationV225Test-1393822485 tempest-LiveAutoBlockMigrationV225Test-1393822485-project] 10.222.0.44 "GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8" status: 404 len: 111 microversion: 2.25 time: 0.081281 Oct 28 19:15:26.902656 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1025/2071] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:15:26 2022] GET /compute/v2.1/servers/e56da196-1ce9-4bb4-948b-785ea839bff8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:15:27.033449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:27.045850 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04fb86d8-9b1f-4d87-bd87-0dbc9567fdcb tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1503 microversion: 2.1 time: 0.456805 Oct 28 19:15:27.046925 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1047/2072] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:26 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:27.072789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9e773e19-dd03-41b9-bd6e-68b66dd8fd0a req-eb0281df-269e-40ff-89f1-9a6c82c5b0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bea25a8-c910-4c3a-87a0-715a4885c7c8", "name": "network-vif-deleted", "tag": "cc7fa0ef-7f7e-4701-8beb-32af6d540b6b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:27.084730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1684793271"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:27.086349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9e773e19-dd03-41b9-bd6e-68b66dd8fd0a req-eb0281df-269e-40ff-89f1-9a6c82c5b0db service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:27.087065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9e773e19-dd03-41b9-bd6e-68b66dd8fd0a req-eb0281df-269e-40ff-89f1-9a6c82c5b0db service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:27.087877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9e773e19-dd03-41b9-bd6e-68b66dd8fd0a req-eb0281df-269e-40ff-89f1-9a6c82c5b0db service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:27.089481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:27.104916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:27.113605 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9e773e19-dd03-41b9-bd6e-68b66dd8fd0a req-eb0281df-269e-40ff-89f1-9a6c82c5b0db service nova] Creating event network-vif-deleted:cc7fa0ef-7f7e-4701-8beb-32af6d540b6b for instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 on n-h2-862769-3 Oct 28 19:15:27.119211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:27.125850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:27.127009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:27.131356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:27.137131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:27.137379 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9e773e19-dd03-41b9-bd6e-68b66dd8fd0a req-eb0281df-269e-40ff-89f1-9a6c82c5b0db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063684 Oct 28 19:15:27.138278 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1026/2073] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:27.262013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:27.263508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:27.280337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:27.302683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:27.305603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:27.311824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:27.313324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:27.313776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:27.734059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.network.security_group_api [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Adding security group ee525360-89c8-48aa-b38e-e66dd6c62a73 to port b64f4261-a7a1-4df5-ba16-4d9c7679af79 Oct 28 19:15:28.387235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:28.397202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:28.400208 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a81569d-c7c8-4618-8833-48e557324eb8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 200 len: 1448 microversion: 2.1 time: 1.143111 Oct 28 19:15:28.416842 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1027/2074] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:27 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 1448 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:28.435543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:28.436543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:28.444658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:28.453463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:28.454203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:28.455160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:28.455778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:28.456394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:28.804877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:28.813600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c833164-2419-423c-a0f2-9e6eedfc101a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.395197 Oct 28 19:15:28.814799 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1028/2075] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:28 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:28.819750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-690d1399-4d79-40cc-8380-4f5a55b13311 req-e2819eec-aa7b-4fcd-9901-a86834ae5a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9908d12e-78a2-487f-b024-6b70458c31bf", "name": "network-vif-unplugged", "status": "completed", "tag": "e4a459cf-63b3-4d25-b574-d0e73c54b919"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:28.829556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-690d1399-4d79-40cc-8380-4f5a55b13311 req-e2819eec-aa7b-4fcd-9901-a86834ae5a3e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:28.830037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-690d1399-4d79-40cc-8380-4f5a55b13311 req-e2819eec-aa7b-4fcd-9901-a86834ae5a3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:28.830892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-690d1399-4d79-40cc-8380-4f5a55b13311 req-e2819eec-aa7b-4fcd-9901-a86834ae5a3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:28.841745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.server_external_events [req-690d1399-4d79-40cc-8380-4f5a55b13311 req-e2819eec-aa7b-4fcd-9901-a86834ae5a3e service nova] Unable to find a host for instance 9908d12e-78a2-487f-b024-6b70458c31bf. Dropping event network-vif-unplugged {{(pid=120629) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:15:28.842627 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-690d1399-4d79-40cc-8380-4f5a55b13311 req-e2819eec-aa7b-4fcd-9901-a86834ae5a3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026645 Oct 28 19:15:28.846744 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1029/2076] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 19:15:28.860335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:28.861345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:28.870649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:28.871325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:28.871941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:28.873673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:28.874387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:28.875095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:29.150747 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc758d6a-6f6d-43c8-8daf-71dedd15edf3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1/action" status: 202 len: 0 microversion: 2.1 time: 2.080871 Oct 28 19:15:29.151599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1048/2077] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:27 2022] POST /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1/action => generated 0 bytes in 2083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:15:29.157827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:29.158577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] [instance: 0bea25a8-c910-4c3a-87a0-715a4885c7c8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:29.171724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:29.172338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:29.175779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:29.176978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:29.178226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:29.178954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:29.203665 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] HTTP exception thrown: Instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 could not be found. Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Request method failure captured: Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 HTTP/1.1 Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClqhoiYRFZJBVa4Ga1kIeU3DDyICkcLWnDnKbX4_d0LL75FyHjK-czjcW6q9e1YgcuVjKazDONrPkVDikp5JC4pgJyNvy7sWSs5_BmeOAupdnEZPyO5O_6y18J1x6Ab64bZSSxoVRyVyaj1qHMNMZX0d82O0gn8VyG4w9Eg5YVau1A Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:15:29.205908 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6df42e9bda2b4307a800e2a35af177be", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6df42e9bda2b4307a800e2a35af177be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 6df42e9bda2b4307a800e2a35af177be Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1711567626 Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 1a3dbfbf41424e6382c532c4af5f8a01 Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersOnMultiNodesTest-1711567626-project Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 could not be found. Oct 28 19:15:29.207848 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '0bea25a8-c910-4c3a-87a0-715a4885c7c8'} Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 could not be found. Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:29.208816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 could not be found. Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 could not be found. Oct 28 19:15:29.210523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:29.212657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] Returning 404 to user: Instance 0bea25a8-c910-4c3a-87a0-715a4885c7c8 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:29.213705 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43a98b18-36da-4d68-a218-4d8e3c17c0e3 tempest-ServersOnMultiNodesTest-1711567626 tempest-ServersOnMultiNodesTest-1711567626-project] 10.222.0.44 "GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8" status: 404 len: 111 microversion: 2.1 time: 0.061081 Oct 28 19:15:29.214773 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1049/2078] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:29 2022] GET /compute/v2.1/servers/0bea25a8-c910-4c3a-87a0-715a4885c7c8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:29.220324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:29.221031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:29.230990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:29.231665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:29.232312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:29.233195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:29.233808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:29.234385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:29.239229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:29.293679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:29.311872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.compute.api [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Working on deleting snapshot 9d50b8d7-ce78-45a7-b94f-0e96d62b33d0 from shelved instance... Oct 28 19:15:29.550061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:29.559254 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11508973-c8d9-4614-9a2c-c3048337b155 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1332 microversion: 2.1 time: 0.706079 Oct 28 19:15:29.580394 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1030/2079] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:28 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1332 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:29.603144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e852523-8630-43ce-a4d6-e2f87d5042fd tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7c37f040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:30.159100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-7e852523-8630-43ce-a4d6-e2f87d5042fd tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use.", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:30.160400 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-7e852523-8630-43ce-a4d6-e2f87d5042fd tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.160400 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e852523-8630-43ce-a4d6-e2f87d5042fd tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73 HTTP/1.1 Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:30.164485 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: exception: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] Oct 28 19:15:30.166239 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ee525360-89c8-48aa-b38e-e66dd6c62a73'} Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:30.170464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.172218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:30.173933 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e852523-8630-43ce-a4d6-e2f87d5042fd tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 400 to user: Security Group ee525360-89c8-48aa-b38e-e66dd6c62a73 in use. Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-148b199e-8373-4b66-88e5-ca1a206f88ed'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e852523-8630-43ce-a4d6-e2f87d5042fd tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73" status: 400 len: 185 microversion: 2.1 time: 0.582709 Oct 28 19:15:30.175643 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1031/2080] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:29 2022] DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73 => generated 185 bytes in 587 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:15:30.178621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4781cfd5-6134-4c88-a685-9cbb288067a7 req-201fa765-ec9c-47f4-934b-c84d9a9f754f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b282fb-2903-4a72-bc09-9f4892b692c1", "tag": "b64f4261-a7a1-4df5-ba16-4d9c7679af79"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:30.206886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4781cfd5-6134-4c88-a685-9cbb288067a7 req-201fa765-ec9c-47f4-934b-c84d9a9f754f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.207379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4781cfd5-6134-4c88-a685-9cbb288067a7 req-201fa765-ec9c-47f4-934b-c84d9a9f754f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.207926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4781cfd5-6134-4c88-a685-9cbb288067a7 req-201fa765-ec9c-47f4-934b-c84d9a9f754f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:30.231751 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4781cfd5-6134-4c88-a685-9cbb288067a7 req-201fa765-ec9c-47f4-934b-c84d9a9f754f service nova] Creating event network-changed:b64f4261-a7a1-4df5-ba16-4d9c7679af79 for instance 74b282fb-2903-4a72-bc09-9f4892b692c1 on n-h2-862769-3 Oct 28 19:15:30.241786 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4781cfd5-6134-4c88-a685-9cbb288067a7 req-201fa765-ec9c-47f4-934b-c84d9a9f754f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071739 Oct 28 19:15:30.244269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1032/2081] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:30.260714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-63c98272-e9a8-4e50-82f0-7b1e33422f24 req-aaeaebc3-4ef9-4ed5-ad2d-e029a930d624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6", "tag": "37243648-5afd-4664-91f4-eed7014ae7c6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:30.273523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Doing local delete in cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=120628) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 19:15:30.274334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.274844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.275278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:30.275700 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.compute.api [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 19:15:30.283989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-63c98272-e9a8-4e50-82f0-7b1e33422f24 req-aaeaebc3-4ef9-4ed5-ad2d-e029a930d624 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.287508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] deallocate_for_instance() {{(pid=120628) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 19:15:30.287678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-63c98272-e9a8-4e50-82f0-7b1e33422f24 req-aaeaebc3-4ef9-4ed5-ad2d-e029a930d624 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.288103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-63c98272-e9a8-4e50-82f0-7b1e33422f24 req-aaeaebc3-4ef9-4ed5-ad2d-e029a930d624 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:30.316637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-63c98272-e9a8-4e50-82f0-7b1e33422f24 req-aaeaebc3-4ef9-4ed5-ad2d-e029a930d624 service nova] Creating event network-changed:37243648-5afd-4664-91f4-eed7014ae7c6 for instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 on n-h2-862769-3 Oct 28 19:15:30.325402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-63c98272-e9a8-4e50-82f0-7b1e33422f24 req-aaeaebc3-4ef9-4ed5-ad2d-e029a930d624 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078544 Oct 28 19:15:30.328415 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1033/2082] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:30.335371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:30.336566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:30.344725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.345720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.346778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:30.347799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.349287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.349960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:30.736265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:30.754142 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6c4549fd-9d8c-4613-9a5e-91eea150d6f2 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.423300 Oct 28 19:15:30.758746 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1034/2083] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:30 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:30.783018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:30.814367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:30.823385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.828569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.830026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:30.831106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:30.833517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:30.835020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.078015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53e8f6ab-6b0f-4088-ac89-38dd4fcf6dc4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1/action" status: 202 len: 0 microversion: 2.1 time: 0.317117 Oct 28 19:15:31.078706 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1035/2084] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:30 2022] POST /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:31.108714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:31.109424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:31.128756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.130523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.131169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.136446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.136955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.137415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.289962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Updating instance_info_cache with network_info: [] {{(pid=120628) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:15:31.540156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:31.550357 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5595966f-3325-44f9-9eba-a47bc8edc7c4 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1332 microversion: 2.1 time: 0.454179 Oct 28 19:15:31.557057 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fddbcb1c-6876-4990-9838-e7b82fd14c51 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 204 len: 0 microversion: 2.1 time: 2.340767 Oct 28 19:15:31.558415 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1050/2085] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:29 2022] DELETE /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 0 bytes in 2343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:31.563802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-bb60d0ec-f066-475c-8b7e-1c9ab3ee5d21 req-5493814c-549e-4966-8887-5c7a6f74cfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaefac-41cf-4e4b-bd0a-264f86c0e163", "name": "network-vif-plugged", "status": "completed", "tag": "ff4e29a2-9a0e-414c-8644-26eb9a8322df"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:31.574486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bb60d0ec-f066-475c-8b7e-1c9ab3ee5d21 req-5493814c-549e-4966-8887-5c7a6f74cfd6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.575286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bb60d0ec-f066-475c-8b7e-1c9ab3ee5d21 req-5493814c-549e-4966-8887-5c7a6f74cfd6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.575915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bb60d0ec-f066-475c-8b7e-1c9ab3ee5d21 req-5493814c-549e-4966-8887-5c7a6f74cfd6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.580826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1036/2086] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:31 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1332 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:31.588594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-bb60d0ec-f066-475c-8b7e-1c9ab3ee5d21 req-5493814c-549e-4966-8887-5c7a6f74cfd6 service nova] Creating event network-vif-plugged:ff4e29a2-9a0e-414c-8644-26eb9a8322df for instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 on n-h1-862769-3 Oct 28 19:15:31.590025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:31.590648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:31.595419 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-bb60d0ec-f066-475c-8b7e-1c9ab3ee5d21 req-5493814c-549e-4966-8887-5c7a6f74cfd6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035339 Oct 28 19:15:31.596425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1051/2087] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:31.604028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:31.604847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:31.614756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.615607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.616373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.617665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.618669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.619454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.627167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.630412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.630887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.632944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.633265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.633698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.643391 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf HTTP/1.1 Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:15:31.646334 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:15:31.648186 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9908d12e-78a2-487f-b024-6b70458c31bf'} Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:31.649069 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:15:31.653252 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:31.670578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:31.673257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c01d7088-0326-49df-b6be-79bbde362b9a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 404 len: 111 microversion: 2.1 time: 0.074587 Oct 28 19:15:31.676716 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1052/2088] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:31 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:31.718404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:31.778833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:31.779516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:31.793616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.794541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.795278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:31.796258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:31.802282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:31.803235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:32.252252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:32.264350 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-421f9bcc-8693-4561-92b5-66cde165198a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.490699 Oct 28 19:15:32.278712 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1053/2089] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:31 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:32.287949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2024068283", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:32.392061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:32.428786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:32.445903 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f5d4692-1d10-4e4f-bb90-a301cea470e5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1574 microversion: 2.1 time: 0.861933 Oct 28 19:15:32.447236 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1037/2090] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:31 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1574 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:32.456687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-cae81337-34ec-47e5-973a-535a0b2f0a2a req-f6b79cdf-3d19-47a4-89a6-b6f497106ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9908d12e-78a2-487f-b024-6b70458c31bf", "name": "network-vif-deleted", "tag": "e4a459cf-63b3-4d25-b574-d0e73c54b919"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:32.481940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cae81337-34ec-47e5-973a-535a0b2f0a2a req-f6b79cdf-3d19-47a4-89a6-b6f497106ae0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:32.483664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cae81337-34ec-47e5-973a-535a0b2f0a2a req-f6b79cdf-3d19-47a4-89a6-b6f497106ae0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:32.484111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cae81337-34ec-47e5-973a-535a0b2f0a2a req-f6b79cdf-3d19-47a4-89a6-b6f497106ae0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:32.505152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.server_external_events [req-cae81337-34ec-47e5-973a-535a0b2f0a2a req-f6b79cdf-3d19-47a4-89a6-b6f497106ae0 service nova] Unable to find a host for instance 9908d12e-78a2-487f-b024-6b70458c31bf. Dropping event network-vif-deleted {{(pid=120629) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:15:32.506279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-cae81337-34ec-47e5-973a-535a0b2f0a2a req-f6b79cdf-3d19-47a4-89a6-b6f497106ae0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.057364 Oct 28 19:15:32.507379 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1038/2091] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 19:15:32.601077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:32.602346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:32.617752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:32.619320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:32.623175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:32.624152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:32.626897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:32.629358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:32.815877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:33.045071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:33.060951 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d0f469f-f6ff-4624-8d37-9398b1575b73 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1332 microversion: 2.1 time: 0.475764 Oct 28 19:15:33.078415 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1039/2092] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:32 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1332 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:33.250656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:15:33.251287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:15:33.251949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:15:33.252505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:15:33.252921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:15:33.264882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:33.265585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:33.266347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:33.267341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:33.267970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:33.269093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:33.289922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:33.291658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:33.292646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:33.295411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:33.307559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:33.308051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:33.308471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:33.309198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:33.309653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:33.312178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:15:33.315135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:15:33.324291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:33.366743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:33.402969 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-682e0813-f973-48e2-b0db-7b2dca7f1db2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122821 Oct 28 19:15:33.403962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1054/2093] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:15:33.418278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7739e36-8df7-4a06-a36a-c181146d31ab tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:33.441421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7739e36-8df7-4a06-a36a-c181146d31ab tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:33.551242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b7739e36-8df7-4a06-a36a-c181146d31ab tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:33.561725 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7739e36-8df7-4a06-a36a-c181146d31ab tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1215 microversion: 2.1 time: 0.149131 Oct 28 19:15:33.567114 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1055/2094] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:33 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:33.583526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:33.584370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:33.597478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:33.598176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:33.599436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:33.602507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:33.603283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:33.604439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:33.718865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:33.732026 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d621a731-5231-4f95-a772-122afefd228f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1522 microversion: 2.1 time: 0.445865 Oct 28 19:15:33.732601 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1040/2095] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:33 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:33.831962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:33.841447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f6afa555-3279-4d9e-8bea-5c572771c097 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1574 microversion: 2.1 time: 0.272859 Oct 28 19:15:33.843228 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1056/2096] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:33 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1574 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:34.086065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:34.087099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:34.099889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:34.102576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:34.103230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:34.104658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:34.105746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:34.107205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:34.363606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:34.369184 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a23a48b5-36a7-4d67-9728-e8f81e4f573a tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1332 microversion: 2.1 time: 0.288027 Oct 28 19:15:34.391736 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1041/2097] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:34 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1332 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:34.588898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:34.589821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:34.602832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:34.603709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:34.604432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:34.606314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:34.607709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:34.608300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:34.718637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:34.731272 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4eb7e482-57c6-40a1-b849-bf585354ec38 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1219 microversion: 2.1 time: 0.145288 Oct 28 19:15:34.733533 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1042/2098] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:34 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:34.760414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:34.761029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:34.772350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:34.772847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:34.773277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:34.773983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:34.776225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:34.778233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:34.920514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27d02216-eb0e-4b5b-b87f-ceef476f1385 tempest-ListImagesTestJSON-408661673 tempest-ListImagesTestJSON-408661673-project] Calling method '.version_select at 0x7f1d77d16ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:34.980113 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-27d02216-eb0e-4b5b-b87f-ceef476f1385 tempest-ListImagesTestJSON-408661673 tempest-ListImagesTestJSON-408661673-project] 10.222.0.44 "GET /compute/v2.1/images/d275f742-67cf-44be-b2bb-1596dfea8f48" status: 200 len: 784 microversion: 2.1 time: 0.431926 Oct 28 19:15:34.981134 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1057/2099] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:15:34 2022] GET /compute/v2.1/images/d275f742-67cf-44be-b2bb-1596dfea8f48 => generated 784 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:34.982935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:34.995775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:34.996527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:35.006001 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5e20098-4e12-42a3-957a-4a706365e20a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1507 microversion: 2.1 time: 0.249343 Oct 28 19:15:35.009985 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1043/2100] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:34 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:35.015315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e41fc706-0f28-427d-a2eb-a4e0626becd2 tempest-ListImagesTestJSON-408661673 tempest-ListImagesTestJSON-408661673-project] Calling method '.version_select at 0x7f1d7c058280>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.022564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.023510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.024105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.025060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.026086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.027439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.199397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:35.227703 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e41fc706-0f28-427d-a2eb-a4e0626becd2 tempest-ListImagesTestJSON-408661673 tempest-ListImagesTestJSON-408661673-project] 10.222.0.44 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.212920 Oct 28 19:15:35.228469 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1044/2101] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/images => generated 871 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:35.238080 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae9b5a19-697d-4d6d-a6a8-d71ff9a60d41 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1574 microversion: 2.1 time: 0.244812 Oct 28 19:15:35.238823 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1058/2102] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:34 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:35.248955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.249989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5a31656-6f2c-4959-a3b8-f2532502251f tempest-ListImagesTestJSON-408661673 tempest-ListImagesTestJSON-408661673-project] Calling method '.version_select at 0x7f1d77905dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.251983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:35.268274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.270245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.271311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.276111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.276840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.277481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.357484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5a31656-6f2c-4959-a3b8-f2532502251f tempest-ListImagesTestJSON-408661673 tempest-ListImagesTestJSON-408661673-project] 10.222.0.44 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.114032 Oct 28 19:15:35.358390 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1059/2103] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:35.396091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.397290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:35.414920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.419633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.425243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.427912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.430589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.431278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.595947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:35.607284 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff57f2cf-a146-4fcc-b9ce-752b184c7104 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 200 len: 1507 microversion: 2.1 time: 0.367112 Oct 28 19:15:35.607873 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1045/2104] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:35.622973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.627747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:35.656590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.660848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.662048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.669776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.674714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.675449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.761449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ace5a92c-cd00-46d5-9ecc-9727c272109d tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150379 Oct 28 19:15:35.763263 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1046/2105] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:35.772404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.773277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:35.782404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.783248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.783928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.785514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.787044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.788105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.826609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:35.858385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:35.904974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:35.918008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f820cc47-9a8c-4b14-ac0a-14449013ca78 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1332 microversion: 2.1 time: 0.524974 Oct 28 19:15:35.919498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1060/2106] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1332 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:35.928399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.929886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:35.964745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.965599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.966664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.971365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.972337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.974601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.992187 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-95190502-5c16-472b-b256-a1c8aeda6d9a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 204 len: 0 microversion: 2.1 time: 0.227066 Oct 28 19:15:35.993341 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1047/2107] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:35 2022] DELETE /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:36.020685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:36.024610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:36.031889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:36.032615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:36.033810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:36.035194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:36.035724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:36.036239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:36.090560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:36.100610 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fde7aebe-1b6a-4083-abd3-2c9a0a34ee9f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1273 microversion: 2.1 time: 0.179616 Oct 28 19:15:36.102944 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1061/2108] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:36.225755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lazy-loading 'services' on Instance uuid 7efddd30-6dca-454a-b51b-f74fe8f42bd1 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:36.270774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:36.270774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:36.296187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:36.300043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:36.300894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:36.306485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:36.308443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:36.310766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:36.339273 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ddb97bbb-8f21-4e55-976d-b0662db56b58 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments/f0e900d1-cf83-4c88-97fc-3cf4bdb40941" status: 202 len: 0 microversion: 2.1 time: 0.343325 Oct 28 19:15:36.341451 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1048/2109] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:15:35 2022] DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments/f0e900d1-cf83-4c88-97fc-3cf4bdb40941 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:36.354991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-142863712", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "7a58ac5b-5454-4d41-ba04-839f867ccf04"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:36.514345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] validate_networks() for [('7a58ac5b-5454-4d41-ba04-839f867ccf04', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:36.855450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:36.870020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cef33a1-7f29-4dae-9d6a-6e325aecf444 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1572 microversion: 2.1 time: 0.608893 Oct 28 19:15:36.874617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1062/2110] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:36 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1572 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:37.193702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b59fc506-b6e7-426d-8e55-16dbec778645 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '.version_select at 0x7f1d77905ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:37.342485 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b59fc506-b6e7-426d-8e55-16dbec778645 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6" status: 200 len: 371 microversion: 2.1 time: 0.465318 Oct 28 19:15:37.353706 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1063/2111] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:15:36 2022] GET /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6 => generated 371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:37.361642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e9ded9d2-50ee-4e20-b3ae-48c5f8e2dee7 req-f61eeb3a-0e16-4f8e-8652-3a52b928ed86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6", "name": "network-vif-plugged", "status": "completed", "tag": "37243648-5afd-4664-91f4-eed7014ae7c6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:37.379379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e9ded9d2-50ee-4e20-b3ae-48c5f8e2dee7 req-f61eeb3a-0e16-4f8e-8652-3a52b928ed86 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.380305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e9ded9d2-50ee-4e20-b3ae-48c5f8e2dee7 req-f61eeb3a-0e16-4f8e-8652-3a52b928ed86 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.380951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e9ded9d2-50ee-4e20-b3ae-48c5f8e2dee7 req-f61eeb3a-0e16-4f8e-8652-3a52b928ed86 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.413706 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e9ded9d2-50ee-4e20-b3ae-48c5f8e2dee7 req-f61eeb3a-0e16-4f8e-8652-3a52b928ed86 service nova] Creating event network-vif-plugged:37243648-5afd-4664-91f4-eed7014ae7c6 for instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 on n-h2-862769-3 Oct 28 19:15:37.421809 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e9ded9d2-50ee-4e20-b3ae-48c5f8e2dee7 req-f61eeb3a-0e16-4f8e-8652-3a52b928ed86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066126 Oct 28 19:15:37.461170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1064/2112] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:37.482156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2066002514"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:37.487055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:37.528872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.529772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.532116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.534054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.535100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.536444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.616017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:15:37.616584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:15:37.617126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:15:37.617836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:15:37.618502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:15:37.622232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:37.656046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.656977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.660082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.667150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.667660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.668100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.705371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Getting quotas for project 2f724cbeaab34c56bd952bff01078b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:37.710594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Getting quotas for user 0a61d398929c482da48baf1f7ec1c2f4 and project 2f724cbeaab34c56bd952bff01078b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:37.724884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:15:37.727833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:15:37.817586 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b90b6ca-f7a5-4b0f-afce-ec20c2e05c85 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472675 Oct 28 19:15:37.824940 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1049/2113] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:15:37.831037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:37.832038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:37.839582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.840338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.840933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.841843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.842492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.843091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:38.072932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.network.security_group_api [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Adding security group 9831c414-3c87-41b0-b9d1-cb311a4c377f to port b64f4261-a7a1-4df5-ba16-4d9c7679af79 Oct 28 19:15:38.363914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:38.375229 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1042d715-fd5f-43c6-b9c3-98e4595efaa9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1332 microversion: 2.1 time: 0.548793 Oct 28 19:15:38.375940 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1050/2114] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:37 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1332 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:38.389776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:38.390798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:38.399817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:38.409990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:38.410733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:38.411511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:38.412859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:38.413459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.188603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:39.202503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca8016f4-57fd-45d4-8051-c3b69847447f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1315 microversion: 2.1 time: 0.825526 Oct 28 19:15:39.204856 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1051/2115] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:38 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:39.214089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c312160>, body: {"quota_set": {"ram": "5120"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:39.629892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56046a77-99a1-469b-961f-6f3937b40221 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1/action" status: 202 len: 0 microversion: 2.1 time: 2.163264 Oct 28 19:15:39.640317 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1065/2116] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:37 2022] POST /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1/action => generated 0 bytes in 2177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:39.653562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:39.663034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.664590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:39.673492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.676988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.678127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.682339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.683163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.686363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.686912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.690269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.691119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.694287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.694793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.850923 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-706b331c-1d1b-4bb5-9adb-a69a26e21115 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6" status: 200 len: 328 microversion: 2.1 time: 0.637785 Oct 28 19:15:39.852652 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1052/2117] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:15:39 2022] PUT /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6 => generated 328 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:39.868996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:39.871247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:39.890600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.891551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.892175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.893220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.893817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.894252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:40.042363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:40.059317 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3017bd4b-8501-4a9f-842b-1ced91fc9e92 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1269 microversion: 2.1 time: 0.417976 Oct 28 19:15:40.063013 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1066/2118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:39 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1269 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:40.079176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-59eed3c3-ee54-4829-b866-f1deac9da65c req-056c49e7-b2f5-4f08-98df-7d41bd46ec27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaefac-41cf-4e4b-bd0a-264f86c0e163", "name": "network-vif-deleted", "tag": "ff4e29a2-9a0e-414c-8644-26eb9a8322df"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:40.129022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59eed3c3-ee54-4829-b866-f1deac9da65c req-056c49e7-b2f5-4f08-98df-7d41bd46ec27 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:40.130821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59eed3c3-ee54-4829-b866-f1deac9da65c req-056c49e7-b2f5-4f08-98df-7d41bd46ec27 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:40.131547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59eed3c3-ee54-4829-b866-f1deac9da65c req-056c49e7-b2f5-4f08-98df-7d41bd46ec27 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:40.157050 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-59eed3c3-ee54-4829-b866-f1deac9da65c req-056c49e7-b2f5-4f08-98df-7d41bd46ec27 service nova] Creating event network-vif-deleted:ff4e29a2-9a0e-414c-8644-26eb9a8322df for instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 on n-h1-862769-3 Oct 28 19:15:40.169435 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-59eed3c3-ee54-4829-b866-f1deac9da65c req-056c49e7-b2f5-4f08-98df-7d41bd46ec27 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104782 Oct 28 19:15:40.171870 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1067/2119] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:40.181825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0e1719f7-2cb8-44e1-95f2-c772af4973e4 req-3b3dd57a-b14b-470e-b39a-20e04ea82d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea55ae1-785f-4e88-810d-6b0ada2a6141", "tag": "0c708e99-a16c-4074-b83d-8fdc3202bc18"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:40.206410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0e1719f7-2cb8-44e1-95f2-c772af4973e4 req-3b3dd57a-b14b-470e-b39a-20e04ea82d53 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:40.209429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0e1719f7-2cb8-44e1-95f2-c772af4973e4 req-3b3dd57a-b14b-470e-b39a-20e04ea82d53 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:40.210100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0e1719f7-2cb8-44e1-95f2-c772af4973e4 req-3b3dd57a-b14b-470e-b39a-20e04ea82d53 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:40.222648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:40.234372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:40.243071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0e1719f7-2cb8-44e1-95f2-c772af4973e4 req-3b3dd57a-b14b-470e-b39a-20e04ea82d53 service nova] Creating event network-changed:0c708e99-a16c-4074-b83d-8fdc3202bc18 for instance aea55ae1-785f-4e88-810d-6b0ada2a6141 on n-h1-862769-3 Oct 28 19:15:40.244733 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf7b67e4-e8b5-478b-8b09-9536eedd77c5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1536 microversion: 2.1 time: 0.390668 Oct 28 19:15:40.246410 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1053/2120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:39 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1536 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:40.254228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0e1719f7-2cb8-44e1-95f2-c772af4973e4 req-3b3dd57a-b14b-470e-b39a-20e04ea82d53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078337 Oct 28 19:15:40.254850 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1068/2121] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:40.267862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-67d45f74-29b1-4b48-b689-2c088909769f tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:40.269207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f602a289-4b67-40c1-9950-7dd0c2a8a926 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d80094ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:40.295118 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-67d45f74-29b1-4b48-b689-2c088909769f tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6" status: 202 len: 0 microversion: 2.1 time: 0.038177 Oct 28 19:15:40.295827 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1069/2122] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:15:40 2022] DELETE /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:40.313473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:40.315999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:40.335257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:40.338706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:40.339284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:40.340127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:40.341914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:40.343756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:40.556306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-f602a289-4b67-40c1-9950-7dd0c2a8a926 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use.", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:40.557517 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-f602a289-4b67-40c1-9950-7dd0c2a8a926 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.557517 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f602a289-4b67-40c1-9950-7dd0c2a8a926 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f HTTP/1.1 Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:40.560012 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: exception: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] Oct 28 19:15:40.561940 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9831c414-3c87-41b0-b9d1-cb311a4c377f'} Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:40.563213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.564769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:40.566483 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:40.568831 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:40.568831 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:40.568831 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:40.568831 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.568831 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] Oct 28 19:15:40.568831 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:40.578296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f602a289-4b67-40c1-9950-7dd0c2a8a926 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 400 to user: Security Group 9831c414-3c87-41b0-b9d1-cb311a4c377f in use. Oct 28 19:15:40.578296 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-78c37423-abc3-4613-a06a-77a8721c9b73'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:40.584014 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f602a289-4b67-40c1-9950-7dd0c2a8a926 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f" status: 400 len: 185 microversion: 2.1 time: 0.334018 Oct 28 19:15:40.590666 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1054/2123] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:40 2022] DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f => generated 185 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:15:40.596222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1505653-3a62-4590-8987-eb934e0ee8e3 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'create', calling method: .version_select at 0x7f1d7ff748b0>, body: {"pool": "693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f"} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:40.968333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:40.979755 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8706b82-8744-481f-aaa2-8514efa7787d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1315 microversion: 2.1 time: 0.677736 Oct 28 19:15:40.981258 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1070/2124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:40 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:41.011280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a19b9d91-fb35-4b5f-b82e-be611a64050b tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '.version_select at 0x7f1d77d678b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:41.125317 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a19b9d91-fb35-4b5f-b82e-be611a64050b tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6" status: 200 len: 371 microversion: 2.1 time: 0.140899 Oct 28 19:15:41.126025 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1071/2125] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:15:40 2022] GET /compute/v2.1/os-quota-sets/8a4ad90f92484e7384c6fa711dbceaf6 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:41.135787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:41.141464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:41.148618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:41.151513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:41.152822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:41.156297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:41.156995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:41.157522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:41.237983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:41.393371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f6dd8edc-e131-49c0-914d-a91b84ee89b8 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 204 len: 0 microversion: 2.1 time: 0.265918 Oct 28 19:15:41.396573 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1072/2126] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:41 2022] DELETE /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:41.411450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:41.412606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:41.436084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:41.437554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:41.439054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:41.440766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:41.442269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:41.443946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:41.642703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:41.651486 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a550c8e0-c69b-4d61-9406-303ae84da86b tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1275 microversion: 2.1 time: 0.252666 Oct 28 19:15:41.670951 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1073/2127] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:41 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:41.678114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7aa5a71b-06bb-4439-a1bb-17905d63a669 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '.version_select at 0x7f1d77d6cd30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:41.996321 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7aa5a71b-06bb-4439-a1bb-17905d63a669 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.323671 Oct 28 19:15:42.007405 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1074/2128] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:15:41 2022] GET /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5/defaults => generated 371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:42.020139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:42.020874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:42.049478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:42.050377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:42.052936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:42.053710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:42.059349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:42.059823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:42.704750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:42.715467 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-752df3ff-8f6e-4537-9779-3c311be296d7 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1647 microversion: 2.1 time: 0.706692 Oct 28 19:15:42.723524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1075/2129] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:42 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1647 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:42.729033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:42.729880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:42.736511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:42.738442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:42.739177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:42.745371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:42.746287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:42.746993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:43.156858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:43.175514 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-76df0010-d23b-4125-90c3-3466f9b05387 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1315 microversion: 2.1 time: 0.450602 Oct 28 19:15:43.191091 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1076/2130] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:42 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:43.196319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2e0172c7-b609-49c6-8598-792c4ea8c26f req-afc57b57-914a-4fa9-8255-4c49d54dc91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b282fb-2903-4a72-bc09-9f4892b692c1", "tag": "b64f4261-a7a1-4df5-ba16-4d9c7679af79"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:43.217361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e0172c7-b609-49c6-8598-792c4ea8c26f req-afc57b57-914a-4fa9-8255-4c49d54dc91b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:43.217361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e0172c7-b609-49c6-8598-792c4ea8c26f req-afc57b57-914a-4fa9-8255-4c49d54dc91b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:43.217361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e0172c7-b609-49c6-8598-792c4ea8c26f req-afc57b57-914a-4fa9-8255-4c49d54dc91b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:43.254777 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2e0172c7-b609-49c6-8598-792c4ea8c26f req-afc57b57-914a-4fa9-8255-4c49d54dc91b service nova] Creating event network-changed:b64f4261-a7a1-4df5-ba16-4d9c7679af79 for instance 74b282fb-2903-4a72-bc09-9f4892b692c1 on n-h2-862769-3 Oct 28 19:15:43.261863 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2e0172c7-b609-49c6-8598-792c4ea8c26f req-afc57b57-914a-4fa9-8255-4c49d54dc91b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069248 Oct 28 19:15:43.263302 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1077/2131] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:43.283581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77d670d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:43.298885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:43.498547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:43.499393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:43.500019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:43.501018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:43.501649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:43.502257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:43.571358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ff162b9-3751-4d40-accf-40662ec08e96 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4" status: 200 len: 328 microversion: 2.1 time: 0.306315 Oct 28 19:15:43.581329 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1078/2132] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:15:43 2022] PUT /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4 => generated 328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:43.587506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:43.588611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:43.595981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:43.596781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:43.597379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:43.598476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:43.599122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:43.599710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:43.936803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:43.963040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05ff540c-eed8-4bd2-a3dd-8e6c8fb3ea00 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1317 microversion: 2.1 time: 0.379636 Oct 28 19:15:43.966572 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1079/2133] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:43 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:43.971950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '.version_select at 0x7f1d778f6e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:44.053344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:44.054409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:44.054977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:44.056143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:44.056702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:44.057222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:44.086297 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8fa8ba62-8e7a-4446-9e7f-e266791cfb05 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4/detail" status: 200 len: 916 microversion: 2.1 time: 0.117043 Oct 28 19:15:44.106162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1080/2134] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:15:43 2022] GET /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4/detail => generated 916 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:44.114954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:44.116205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:44.126665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:44.127287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:44.128825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:44.129714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:44.130276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:44.130828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:44.744902 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1505653-3a62-4590-8987-eb934e0ee8e3 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.156181 Oct 28 19:15:44.746508 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1055/2135] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:15:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:44.751594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:44.752298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:44.768204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:44.769080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:44.770374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:44.771856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:44.772650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:44.773273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.153051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:45.161429 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bac1f5f-8a2c-4fd7-b6c0-c7701ecf1c67 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 200 len: 1647 microversion: 2.1 time: 1.053776 Oct 28 19:15:45.161948 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1081/2136] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:44 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 1647 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:45.166772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:45.169040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:45.177523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.178016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.178448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.179180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.179678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.180108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.209480 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5d90c38-e3d8-48cb-b68f-99f0b54ef630 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046463 Oct 28 19:15:45.210126 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1082/2137] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:15:45 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:15:45.214741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77def160>, body: {"quota_set": {"ram": "2048"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:45.228605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:45.246038 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb6348b8-6aa5-4c53-827f-82ac64cb24df tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1315 microversion: 2.1 time: 0.498173 Oct 28 19:15:45.246638 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1056/2138] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:44 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:45.271705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a01f15bc-54fa-4e6b-9e03-6fc7648f043b req-5284bbd0-79f8-4512-b0c7-f0aa6c7ca7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b282fb-2903-4a72-bc09-9f4892b692c1", "name": "network-vif-deleted", "tag": "b64f4261-a7a1-4df5-ba16-4d9c7679af79"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:45.302556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a01f15bc-54fa-4e6b-9e03-6fc7648f043b req-5284bbd0-79f8-4512-b0c7-f0aa6c7ca7b2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.303087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a01f15bc-54fa-4e6b-9e03-6fc7648f043b req-5284bbd0-79f8-4512-b0c7-f0aa6c7ca7b2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.303639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a01f15bc-54fa-4e6b-9e03-6fc7648f043b req-5284bbd0-79f8-4512-b0c7-f0aa6c7ca7b2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.329213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.329809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.330088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a01f15bc-54fa-4e6b-9e03-6fc7648f043b req-5284bbd0-79f8-4512-b0c7-f0aa6c7ca7b2 service nova] Creating event network-vif-deleted:b64f4261-a7a1-4df5-ba16-4d9c7679af79 for instance 74b282fb-2903-4a72-bc09-9f4892b692c1 on n-h2-862769-3 Oct 28 19:15:45.330371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.332313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.335060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.354026 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a01f15bc-54fa-4e6b-9e03-6fc7648f043b req-5284bbd0-79f8-4512-b0c7-f0aa6c7ca7b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086043 Oct 28 19:15:45.355695 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1057/2139] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:45.356556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.379236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.238"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:45.389172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:45.398635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.400020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.402387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.403394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.403928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.404380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.412452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.413181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.413771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.414655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.415417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.415999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.462073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:15:45.462636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquired lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:15:45.468037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:45.496040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20bb7daa-e1c3-4f13-a894-6493e13f6705 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4?user_id=925fcdff96ac4afc87ce735c0927eb47" status: 200 len: 328 microversion: 2.1 time: 0.284820 Oct 28 19:15:45.497188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1083/2140] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:15:45 2022] PUT /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4?user_id=925fcdff96ac4afc87ce735c0927eb47 => generated 328 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:45.509220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:45.509840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:45.522499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.523032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.523687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.524632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.525177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.525624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.851599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:45.859636 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2d2f0e38-7c2d-4703-925f-508c70c3c239 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1317 microversion: 2.1 time: 0.361360 Oct 28 19:15:45.860188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1084/2141] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:45 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:45.865607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-db3a26db-9ec3-41f2-9b60-d51d6d9387f4 req-5d0c012b-9381-48af-bdbd-528172618c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904090ce-0d4b-4fc4-99b7-abec57097449", "tag": "50dadf91-1450-49e8-be90-82fae7584731"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:45.876374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-db3a26db-9ec3-41f2-9b60-d51d6d9387f4 req-5d0c012b-9381-48af-bdbd-528172618c9e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.876910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-db3a26db-9ec3-41f2-9b60-d51d6d9387f4 req-5d0c012b-9381-48af-bdbd-528172618c9e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.877446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-db3a26db-9ec3-41f2-9b60-d51d6d9387f4 req-5d0c012b-9381-48af-bdbd-528172618c9e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.889427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-db3a26db-9ec3-41f2-9b60-d51d6d9387f4 req-5d0c012b-9381-48af-bdbd-528172618c9e service nova] Creating event network-changed:50dadf91-1450-49e8-be90-82fae7584731 for instance 904090ce-0d4b-4fc4-99b7-abec57097449 on n-h1-862769-3 Oct 28 19:15:45.895032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-db3a26db-9ec3-41f2-9b60-d51d6d9387f4 req-5d0c012b-9381-48af-bdbd-528172618c9e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033396 Oct 28 19:15:45.895835 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1085/2142] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:45.900958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:45.903999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:45.910641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.911163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.911592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.912262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:45.912834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:45.914575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:45.945730 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7cf67096-f28d-4729-9fc6-0a53e1823707 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048818 Oct 28 19:15:45.946317 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1086/2143] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:15:45 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:15:45.950992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6579315-f4d2-42b1-a45f-fad4064d36ac tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '.version_select at 0x7f1d77cf1f70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:46.336982 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6579315-f4d2-42b1-a45f-fad4064d36ac tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4?user_id=925fcdff96ac4afc87ce735c0927eb47" status: 200 len: 370 microversion: 2.1 time: 0.389364 Oct 28 19:15:46.338431 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1087/2144] 10.222.0.44 () {58 vars in 1323 bytes} [Fri Oct 28 19:15:45 2022] GET /compute/v2.1/os-quota-sets/8e3d765142624df899d7978a896135e4?user_id=925fcdff96ac4afc87ce735c0927eb47 => generated 370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:46.343377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c1c66cad-0cf6-4b92-84f5-6ba147d9cdea req-3a412f53-85a2-4baa-afcb-d92fdeca3124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea55ae1-785f-4e88-810d-6b0ada2a6141", "name": "network-vif-plugged", "status": "completed", "tag": "0c708e99-a16c-4074-b83d-8fdc3202bc18"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:46.353849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c1c66cad-0cf6-4b92-84f5-6ba147d9cdea req-3a412f53-85a2-4baa-afcb-d92fdeca3124 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.355123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c1c66cad-0cf6-4b92-84f5-6ba147d9cdea req-3a412f53-85a2-4baa-afcb-d92fdeca3124 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.355834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c1c66cad-0cf6-4b92-84f5-6ba147d9cdea req-3a412f53-85a2-4baa-afcb-d92fdeca3124 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:46.370278 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c1c66cad-0cf6-4b92-84f5-6ba147d9cdea req-3a412f53-85a2-4baa-afcb-d92fdeca3124 service nova] Creating event network-vif-plugged:0c708e99-a16c-4074-b83d-8fdc3202bc18 for instance aea55ae1-785f-4e88-810d-6b0ada2a6141 on n-h1-862769-3 Oct 28 19:15:46.376724 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c1c66cad-0cf6-4b92-84f5-6ba147d9cdea req-3a412f53-85a2-4baa-afcb-d92fdeca3124 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Oct 28 19:15:46.377532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1088/2145] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:46.383080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:46.383763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:46.391170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.392249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.392679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:46.393797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.394550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.395157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:46.438975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:46.515866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:46.589307 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f4d30c1-9e17-4f33-9fbe-573b324fdcf3 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 204 len: 0 microversion: 2.1 time: 0.209321 Oct 28 19:15:46.590942 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1089/2146] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:46 2022] DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:46.602318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:46.612588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:46.625358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.626037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.631452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:46.634808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.634808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.634808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:46.656234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 HTTP/1.1 Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:15:46.658858 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:46.661103 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '74b282fb-2903-4a72-bc09-9f4892b692c1'} Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:46.662059 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:46.664061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:46.665914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:46.665914 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-60087fd7-5ca8-4473-aa46-a779839f78b0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 404 len: 111 microversion: 2.1 time: 0.068348 Oct 28 19:15:46.665914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1090/2147] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:46 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:46.671580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:46.672217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:46.696256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.700793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.702935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:46.703928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:46.704582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:46.705175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:47.032276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:47.040480 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b352e9dc-66ec-4507-83f2-916a0638ccd4 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1315 microversion: 2.1 time: 0.377615 Oct 28 19:15:47.041060 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1091/2148] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:46 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:47.045774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:47.046730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:47.052476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:47.052954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:47.053382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:47.054070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:47.054512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:47.054974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:47.197321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Building network info cache for instance {{(pid=120629) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:15:47.412567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:47.427766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ef5586b-f1aa-4ad5-9708-e54558ae7582 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1683 microversion: 2.1 time: 0.381004 Oct 28 19:15:47.428357 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1092/2149] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:47 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1683 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:47.433932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d4ed223-a418-4ff1-a929-ea6a5a31bfe3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77efcf70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:47.803606 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7d4ed223-a418-4ff1-a929-ea6a5a31bfe3 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73" status: 202 len: 0 microversion: 2.1 time: 0.373829 Oct 28 19:15:47.804438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1093/2150] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:47 2022] DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:47.809194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:47.810088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:47.816701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:47.817391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:47.817982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:47.819073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:47.819519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:47.820338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:48.212912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:48.223672 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78505dbd-bafe-48f4-b8d4-3c68964c6499 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1317 microversion: 2.1 time: 0.417999 Oct 28 19:15:48.224389 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1094/2151] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:47 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:48.236575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f2601c9-5426-4a13-a083-b239bd664819 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Calling method '.version_select at 0x7f1d77f79ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:48.373533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Updating instance_info_cache with network_info: [{"id": "37243648-5afd-4664-91f4-eed7014ae7c6", "address": "fa:16:3e:29:e9:4a", "network": {"id": "380c844d-030f-4c3a-b35e-5e685ce1c280", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-256128081-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2db7df5a30b741e5922edcb7ae29b2d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap37243648-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120629) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:15:48.394383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Releasing lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:15:48.395436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c022d1d4-2023-477c-abd9-498ec4ffad32 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action" status: 202 len: 0 microversion: 2.1 time: 3.023597 Oct 28 19:15:48.396293 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1058/2152] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:45 2022] POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action => generated 0 bytes in 3040 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:15:48.406222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c5a8fd1-1ef6-4028-aa97-485e1a0585ef tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77df8310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:48.630857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f2601c9-5426-4a13-a083-b239bd664819 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.405078 Oct 28 19:15:48.632725 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1095/2153] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:15:48 2022] GET /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5/defaults => generated 371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:48.637804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c9f717bb-1b7c-4a49-b633-994586c95096 req-0c1e65df-f1c0-4529-bd05-41b570cd293d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6", "tag": "37243648-5afd-4664-91f4-eed7014ae7c6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:48.641685 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c5a8fd1-1ef6-4028-aa97-485e1a0585ef tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f" status: 202 len: 0 microversion: 2.1 time: 0.244159 Oct 28 19:15:48.642249 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1059/2154] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:48 2022] DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:48.647161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:48.647971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:48.657135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:48.658346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:48.659445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:48.660594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:48.661280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:48.661928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:48.675819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c9f717bb-1b7c-4a49-b633-994586c95096 req-0c1e65df-f1c0-4529-bd05-41b570cd293d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:48.676402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c9f717bb-1b7c-4a49-b633-994586c95096 req-0c1e65df-f1c0-4529-bd05-41b570cd293d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:48.677537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c9f717bb-1b7c-4a49-b633-994586c95096 req-0c1e65df-f1c0-4529-bd05-41b570cd293d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:48.694529 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c9f717bb-1b7c-4a49-b633-994586c95096 req-0c1e65df-f1c0-4529-bd05-41b570cd293d service nova] Creating event network-changed:37243648-5afd-4664-91f4-eed7014ae7c6 for instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 on n-h2-862769-3 Oct 28 19:15:48.700634 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c9f717bb-1b7c-4a49-b633-994586c95096 req-0c1e65df-f1c0-4529-bd05-41b570cd293d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066501 Oct 28 19:15:48.701543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1096/2155] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:48.707330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f7b2d680-a894-42d6-80de-ae6739363eb7 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'create', calling method: .version_select at 0x7f1d77e4b940>, body: {"pool": "693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f"} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:49.231109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:49.241144 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e420044d-9252-47e2-b2d1-653c374c8813 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1503 microversion: 2.1 time: 0.597605 Oct 28 19:15:49.242040 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1060/2156] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:48 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1503 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:49.254003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:49.255323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:49.262954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:49.263720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:49.265191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:49.266181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:49.268681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:49.268681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:49.371023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4271240a440e9951810577142f269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af309e15479e445c98da964d87177c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:49.392706 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1abbef42-9873-41d8-ad4f-ea8aefd041a7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 200 len: 1615 microversion: 2.1 time: 0.149574 Oct 28 19:15:49.399368 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1061/2157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:49 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 1615 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:49.501040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1542809961", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:49.659998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:49.718548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:49.837371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=14 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:50.032167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:15:50.032855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:15:50.033337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:15:50.033883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:15:50.035017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:15:50.044680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.045283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.045776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.046606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.047138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.047621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.071919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Getting quotas for project 1d288edc66234feb87c8b8df1aee1fe0. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:50.098346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Getting quotas for user 602f76b746d64eb9b59a52f2388a2312 and project 1d288edc66234feb87c8b8df1aee1fe0. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:50.123896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:15:50.127423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:15:50.186249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ee0805d-3c9d-480e-8956-a2a1c936de3c tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784135 Oct 28 19:15:50.187363 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1062/2158] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:15:50.192204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Action: 'update', calling method: .version_select at 0x7f1d8001b5e0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:50.305288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.305822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.306257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.307008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.307629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.308052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.552864 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82aec7ea-db5e-4d62-91a4-086c29eeaa81 tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5" status: 200 len: 329 microversion: 2.1 time: 0.364018 Oct 28 19:15:50.554909 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1063/2159] 10.222.0.44 () {60 vars in 1263 bytes} [Fri Oct 28 19:15:50 2022] PUT /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5 => generated 329 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:50.567438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fc9535f-2180-4a29-b4af-b17409ca93a4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'create', calling method: .version_select at 0x7f1d77df5c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-669439489", "description": "tempest-description-1047596531"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:50.817595 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f7b2d680-a894-42d6-80de-ae6739363eb7 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.114816 Oct 28 19:15:50.818879 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1097/2160] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:15:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:50.833582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:50.834937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:50.846106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.850123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.850880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.851832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.852703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.853236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.865901 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fc9535f-2180-4a29-b4af-b17409ca93a4 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.309666 Oct 28 19:15:50.866515 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1064/2161] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:15:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:50.887533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0511c577-96a4-406a-a705-982b1ebe64d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:50.889729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=21 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:50.899316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0511c577-96a4-406a-a705-982b1ebe64d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.899941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0511c577-96a4-406a-a705-982b1ebe64d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.900219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0511c577-96a4-406a-a705-982b1ebe64d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.984930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0511c577-96a4-406a-a705-982b1ebe64d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Going to try to stop instance {{(pid=120629) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:15:51.013040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:51.021793 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-036fac0f-682f-4953-a58d-928f49b47b45 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1317 microversion: 2.1 time: 0.194338 Oct 28 19:15:51.022448 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1098/2162] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:50 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:51.027860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4ccc90aa-d7f7-4c7d-8a30-222f37620794 req-4c18f2ab-57f9-418e-9cec-fb311b3f6347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efddd30-6dca-454a-b51b-f74fe8f42bd1", "name": "network-vif-deleted", "tag": "bfde1a01-62ff-4eba-94c2-3c93da12384f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:51.037094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4ccc90aa-d7f7-4c7d-8a30-222f37620794 req-4c18f2ab-57f9-418e-9cec-fb311b3f6347 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.037809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4ccc90aa-d7f7-4c7d-8a30-222f37620794 req-4c18f2ab-57f9-418e-9cec-fb311b3f6347 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.038227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4ccc90aa-d7f7-4c7d-8a30-222f37620794 req-4c18f2ab-57f9-418e-9cec-fb311b3f6347 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.052135 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4ccc90aa-d7f7-4c7d-8a30-222f37620794 req-4c18f2ab-57f9-418e-9cec-fb311b3f6347 service nova] Creating event network-vif-deleted:bfde1a01-62ff-4eba-94c2-3c93da12384f for instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 on n-h2-862769-3 Oct 28 19:15:51.057592 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4ccc90aa-d7f7-4c7d-8a30-222f37620794 req-4c18f2ab-57f9-418e-9cec-fb311b3f6347 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Oct 28 19:15:51.058206 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1099/2163] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:51.063268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:51.064383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:51.069694 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0511c577-96a4-406a-a705-982b1ebe64d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141/action" status: 202 len: 0 microversion: 2.1 time: 0.197505 Oct 28 19:15:51.073654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1065/2164] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:50 2022] POST /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:51.073846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.073846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.073846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.078128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.078859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.079466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.087659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:51.088403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:51.094709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.095344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.095791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.096499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.096940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.097476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.111544 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] HTTP exception thrown: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Request method failure captured: Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 HTTP/1.1 Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCm7qOWNrpViyNOz47uGSpAaDon6cOYmaYbdGcQQolSCxZbqP1DBNE4c8nFnKWD4Gy0VeN_HomtFOaslcW4UJIaDrO69vbak4PgWspsQccL9rh2jLidAf3ubhgOBSWZ_K81epzKz4CkMTTLj0mtqkohIjBLUJUwjKaveb3NKME2YQbk Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: af309e15479e445c98da964d87177c25 Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:51.113223 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/af309e15479e445c98da964d87177c25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_af309e15479e445c98da964d87177c25", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/af309e15479e445c98da964d87177c25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/af309e15479e445c98da964d87177c25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: af309e15479e445c98da964d87177c25 Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachSCSIVolumeTestJSON-1539344359-project Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: a4f4271240a440e9951810577142f269 Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1539344359-project Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:15:51.115009 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7efddd30-6dca-454a-b51b-f74fe8f42bd1'} Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:51.116107 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:15:51.117741 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.121078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Returning 404 to user: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:51.129323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-340c7266-c476-441f-b4cf-c007a36db0f7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 404 len: 111 microversion: 2.1 time: 0.051930 Oct 28 19:15:51.129323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1066/2165] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:51 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:51.130470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77e79f70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:51.149952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:51.157688 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3fa766fe-9a25-4ff9-bcda-dde2c40b85aa tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1271 microversion: 2.1 time: 0.098296 Oct 28 19:15:51.158256 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1100/2166] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:51 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:51.163641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.191"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:51.166148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:51.172079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.172560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.172986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.173669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.174109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.174521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.199279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:15:51.199670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquired lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:15:51.210001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.210480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.210938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.211650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.212095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.212507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.586793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1749467a-2265-4d84-897d-10d2a75e64ed tempest-QuotasAdminTestJSON-1254920985 tempest-QuotasAdminTestJSON-1254920985-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5" status: 200 len: 329 microversion: 2.1 time: 0.460093 Oct 28 19:15:51.591256 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1067/2167] 10.222.0.44 () {60 vars in 1263 bytes} [Fri Oct 28 19:15:51 2022] PUT /compute/v2.1/os-quota-sets/bbd923d808a44f5dbe2633899d5b13d5 => generated 329 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:51.606187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15e13f70-954b-45d4-82bf-022fc5301ca0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Action: 'update', calling method: .version_select at 0x7f1d77df83a0>, body: {"security_group": {"name": "tempest-sg-hth-227799531", "description": "tempest-description-hth-1234461864"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:51.685686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f.", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:51.686569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Releasing lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:15:51.687337 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.687337 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Request method failure captured: Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action HTTP/1.1 Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 46 Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpGNXqqqHI__fab4nkB9cEMeaLfC0tYTT-SyVTKXHuW0fNxSrV1SeFMseaAMmm69Wr_FvpJFVauxm7KxuxBISuB76cz9yIelHW45DLNSyV7q9jfSIjwXhwqfuwiHqxWtPqK7KgolyAXgSRJq537Dp0c2lpKxB65CxOnEmzNVLzXJhM Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:15:51.691960 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2db7df5a30b741e5922edcb7ae29b2d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a82493f4265b487fb0a2437c24c2b777 Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: {"addFloatingIp": {"address": "172.25.9.191"}} Oct 28 19:15:51.693734 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6', 'body': {'addFloatingIp': {'address': '172.25.9.191'}}} Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:51.695032 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:51.696431 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.697846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.699306 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] Oct 28 19:15:51.700815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:15:51.703993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Returning 400 to user: Cannot associate floating IP 172.25.9.191 (f7dd86cf-557b-4f17-96ae-e071cfa0f010) with port 37243648-5afd-4664-91f4-eed7014ae7c6 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 693038e3-5fa6-4ce6-9c03-2c5dd2cfd60f. Oct 28 19:15:51.703993 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-46dbe3c3-0c6f-46df-a012-13dcb46ee986'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:51.703993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9abe6eab-09da-44b9-9f3c-bffa5611c38f tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action" status: 400 len: 382 microversion: 2.1 time: 0.543678 Oct 28 19:15:51.704895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1101/2168] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:51 2022] POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action => generated 382 bytes in 546 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:15:51.712313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:51.713166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:51.721666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.722663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.723424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.724338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.725081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.725699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.864747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15e13f70-954b-45d4-82bf-022fc5301ca0 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "PUT /compute/v2.1/os-security-groups/8a3b39a2-88af-4024-ae9a-ced609b6262f" status: 200 len: 217 microversion: 2.1 time: 0.271682 Oct 28 19:15:51.876111 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1068/2169] 10.222.0.44 () {60 vars in 1290 bytes} [Fri Oct 28 19:15:51 2022] PUT /compute/v2.1/os-security-groups/8a3b39a2-88af-4024-ae9a-ced609b6262f => generated 217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:51.882669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a082bd1-1d55-427b-bcf9-915fb82ff490 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '.version_select at 0x7f1d77df5700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:51.910391 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a082bd1-1d55-427b-bcf9-915fb82ff490 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288376368" status: 202 len: 0 microversion: 2.1 time: 0.031938 Oct 28 19:15:51.913444 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1069/2170] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288376368 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:51.923917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e1593061-9278-4ab7-9cb0-4356ce9bc64d req-7dae9fa8-911e-402c-ae44-5bde910fa31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904090ce-0d4b-4fc4-99b7-abec57097449", "name": "network-vif-plugged", "status": "completed", "tag": "50dadf91-1450-49e8-be90-82fae7584731"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:51.959749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:51.961351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e1593061-9278-4ab7-9cb0-4356ce9bc64d req-7dae9fa8-911e-402c-ae44-5bde910fa31d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.961840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e1593061-9278-4ab7-9cb0-4356ce9bc64d req-7dae9fa8-911e-402c-ae44-5bde910fa31d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.962268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e1593061-9278-4ab7-9cb0-4356ce9bc64d req-7dae9fa8-911e-402c-ae44-5bde910fa31d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.981583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48c778c1-08fd-40cf-b3eb-0343a1a83b57 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.275444 Oct 28 19:15:51.987325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e1593061-9278-4ab7-9cb0-4356ce9bc64d req-7dae9fa8-911e-402c-ae44-5bde910fa31d service nova] Creating event network-vif-plugged:50dadf91-1450-49e8-be90-82fae7584731 for instance 904090ce-0d4b-4fc4-99b7-abec57097449 on n-h1-862769-3 Oct 28 19:15:51.994077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e1593061-9278-4ab7-9cb0-4356ce9bc64d req-7dae9fa8-911e-402c-ae44-5bde910fa31d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078353 Oct 28 19:15:51.995059 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1070/2171] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:51.995811 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1102/2172] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:51 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:52.032695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf7c8e38-41f5-45d4-a5d7-12bf78107a65 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '.version_select at 0x7f1d77898e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:52.236074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Calling method '.version_select at 0x7f1d7c0b6ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:52.254194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.254889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.255440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.256271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.256864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.257374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.279721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c232c5bf-892e-416a-851d-dfcb8aa60a07 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] 10.222.0.44 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.283265 Oct 28 19:15:52.281234 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1071/2173] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 19:15:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:52.300729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-539f5afc-4665-45da-8099-383cdfd8e37f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d7ff74f70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:52.501392 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-539f5afc-4665-45da-8099-383cdfd8e37f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/os-security-groups/8a3b39a2-88af-4024-ae9a-ced609b6262f" status: 200 len: 217 microversion: 2.1 time: 0.204741 Oct 28 19:15:52.502377 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1072/2174] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:15:52 2022] GET /compute/v2.1/os-security-groups/8a3b39a2-88af-4024-ae9a-ced609b6262f => generated 217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:52.507228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:52.507977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:52.526609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.527127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.527741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.528667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.529124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.529552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.851208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:52.862843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:52.881167 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dbf7e3b0-8141-4da3-9c5f-cef1575d7c90 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1317 microversion: 2.1 time: 0.377323 Oct 28 19:15:52.882339 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1073/2175] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:52 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:52.909555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:52.910768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:52.922981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.923779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.925210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.926654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.927397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.928078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:53.190233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:53.203131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a426844-65cf-43ee-96d6-a1e7efd12b64 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.319252 Oct 28 19:15:53.204715 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1074/2176] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:52 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:53.210919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1354890618", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:53.302960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:53.551295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf7c8e38-41f5-45d4-a5d7-12bf78107a65 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/f7dd86cf-557b-4f17-96ae-e071cfa0f010" status: 202 len: 0 microversion: 2.1 time: 1.554056 Oct 28 19:15:53.553150 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1103/2177] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:15:51 2022] DELETE /compute/v2.1/os-floating-ips/f7dd86cf-557b-4f17-96ae-e071cfa0f010 => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:53.565224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37d2e958-67db-42a9-9a72-e7834850fc17 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77898040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:53.690036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Getting quotas for project 11a29deb305b43aeab1e852f85ff30d5. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:53.697986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Getting quotas for user 50037b55e9a14dc2aaf89e4040d6b4b4 and project 11a29deb305b43aeab1e852f85ff30d5. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:53.717822 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Request method failure captured: Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 1752 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCpagMqkScqDTj6s32jfbqfbpP73FyEGOb2nSHlTLrfw2fd9-cAKskoVO25jRdthAZI8UrzxjGp62Oztg8GnJupaGoMEMYGTAub1uepgXY3R6sGA1izIi6TkzYrJ2EoU30610XMfyWR965Gqsrl1CFfmTxHI7YgQeQ3WCPRLjtJpXzM Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 11a29deb305b43aeab1e852f85ff30d5 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1555700445 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/11a29deb305b43aeab1e852f85ff30d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_11a29deb305b43aeab1e852f85ff30d5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/11a29deb305b43aeab1e852f85ff30d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/11a29deb305b43aeab1e852f85ff30d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1555700445 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 11a29deb305b43aeab1e852f85ff30d5 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1555700445 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 50037b55e9a14dc2aaf89e4040d6b4b4 Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1354890618", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:53.722714 n-d-862769-3 devstack@n-api.service[120629]: exception: Maximum number of metadata items exceeds 128 Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1354890618', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:15:53.725499 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 28 19:15:53.728760 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:53.732210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:53.733098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-053deaee-21e5-46b9-a7f2-a81fdf002bb8 tempest-AbsoluteLimitsNegativeTestJSON-1555700445 tempest-AbsoluteLimitsNegativeTestJSON-1555700445-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.526870 Oct 28 19:15:53.739123 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1075/2178] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Oct 28 19:15:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 528 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:15:53.763294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:53.767308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:53.801534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:53.803199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:53.803935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:53.804795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:53.805351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:53.805880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:53.967971 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37d2e958-67db-42a9-9a72-e7834850fc17 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/8a3b39a2-88af-4024-ae9a-ced609b6262f" status: 202 len: 0 microversion: 2.1 time: 0.408263 Oct 28 19:15:53.971556 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1104/2179] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:53 2022] DELETE /compute/v2.1/os-security-groups/8a3b39a2-88af-4024-ae9a-ced609b6262f => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:53.979689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.238"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:54.104022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:54.121632 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd365e68-0a44-4d6b-8bde-ec3b9f0a01ba tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.386635 Oct 28 19:15:54.122374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1076/2180] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:53 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:54.129317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:54.130374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:54.147193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=14,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:54.160218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.161982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.162946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.163912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.164608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.165319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.267417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:54.275356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.276986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.277635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.280797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.282094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.284964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.552866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:54.569000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7fa046c3-d2f2-4363-84db-664d14d19ed7 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1506 microversion: 2.1 time: 0.445010 Oct 28 19:15:54.569954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1077/2181] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:54 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:54.574658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:54.575171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:54.630535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.630535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.630535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.630535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.631110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.631200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.672437 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 HTTP/1.1 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '74b282fb-2903-4a72-bc09-9f4892b692c1'} Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:54.675865 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:54.681376 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34c9433b-3a3d-4b16-90d7-1a8767968a19 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 404 len: 111 microversion: 2.1 time: 0.106403 Oct 28 19:15:54.685203 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1078/2182] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:54 2022] DELETE /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:54.697505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:54.698171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:54.711138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.711681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.716039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.716997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.717482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.718033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.845991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:15:54.847219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquired lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:15:55.003094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:55.019251 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-acc5bcf8-d8f7-480e-851b-65ecda27087f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.332747 Oct 28 19:15:55.020205 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1079/2183] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:54 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:55.025267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e0b31db7-73a9-4468-b9a2-26fe8a6645b8 req-76b4a80e-f12e-4bd3-bead-5b2221b38943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97cc018-7ca5-47e5-98e3-8660906e59f0", "tag": "3b562af9-3c8f-4a00-a882-a853357960c8"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:55.048718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e0b31db7-73a9-4468-b9a2-26fe8a6645b8 req-76b4a80e-f12e-4bd3-bead-5b2221b38943 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.049472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e0b31db7-73a9-4468-b9a2-26fe8a6645b8 req-76b4a80e-f12e-4bd3-bead-5b2221b38943 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.050043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e0b31db7-73a9-4468-b9a2-26fe8a6645b8 req-76b4a80e-f12e-4bd3-bead-5b2221b38943 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.077800 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e0b31db7-73a9-4468-b9a2-26fe8a6645b8 req-76b4a80e-f12e-4bd3-bead-5b2221b38943 service nova] Creating event network-changed:3b562af9-3c8f-4a00-a882-a853357960c8 for instance a97cc018-7ca5-47e5-98e3-8660906e59f0 on n-h2-862769-3 Oct 28 19:15:55.097546 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e0b31db7-73a9-4468-b9a2-26fe8a6645b8 req-76b4a80e-f12e-4bd3-bead-5b2221b38943 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074346 Oct 28 19:15:55.100003 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1080/2184] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:55.120725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:55.127423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:55.148151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.150124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.152689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.154532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.156534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.157819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.430500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=9 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:55.527494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:55.536752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0898ef6-c522-441e-ba3a-520daf84c70f tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1506 microversion: 2.1 time: 0.433423 Oct 28 19:15:55.537499 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1081/2185] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:55 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:55.561747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:55.562363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: 74b282fb-2903-4a72-bc09-9f4892b692c1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:55.574238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.574761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.575193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.575902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.576351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.576783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.593197 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 HTTP/1.1 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '74b282fb-2903-4a72-bc09-9f4892b692c1'} Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:55.594963 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Instance 74b282fb-2903-4a72-bc09-9f4892b692c1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:55.600328 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4eac068-05d6-47c0-a589-0ee1c19d7df5 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1" status: 404 len: 111 microversion: 2.1 time: 0.047044 Oct 28 19:15:55.601177 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1082/2186] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:55 2022] GET /compute/v2.1/servers/74b282fb-2903-4a72-bc09-9f4892b692c1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:55.608450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:55.609168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:55.616217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.616938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.617525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.618398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.619036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.619614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:56.215586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:56.226826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b6a5bec-6e0d-44bc-8542-279b0211bcfd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.624226 Oct 28 19:15:56.242745 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1083/2187] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:55 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:56.252517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:56.255164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:56.281556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:56.282263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:56.282739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:56.283812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:56.284667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:56.285097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:56.330819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=38 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:56.445324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e43a4f0f-138e-4043-bf95-61e9991400fe tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "PUT /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1078 microversion: 2.1 time: 0.201358 Oct 28 19:15:56.451096 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1084/2188] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:15:56 2022] PUT /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1078 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:56.462633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77dd8ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:56.586025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:56.586843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 9831c414-3c87-41b0-b9d1-cb311a4c377f not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:15:56.587549 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.587549 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f HTTP/1.1 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9831c414-3c87-41b0-b9d1-cb311a4c377f'} Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:56.590364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] Oct 28 19:15:56.595823 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:56.603629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Building network info cache for instance {{(pid=120628) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:15:56.608878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 9831c414-3c87-41b0-b9d1-cb311a4c377f does not exist Oct 28 19:15:56.608878 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-8c3aa6d9-f0b5-4b48-a4f0-accd091df168'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:56.613322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-226fcf84-96a8-4679-821b-415e774bbbfc tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f" status: 404 len: 194 microversion: 2.1 time: 0.158923 Oct 28 19:15:56.624179 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1085/2189] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:56 2022] DELETE /compute/v2.1/os-security-groups/9831c414-3c87-41b0-b9d1-cb311a4c377f => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:56.629372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:56.632856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:56.645279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:56.646397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:56.647092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:56.648082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:56.648761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:56.649396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.126674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:57.139094 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0fd1e4ee-d3ce-433d-95c5-18bbad771335 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.517486 Oct 28 19:15:57.139681 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1086/2190] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:56 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:57.144986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:57.148141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:57.157796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.160835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.163102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.163849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.164320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.164739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.523184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:57.538506 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3da6d3d6-b026-44e4-b7aa-6bc9dea783cc tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1504 microversion: 2.1 time: 0.397354 Oct 28 19:15:57.539887 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1087/2191] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:57 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:57.555389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-576b30bf-5186-4047-b8af-3e34cd940920 req-0ea1b45a-1f1a-48d6-af01-fbd128255f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6", "tag": "37243648-5afd-4664-91f4-eed7014ae7c6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:57.569436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-576b30bf-5186-4047-b8af-3e34cd940920 req-0ea1b45a-1f1a-48d6-af01-fbd128255f36 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.572691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-576b30bf-5186-4047-b8af-3e34cd940920 req-0ea1b45a-1f1a-48d6-af01-fbd128255f36 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.573918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-576b30bf-5186-4047-b8af-3e34cd940920 req-0ea1b45a-1f1a-48d6-af01-fbd128255f36 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.596224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-576b30bf-5186-4047-b8af-3e34cd940920 req-0ea1b45a-1f1a-48d6-af01-fbd128255f36 service nova] Creating event network-changed:37243648-5afd-4664-91f4-eed7014ae7c6 for instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 on n-h2-862769-3 Oct 28 19:15:57.605159 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-576b30bf-5186-4047-b8af-3e34cd940920 req-0ea1b45a-1f1a-48d6-af01-fbd128255f36 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062992 Oct 28 19:15:57.607472 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1088/2192] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:57.638815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77c7a700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:57.722281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:57.723136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group ee525360-89c8-48aa-b38e-e66dd6c62a73 not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:15:57.723960 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.723960 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73 HTTP/1.1 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ee525360-89c8-48aa-b38e-e66dd6c62a73'} Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:57.726389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group ee525360-89c8-48aa-b38e-e66dd6c62a73 does not exist Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-1911ecc6-d67c-405c-97e7-963f70f4d8e3'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7fd1761-42dc-42b3-a450-a89772e07384 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73" status: 404 len: 194 microversion: 2.1 time: 0.122003 Oct 28 19:15:57.733564 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1089/2193] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:57 2022] DELETE /compute/v2.1/os-security-groups/ee525360-89c8-48aa-b38e-e66dd6c62a73 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:57.744522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Updating instance_info_cache with network_info: [{"id": "37243648-5afd-4664-91f4-eed7014ae7c6", "address": "fa:16:3e:29:e9:4a", "network": {"id": "380c844d-030f-4c3a-b35e-5e685ce1c280", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-256128081-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2db7df5a30b741e5922edcb7ae29b2d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap37243648-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120628) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:15:57.761812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Releasing lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:15:57.764831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c325bed7-f455-4901-aa66-986bdb5e9f2b tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action" status: 202 len: 0 microversion: 2.1 time: 3.794198 Oct 28 19:15:57.767125 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1105/2194] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:53 2022] POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action => generated 0 bytes in 3797 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:15:57.773625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:57.774480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:57.783418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.784677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.785315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.786218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.786885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.787469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.018449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:58.034580 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d4257fcd-ffaa-478c-b2b3-556067076baf tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.265168 Oct 28 19:15:58.035307 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1106/2195] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:57 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:58.058339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:58.064401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:58.074505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.075037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.075471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.076602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.077815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.078664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.101146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c5415e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:58.207236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.211434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.212451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.214521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.215069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.216846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.302830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3362c06-748e-45c6-a836-374f3b15e122 tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445" status: 200 len: 240 microversion: 2.36 time: 0.568431 Oct 28 19:15:58.303511 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1090/2196] 10.222.0.44 () {62 vars in 1303 bytes} [Fri Oct 28 19:15:57 2022] PUT /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445 => generated 240 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:15:58.305035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:58.308976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77c4d1f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:58.314259 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21c371c4-7557-4c22-b4b3-e0e869f5bca4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1504 microversion: 2.1 time: 0.262212 Oct 28 19:15:58.317955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1107/2197] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:58 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:58.334098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5fd3524d-3bd1-4c16-ba13-7b6c61972a11 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '.version_select at 0x7f1d77898670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:58.341737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:58.342740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 7c2940ce-e224-48d5-bed0-b7c3294965fe not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:15:58.343554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.343554 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe HTTP/1.1 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7c2940ce-e224-48d5-bed0-b7c3294965fe'} Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:58.345998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] Oct 28 19:15:58.352495 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.356936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 7c2940ce-e224-48d5-bed0-b7c3294965fe does not exist Oct 28 19:15:58.356936 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-a0f2bbb5-5367-4b40-9a9c-47d6d3ba7573'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:58.358300 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-776a0501-d138-449b-9515-17a52f553b5f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe" status: 404 len: 194 microversion: 2.1 time: 0.053304 Oct 28 19:15:58.362848 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1091/2198] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:58 2022] DELETE /compute/v2.1/os-security-groups/7c2940ce-e224-48d5-bed0-b7c3294965fe => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:58.369024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:58.370033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:58.379194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.380094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.380731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.381733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.382350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.382984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.696895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:58.712931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a628b56-fbc2-48ff-99cf-4a95e928d5a7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.347411 Oct 28 19:15:58.717678 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1092/2199] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:58 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:58.738125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Calling method '.version_select at 0x7f1d77df54c0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:58.934861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.935558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.937376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.938749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.941045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.941646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.992040 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83609858-db0f-4754-809a-ad93ef4ec2fa tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445/detail" status: 200 len: 672 microversion: 2.36 time: 0.271174 Oct 28 19:15:58.993263 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1093/2200] 10.222.0.44 () {60 vars in 1304 bytes} [Fri Oct 28 19:15:58 2022] GET /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445/detail => generated 672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:15:59.010964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:59.020218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:59.035938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:59.038325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:59.038796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:59.040796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:59.041284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:59.043813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:59.216661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca8033be-d8ee-4fba-9ddc-a54ebfbbecc3 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "PUT /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1080 microversion: 2.1 time: 0.221930 Oct 28 19:15:59.222930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1094/2201] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:15:58 2022] PUT /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1080 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:59.243964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77d29ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:59.308950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:15:59.310428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:15:59.311480 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.311480 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf HTTP/1.1 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7d65a79d-6489-4f23-ae2b-cfac0e95a8bf'} Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:15:59.315309 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 7d65a79d-6489-4f23-ae2b-cfac0e95a8bf does not exist Oct 28 19:15:59.321289 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-9280e625-5c7b-4fc4-a448-378cf104aa17'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2621dd61-9925-40da-85d4-8eadec1565ea tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf" status: 404 len: 194 microversion: 2.1 time: 0.096693 Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1095/2202] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:15:59 2022] DELETE /compute/v2.1/os-security-groups/7d65a79d-6489-4f23-ae2b-cfac0e95a8bf => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:59.376193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:59.684400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:59.692616 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bc2d588-c477-4e92-9100-990f0f9b48b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.368939 Oct 28 19:15:59.693194 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1096/2203] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:59 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:59.708710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:59.711729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:59.727648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:59.728801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:59.729245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:59.730263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:59.730788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:59.731917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:59.940565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5fd3524d-3bd1-4c16-ba13-7b6c61972a11 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/082fb8a1-b6a0-4396-a991-8d928d50f894" status: 202 len: 0 microversion: 2.1 time: 1.610762 Oct 28 19:15:59.948286 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1108/2204] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:15:58 2022] DELETE /compute/v2.1/os-floating-ips/082fb8a1-b6a0-4396-a991-8d928d50f894 => generated 0 bytes in 1619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:15:59.953958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Action: 'update', calling method: .version_select at 0x7f1d77898160>, body: {"quota_set": {"ram": "2048"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:59.995778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:00.013786 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b3a4d37e-b59d-408a-aa33-12f014fa53ed tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1506 microversion: 2.1 time: 0.319294 Oct 28 19:16:00.014487 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1097/2205] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:59 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:00.021183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77c52c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.064803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:16:00.066972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 30c75112-e5ad-4b96-91a5-1a39971f081d not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:16:00.067806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.067806 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d HTTP/1.1 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '30c75112-e5ad-4b96-91a5-1a39971f081d'} Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:16:00.077364 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 30c75112-e5ad-4b96-91a5-1a39971f081d does not exist Oct 28 19:16:00.080398 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-3739b621-89ef-4386-b970-3b664b007ee4'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:00.083532 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a7f6ba6-d006-43e2-a865-64392fadf77c tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d" status: 404 len: 194 microversion: 2.1 time: 0.067197 Oct 28 19:16:00.084583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1098/2206] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:16:00 2022] DELETE /compute/v2.1/os-security-groups/30c75112-e5ad-4b96-91a5-1a39971f081d => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:00.100184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.100676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.101107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.101539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.101837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.102287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.102903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.103765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:00.124187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.124902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.133955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.134980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.135594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.136160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.140999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:00.146717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.147423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.148638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.149512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.150157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.150858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.229460 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80f2c03a-7968-4913-b065-3a2a47dc62ec tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445?user_id=e069877c8dc84d85a668899c89168267" status: 200 len: 240 microversion: 2.36 time: 0.279820 Oct 28 19:16:00.230656 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1109/2207] 10.222.0.44 () {62 vars in 1384 bytes} [Fri Oct 28 19:15:59 2022] PUT /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445?user_id=e069877c8dc84d85a668899c89168267 => generated 240 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:16:00.235456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.235944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:00.242804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.243284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.244165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.244394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.245095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.245244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.268411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] HTTP exception thrown: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Request method failure captured: Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 HTTP/1.1 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCm7qOWNrpViyNOz47uGSpAaDon6cOYmaYbdGcQQolSCxZbqP1DBNE4c8nFnKWD4Gy0VeN_HomtFOaslcW4UJIaDrO69vbak4PgWspsQccL9rh2jLidAf3ubhgOBSWZ_K81epzKz4CkMTTLj0mtqkohIjBLUJUwjKaveb3NKME2YQbk Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: af309e15479e445c98da964d87177c25 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/af309e15479e445c98da964d87177c25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_af309e15479e445c98da964d87177c25", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/af309e15479e445c98da964d87177c25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/af309e15479e445c98da964d87177c25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: af309e15479e445c98da964d87177c25 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachSCSIVolumeTestJSON-1539344359-project Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a4f4271240a440e9951810577142f269 Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1539344359-project Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7efddd30-6dca-454a-b51b-f74fe8f42bd1'} Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:00.271490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Returning 404 to user: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c894bd5-55e9-4bce-9c85-189f49c223c7 tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 404 len: 111 microversion: 2.1 time: 0.041141 Oct 28 19:16:00.274257 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1110/2208] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:00 2022] DELETE /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:00.278831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0915833d-666f-4034-9214-98965706b9cb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0915833d-666f-4034-9214-98965706b9cb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Request method failure captured: Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action HTTP/1.1 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 34 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpGNXqqqHI__fab4nkB9cEMeaLfC0tYTT-SyVTKXHuW0fNxSrV1SeFMseaAMmm69Wr_FvpJFVauxm7KxuxBISuB76cz9yIelHW45DLNSyV7q9jfSIjwXhwqfuwiHqxWtPqK7KgolyAXgSRJq537Dp0c2lpKxB65CxOnEmzNVLzXJhM Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2db7df5a30b741e5922edcb7ae29b2d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a82493f4265b487fb0a2437c24c2b777 Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: {"addFloatingIp": {"address": ""}} Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6', 'body': {'addFloatingIp': {'address': ''}}} Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '' Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:16:00.283402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0915833d-666f-4034-9214-98965706b9cb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:00.286847 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0915833d-666f-4034-9214-98965706b9cb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action" status: 400 len: 142 microversion: 2.1 time: 0.010502 Oct 28 19:16:00.290603 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1111/2209] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:00 2022] POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action => generated 142 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:16:00.295821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.296428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:00.304826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.305311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.305737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.306437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.306922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.307339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.536674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:00.550555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48a6a484-f55e-4986-828e-9ae8a6e6b939 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.464591 Oct 28 19:16:00.551792 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1099/2210] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:00 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:00.559389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77c7a160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.625369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:16:00.626983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Neutron security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 not found {{(pid=120629) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:16:00.629245 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.629245 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48 HTTP/1.1 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0e2586a0-c3e0-489c-a1a8-8aaaced56e48'} Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:16:00.633410 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] Oct 28 19:16:00.636773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.640747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Security group 0e2586a0-c3e0-489c-a1a8-8aaaced56e48 does not exist Oct 28 19:16:00.640747 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-b57525f7-1a24-40dc-9d0f-b61b015c84e5'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:00.642257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c99471f0-8be1-48f6-9167-4787e2773bcf tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48" status: 404 len: 194 microversion: 2.1 time: 0.089131 Oct 28 19:16:00.644325 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1100/2211] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:16:00 2022] DELETE /compute/v2.1/os-security-groups/0e2586a0-c3e0-489c-a1a8-8aaaced56e48 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:00.653071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-597b5616-3b70-4319-b2bf-e2b49dba0c3f tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] Calling method '.version_select at 0x7f1d77c523a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.663783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:00.676576 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51431289-47e2-4e77-9db3-294099f02b21 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1506 microversion: 2.1 time: 0.384404 Oct 28 19:16:00.679177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1112/2212] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:00 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:00.690253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.691271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] [instance: 7efddd30-6dca-454a-b51b-f74fe8f42bd1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:00.706040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.706996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.711276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.712451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.713031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.713577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.751641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] HTTP exception thrown: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Request method failure captured: Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 HTTP/1.1 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCm7qOWNrpViyNOz47uGSpAaDon6cOYmaYbdGcQQolSCxZbqP1DBNE4c8nFnKWD4Gy0VeN_HomtFOaslcW4UJIaDrO69vbak4PgWspsQccL9rh2jLidAf3ubhgOBSWZ_K81epzKz4CkMTTLj0mtqkohIjBLUJUwjKaveb3NKME2YQbk Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: af309e15479e445c98da964d87177c25 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/af309e15479e445c98da964d87177c25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_af309e15479e445c98da964d87177c25", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/af309e15479e445c98da964d87177c25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/af309e15479e445c98da964d87177c25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: af309e15479e445c98da964d87177c25 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1539344359 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachSCSIVolumeTestJSON-1539344359-project Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a4f4271240a440e9951810577142f269 Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1539344359-project Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7efddd30-6dca-454a-b51b-f74fe8f42bd1'} Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:00.755233 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] Returning 404 to user: Instance 7efddd30-6dca-454a-b51b-f74fe8f42bd1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f538a106-c6e9-47d6-9e39-9399c56f35ca tempest-AttachSCSIVolumeTestJSON-1539344359 tempest-AttachSCSIVolumeTestJSON-1539344359-project] 10.222.0.44 "GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1" status: 404 len: 111 microversion: 2.1 time: 0.078871 Oct 28 19:16:00.759713 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1113/2213] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:00 2022] GET /compute/v2.1/servers/7efddd30-6dca-454a-b51b-f74fe8f42bd1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:00.770219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:00.772604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:00.791510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.791994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.792422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.793121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.794761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.798950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.820170 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-597b5616-3b70-4319-b2bf-e2b49dba0c3f tempest-QuotasAdminTestV236-120733484 tempest-QuotasAdminTestV236-120733484-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445?user_id=e069877c8dc84d85a668899c89168267" status: 200 len: 282 microversion: 2.36 time: 0.174431 Oct 28 19:16:00.821323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1101/2214] 10.222.0.44 () {60 vars in 1364 bytes} [Fri Oct 28 19:16:00 2022] GET /compute/v2.1/os-quota-sets/c39e63bcb9b14cb19c636f12f3e9e445?user_id=e069877c8dc84d85a668899c89168267 => generated 282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:16:00.836201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:00.846350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:00.853688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.855283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:16:00.855683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquired lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:16:00.863262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.863968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.865116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:00.866042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:00.866934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:00.967420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:01.076606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Releasing lock "refresh_cache-7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:16:01.077739 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] HTTP exception thrown: floating IP not found Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Request method failure captured: Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action HTTP/1.1 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 41 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpGNXqqqHI__fab4nkB9cEMeaLfC0tYTT-SyVTKXHuW0fNxSrV1SeFMseaAMmm69Wr_FvpJFVauxm7KxuxBISuB76cz9yIelHW45DLNSyV7q9jfSIjwXhwqfuwiHqxWtPqK7KgolyAXgSRJq537Dp0c2lpKxB65CxOnEmzNVLzXJhM Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2db7df5a30b741e5922edcb7ae29b2d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a82493f4265b487fb0a2437c24c2b777 Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: exception: floating IP not found Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 28 19:16:01.080313 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 28 19:16:01.086097 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.088450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Returning 404 to user: floating IP not found {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:01.089401 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea02491e-df6a-4236-aafa-54f8db11a4ae tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action" status: 404 len: 67 microversion: 2.1 time: 0.328816 Oct 28 19:16:01.090189 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1114/2215] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:00 2022] POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action => generated 67 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:16:01.102757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:01.103535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:01.119802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.121536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.123091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.124572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.131357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.133301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.189420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:01.247052 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-251d831c-7dad-41bb-bc50-ff25eb51bb8a tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 204 len: 0 microversion: 2.1 time: 0.417414 Oct 28 19:16:01.251991 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1102/2216] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:00 2022] DELETE /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:01.261219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:01.268662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:01.269550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:01.283418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.286365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.287588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.295252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.297581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.298058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.417700 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94a9dbad-7735-4942-b484-2ccec2aae55a tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 204 len: 0 microversion: 2.1 time: 0.325694 Oct 28 19:16:01.419170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1115/2217] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:01 2022] DELETE /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:01.426466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cfb1f63-6753-4070-92c8-316528fa7cfb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:01.539040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4cfb1f63-6753-4070-92c8-316528fa7cfb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cfb1f63-6753-4070-92c8-316528fa7cfb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Request method failure captured: Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action HTTP/1.1 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 44 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpGNXqqqHI__fab4nkB9cEMeaLfC0tYTT-SyVTKXHuW0fNxSrV1SeFMseaAMmm69Wr_FvpJFVauxm7KxuxBISuB76cz9yIelHW45DLNSyV7q9jfSIjwXhwqfuwiHqxWtPqK7KgolyAXgSRJq537Dp0c2lpKxB65CxOnEmzNVLzXJhM Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2db7df5a30b741e5922edcb7ae29b2d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a82493f4265b487fb0a2437c24c2b777 Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: exception: Floating IP not found for address 0.0.0.0. Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 28 19:16:01.542650 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 28 19:16:01.545580 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:01.549055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cfb1f63-6753-4070-92c8-316528fa7cfb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:01.551027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cfb1f63-6753-4070-92c8-316528fa7cfb tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action" status: 404 len: 88 microversion: 2.1 time: 0.130262 Oct 28 19:16:01.552524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1116/2218] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:01 2022] POST /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6/action => generated 88 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:16:01.566935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7b596b68-c7e8-4b92-8a52-caa74c3f3f10 req-d1a37c7e-e408-4ac7-8bd3-9c912decf707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97cc018-7ca5-47e5-98e3-8660906e59f0", "name": "network-vif-plugged", "status": "completed", "tag": "3b562af9-3c8f-4a00-a882-a853357960c8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:01.588377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7b596b68-c7e8-4b92-8a52-caa74c3f3f10 req-d1a37c7e-e408-4ac7-8bd3-9c912decf707 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.591077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7b596b68-c7e8-4b92-8a52-caa74c3f3f10 req-d1a37c7e-e408-4ac7-8bd3-9c912decf707 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.592243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7b596b68-c7e8-4b92-8a52-caa74c3f3f10 req-d1a37c7e-e408-4ac7-8bd3-9c912decf707 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.656898 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7b596b68-c7e8-4b92-8a52-caa74c3f3f10 req-d1a37c7e-e408-4ac7-8bd3-9c912decf707 service nova] Creating event network-vif-plugged:3b562af9-3c8f-4a00-a882-a853357960c8 for instance a97cc018-7ca5-47e5-98e3-8660906e59f0 on n-h2-862769-3 Oct 28 19:16:01.663655 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7b596b68-c7e8-4b92-8a52-caa74c3f3f10 req-d1a37c7e-e408-4ac7-8bd3-9c912decf707 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102303 Oct 28 19:16:01.670948 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1117/2219] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:01.697488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:01.698546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:01.706554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.707412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.707961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.708732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.709318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.709803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.807275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:01.820670 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bab85a3-203e-4aeb-99da-09ebd13aa550 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.563622 Oct 28 19:16:01.836994 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1103/2220] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:01 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:01.848762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:01.849599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:01.872932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.873715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.874511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.875455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:01.876837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:01.877603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:01.925586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:02.018942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Instance is already in deleting state, ignoring this request Oct 28 19:16:02.020409 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b336876-9924-41a0-bc3f-a5a456542652 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 204 len: 0 microversion: 2.1 time: 0.181934 Oct 28 19:16:02.021714 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1104/2221] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:01 2022] DELETE /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:02.029191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:02.029953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:02.036901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.037686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.038320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.039252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.039904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.040554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.080848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:02.135691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:02.148790 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0196040d-5bdb-4150-99b1-b7c026979900 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1646 microversion: 2.1 time: 0.457581 Oct 28 19:16:02.149937 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1118/2222] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:01 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1646 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:02.178733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:02.185700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:02.197103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.198315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.199790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.201840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.202943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.204227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.271210 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-974c3049-942f-49ef-b1fb-573ce09b2eba tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 204 len: 0 microversion: 2.1 time: 0.247225 Oct 28 19:16:02.271804 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1105/2223] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:02 2022] DELETE /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:02.278071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:02.278817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:02.299309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.300159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.300655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.302131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.302998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.303775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.702938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:02.715131 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0949cd21-58ec-45d3-b4c4-ee7278c0f929 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.563385 Oct 28 19:16:02.730002 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1119/2224] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:02 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:02.735576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:02.740001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:02.740711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:02.746860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:02.748842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.749566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.750183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.751287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.751922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.752520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.762819 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2cbc8aaf-c9ad-4354-a829-898a46cd16e6 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1512 microversion: 2.1 time: 0.489661 Oct 28 19:16:02.763480 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1106/2225] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:02 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:02.879896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:02.880855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:02.895476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.896214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.896792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:02.897799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:02.907661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:02.908331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:03.549813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:03.562369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d763e4b3-ecf0-450d-b82c-90c8cf4ad725 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1542 microversion: 2.1 time: 0.830706 Oct 28 19:16:03.575470 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1120/2226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:02 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1542 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:03.597240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:03.598029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:03.606142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:03.609409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:03.609409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:03.609409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:03.609409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:03.609409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:03.764748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:03.774242 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-641316ef-d2e3-4780-b95e-5ddaca7c9ab9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.903942 Oct 28 19:16:03.775443 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1107/2227] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:02 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:03.780618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:03.781459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:03.789090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:03.789965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:03.790546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:03.791438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:03.792135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:03.792705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:04.317250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:04.327645 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-347b7fec-d14c-47ce-b22d-4c86417b2246 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1319 microversion: 2.1 time: 0.550874 Oct 28 19:16:04.333225 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1108/2228] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:03 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:04.343125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:04.343765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:04.358089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:04.359634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:04.362226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:04.365279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:04.365961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:04.366576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:04.397582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:04.413720 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-312c6b42-d7a5-4761-af55-ab3c5ba9f08d tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1646 microversion: 2.1 time: 0.835543 Oct 28 19:16:04.415297 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1121/2229] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:03 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1646 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:04.604429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:04.605153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:04.616541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:04.619815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:04.625642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:04.626638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:04.627242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:04.628949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:04.882089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:04.899033 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-efa769be-3312-48e3-abf4-40cc39c18db4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1512 microversion: 2.1 time: 0.560676 Oct 28 19:16:04.914718 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1109/2230] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:04 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:04.914718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:04.915645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:04.940229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:04.941065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:04.941511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:04.942239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:04.942705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:04.949487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:05.334631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:05.351885 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd47ef50-00ab-42f9-9a04-9c4cac587cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1542 microversion: 2.1 time: 0.751668 Oct 28 19:16:05.354198 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1122/2231] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:04 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1542 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:05.367495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:05.368369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:05.378933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:05.380896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:05.381551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:05.383737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:05.384406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:05.385811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:05.418329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:05.448156 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91a637f3-5c31-44d4-9bca-1eb477b0022f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.542818 Oct 28 19:16:05.449447 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1110/2232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:04 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:05.478808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:05.480319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:05.499161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:05.500132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:05.500786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:05.502021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:05.502954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:05.507313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:05.736790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:05.761908 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e70eded8-f15f-410e-9a04-124ad3c95b27 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1469 microversion: 2.1 time: 0.405295 Oct 28 19:16:05.765219 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1123/2233] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:05 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:06.180369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:06.188523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1932938628", "block_migration": true, "disk_over_commit": false}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:06.191662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:06.195607 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71672640-5383-4f52-bd7b-c180857e7949 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1646 microversion: 2.1 time: 0.742609 Oct 28 19:16:06.198360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1111/2234] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:05 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1646 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:06.210712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.212276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.212761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.213519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.213982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.216141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:06.217167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:06.218244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.229204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.230060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.231218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.234220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.235990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.237285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.285299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lazy-loading 'flavor' on Instance uuid a97cc018-7ca5-47e5-98e3-8660906e59f0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:06.323701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Going to try to live migrate instance to tempest-host-1932938628 {{(pid=120628) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:16:06.346315 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] HTTP exception thrown: Compute host tempest-host-1932938628 could not be found. Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Request method failure captured: Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0/action HTTP/1.1 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 107 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpkdzhNz-7rHWbci8wgQj0MMdHyb5dwK-gSxjtyIwmdURVgek9hHBAV1defGtfPNIaNtDjBbcTRUgEK-7TTU_rqxGdR9ZG8vseVgO7qX-CAEMRx58coKk4GaICcJNb4o5Km1joBS-y1MOwmOIBs6bTg5_XracFTliAF998RxBMfWEI Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48c8b131bdfc40e9a5fe288a72d0f44a Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveMigrationNegativeTest-947540754 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48c8b131bdfc40e9a5fe288a72d0f44a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48c8b131bdfc40e9a5fe288a72d0f44a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48c8b131bdfc40e9a5fe288a72d0f44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48c8b131bdfc40e9a5fe288a72d0f44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveMigrationNegativeTest-947540754 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48c8b131bdfc40e9a5fe288a72d0f44a Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-947540754 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveMigrationNegativeTest-947540754-project-admin Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d003b98de0c4467ba49425e913b51b49 Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveMigrationNegativeTest-947540754-project-admin Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: {"os-migrateLive": {"host": "tempest-host-1932938628", "block_migration": true, "disk_over_commit": false}} Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: exception: Compute host tempest-host-1932938628 could not be found. Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a97cc018-7ca5-47e5-98e3-8660906e59f0', 'body': {'os-migrateLive': {'host': 'tempest-host-1932938628', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 28 19:16:06.370662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1932938628 could not be found. Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1932938628 could not be found. Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1932938628 could not be found. Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:06.373747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Returning 400 to user: Compute host tempest-host-1932938628 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:06.377680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-118a87cf-1b3d-4cce-9aaf-4275b9c3a634 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0/action" status: 400 len: 100 microversion: 2.1 time: 0.587073 Oct 28 19:16:06.378482 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1124/2235] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Oct 28 19:16:05 2022] POST /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0/action => generated 100 bytes in 594 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:16:06.392980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:06.396894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:06.414992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.415718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.416308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.417177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.420443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.421301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.510477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a61d398929c482da48baf1f7ec1c2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f724cbeaab34c56bd952bff01078b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:06.557298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3efaf306-1780-4fa6-8dae-0fd4d214653c tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 200 len: 1470 microversion: 2.1 time: 0.349178 Oct 28 19:16:06.559954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1112/2236] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:06 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 1470 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:06.579585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:06.585154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:06.612234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.622561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.623550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.624659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:06.628750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:06.630402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:06.665352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:06.975184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82493f4265b487fb0a2437c24c2b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2db7df5a30b741e5922edcb7ae29b2d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:06.984368 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57cbc4db-b08c-4066-9c36-c9b5e9e0a070 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 200 len: 1500 microversion: 2.1 time: 0.600515 Oct 28 19:16:06.987990 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1125/2237] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:06 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 1500 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:06.998054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-cc1c0488-5cdb-4fa4-9a12-e10a2f69017f req-1121ec9c-941f-4d71-88c3-2e4e7e884b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6", "name": "network-vif-deleted", "tag": "37243648-5afd-4664-91f4-eed7014ae7c6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:07.021862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cc1c0488-5cdb-4fa4-9a12-e10a2f69017f req-1121ec9c-941f-4d71-88c3-2e4e7e884b50 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.022517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cc1c0488-5cdb-4fa4-9a12-e10a2f69017f req-1121ec9c-941f-4d71-88c3-2e4e7e884b50 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.023175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cc1c0488-5cdb-4fa4-9a12-e10a2f69017f req-1121ec9c-941f-4d71-88c3-2e4e7e884b50 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.056842 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-cc1c0488-5cdb-4fa4-9a12-e10a2f69017f req-1121ec9c-941f-4d71-88c3-2e4e7e884b50 service nova] Creating event network-vif-deleted:37243648-5afd-4664-91f4-eed7014ae7c6 for instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 on n-h2-862769-3 Oct 28 19:16:07.071983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-cc1c0488-5cdb-4fa4-9a12-e10a2f69017f req-1121ec9c-941f-4d71-88c3-2e4e7e884b50 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081470 Oct 28 19:16:07.072461 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1126/2238] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:07.087412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:07.088949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:07.098037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.100151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.100734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.101653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.103227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.103833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.356447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:07.367476 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1810de57-3230-40d1-adac-00b7e2365c2b tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1469 microversion: 2.1 time: 0.803994 Oct 28 19:16:07.374105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1113/2239] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:06 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1469 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:07.395221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-52a8281a-3b1d-430b-9855-0af6568bade6 req-44d252b9-22da-4f3b-8649-3c500a4739e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398", "name": "network-vif-deleted", "tag": "1f58cb5b-d4e4-41ca-81ac-f3589733aedf"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:07.430265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-52a8281a-3b1d-430b-9855-0af6568bade6 req-44d252b9-22da-4f3b-8649-3c500a4739e9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.431222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-52a8281a-3b1d-430b-9855-0af6568bade6 req-44d252b9-22da-4f3b-8649-3c500a4739e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.436038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-52a8281a-3b1d-430b-9855-0af6568bade6 req-44d252b9-22da-4f3b-8649-3c500a4739e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.487286 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-52a8281a-3b1d-430b-9855-0af6568bade6 req-44d252b9-22da-4f3b-8649-3c500a4739e9 service nova] Creating event network-vif-deleted:1f58cb5b-d4e4-41ca-81ac-f3589733aedf for instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 on n-h1-862769-3 Oct 28 19:16:07.512813 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-52a8281a-3b1d-430b-9855-0af6568bade6 req-44d252b9-22da-4f3b-8649-3c500a4739e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134597 Oct 28 19:16:07.514157 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1114/2240] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:07.543689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:07.545884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:07.585087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.586115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.590701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.592836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.594568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.595337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.689107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:07.702919 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61cebd58-c197-4676-9151-c2be7d920ad9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.628852 Oct 28 19:16:07.703756 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1127/2241] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:07 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:07.719378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:07.720230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 904090ce-0d4b-4fc4-99b7-abec57097449] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:07.726390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.727540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.728039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.728556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lazy-loading 'fault' on Instance uuid e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:07.736992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.737526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.737962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.738680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.739180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.751672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.782925 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] HTTP exception thrown: Instance 904090ce-0d4b-4fc4-99b7-abec57097449 could not be found. Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Request method failure captured: Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 HTTP/1.1 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCnIfyw3pdPKAH4AiGyFhLniWProsTcdZ9K2m25kbgH84QLUiWkLggdXtkU-f8l8luWV5wHJbUxvj9uO_S74NHfw1-N9e0xjyRv1pnx-mabGnHuB8w3RtdA62YhddeY4RgB81MJybXWft_-uVMiYKZi6YeYg-vY26kKZGBmfCqJRO1E Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f724cbeaab34c56bd952bff01078b93", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0a61d398929c482da48baf1f7ec1c2f4 Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 904090ce-0d4b-4fc4-99b7-abec57097449 could not be found. Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '904090ce-0d4b-4fc4-99b7-abec57097449'} Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904090ce-0d4b-4fc4-99b7-abec57097449 could not be found. Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904090ce-0d4b-4fc4-99b7-abec57097449 could not be found. Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:07.786157 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904090ce-0d4b-4fc4-99b7-abec57097449 could not be found. Oct 28 19:16:07.789373 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:07.791381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Returning 404 to user: Instance 904090ce-0d4b-4fc4-99b7-abec57097449 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:07.792861 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc3733c0-50f1-4242-8934-e67dad4335bf tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449" status: 404 len: 111 microversion: 2.1 time: 0.086599 Oct 28 19:16:07.793964 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1128/2242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:07 2022] GET /compute/v2.1/servers/904090ce-0d4b-4fc4-99b7-abec57097449 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:07.799301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-239341291", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:07.852031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54eb9513374c415bb4744578d640b888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5ba6ddbf324d7f86f14da325613bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:07.859138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5892cec1-8322-4ab9-8ce4-e1dc802d2652 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 200 len: 1306 microversion: 2.1 time: 0.343502 Oct 28 19:16:07.875053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1115/2243] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:07 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 1306 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:07.882350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:07.883145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:07.890928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:07.895815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:07.928573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.930900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.931847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:07.932989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:07.934703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:07.936091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.047371 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] HTTP exception thrown: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Request method failure captured: Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 HTTP/1.1 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnIfyw3pdPKAH4AiGyFhLniWProsTcdZ9K2m25kbgH84QLUiWkLggdXtkU-f8l8luWV5wHJbUxvj9uO_S74NHfw1-N9e0xjyRv1pnx-mabGnHuB8w3RtdA62YhddeY4RgB81MJybXWft_-uVMiYKZi6YeYg-vY26kKZGBmfCqJRO1E Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f724cbeaab34c56bd952bff01078b93", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 0a61d398929c482da48baf1f7ec1c2f4 Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '3eaaefac-41cf-4e4b-bd0a-264f86c0e163'} Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:08.049184 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.054067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Returning 404 to user: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:08.057045 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-762a0314-a5f7-42b8-894f-df4a7939ccff tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 404 len: 111 microversion: 2.1 time: 0.174394 Oct 28 19:16:08.067409 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1116/2244] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:07 2022] DELETE /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:08.075010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:08.075672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] [instance: 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:08.094642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.094973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.095576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.096435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.097078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.097644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.133553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] HTTP exception thrown: Instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 could not be found. Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Request method failure captured: Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 HTTP/1.1 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCpGNXqqqHI__fab4nkB9cEMeaLfC0tYTT-SyVTKXHuW0fNxSrV1SeFMseaAMmm69Wr_FvpJFVauxm7KxuxBISuB76cz9yIelHW45DLNSyV7q9jfSIjwXhwqfuwiHqxWtPqK7KgolyAXgSRJq537Dp0c2lpKxB65CxOnEmzNVLzXJhM Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2db7df5a30b741e5922edcb7ae29b2d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2db7df5a30b741e5922edcb7ae29b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2db7df5a30b741e5922edcb7ae29b2d7 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: a82493f4265b487fb0a2437c24c2b777 Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 could not be found. Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6'} Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 could not be found. Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 could not be found. Oct 28 19:16:08.141944 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 could not be found. Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.145550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] Returning 404 to user: Instance 7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:08.146136 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d8e9387-c85e-456a-b643-e85d5bca47d9 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488 tempest-FloatingIPsAssociationNegativeTestJSON-1037261488-project] 10.222.0.44 "GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6" status: 404 len: 111 microversion: 2.1 time: 0.077571 Oct 28 19:16:08.159360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1117/2245] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:08 2022] GET /compute/v2.1/servers/7ec9b40f-68c0-49bd-8eca-c12a0b84e6a6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:08.179796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:08.182804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: 3eaaefac-41cf-4e4b-bd0a-264f86c0e163] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:08.198670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.202173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.203792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.206599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.210307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.210307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.255468 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] HTTP exception thrown: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Request method failure captured: Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 HTTP/1.1 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnIfyw3pdPKAH4AiGyFhLniWProsTcdZ9K2m25kbgH84QLUiWkLggdXtkU-f8l8luWV5wHJbUxvj9uO_S74NHfw1-N9e0xjyRv1pnx-mabGnHuB8w3RtdA62YhddeY4RgB81MJybXWft_-uVMiYKZi6YeYg-vY26kKZGBmfCqJRO1E Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f724cbeaab34c56bd952bff01078b93", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 0a61d398929c482da48baf1f7ec1c2f4 Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '3eaaefac-41cf-4e4b-bd0a-264f86c0e163'} Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.257782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Returning 404 to user: Instance 3eaaefac-41cf-4e4b-bd0a-264f86c0e163 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:08.260774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18fdd20b-b5ee-4608-914b-883e56c213c4 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163" status: 404 len: 111 microversion: 2.1 time: 0.097324 Oct 28 19:16:08.268153 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1118/2246] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:08 2022] GET /compute/v2.1/servers/3eaaefac-41cf-4e4b-bd0a-264f86c0e163 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:08.280903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:08.280903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:08.291252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.293764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.296431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.297615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.298148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.299370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.365924 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] HTTP exception thrown: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Request method failure captured: Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 HTTP/1.1 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnIfyw3pdPKAH4AiGyFhLniWProsTcdZ9K2m25kbgH84QLUiWkLggdXtkU-f8l8luWV5wHJbUxvj9uO_S74NHfw1-N9e0xjyRv1pnx-mabGnHuB8w3RtdA62YhddeY4RgB81MJybXWft_-uVMiYKZi6YeYg-vY26kKZGBmfCqJRO1E Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f724cbeaab34c56bd952bff01078b93", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 0a61d398929c482da48baf1f7ec1c2f4 Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd4ab6041-2ed9-40e8-a8fc-809d5022a310'} Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:08.369644 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.372489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Returning 404 to user: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:08.373125 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf13ffc8-298d-4eb7-9d8b-b88112ce5e17 tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 404 len: 111 microversion: 2.1 time: 0.102100 Oct 28 19:16:08.384400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1119/2247] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:08 2022] DELETE /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:08.398310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:08.399974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] [instance: d4ab6041-2ed9-40e8-a8fc-809d5022a310] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:08.431849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.433410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.435125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.437535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.438317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.439197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.480668 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] HTTP exception thrown: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Request method failure captured: Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 HTTP/1.1 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCnIfyw3pdPKAH4AiGyFhLniWProsTcdZ9K2m25kbgH84QLUiWkLggdXtkU-f8l8luWV5wHJbUxvj9uO_S74NHfw1-N9e0xjyRv1pnx-mabGnHuB8w3RtdA62YhddeY4RgB81MJybXWft_-uVMiYKZi6YeYg-vY26kKZGBmfCqJRO1E Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f724cbeaab34c56bd952bff01078b93", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f724cbeaab34c56bd952bff01078b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2f724cbeaab34c56bd952bff01078b93 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-467266627 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 0a61d398929c482da48baf1f7ec1c2f4 Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerDiskConfigTestJSON-467266627-project Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd4ab6041-2ed9-40e8-a8fc-809d5022a310'} Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:08.484093 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. Oct 28 19:16:08.492382 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:08.495124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] Returning 404 to user: Instance d4ab6041-2ed9-40e8-a8fc-809d5022a310 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:08.497182 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77343659-e918-4c44-be94-ee37f7417ccd tempest-ServerDiskConfigTestJSON-467266627 tempest-ServerDiskConfigTestJSON-467266627-project] 10.222.0.44 "GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310" status: 404 len: 111 microversion: 2.1 time: 0.110463 Oct 28 19:16:08.505481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1120/2248] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:08 2022] GET /compute/v2.1/servers/d4ab6041-2ed9-40e8-a8fc-809d5022a310 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:08.738920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:08.741239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:08.763906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.767443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.767894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.768666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:08.769194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:08.769619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:08.973061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:09.103442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:09.104218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:09.105223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:09.105996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:09.111755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:09.135034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:09.143124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:09.145175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:09.147094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:09.148040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:09.150493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:09.198410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Getting quotas for project 1d288edc66234feb87c8b8df1aee1fe0. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:09.205799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Getting quotas for user 602f76b746d64eb9b59a52f2388a2312 and project 1d288edc66234feb87c8b8df1aee1fe0. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:09.229961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:09.235312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:09.322811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d66c95e4-8b1d-4fd4-9f35-f06389179903 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527331 Oct 28 19:16:09.332984 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1129/2249] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:09.340422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:09.341652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] [instance: e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:09.351787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:09.353560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:09.357256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:09.363634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:09.367812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:09.368379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:09.406862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] HTTP exception thrown: Instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 could not be found. Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Request method failure captured: Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 HTTP/1.1 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCn6SQCUurvu3VOMuZ9WVRbR1FFFyed-l-LYE0Pd1QQTTu3u8BNM8OBMFddfYwadmsfozqAEF8ROOqYK0v3K3IT7oJSGXDEegTRPGJkGOsYIbipFSd14AsQvPpWOzc7-3g5LWFZsoYRw1GTboWWayWvw35NgmEtJROKSHUuMuBWqBXU Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c5ba6ddbf324d7f86f14da325613bd3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c5ba6ddbf324d7f86f14da325613bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9c5ba6ddbf324d7f86f14da325613bd3 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-126727517 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 54eb9513374c415bb4744578d640b888 Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupsTestJSON-126727517-project Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 could not be found. Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398'} Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 could not be found. Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 could not be found. Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:09.412643 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 could not be found. Oct 28 19:16:09.415940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:09.420407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Returning 404 to user: Instance e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:09.421749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ccd21700-0425-4dde-9231-7d613b25fdc1 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398" status: 404 len: 111 microversion: 2.1 time: 0.086406 Oct 28 19:16:09.424417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1130/2250] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:09 2022] GET /compute/v2.1/servers/e3c79c0c-bbbd-4ca3-a7ea-d0f84615d398 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:09.438165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2f1695d8-7834-40fc-8d36-7343cab403bd req-5ddedd2b-7d89-4360-93d0-0c69abf73919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904090ce-0d4b-4fc4-99b7-abec57097449", "name": "network-vif-deleted", "tag": "50dadf91-1450-49e8-be90-82fae7584731"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:09.473132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2f1695d8-7834-40fc-8d36-7343cab403bd req-5ddedd2b-7d89-4360-93d0-0c69abf73919 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:09.474068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2f1695d8-7834-40fc-8d36-7343cab403bd req-5ddedd2b-7d89-4360-93d0-0c69abf73919 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:09.474972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2f1695d8-7834-40fc-8d36-7343cab403bd req-5ddedd2b-7d89-4360-93d0-0c69abf73919 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:09.503689 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2f1695d8-7834-40fc-8d36-7343cab403bd req-5ddedd2b-7d89-4360-93d0-0c69abf73919 service nova] Creating event network-vif-deleted:50dadf91-1450-49e8-be90-82fae7584731 for instance 904090ce-0d4b-4fc4-99b7-abec57097449 on n-h1-862769-3 Oct 28 19:16:09.516797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2f1695d8-7834-40fc-8d36-7343cab403bd req-5ddedd2b-7d89-4360-93d0-0c69abf73919 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090340 Oct 28 19:16:09.518016 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1131/2251] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:09.544893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dda1c77f-ece0-432c-b388-b72fd0dea018 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:09.546123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dda1c77f-ece0-432c-b388-b72fd0dea018 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:09.989704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dda1c77f-ece0-432c-b388-b72fd0dea018 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:10.010214 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dda1c77f-ece0-432c-b388-b72fd0dea018 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1218 microversion: 2.1 time: 0.490624 Oct 28 19:16:10.012702 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1132/2252] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:09 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1218 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:10.029543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-debb43b8-4f17-4a8c-8551-ef2b79cb4b48 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77a1c040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:10.332456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:10.345046 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ddb92bc-8cb7-463d-8056-500a7fcced19 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 1.618592 Oct 28 19:16:10.347307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1121/2253] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:08 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:10.865286 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-debb43b8-4f17-4a8c-8551-ef2b79cb4b48 tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/0d04cea0-7439-4d3f-bf08-0a280e423aa8" status: 202 len: 0 microversion: 2.1 time: 0.849831 Oct 28 19:16:10.884188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1133/2254] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:16:10 2022] DELETE /compute/v2.1/os-security-groups/0d04cea0-7439-4d3f-bf08-0a280e423aa8 => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:10.892998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a08d7196-1515-4f38-b87e-8ced3c8ef02f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] Calling method '.version_select at 0x7f1d77cf2670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:10.899199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=94 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:11.037157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:11.038085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:11.046371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:11.051428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:11.052037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:11.052916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:11.055704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:11.056370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:11.253071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:11.266858 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99262c3f-efee-4464-94bd-581dd85875a1 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1270 microversion: 2.1 time: 0.235097 Oct 28 19:16:11.268306 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1134/2255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:11 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:11.390426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:11.391477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:11.398587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:11.399408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:11.400796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:11.401753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:11.402384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:11.403035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:11.935829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:11.962608 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28d3ed88-6bd2-4bba-937f-3dacb55d3701 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 0.576285 Oct 28 19:16:11.967204 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1135/2256] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:11 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:12.108274 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a08d7196-1515-4f38-b87e-8ced3c8ef02f tempest-SecurityGroupsTestJSON-126727517 tempest-SecurityGroupsTestJSON-126727517-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/e3c83714-afe4-4401-9630-68c7f65f8ceb" status: 202 len: 0 microversion: 2.1 time: 1.219466 Oct 28 19:16:12.108978 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1122/2257] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:16:10 2022] DELETE /compute/v2.1/os-security-groups/e3c83714-afe4-4401-9630-68c7f65f8ceb => generated 0 bytes in 1221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:12.304928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:12.306345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:12.339450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:12.341021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:12.342663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:12.347008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:12.350012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:12.352801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:12.553460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:12.595037 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a92561a6-d68c-46d9-8130-b424e88c5c94 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1276 microversion: 2.1 time: 0.296364 Oct 28 19:16:12.599025 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1123/2258] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:12 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:12.905068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d98bdd61-44dd-4c62-ac73-f76690df9ffd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: .version_select at 0x7f1d779fb790>, body: {"keypair": {"name": "tempest-keypair-1220413427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgxgBx944YBU3kz4+GVytnNG1+ge6C/BQ0P9wFHDIgdSNbjIiahdyrtpWNXK78HPL8ldiz2y3SzlOkkpg2APgUmkBrI895LxcYvUT1PnEDWpHfBA8J3iqX9ORunNaME9w=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:12.962123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d98bdd61-44dd-4c62-ac73-f76690df9ffd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:12.982716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d98bdd61-44dd-4c62-ac73-f76690df9ffd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for user 7a3f354a00cf468ca48261a56f68c410 and project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:12.995029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:13.003990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:13.042837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:13.047731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:13.048368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:13.050339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:13.056086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:13.058602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:13.173759 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d98bdd61-44dd-4c62-ac73-f76690df9ffd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.911307 Oct 28 19:16:13.176180 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1136/2259] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:13.622406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:13.623115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:13.634573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:13.636563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:13.637962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:13.640696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:13.641228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:13.641821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:14.586491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:14.595920 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2be84d4-91e6-4d65-b8b3-09e684465f36 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1276 microversion: 2.1 time: 0.978123 Oct 28 19:16:14.607554 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1137/2260] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:13 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1276 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:14.615751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:14.628789 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4860a68-a5a7-4654-bd57-81e5aef04230 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 1.638369 Oct 28 19:16:14.629607 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1124/2261] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:12 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:15.631242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:15.633344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:15.655498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:15.672010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:15.672471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:15.682988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:15.685437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:15.688670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:15.983139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:15.985955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:15.997678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:15.998968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:16.000980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:16.002419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:16.009284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:16.010040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:16.961201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:16.986245 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ae4520c-e695-455d-aee6-d20e56898e24 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 1.358588 Oct 28 19:16:16.987219 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1138/2262] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:15 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:17.126519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:17.146554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0cc1c01-f31e-4620-be40-9d4674374c8d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 1.489325 Oct 28 19:16:17.151319 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1125/2263] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:15 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:18.021966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:18.025095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:18.046158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:18.046720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:18.047994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:18.051034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:18.051617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:18.052756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:18.102271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:18.181764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:18.182424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:18.197002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:18.199950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:18.200420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:18.203182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:18.204332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:18.204769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:19.175092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=7 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:19.519837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:19.543109 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35ea518c-5aa2-45cb-bff6-5f4eeb3f892a tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 1.531033 Oct 28 19:16:19.560271 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1139/2264] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:18 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:19.846855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:19.880342 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc47aa09-50ff-494a-b6bb-b68dff3b099c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1513 microversion: 2.1 time: 1.703211 Oct 28 19:16:19.881296 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1126/2265] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:18 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1513 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:19.898953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1759411740", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:20.073554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:20.280112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-335237618", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c18f971-8016-410f-b296-e7a7c373023b"}], "security_groups": [{"name": "tempest-securitygroup--1250998673"}], "key_name": "tempest-keypair-1220413427", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:20.789933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] validate_networks() for [('3c18f971-8016-410f-b296-e7a7c373023b', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:21.109981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:21.111447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:21.112243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:21.113902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:21.114939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:21.134953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:21.135685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:21.136274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:21.139815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:21.141509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:21.142235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:21.183501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Getting quotas for project 046929f0d0b44a3191ed57f9d72d2dff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:21.191087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Getting quotas for user fe4df4ef5bf94c9393f0f8b82c86eb1d and project 046929f0d0b44a3191ed57f9d72d2dff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:21.208375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:21.212091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:21.297521 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4043dae7-1770-4837-89c4-75c818d14e30 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733974 Oct 28 19:16:21.302813 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1140/2266] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:21.307852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:21.308489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:21.348876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:21.349379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:21.349821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:21.350591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:21.351073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:21.351492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:22.246151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:22.269992 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba0e49bf-6d96-41dd-966f-d3631eb97547 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 0.965913 Oct 28 19:16:22.280588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1141/2267] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:21 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:22.291626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:22.292372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:22.302843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:22.303499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:22.304030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:22.305287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:22.306025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:22.306675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:22.863983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:22.877426 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-afadc259-8f4d-4c7f-a9c0-db61c5d97363 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1490 microversion: 2.1 time: 0.591371 Oct 28 19:16:22.878968 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1142/2268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:22 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1490 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:22.885700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-616698952", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:22.966618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:23.880240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:23.880815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:23.881172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:23.883216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:23.884084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:23.907102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:23.910896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:23.912875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:23.915308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:23.917904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:23.920343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:23.982527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:23.999724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for user 7a3f354a00cf468ca48261a56f68c410 and project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:24.041938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:24.042045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:24.042045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:24.042045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:24.042045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:24.042607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:24.042729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:24.054008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.054505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.054983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.058812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.059305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.059741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.102121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Getting quotas for project 046929f0d0b44a3191ed57f9d72d2dff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:24.113816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Getting quotas for user fe4df4ef5bf94c9393f0f8b82c86eb1d and project 046929f0d0b44a3191ed57f9d72d2dff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:24.138313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:24.140621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:24.193999 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fcdd527-4ad2-4b3d-be38-30c3751ce699 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.917861 Oct 28 19:16:24.194748 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1127/2269] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:24.205166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2190b18e-c09a-48b8-9bf5-12f3bc105f20 req-40ab383e-18c0-48ef-ae7e-c85a6ed12bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33475b0-ec29-4429-af74-980fd7de4d8c", "tag": "4c1277b8-a1e3-4ca6-88b0-f0eb8bc002be"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:24.261688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2190b18e-c09a-48b8-9bf5-12f3bc105f20 req-40ab383e-18c0-48ef-ae7e-c85a6ed12bdd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.262178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2190b18e-c09a-48b8-9bf5-12f3bc105f20 req-40ab383e-18c0-48ef-ae7e-c85a6ed12bdd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.262598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2190b18e-c09a-48b8-9bf5-12f3bc105f20 req-40ab383e-18c0-48ef-ae7e-c85a6ed12bdd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.294567 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-89edfd1f-897a-4fbb-9a24-de4a9504d8e0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413620 Oct 28 19:16:24.295493 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1143/2270] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:24.313614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:24.318920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:24.323827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2190b18e-c09a-48b8-9bf5-12f3bc105f20 req-40ab383e-18c0-48ef-ae7e-c85a6ed12bdd service nova] Creating event network-changed:4c1277b8-a1e3-4ca6-88b0-f0eb8bc002be for instance e33475b0-ec29-4429-af74-980fd7de4d8c on n-h1-862769-3 Oct 28 19:16:24.342930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:24.345164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.346076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.347021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.348680 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2190b18e-c09a-48b8-9bf5-12f3bc105f20 req-40ab383e-18c0-48ef-ae7e-c85a6ed12bdd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152411 Oct 28 19:16:24.351408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.352041 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1128/2271] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:24.357730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:24.358448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:24.366971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.367754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.375725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.376226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.376667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.377385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.377842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.378297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.506089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:24.702865 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fdeab08f-b853-4cca-98ec-d9d46dbfceb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 204 len: 0 microversion: 2.1 time: 0.395358 Oct 28 19:16:24.704714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1144/2272] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:24 2022] DELETE /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:24.720680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-533916d9-5639-4e94-bb4d-8a93884bea1d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:24.721476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-533916d9-5639-4e94-bb4d-8a93884bea1d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:25.021046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:25.031321 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bdeb160-1a03-40e9-b741-eeb4149b220e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 0.677922 Oct 28 19:16:25.037104 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1129/2273] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:24 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:25.054786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-309ac2dc-4575-42e2-afe3-c24bc8ba7bdb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:25.055898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-309ac2dc-4575-42e2-afe3-c24bc8ba7bdb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:25.153633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-533916d9-5639-4e94-bb4d-8a93884bea1d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:25.177749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-533916d9-5639-4e94-bb4d-8a93884bea1d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1237 microversion: 2.1 time: 0.467202 Oct 28 19:16:25.198026 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1145/2274] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:24 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1237 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:25.205715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:25.206399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:25.230708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:25.231323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:25.231782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:25.233629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:25.236804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:25.237564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:25.295376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-309ac2dc-4575-42e2-afe3-c24bc8ba7bdb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:25.306651 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-309ac2dc-4575-42e2-afe3-c24bc8ba7bdb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1213 microversion: 2.1 time: 0.264536 Oct 28 19:16:25.315991 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1130/2275] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:25 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1213 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:25.609368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:25.628653 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7522d3e1-d708-4155-b6f4-9b9f4d734f37 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1496 microversion: 2.1 time: 0.427242 Oct 28 19:16:25.633222 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1146/2276] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:25 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1496 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:25.805182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b9d202bb-8868-4813-b6d5-9edc7464ffcc tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:25.816456 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b9d202bb-8868-4813-b6d5-9edc7464ffcc tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.181775 Oct 28 19:16:25.817049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1131/2277] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:16:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:16:26.066300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:26.067545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:26.117680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.120453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.122223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.125583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.129653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.130254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.205386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:26.206076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:26.226503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.227288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.227874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.228741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.229341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.229907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.412654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:26.431380 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40f1e11e-4d84-4de5-9c99-dc1b0822a043 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1241 microversion: 2.1 time: 0.230428 Oct 28 19:16:26.431972 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1132/2278] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:26 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1241 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:26.439329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:26.439822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:26.454063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.454892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.455503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.456466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.461395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.462167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.654291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:26.665763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:26.673553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4fde9c0c-7f4a-437e-ba2b-65f4b0b1d729 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1217 microversion: 2.1 time: 0.240469 Oct 28 19:16:26.674991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2a4acf3-8863-4783-b69d-8f86b19eccec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 0.620041 Oct 28 19:16:26.675657 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1147/2279] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:26 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:26.686972 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1133/2280] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:26 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:26.694027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:26.694027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:26.709593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.712637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.713478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.716896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.718946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.720763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.115067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9aeeb9e-38f5-4003-848b-007baee81c25 tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-27315366", "imageRef": "6239504a-c1ab-4aa6-9342-824cbe1041da", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:27.198425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:27.218349 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f536c515-037c-45cc-9ed2-1a380d83abeb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1496 microversion: 2.1 time: 0.533941 Oct 28 19:16:27.219674 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1134/2281] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:26 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1496 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:27.228970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-b9aeeb9e-38f5-4003-848b-007baee81c25 tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:27.462724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:27.464642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:27.482036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.484559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.485404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.488179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.489633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.491509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.649593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:27.678530 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6d158510-a096-4d4b-aa02-e0fc0890595f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1233 microversion: 2.1 time: 0.226223 Oct 28 19:16:27.680001 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1135/2282] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:27 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1233 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:27.702476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:27.703450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:27.710776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.711584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.712255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.713166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.713982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.714606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.757973 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b9aeeb9e-38f5-4003-848b-007baee81c25 tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9aeeb9e-38f5-4003-848b-007baee81c25 tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] Request method failure captured: Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 141 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqJgk_9hYXe5Q6YO637sDcRcsLXM9qLEvqUIheER78idooAWQU9T2ZLph97CylbVKS0ph2Zu-_WGlUK1nfDJHEYyI1UReKTgWVCZ2gIb6aWnC23aPQtfIW4OWa1TDWHj4ZzC6EdjxLoy4awHn4Of2zjZTxvPcpNnQXVT1bqWo38hHs Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: a332582d66db4bf79f127475cd91accb Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-FlavorsV2NegativeTest-258251146 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a332582d66db4bf79f127475cd91accb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a332582d66db4bf79f127475cd91accb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a332582d66db4bf79f127475cd91accb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a332582d66db4bf79f127475cd91accb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-FlavorsV2NegativeTest-258251146 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: a332582d66db4bf79f127475cd91accb Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-258251146 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-FlavorsV2NegativeTest-258251146-project Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ce6366c9bb13437887eddcf1656fb8d3 Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-FlavorsV2NegativeTest-258251146-project Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-27315366", "imageRef": "6239504a-c1ab-4aa6-9342-824cbe1041da", "flavorRef": "452"}} Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: exception: Flavor's memory is too small for requested image. Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-27315366', 'imageRef': '6239504a-c1ab-4aa6-9342-824cbe1041da', 'flavorRef': '452'}}} Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:27.760260 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9aeeb9e-38f5-4003-848b-007baee81c25 tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9aeeb9e-38f5-4003-848b-007baee81c25 tempest-FlavorsV2NegativeTest-258251146 tempest-FlavorsV2NegativeTest-258251146-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.650917 Oct 28 19:16:27.765139 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1148/2283] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:27 2022] POST /compute/v2.1/servers => generated 93 bytes in 653 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 19:16:27.775224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:27.776980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:27.801721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.802163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.802612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.803371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.803828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.807748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.040415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:28.049939 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a5b7952-5999-41fa-a131-be05520740e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1265 microversion: 2.1 time: 0.285920 Oct 28 19:16:28.066376 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1149/2284] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:27 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:28.189394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-05c34ad8-5791-4928-b2d1-f411bb24612d req-3d846115-4e5b-409a-a0df-77e26d1e0fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:28.249712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05c34ad8-5791-4928-b2d1-f411bb24612d req-3d846115-4e5b-409a-a0df-77e26d1e0fad service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.258616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05c34ad8-5791-4928-b2d1-f411bb24612d req-3d846115-4e5b-409a-a0df-77e26d1e0fad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.263143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05c34ad8-5791-4928-b2d1-f411bb24612d req-3d846115-4e5b-409a-a0df-77e26d1e0fad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.304366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-05c34ad8-5791-4928-b2d1-f411bb24612d req-3d846115-4e5b-409a-a0df-77e26d1e0fad service nova] Creating event network-changed:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:16:28.324273 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-05c34ad8-5791-4928-b2d1-f411bb24612d req-3d846115-4e5b-409a-a0df-77e26d1e0fad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146196 Oct 28 19:16:28.334765 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1150/2285] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:16:28.350221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:28.354350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:28.366513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.373920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.377617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.378875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.380546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.382093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.548650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:28.560138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c85eb27-785c-4cf3-af3d-3f2d1454078d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 0.862460 Oct 28 19:16:28.579311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1136/2286] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:27 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:28.703692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:28.705536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:28.723670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.725497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.727708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.731779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.732412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.733345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.068437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:29.087980 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-713af810-af53-4899-bbb5-d2baa1f968b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1496 microversion: 2.1 time: 0.746740 Oct 28 19:16:29.089262 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1151/2287] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:28 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1496 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:29.101273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:29.102894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:29.108292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:29.110404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:29.110926 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef324f2a-b880-4d8a-aaea-a295b9a029f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1297 microversion: 2.1 time: 0.412431 Oct 28 19:16:29.111666 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1137/2288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:28 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1297 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:29.131778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:29.135851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:29.136609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.139239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:29.139741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:29.140198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.369554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:29.387894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-051bb792-780a-46c6-a10c-4779c57d58aa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1271 microversion: 2.1 time: 0.295022 Oct 28 19:16:29.388530 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1152/2289] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:29 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:29.586053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:29.586839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:29.609454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:29.612725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:29.613970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.616378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:29.619058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:29.620814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.114780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:30.116260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:30.129162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.130928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.132874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.138070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.140299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.145644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.226323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.226872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.231543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.232160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lazy-loading 'fault' on Instance uuid aea55ae1-785f-4e88-810d-6b0ada2a6141 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:30.476985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:30.491033 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af09ad69-ce56-4cb9-bb8d-b4899d533841 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 200 len: 1305 microversion: 2.1 time: 0.381090 Oct 28 19:16:30.491810 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1153/2290] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:30 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 1305 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:30.496960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:30.503576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:30.516056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.516785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.517366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.518448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.519163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.519741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.749125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:30.758224 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f35a3b50-fbad-4e2c-86d1-29bb468eb7a3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1295 microversion: 2.1 time: 0.264408 Oct 28 19:16:30.768099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:30.771728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1154/2291] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:30 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:30.779872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af6deece-f691-4781-aee6-10970f63b3f0 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 1.199316 Oct 28 19:16:30.780088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8bf803a5-5182-4db4-b2a7-7136206ae960 req-48083a53-7a1b-4bdb-b397-d8eda8b527ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33475b0-ec29-4429-af74-980fd7de4d8c", "name": "network-vif-plugged", "status": "completed", "tag": "4c1277b8-a1e3-4ca6-88b0-f0eb8bc002be"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:30.791045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8bf803a5-5182-4db4-b2a7-7136206ae960 req-48083a53-7a1b-4bdb-b397-d8eda8b527ba service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.792230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8bf803a5-5182-4db4-b2a7-7136206ae960 req-48083a53-7a1b-4bdb-b397-d8eda8b527ba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.792858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8bf803a5-5182-4db4-b2a7-7136206ae960 req-48083a53-7a1b-4bdb-b397-d8eda8b527ba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.796753 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1138/2292] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:29 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:30.804307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1c13a9a1-707b-41eb-a782-ad15a5e0ec9a req-10db13bf-924e-42ee-b623-910ae008b3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea55ae1-785f-4e88-810d-6b0ada2a6141", "name": "network-vif-deleted", "tag": "0c708e99-a16c-4074-b83d-8fdc3202bc18"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:30.806647 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8bf803a5-5182-4db4-b2a7-7136206ae960 req-48083a53-7a1b-4bdb-b397-d8eda8b527ba service nova] Creating event network-vif-plugged:4c1277b8-a1e3-4ca6-88b0-f0eb8bc002be for instance e33475b0-ec29-4429-af74-980fd7de4d8c on n-h1-862769-3 Oct 28 19:16:30.813569 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8bf803a5-5182-4db4-b2a7-7136206ae960 req-48083a53-7a1b-4bdb-b397-d8eda8b527ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040141 Oct 28 19:16:30.815229 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1155/2293] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:30.821744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:30.823401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:30.824768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1c13a9a1-707b-41eb-a782-ad15a5e0ec9a req-10db13bf-924e-42ee-b623-910ae008b3f4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.825600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1c13a9a1-707b-41eb-a782-ad15a5e0ec9a req-10db13bf-924e-42ee-b623-910ae008b3f4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.827827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1c13a9a1-707b-41eb-a782-ad15a5e0ec9a req-10db13bf-924e-42ee-b623-910ae008b3f4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.831870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.833073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.833780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.834782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.835448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.836125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.867873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1c13a9a1-707b-41eb-a782-ad15a5e0ec9a req-10db13bf-924e-42ee-b623-910ae008b3f4 service nova] Creating event network-vif-deleted:0c708e99-a16c-4074-b83d-8fdc3202bc18 for instance aea55ae1-785f-4e88-810d-6b0ada2a6141 on n-h1-862769-3 Oct 28 19:16:30.883922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1c13a9a1-707b-41eb-a782-ad15a5e0ec9a req-10db13bf-924e-42ee-b623-910ae008b3f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085759 Oct 28 19:16:30.884947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1139/2294] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:31.424764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:31.433625 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5249acff-82f5-4e8f-8e23-fd8068dc442a tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1271 microversion: 2.1 time: 0.616398 Oct 28 19:16:31.434212 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1156/2295] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:30 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1271 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:31.519222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:31.520010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:31.526917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:31.527709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:31.528145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:31.528846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:31.529290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:31.529712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:31.554170 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 HTTP/1.1 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aea55ae1-785f-4e88-810d-6b0ada2a6141'} Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:31.556371 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:16:31.560369 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:31.561127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:31.562223 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc5b7e26-c832-412b-9d4a-33ea4e503aa2 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 404 len: 111 microversion: 2.1 time: 0.047473 Oct 28 19:16:31.571828 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1140/2296] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:31 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:31.702347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-997586501", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b77f98ab-697f-4ba7-8baa-9ce113d2c2eb"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:31.786490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:31.787589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:31.805647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:31.806713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:31.807371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:31.807686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] validate_networks() for [('b77f98ab-697f-4ba7-8baa-9ce113d2c2eb', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:31.809564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:31.810348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:31.811639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.097425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:32.113303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-57467443-38e9-498e-b7ec-5ec4065e328c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1295 microversion: 2.1 time: 0.331719 Oct 28 19:16:32.114033 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1141/2297] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:31 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1295 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:32.129792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:32.130478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:32.147782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.150314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.150825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.156447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.157146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.157824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:33.527874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:33.540279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-615e40ee-4375-45f1-9443-c9bbcec8d01e tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1318 microversion: 2.1 time: 1.423471 Oct 28 19:16:33.543772 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1142/2298] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:32 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1318 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:33.548927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:33.549984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:33.561513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:33.562227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:33.562826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:33.563709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:33.564299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:33.564853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:33.957410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:34.081598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:34.220248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:34.232039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-849a5c14-9431-4e95-9921-d5883c08d035 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.686934 Oct 28 19:16:34.234437 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1143/2299] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:33 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:34.246514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:34.247624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:34.270100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.272743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.274838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.275851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.276446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.276978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.574561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:34.575669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:34.576357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:34.577028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:34.577589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:34.592154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=39 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:34.594996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.595764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.596351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.597396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.597954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.598473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.636689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:34.648498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Getting quotas for user 9810c2ad77cf46e39987a29f64c2b0fe and project 93607878d8054461ac3df081a4803b81. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:34.670712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:34.673281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:34.754817 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d77b052-0f73-4d47-8a27-80301e2b461e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.056365 Oct 28 19:16:34.756492 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1157/2300] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:34.776108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e584ddc-078a-461e-a2a6-73c5c19e2f11 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d777c3040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:34.860780 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2e584ddc-078a-461e-a2a6-73c5c19e2f11 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085" status: 200 len: 636 microversion: 2.1 time: 0.103082 Oct 28 19:16:34.874003 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1158/2301] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:16:34 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085 => generated 636 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:34.881506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:34.882189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:34.891061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.892327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.892782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.895955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.896526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.896964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:35.300391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:35.430760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:35.443691 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-669a84b4-e996-4423-9748-047ab2487005 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 1.205457 Oct 28 19:16:35.461855 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1144/2302] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:34 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:35.467327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bcfbdca7-dccb-468d-a0b6-e7247bccf15e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:35.468038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bcfbdca7-dccb-468d-a0b6-e7247bccf15e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:35.637165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bcfbdca7-dccb-468d-a0b6-e7247bccf15e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:35.643816 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bcfbdca7-dccb-468d-a0b6-e7247bccf15e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1214 microversion: 2.1 time: 0.180613 Oct 28 19:16:35.645608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1145/2303] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:35 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:35.669479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-300f8150-5186-423b-b180-e4076f23aced tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d77aa1a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:35.747570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-300f8150-5186-423b-b180-e4076f23aced tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:35.758002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-300f8150-5186-423b-b180-e4076f23aced tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:35.789416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:35.799869 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba337bf4-afe1-45a5-9703-afc58e6a6879 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1467 microversion: 2.1 time: 0.924383 Oct 28 19:16:35.811871 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1159/2304] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:34 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1467 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:35.817191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:35.818790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:35.829590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:35.830218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:35.830867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:35.831746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:35.834854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:35.835409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:35.841866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:36.249198 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-300f8150-5186-423b-b180-e4076f23aced tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.582906 Oct 28 19:16:36.250636 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1146/2305] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:35 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:36.255972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:36.256748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:36.275027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.275838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.276418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.277307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.277890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.278416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.303951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lazy-loading 'flavor' on Instance uuid e33475b0-ec29-4429-af74-980fd7de4d8c {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:36.365720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:36.386635 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63175af3-2954-4093-ad8b-ead780d3bc80 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.133975 Oct 28 19:16:36.387513 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3040cc6d-a811-44fb-a1dc-ad2ccb7fadfb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.570947 Oct 28 19:16:36.389172 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1147/2306] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:36 2022] POST /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:36.405275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25466967-6291-4f04-bb19-32bd52473901 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d77aa1ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:36.406931 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1160/2307] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:35 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:36.422776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:36.425088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:36.446042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.446804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.447389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.448658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.449258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.452327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.753545 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25466967-6291-4f04-bb19-32bd52473901 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "DELETE /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.362242 Oct 28 19:16:36.754455 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1148/2308] 10.222.0.44 () {58 vars in 1296 bytes} [Fri Oct 28 19:16:36 2022] DELETE /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata/os_version => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:36.761242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:36.762350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:36.770063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.770886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.771539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.772502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.773174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.773861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.006011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:37.032251 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4cc0bc6-50a1-4e04-b3a4-436f04d8e40f tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1475 microversion: 2.1 time: 0.623504 Oct 28 19:16:37.064103 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1161/2309] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:36 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1475 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:37.089222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:37.091198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:37.101883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.102491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.103051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.104618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.105727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.106462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.297822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:37.333358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21c7c1dd-1afc-4e2e-9a35-1f86e321b358 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1272 microversion: 2.1 time: 0.259061 Oct 28 19:16:37.333956 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1162/2310] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:37 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:37.348720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d78b9596-d793-4b52-b981-347b3eeb4bd1 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d7783b280>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:37.409161 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d78b9596-d793-4b52-b981-347b3eeb4bd1 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070578 Oct 28 19:16:37.411107 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1163/2311] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:16:37 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 37 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:37.418646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:37.420799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:37.429459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.430263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.431934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.434234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.435086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.435687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.509355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:37.522015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cfd6c91a-a258-4adc-b4a8-145d6d737eaa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.766105 Oct 28 19:16:37.523739 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1149/2312] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:36 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:37.533239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2657603-c1d4-4bf1-aed1-ed7a9861c77b tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d7ff74dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:37.612506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d2657603-c1d4-4bf1-aed1-ed7a9861c77b tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:37.620678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d2657603-c1d4-4bf1-aed1-ed7a9861c77b tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:37.833769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:37.848909 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c5eb42a5-d15a-447c-88d2-ceb75b3ad649 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.431170 Oct 28 19:16:37.849804 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1164/2313] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:37 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:37.869549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e3e6905b-ed64-4444-b995-2332a0f2fcb6 req-e9ffa111-a317-421e-baef-e84e46bba3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15db0f7-62a1-454f-b58a-acb2c5104395", "tag": "6b41e8e6-f74f-45b2-80a7-2be709385a87"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:37.889136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e3e6905b-ed64-4444-b995-2332a0f2fcb6 req-e9ffa111-a317-421e-baef-e84e46bba3b4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.889892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e3e6905b-ed64-4444-b995-2332a0f2fcb6 req-e9ffa111-a317-421e-baef-e84e46bba3b4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.891457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e3e6905b-ed64-4444-b995-2332a0f2fcb6 req-e9ffa111-a317-421e-baef-e84e46bba3b4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.913539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e3e6905b-ed64-4444-b995-2332a0f2fcb6 req-e9ffa111-a317-421e-baef-e84e46bba3b4 service nova] Creating event network-changed:6b41e8e6-f74f-45b2-80a7-2be709385a87 for instance a15db0f7-62a1-454f-b58a-acb2c5104395 on n-h1-862769-3 Oct 28 19:16:37.934914 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e3e6905b-ed64-4444-b995-2332a0f2fcb6 req-e9ffa111-a317-421e-baef-e84e46bba3b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080472 Oct 28 19:16:37.935914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1165/2314] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:37.948942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c3551d8e-198a-42db-bd83-0862baad34f7 req-689fbf0b-5c88-4fb0-adc2-951578c904dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "name": "network-vif-plugged", "status": "completed", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:37.969096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3551d8e-198a-42db-bd83-0862baad34f7 req-689fbf0b-5c88-4fb0-adc2-951578c904dc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.979495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3551d8e-198a-42db-bd83-0862baad34f7 req-689fbf0b-5c88-4fb0-adc2-951578c904dc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.980338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3551d8e-198a-42db-bd83-0862baad34f7 req-689fbf0b-5c88-4fb0-adc2-951578c904dc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:38.002943 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c3551d8e-198a-42db-bd83-0862baad34f7 req-689fbf0b-5c88-4fb0-adc2-951578c904dc service nova] Creating event network-vif-plugged:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:16:38.020213 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c3551d8e-198a-42db-bd83-0862baad34f7 req-689fbf0b-5c88-4fb0-adc2-951578c904dc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082284 Oct 28 19:16:38.021334 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1166/2315] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:38.062006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:38.062986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:38.077923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:38.078718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:38.079300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:38.083966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:38.084758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:38.085982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:38.162469 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2657603-c1d4-4bf1-aed1-ed7a9861c77b tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.637185 Oct 28 19:16:38.163122 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1150/2316] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:37 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:38.173374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eff92bdb-9bc3-4c0a-bab8-7a75fab2c698 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d77bcbf70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:38.250155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eff92bdb-9bc3-4c0a-bab8-7a75fab2c698 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.080632 Oct 28 19:16:38.251591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1151/2317] 10.222.0.44 () {58 vars in 1290 bytes} [Fri Oct 28 19:16:38 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata/os_distro => generated 33 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:16:38.283549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9afe9bd9-bd70-4f70-8219-c217066da0fc tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d7ff743a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:38.347426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:38.360973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9afe9bd9-bd70-4f70-8219-c217066da0fc tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:38.368126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9afe9bd9-bd70-4f70-8219-c217066da0fc tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:38.617618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9afe9bd9-bd70-4f70-8219-c217066da0fc tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.359179 Oct 28 19:16:38.619791 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1152/2318] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:38 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:38.624888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:38.625900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:38.648730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:38.649708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:38.650318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:38.651242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:38.651871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:38.652698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.314764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:39.327312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a416a676-c208-4df2-8f16-a90d2ae39ba7 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1458 microversion: 2.1 time: 1.267880 Oct 28 19:16:39.329619 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1167/2319] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:38 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1458 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:39.344323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:39.345312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:39.357102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.359293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.359921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.361061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.363132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.365550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.609994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:39.627595 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ffcf8916-ef6d-42d2-a20b-fa1cbad96a9e tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 1.006456 Oct 28 19:16:39.628260 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1153/2320] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:38 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:39.633168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56803613-2e11-4f00-a682-0e0dc696e410 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d77b68ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:39.732695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56803613-2e11-4f00-a682-0e0dc696e410 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.103351 Oct 28 19:16:39.733279 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1154/2321] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:16:39 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:39.740065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:39.751686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:39.758529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.759248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.759861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.760720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.761309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.761872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.910321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:39.929384 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8177ad93-a8c2-4312-9ecf-7879b0c6b2b4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.596871 Oct 28 19:16:39.932846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1168/2322] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:39 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:39.947469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:39.962931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:39.984312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.985294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.985954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.988711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.996159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.999650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:40.481712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:40.491557 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2cb6a62-fde9-4711-9c67-72e624cdbdd1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.757060 Oct 28 19:16:40.492269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1155/2323] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:39 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:40.510919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40b31653-b432-4792-bf7d-e7614abb3dd8 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d77b689d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:40.593711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-40b31653-b432-4792-bf7d-e7614abb3dd8 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:40.598839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-40b31653-b432-4792-bf7d-e7614abb3dd8 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:40.902772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40b31653-b432-4792-bf7d-e7614abb3dd8 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.395688 Oct 28 19:16:40.903754 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1156/2324] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:40 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:40.910434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-27347593-1270-41b3-8001-ada5aa21b0e9 req-a7641193-0a92-4643-acdd-73a060db3fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a9adc5-334c-4b5e-b804-3fed340769f4", "tag": "c4d9e8d3-51ad-44f3-8e24-58d12b3521fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:40.937687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-27347593-1270-41b3-8001-ada5aa21b0e9 req-a7641193-0a92-4643-acdd-73a060db3fbb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:40.938609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-27347593-1270-41b3-8001-ada5aa21b0e9 req-a7641193-0a92-4643-acdd-73a060db3fbb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:40.942178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-27347593-1270-41b3-8001-ada5aa21b0e9 req-a7641193-0a92-4643-acdd-73a060db3fbb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:40.963020 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-27347593-1270-41b3-8001-ada5aa21b0e9 req-a7641193-0a92-4643-acdd-73a060db3fbb service nova] Creating event network-changed:c4d9e8d3-51ad-44f3-8e24-58d12b3521fc for instance 47a9adc5-334c-4b5e-b804-3fed340769f4 on n-h1-862769-3 Oct 28 19:16:40.988845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49229e06-8cca-4541-8a60-a01ff0060ba1 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1609 microversion: 2.1 time: 1.052161 Oct 28 19:16:40.992224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1169/2325] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:39 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1609 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:41.012930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:41.015480 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-27347593-1270-41b3-8001-ada5aa21b0e9 req-a7641193-0a92-4643-acdd-73a060db3fbb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107220 Oct 28 19:16:41.019345 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1157/2326] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:41.026265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:41.040610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f60cfa87-043b-4cf4-ac32-6927257350b2 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d77c521f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:41.049267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.049780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.050287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.068563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.069358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.071474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.172684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f60cfa87-043b-4cf4-ac32-6927257350b2 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:41.192566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f60cfa87-043b-4cf4-ac32-6927257350b2 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:41.526399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:41.563597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72f08063-efa6-42fd-80f2-c54313a630da tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.564629 Oct 28 19:16:41.569061 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1170/2327] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:40 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:41.574212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:41.576569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:41.597944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.598435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.600607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.601585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.606957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.607813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.887310 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f60cfa87-043b-4cf4-ac32-6927257350b2 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 64 microversion: 2.1 time: 0.865369 Oct 28 19:16:41.888155 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1158/2328] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:41 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 64 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:41.893169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:41.898991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.905261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.906402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.911753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.912485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.912687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:41.913443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.924658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04a0db2a-cd11-4ec1-b273-256fa1768af8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.354190 Oct 28 19:16:41.929750 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1171/2329] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:41 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:41.964995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77f2cb90-a3a7-4ed6-a751-00f9e45188ab tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.075567 Oct 28 19:16:41.965625 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1159/2330] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:16:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:41.968363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:41.970189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3b70790-f5d6-4673-9ba1-a7cb255e5609 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d77b8b790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:41.970709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:41.985029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.985524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.985966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:41.986713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:41.987163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:41.987616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.049330 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3b70790-f5d6-4673-9ba1-a7cb255e5609 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 64 microversion: 2.1 time: 0.082297 Oct 28 19:16:42.050468 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1160/2331] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:16:41 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 64 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:42.057585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-3", "block_migration": true, "disk_over_commit": false}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:42.075605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:42.087606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:42.088445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:42.089103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.090339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:42.091015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:42.091646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.125431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Lazy-loading 'flavor' on Instance uuid e33475b0-ec29-4429-af74-980fd7de4d8c {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:42.162113 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e33475b0-ec29-4429-af74-980fd7de4d8c while it is in vm_state suspended Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Request method failure captured: Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c/action HTTP/1.1 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 97 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCpkdzhNz-7rHWbci8wgQj0MMdHyb5dwK-gSxjtyIwmdURVgek9hHBAV1defGtfPNIaNtDjBbcTRUgEK-7TTU_rqxGdR9ZG8vseVgO7qX-CAEMRx58coKk4GaICcJNb4o5Km1joBS-y1MOwmOIBs6bTg5_XracFTliAF998RxBMfWEI Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48c8b131bdfc40e9a5fe288a72d0f44a Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-LiveMigrationNegativeTest-947540754 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48c8b131bdfc40e9a5fe288a72d0f44a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48c8b131bdfc40e9a5fe288a72d0f44a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48c8b131bdfc40e9a5fe288a72d0f44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48c8b131bdfc40e9a5fe288a72d0f44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-LiveMigrationNegativeTest-947540754 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48c8b131bdfc40e9a5fe288a72d0f44a Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-947540754 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-LiveMigrationNegativeTest-947540754-project-admin Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: d003b98de0c4467ba49425e913b51b49 Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-LiveMigrationNegativeTest-947540754-project-admin Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: {"os-migrateLive": {"host": "n-h2-862769-3", "block_migration": true, "disk_over_commit": false}} Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: exception: Cannot 'os-migrateLive' instance e33475b0-ec29-4429-af74-980fd7de4d8c while it is in vm_state suspended Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e33475b0-ec29-4429-af74-980fd7de4d8c', 'body': {'os-migrateLive': {'host': 'n-h2-862769-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e33475b0-ec29-4429-af74-980fd7de4d8c in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:42.164720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e33475b0-ec29-4429-af74-980fd7de4d8c while it is in vm_state suspended Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e33475b0-ec29-4429-af74-980fd7de4d8c while it is in vm_state suspended Oct 28 19:16:42.169133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:42.173274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e33475b0-ec29-4429-af74-980fd7de4d8c while it is in vm_state suspended {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:42.174483 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fbe33e4-0296-4db0-8dc0-aece989b5ae3 tempest-LiveMigrationNegativeTest-947540754 tempest-LiveMigrationNegativeTest-947540754-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c/action" status: 409 len: 155 microversion: 2.1 time: 0.122687 Oct 28 19:16:42.176271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1161/2332] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:42 2022] POST /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c/action => generated 155 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:16:42.187804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-268cdd64-0770-4116-9a5f-724184b6a31f tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d77c7a5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:42.269421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-268cdd64-0770-4116-9a5f-724184b6a31f tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:42.292547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-268cdd64-0770-4116-9a5f-724184b6a31f tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:42.668899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:42.708038 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23d67be3-97fe-45b3-861a-fc84d6d2a2ec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.754075 Oct 28 19:16:42.712575 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1172/2333] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:41 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:42.727812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:42.737840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:42.748453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:42.749841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:42.752312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.753073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:42.754901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:42.757030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.794807 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-268cdd64-0770-4116-9a5f-724184b6a31f tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.616562 Oct 28 19:16:42.795723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1162/2334] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:42 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:42.800702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:42.802659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:42.804570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:42.818404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:42.818615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:42.819002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.819965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:42.820197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:42.820626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:42.921546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-47cdd1a8-205d-49a6-a333-0310c5d2b965 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 204 len: 0 microversion: 2.1 time: 0.206536 Oct 28 19:16:42.925281 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1173/2335] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:42 2022] DELETE /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:42.930594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5f7317b8-4a95-4702-9dd4-c9081848e691 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update', calling method: .version_select at 0x7f1d777c3c10>, body: {"meta": {"os_version": "alt"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:43.046937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-5f7317b8-4a95-4702-9dd4-c9081848e691 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:43.052975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-5f7317b8-4a95-4702-9dd4-c9081848e691 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:43.561332 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5f7317b8-4a95-4702-9dd4-c9081848e691 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.637606 Oct 28 19:16:43.566396 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1174/2336] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Oct 28 19:16:42 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata/os_version => generated 31 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:43.566937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:43.567866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:43.577013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:43.577842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:43.578510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:43.579488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:43.580183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:43.580852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:43.582660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:43.591128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc10213a-6a72-4181-b8c0-08b1eb1ff226 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.794133 Oct 28 19:16:43.592248 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1163/2337] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:42 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:43.599762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:43.600379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:43.617129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:43.618183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:43.618619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:43.620247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:43.620712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:43.621185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:43.963434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:43.979772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b53e3e84-5307-4654-88ea-e5a4d37f2fa9 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1464 microversion: 2.1 time: 0.416653 Oct 28 19:16:43.981179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1175/2338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:43 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1464 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:43.987548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-03ec67d3-04ab-4116-9857-16f21dabf723 req-2b940181-b07a-44d8-99f5-4e3aa4ceb0ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d25f8d4-6476-4a63-99e4-45251d6a28cd", "tag": "e9343740-51cb-4c76-9dc3-38f16ecf906b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:43.998671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-03ec67d3-04ab-4116-9857-16f21dabf723 req-2b940181-b07a-44d8-99f5-4e3aa4ceb0ae service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:43.999693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-03ec67d3-04ab-4116-9857-16f21dabf723 req-2b940181-b07a-44d8-99f5-4e3aa4ceb0ae service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:44.000473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-03ec67d3-04ab-4116-9857-16f21dabf723 req-2b940181-b07a-44d8-99f5-4e3aa4ceb0ae service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:44.009510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:44.028655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4d4e6ab-6f18-4a20-9dbd-295128176943 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.435227 Oct 28 19:16:44.031331 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1164/2339] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:43 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:44.044874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03016ffc-6064-44b1-b8cb-2fb0bb15303b tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d77bcb1f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:44.062221 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-03ec67d3-04ab-4116-9857-16f21dabf723 req-2b940181-b07a-44d8-99f5-4e3aa4ceb0ae service nova] Creating event network-changed:e9343740-51cb-4c76-9dc3-38f16ecf906b for instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd on n-h2-862769-3 Oct 28 19:16:44.074063 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-03ec67d3-04ab-4116-9857-16f21dabf723 req-2b940181-b07a-44d8-99f5-4e3aa4ceb0ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091167 Oct 28 19:16:44.075465 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1176/2340] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:44.094358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:44.096270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:44.106922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:44.108479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03016ffc-6064-44b1-b8cb-2fb0bb15303b tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 58 microversion: 2.1 time: 0.075699 Oct 28 19:16:44.109225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:44.110901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:44.112004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:44.117214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:44.118729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1165/2341] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:16:44 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 58 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:44.120376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:44.124870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fcb99433-668c-4547-94c4-51439af4c995 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'update_all', calling method: .version_select at 0x7f1d77b8b160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:44.203877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-fcb99433-668c-4547-94c4-51439af4c995 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:44.210104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-fcb99433-668c-4547-94c4-51439af4c995 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:44.618469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:44.649067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:44.657197 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a932e42-6aab-46d9-8786-c60d51777263 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.579846 Oct 28 19:16:44.657761 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1177/2342] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:44 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:44.674853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:44.676530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:44.678706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:44.692213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:44.697295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:44.697666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:44.698410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:44.698953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:44.699363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:44.736430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fcb99433-668c-4547-94c4-51439af4c995 tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 61 microversion: 2.1 time: 0.616516 Oct 28 19:16:44.737858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1166/2343] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:16:44 2022] PUT /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 61 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:44.747707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26cd2285-e025-41ad-ba37-cd586a39a64d tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Action: 'create', calling method: .version_select at 0x7f1d77b8bca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:44.834092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-26cd2285-e025-41ad-ba37-cd586a39a64d tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:44.849201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-26cd2285-e025-41ad-ba37-cd586a39a64d tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Getting quotas for user c4df52bc7bfa490da93cfca38c94a192 and project 68a2dfe384e149e69de2253b531f28e2. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:45.620374 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26cd2285-e025-41ad-ba37-cd586a39a64d tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "POST /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 85 microversion: 2.1 time: 0.875902 Oct 28 19:16:45.621627 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1167/2344] 10.222.0.44 () {60 vars in 1281 bytes} [Fri Oct 28 19:16:44 2022] POST /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 85 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:45.628482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:45.629556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:45.644285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:45.645156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:45.645786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:45.649146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:45.651543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:45.653446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:46.101783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:46.127234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c78c84a-1b69-430a-a99d-c481aae07ec8 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 1.464502 Oct 28 19:16:46.131872 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1178/2345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:44 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:46.139721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:46.140941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:46.150020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:46.151219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:46.151754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:46.152610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:46.153227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:46.154666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:46.187938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:46.577057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:46.591179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe669efd-3229-43e7-bcd1-5ba262beb634 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 200 len: 1464 microversion: 2.1 time: 0.967540 Oct 28 19:16:46.608687 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1168/2346] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:45 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 1464 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:46.809117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:46.823481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5236f122-dba2-4ddb-a18e-4f64f5ac5ff3 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.685256 Oct 28 19:16:46.824336 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1179/2347] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:46 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:46.830483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29b7b80c-687d-488b-a3a0-fc9f44969e3d tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] Calling method '.version_select at 0x7f1d7783e1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:46.899164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1022054010", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "0f1bc319-b318-44e6-bf03-1941f9a927bf"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:46.928147 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29b7b80c-687d-488b-a3a0-fc9f44969e3d tempest-ImagesMetadataTestJSON-1193749807 tempest-ImagesMetadataTestJSON-1193749807-project] 10.222.0.44 "GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata" status: 200 len: 85 microversion: 2.1 time: 0.101650 Oct 28 19:16:46.929414 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1180/2348] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:16:46 2022] GET /compute/v2.1/images/1b3608ea-092b-4656-be7c-7f68d7425085/metadata => generated 85 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:16:46.943893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:46.960252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:46.977555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:46.990602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:46.992245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:46.993130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:46.996468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:46.997179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:47.037397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] validate_networks() for [('0f1bc319-b318-44e6-bf03-1941f9a927bf', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:47.527607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:47.545316 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68b39c7d-7268-4d2a-b369-915d8294dd97 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1313 microversion: 2.1 time: 0.613953 Oct 28 19:16:47.547310 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1181/2349] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:46 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:47.558964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-06ed4e77-15cf-49c3-b365-78f424e25db6 req-3f271c2a-359f-4851-8e9e-27773c1e04e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15db0f7-62a1-454f-b58a-acb2c5104395", "name": "network-vif-plugged", "status": "completed", "tag": "6b41e8e6-f74f-45b2-80a7-2be709385a87"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:47.583293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-06ed4e77-15cf-49c3-b365-78f424e25db6 req-3f271c2a-359f-4851-8e9e-27773c1e04e9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:47.584268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-06ed4e77-15cf-49c3-b365-78f424e25db6 req-3f271c2a-359f-4851-8e9e-27773c1e04e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:47.584861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-06ed4e77-15cf-49c3-b365-78f424e25db6 req-3f271c2a-359f-4851-8e9e-27773c1e04e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:47.619620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-06ed4e77-15cf-49c3-b365-78f424e25db6 req-3f271c2a-359f-4851-8e9e-27773c1e04e9 service nova] Creating event network-vif-plugged:6b41e8e6-f74f-45b2-80a7-2be709385a87 for instance a15db0f7-62a1-454f-b58a-acb2c5104395 on n-h1-862769-3 Oct 28 19:16:47.626910 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-06ed4e77-15cf-49c3-b365-78f424e25db6 req-3f271c2a-359f-4851-8e9e-27773c1e04e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078213 Oct 28 19:16:47.627875 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1182/2350] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:47.746157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ee51380-db6e-47a7-a31e-666254783dd1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Action: 'create', calling method: .version_select at 0x7f1d7783e940>, body: {"keypair": {"name": "tempest-keypair-1230785318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+2a1dMLco/9EBAW58wCGbwVw6yyt6dy/RGuKPHAjz8IzfMMdcy4vJUgfC6fdTZ9R4kzZ9KdRw7fhHDCWpM2CfxuoP8eQbjI912BIGzJmCX9AAWTrIjAdyHBAdrPubiAg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:47.785748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2ee51380-db6e-47a7-a31e-666254783dd1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Getting quotas for project 73cb49a27a3d4d9e995bd43eb390a147. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:47.792290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2ee51380-db6e-47a7-a31e-666254783dd1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Getting quotas for user 9f84a4a12f6a4233864025096fa60dc7 and project 73cb49a27a3d4d9e995bd43eb390a147. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:47.887629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ee51380-db6e-47a7-a31e-666254783dd1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257139 Oct 28 19:16:47.891689 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1183/2351] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:47.904388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0bc49815-81a2-455a-9fd4-10e4a3945332 req-0a79fda5-0f48-44c0-b311-dd8d837dedab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33475b0-ec29-4429-af74-980fd7de4d8c", "name": "network-vif-deleted", "tag": "4c1277b8-a1e3-4ca6-88b0-f0eb8bc002be"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:47.931675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0bc49815-81a2-455a-9fd4-10e4a3945332 req-0a79fda5-0f48-44c0-b311-dd8d837dedab service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:47.932093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0bc49815-81a2-455a-9fd4-10e4a3945332 req-0a79fda5-0f48-44c0-b311-dd8d837dedab service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:47.943575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0bc49815-81a2-455a-9fd4-10e4a3945332 req-0a79fda5-0f48-44c0-b311-dd8d837dedab service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.042934 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0bc49815-81a2-455a-9fd4-10e4a3945332 req-0a79fda5-0f48-44c0-b311-dd8d837dedab service nova] Creating event network-vif-deleted:4c1277b8-a1e3-4ca6-88b0-f0eb8bc002be for instance e33475b0-ec29-4429-af74-980fd7de4d8c on n-h1-862769-3 Oct 28 19:16:48.060450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0bc49815-81a2-455a-9fd4-10e4a3945332 req-0a79fda5-0f48-44c0-b311-dd8d837dedab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166646 Oct 28 19:16:48.061322 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1184/2352] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:48.089485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:48.091095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:48.102052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.102736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.103314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.104167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.104950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:48.105418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:48.105622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.105915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:48.106345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.106457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:48.106801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:48.142507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.142743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.143369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.144874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.146780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.147945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.196958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Getting quotas for project f385a5f3e02a40a9ae0f5f4f1f1005ee. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:48.203178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Getting quotas for user 2e2e39ce965f4cfaa8ea80ab62898593 and project f385a5f3e02a40a9ae0f5f4f1f1005ee. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:48.225414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:48.236175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:48.347814 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a5331faa-2b39-4a9b-b3a6-909906a54d56 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.737374 Oct 28 19:16:48.354543 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1169/2353] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:16:48.560314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:48.572821 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d609de6b-0c88-49e0-8af3-f0f72ca2ccdd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.492399 Oct 28 19:16:48.591735 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1185/2354] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:48 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:48.600346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:48.603414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: e33475b0-ec29-4429-af74-980fd7de4d8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:48.619786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.624587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.626348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.627287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.628117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.628885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.715055 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] HTTP exception thrown: Instance e33475b0-ec29-4429-af74-980fd7de4d8c could not be found. Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Request method failure captured: Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c HTTP/1.1 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpjvufR7rRDfUKc7ht00Dsfdpsmio-qCWutvh87VdV7nqz0Oh10ChPZHUT7w-MpY1AwYPYydomRq6xf1PsBInczYLYdUIFZLam2BgIF1-xq5Gao-cjxJbiWlkjodH1VAsLTCRaeECLkmSdDZLZrhLU3Kvf2lyArI60WVGTJQLHKKLk Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1d288edc66234feb87c8b8df1aee1fe0 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveMigrationNegativeTest-888604993 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d288edc66234feb87c8b8df1aee1fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d288edc66234feb87c8b8df1aee1fe0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d288edc66234feb87c8b8df1aee1fe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d288edc66234feb87c8b8df1aee1fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveMigrationNegativeTest-888604993 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1d288edc66234feb87c8b8df1aee1fe0 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-888604993 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveMigrationNegativeTest-888604993-project Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 602f76b746d64eb9b59a52f2388a2312 Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveMigrationNegativeTest-888604993-project Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e33475b0-ec29-4429-af74-980fd7de4d8c could not be found. Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e33475b0-ec29-4429-af74-980fd7de4d8c'} Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33475b0-ec29-4429-af74-980fd7de4d8c could not be found. Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33475b0-ec29-4429-af74-980fd7de4d8c could not be found. Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:48.716920 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33475b0-ec29-4429-af74-980fd7de4d8c could not be found. Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Returning 404 to user: Instance e33475b0-ec29-4429-af74-980fd7de4d8c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:48.720582 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14a62ebc-a3aa-430c-be61-cda9264f503d tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c" status: 404 len: 111 microversion: 2.1 time: 0.125323 Oct 28 19:16:48.730544 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1186/2355] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:48 2022] GET /compute/v2.1/servers/e33475b0-ec29-4429-af74-980fd7de4d8c => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:48.746310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:48.746973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:48.770158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.772081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.772533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:48.778059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93d9edd2-5f58-4252-908a-e68273529cd0 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d77a9cb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1796065561", "description": "tempest-description-14657987"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:48.788073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:48.788587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:48.789032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.410533 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93d9edd2-5f58-4252-908a-e68273529cd0 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.054269 Oct 28 19:16:49.412343 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1170/2356] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:16:48 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:49.418507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:49.421096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:49.440123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:49.445752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:49.450226 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fcbbf15b-327d-4a91-abbd-e52c18fc5919 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.718158 Oct 28 19:16:49.450848 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1187/2357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:48 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:49.466861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:49.466861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.466861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:49.466861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:49.466861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.476570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:49.478445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:49.485312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:49.502653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:49.503346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:49.503911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.504635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:49.505084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:49.505499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.617101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:49.630973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:49.639637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:49.642489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1665a5a5-24dc-410e-8096-d4c209980e5b tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1263 microversion: 2.21 time: 0.228544 Oct 28 19:16:49.645812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1171/2358] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:16:49 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1263 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:16:49.667367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:49.669910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:49.694835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:49.696526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:49.697609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.700613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:49.710204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:49.711193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:49.842480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:16:49.940638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:49.949945 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd13c8d3-6d33-45c6-826b-e7186a8c0be5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1462 microversion: 2.1 time: 0.485585 Oct 28 19:16:49.950523 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1188/2359] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:49 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1462 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:49.982423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-63f4a05b-976a-403c-8f86-ad197c4d2aca tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d77928dc0>, body: {"security_group_rule": {"parent_group_id": "169a24aa-9373-44cd-99f9-007e016b7515", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:50.057776 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5532150-db2e-459b-93a6-f2dd0de95f31 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 204 len: 0 microversion: 2.1 time: 0.408193 Oct 28 19:16:50.062768 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1172/2360] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:16:49 2022] DELETE /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:16:50.069784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:50.070736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:50.078155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.078879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.079508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:50.080395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.081047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.081870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:50.443780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:50.457477 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c22e125-8398-4f9b-8e20-08c886a83404 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.388276 Oct 28 19:16:50.459148 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1173/2361] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:50 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:50.466574 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-63f4a05b-976a-403c-8f86-ad197c4d2aca tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.494301 Oct 28 19:16:50.467950 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1189/2362] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:50.480777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:50.481733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:50.490128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dd2b148c-2d92-4db5-98c7-9bd0fa696636 req-b7e70cdd-2e1e-422d-afc6-6bec3fcd7474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a9adc5-334c-4b5e-b804-3fed340769f4", "name": "network-vif-plugged", "status": "completed", "tag": "c4d9e8d3-51ad-44f3-8e24-58d12b3521fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:50.497442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.500734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.501441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:50.502333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.503723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.506826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:50.517583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dd2b148c-2d92-4db5-98c7-9bd0fa696636 req-b7e70cdd-2e1e-422d-afc6-6bec3fcd7474 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.519634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dd2b148c-2d92-4db5-98c7-9bd0fa696636 req-b7e70cdd-2e1e-422d-afc6-6bec3fcd7474 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.520081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dd2b148c-2d92-4db5-98c7-9bd0fa696636 req-b7e70cdd-2e1e-422d-afc6-6bec3fcd7474 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:50.563701 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dd2b148c-2d92-4db5-98c7-9bd0fa696636 req-b7e70cdd-2e1e-422d-afc6-6bec3fcd7474 service nova] Creating event network-vif-plugged:c4d9e8d3-51ad-44f3-8e24-58d12b3521fc for instance 47a9adc5-334c-4b5e-b804-3fed340769f4 on n-h1-862769-3 Oct 28 19:16:50.583130 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dd2b148c-2d92-4db5-98c7-9bd0fa696636 req-b7e70cdd-2e1e-422d-afc6-6bec3fcd7474 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116971 Oct 28 19:16:50.583800 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1174/2363] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:50.607843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:50.612691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:50.630972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.631962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.632583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:50.633445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:50.634046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:50.636572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.004470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:51.016517 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2caec3a8-4eac-4298-9307-aa05662cfc38 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1475 microversion: 2.1 time: 0.427754 Oct 28 19:16:51.017616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1175/2364] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:50 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:51.025187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:51.030039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:51.036493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:51.046784 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a4531ab-fd3a-496d-b024-55133bd58226 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1463 microversion: 2.1 time: 0.577238 Oct 28 19:16:51.052302 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1190/2365] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:50 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1463 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:51.060894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c929dbfc-db4d-4541-bad9-2e7669e265d7 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d77a3f940>, body: {"security_group_rule": {"parent_group_id": "169a24aa-9373-44cd-99f9-007e016b7515", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:51.062448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.063165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.063772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.082367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.084311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.086191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.223501 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c929dbfc-db4d-4541-bad9-2e7669e265d7 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: This rule already exists in group 169a24aa-9373-44cd-99f9-007e016b7515 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c929dbfc-db4d-4541-bad9-2e7669e265d7 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 138 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: {"security_group_rule": {"parent_group_id": "169a24aa-9373-44cd-99f9-007e016b7515", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: exception: This rule already exists in group 169a24aa-9373-44cd-99f9-007e016b7515 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'security_group_rule': {'parent_group_id': '169a24aa-9373-44cd-99f9-007e016b7515', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 169a24aa-9373-44cd-99f9-007e016b7515 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 169a24aa-9373-44cd-99f9-007e016b7515 Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:51.225623 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:51.229036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:51.229036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:51.229036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 169a24aa-9373-44cd-99f9-007e016b7515 Oct 28 19:16:51.229036 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:51.230852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c929dbfc-db4d-4541-bad9-2e7669e265d7 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 400 to user: This rule already exists in group 169a24aa-9373-44cd-99f9-007e016b7515 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:51.232234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c929dbfc-db4d-4541-bad9-2e7669e265d7 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.178933 Oct 28 19:16:51.233362 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1191/2366] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:16:51.243442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:51.244068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:51.261586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.262100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.271271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.272366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.273046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.273706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.349980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:51.358634 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9982964c-b2a9-463c-8e71-29f65d1b12e0 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1363 microversion: 2.1 time: 0.337214 Oct 28 19:16:51.371126 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1176/2367] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:51 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:51.384897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:51.394639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:51.396737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:51.398112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e13d0644-1248-4037-92ec-f64ca76e26cb tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1317 microversion: 2.21 time: 0.163620 Oct 28 19:16:51.398927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1192/2368] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:16:51 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:16:51.406087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-620454365", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4f131269-d1fb-4779-a11f-f35a87fd1c87"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:51.491343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:51.550195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24004da0-3406-4fbd-b0c5-f7b408b992c3 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Action: 'create', calling method: .version_select at 0x7f1d77b783a0>, body: {"keypair": {"name": "tempest-keypair-1013972545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh+CwkqOQ7PkHMY8FaTWIGLRubA/nngDuqG6zSlQoxqFzVBy0L0nHU53+CxDdR+WgrmRxvZ3dLIZ51EuE8LksW+DYUKa7n/XyGJsEX03hCEndhMyFLymf/TzSXhw/qxfw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:51.556061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:51.576679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-24004da0-3406-4fbd-b0c5-f7b408b992c3 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:51.584301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-24004da0-3406-4fbd-b0c5-f7b408b992c3 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for user 424ce7f328924665bd17ab151df0e97b and project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:51.617852 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24004da0-3406-4fbd-b0c5-f7b408b992c3 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245133 Oct 28 19:16:51.618519 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1177/2369] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:51.622951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-572840ee-45ea-4001-acba-0b6ab1466e53 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d7ff67af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:51.809824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:51.810356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:51.810988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:51.812313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:51.812960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:51.825764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.826494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.827173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.828103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.828762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.829370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.856761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Getting quotas for project 046929f0d0b44a3191ed57f9d72d2dff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:51.862765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Getting quotas for user fe4df4ef5bf94c9393f0f8b82c86eb1d and project 046929f0d0b44a3191ed57f9d72d2dff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:51.874047 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-572840ee-45ea-4001-acba-0b6ab1466e53 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-group-rules/9924dfdc-5b34-4e91-b3e8-50f5c4733b0e" status: 202 len: 0 microversion: 2.1 time: 0.254311 Oct 28 19:16:51.876692 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1178/2370] 10.222.0.44 () {58 vars in 1287 bytes} [Fri Oct 28 19:16:51 2022] DELETE /compute/v2.1/os-security-group-rules/9924dfdc-5b34-4e91-b3e8-50f5c4733b0e => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:51.881689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:51.884607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:51.887373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:51.888112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:51.895567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.896048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.896630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.897480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:51.897932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:51.898349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:51.935292 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec07227b-f16f-48d7-8d5d-e02d9f780236 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534750 Oct 28 19:16:51.936890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1193/2371] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:51.942230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30dbbeb9-e75a-4f19-a1c6-cefe40cda871 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d779fbca0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:51.952825 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30dbbeb9-e75a-4f19-a1c6-cefe40cda871 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs/tempest-keypair-1013972545" status: 200 len: 498 microversion: 2.1 time: 0.014361 Oct 28 19:16:51.953990 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1194/2372] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:16:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1013972545 => generated 498 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:51.968098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f7023f99-7c0e-4eb3-a6da-f66d4c1e33e6"}], "security_groups": [{"name": "tempest-securitygroup--291166204"}], "key_name": "tempest-keypair-1230785318", "user_data": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:52.091839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:52.118207 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65493f50-46cc-4649-a624-6415f4e7a8b7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.240324 Oct 28 19:16:52.120451 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1179/2373] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:51 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:52.137391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db9f8e64-3cf7-4720-be6b-2e8e2d3a6a2b tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d7c1ea790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-93202139", "description": "tempest-description-470883889"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:52.264189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] validate_networks() for [('f7023f99-7c0e-4eb3-a6da-f66d4c1e33e6', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:53.062516 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db9f8e64-3cf7-4720-be6b-2e8e2d3a6a2b tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.940966 Oct 28 19:16:53.065288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1180/2374] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:16:52 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:53.074201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:53.076790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:53.096987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.097548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.098283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.099223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.103544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.104182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.255077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:53.279284 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-730a7785-fcad-4a1e-85d5-2757899eb1c0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1209 microversion: 2.1 time: 0.212084 Oct 28 19:16:53.280648 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1181/2375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:53 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1209 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:53.288825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba5e2153-8dc6-4cca-9c29-f941e0948656 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d77bcbd30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:53.321795 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba5e2153-8dc6-4cca-9c29-f941e0948656 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013972545" status: 202 len: 0 microversion: 2.1 time: 0.037359 Oct 28 19:16:53.322462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:53.323023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:53.323565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:53.331349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:53.332394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:53.333697 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1182/2376] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:16:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013972545 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:53.346103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:53.346728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:53.350195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.350889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.351396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.352750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.353471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.354088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.367926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.368428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.368868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.369634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.370089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.370680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.381732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Getting quotas for project 73cb49a27a3d4d9e995bd43eb390a147. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:53.386629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Getting quotas for user 9f84a4a12f6a4233864025096fa60dc7 and project 73cb49a27a3d4d9e995bd43eb390a147. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:53.403470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:53.406278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:53.436103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.437140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.437662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.438796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lazy-loading 'fault' on Instance uuid a97cc018-7ca5-47e5-98e3-8660906e59f0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:53.475151 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bee8eee-4fb8-4721-9e54-3e358c0c59f1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.513125 Oct 28 19:16:53.476783 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1195/2377] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:16:53.481779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:53.482755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:53.514136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.515760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602f76b746d64eb9b59a52f2388a2312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d288edc66234feb87c8b8df1aee1fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:53.516122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.516627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.519457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.520129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.523580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.539253 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3158b05-26b1-40af-a178-109f2b1c93ec tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 200 len: 1309 microversion: 2.1 time: 0.198121 Oct 28 19:16:53.556178 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1183/2378] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:53 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:53.564366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:53.565736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:53.576963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.577836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.578572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.579513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.580314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.580957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:53.929919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:53.942116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d54f1c9-c099-4236-80dd-be582e808a77 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1549 microversion: 2.1 time: 0.461393 Oct 28 19:16:53.942843 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1196/2379] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:53 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1549 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:53.953396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-be80fba6-3f91-46b6-ad3e-b138a2b84188 req-b839d323-32ed-4576-b99b-005b161f1230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97cc018-7ca5-47e5-98e3-8660906e59f0", "name": "network-vif-deleted", "tag": "3b562af9-3c8f-4a00-a882-a853357960c8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:53.986936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be80fba6-3f91-46b6-ad3e-b138a2b84188 req-b839d323-32ed-4576-b99b-005b161f1230 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:53.988403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be80fba6-3f91-46b6-ad3e-b138a2b84188 req-b839d323-32ed-4576-b99b-005b161f1230 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:53.988922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be80fba6-3f91-46b6-ad3e-b138a2b84188 req-b839d323-32ed-4576-b99b-005b161f1230 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.020511 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-be80fba6-3f91-46b6-ad3e-b138a2b84188 req-b839d323-32ed-4576-b99b-005b161f1230 service nova] Creating event network-vif-deleted:3b562af9-3c8f-4a00-a882-a853357960c8 for instance a97cc018-7ca5-47e5-98e3-8660906e59f0 on n-h2-862769-3 Oct 28 19:16:54.032831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-be80fba6-3f91-46b6-ad3e-b138a2b84188 req-b839d323-32ed-4576-b99b-005b161f1230 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088553 Oct 28 19:16:54.036725 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1197/2380] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:54.052812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-577cd13e-216d-4f4e-b94d-63dc1f28dc88 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d77a3f3a0>, body: {"security_group_rule": {"parent_group_id": "e7842a72-61ed-4de0-b1f2-0bc38217a513", "ip_protocol": "tcp", "from_port": 624403697, "to_port": 22}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:54.181009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:54.190115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:54.202861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:54.205011 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4061d2d9-55f4-471b-bc9c-ed58235388f3 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1359 microversion: 2.21 time: 0.647085 Oct 28 19:16:54.212502 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1184/2381] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:16:53 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1359 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:16:54.254537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:54.256210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:54.264010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.265004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.266022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.267048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.267971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.268613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.283826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-577cd13e-216d-4f4e-b94d-63dc1f28dc88 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Invalid port range 624403697:22. Former value cannot be greater than the later Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-577cd13e-216d-4f4e-b94d-63dc1f28dc88 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 145 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: {"security_group_rule": {"parent_group_id": "e7842a72-61ed-4de0-b1f2-0bc38217a513", "ip_protocol": "tcp", "from_port": 624403697, "to_port": 22}} Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid port range 624403697:22. Former value cannot be greater than the later Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e7842a72-61ed-4de0-b1f2-0bc38217a513', 'ip_protocol': 'tcp', 'from_port': 624403697, 'to_port': 22}}} Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 624403697:22. Former value cannot be greater than the later Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 624403697:22. Former value cannot be greater than the later Oct 28 19:16:54.285985 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 624403697:22. Former value cannot be greater than the later Oct 28 19:16:54.289893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.291899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-577cd13e-216d-4f4e-b94d-63dc1f28dc88 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 400 to user: Invalid port range 624403697:22. Former value cannot be greater than the later {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:54.292990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-577cd13e-216d-4f4e-b94d-63dc1f28dc88 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.252417 Oct 28 19:16:54.294042 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1198/2382] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:54 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:16:54.306823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-047d1748-0fd9-4548-bacc-f5d92edc5cb6 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Action: 'create', calling method: .version_select at 0x7f1d7783b700>, body: {"keypair": {"name": "tempest-keypair-1107294720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ27dwxuuDpzc1IJKTCQYxABto5joaOvx76LtkZYoqCfTigt38Ki4ThINPlCnXcfvWTgvH8lupUHliGtfSpwVtHW39Qf+3knNhGWJfbLJrovah6uYTwZ/TwqeosRRYMXkw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:54.356443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-047d1748-0fd9-4548-bacc-f5d92edc5cb6 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:54.368272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-047d1748-0fd9-4548-bacc-f5d92edc5cb6 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for user 424ce7f328924665bd17ab151df0e97b and project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:54.400012 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-047d1748-0fd9-4548-bacc-f5d92edc5cb6 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102940 Oct 28 19:16:54.407351 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1199/2383] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:54.419909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:54.421087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:54.431289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.431903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.432545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.433629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.434240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.434933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.484791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:54.497397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc558a28-2229-47af-ba61-7be03870190a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.248199 Oct 28 19:16:54.506937 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1185/2384] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:54 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:54.521031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a868fdcf-7be7-4b6f-9790-c28241d35728 req-642d7eb6-abe4-4481-bd2b-ef395709aedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d25f8d4-6476-4a63-99e4-45251d6a28cd", "name": "network-vif-plugged", "status": "completed", "tag": "e9343740-51cb-4c76-9dc3-38f16ecf906b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:54.524379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:54.532717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-426b8d58-4454-4f40-84c5-4cc842b58be7 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1230 microversion: 2.1 time: 0.124304 Oct 28 19:16:54.533682 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1200/2385] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:54 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1230 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:54.544180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a868fdcf-7be7-4b6f-9790-c28241d35728 req-642d7eb6-abe4-4481-bd2b-ef395709aedd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.544180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a868fdcf-7be7-4b6f-9790-c28241d35728 req-642d7eb6-abe4-4481-bd2b-ef395709aedd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.544180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a868fdcf-7be7-4b6f-9790-c28241d35728 req-642d7eb6-abe4-4481-bd2b-ef395709aedd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.553704 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a868fdcf-7be7-4b6f-9790-c28241d35728 req-642d7eb6-abe4-4481-bd2b-ef395709aedd service nova] Creating event network-vif-plugged:e9343740-51cb-4c76-9dc3-38f16ecf906b for instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd on n-h2-862769-3 Oct 28 19:16:54.561331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:54.563577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:54.574316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.575790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.576456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.576901 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a868fdcf-7be7-4b6f-9790-c28241d35728 req-642d7eb6-abe4-4481-bd2b-ef395709aedd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068107 Oct 28 19:16:54.577547 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1186/2386] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:54.577999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.578681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.579266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.608483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a52b4840-a320-4a59-a014-2d7e0b2628b4 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d7ff9a3a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2100464646", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:54.618430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a52b4840-a320-4a59-a014-2d7e0b2628b4 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Security group id should be uuid Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a52b4840-a320-4a59-a014-2d7e0b2628b4 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 131 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2100464646", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group id should be uuid Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2100464646', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:54.620241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:54.623712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 28 19:16:54.623712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.623712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a52b4840-a320-4a59-a014-2d7e0b2628b4 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 400 to user: Security group id should be uuid {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:54.627536 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a52b4840-a320-4a59-a014-2d7e0b2628b4 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.046227 Oct 28 19:16:54.628155 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1187/2387] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:54 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:16:54.651744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:54.655711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:54.668748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.669630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.670558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.671798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.672755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.673651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.704318 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-778552f7-15ea-49e6-8038-37eca8bde90c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148082 Oct 28 19:16:54.705256 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1201/2388] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:16:54 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:54.720734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba54606d-6cc8-4082-b313-82aa8de5a865 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d77a3f940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:54.760865 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba54606d-6cc8-4082-b313-82aa8de5a865 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107294720" status: 202 len: 0 microversion: 2.1 time: 0.044528 Oct 28 19:16:54.762920 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1202/2389] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:16:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107294720 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:54.774547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:54.775457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] [instance: a97cc018-7ca5-47e5-98e3-8660906e59f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:54.788799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.791438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.792160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.793352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:54.803357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:54.803822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:54.836904 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] HTTP exception thrown: Instance a97cc018-7ca5-47e5-98e3-8660906e59f0 could not be found. Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Request method failure captured: Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 HTTP/1.1 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCpjvufR7rRDfUKc7ht00Dsfdpsmio-qCWutvh87VdV7nqz0Oh10ChPZHUT7w-MpY1AwYPYydomRq6xf1PsBInczYLYdUIFZLam2BgIF1-xq5Gao-cjxJbiWlkjodH1VAsLTCRaeECLkmSdDZLZrhLU3Kvf2lyArI60WVGTJQLHKKLk Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1d288edc66234feb87c8b8df1aee1fe0 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-LiveMigrationNegativeTest-888604993 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d288edc66234feb87c8b8df1aee1fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d288edc66234feb87c8b8df1aee1fe0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d288edc66234feb87c8b8df1aee1fe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d288edc66234feb87c8b8df1aee1fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-LiveMigrationNegativeTest-888604993 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1d288edc66234feb87c8b8df1aee1fe0 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-888604993 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-LiveMigrationNegativeTest-888604993-project Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 602f76b746d64eb9b59a52f2388a2312 Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-LiveMigrationNegativeTest-888604993-project Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a97cc018-7ca5-47e5-98e3-8660906e59f0 could not be found. Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a97cc018-7ca5-47e5-98e3-8660906e59f0'} Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97cc018-7ca5-47e5-98e3-8660906e59f0 could not be found. Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97cc018-7ca5-47e5-98e3-8660906e59f0 could not be found. Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:54.838281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97cc018-7ca5-47e5-98e3-8660906e59f0 could not be found. Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] Returning 404 to user: Instance a97cc018-7ca5-47e5-98e3-8660906e59f0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:54.843121 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e6cee21d-a3e1-4e5f-8550-24f560e5e678 tempest-LiveMigrationNegativeTest-888604993 tempest-LiveMigrationNegativeTest-888604993-project] 10.222.0.44 "GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0" status: 404 len: 111 microversion: 2.1 time: 0.075468 Oct 28 19:16:54.851187 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1203/2390] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:54 2022] GET /compute/v2.1/servers/a97cc018-7ca5-47e5-98e3-8660906e59f0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:16:54.864681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-178a5aa5-de94-4a15-a49b-a443d4c05272 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d779fbc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1989573695", "description": "tempest-description-2024494870"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:54.945814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:54.960740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-212b0b51-5393-410d-af50-c6cdb33481a6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1271 microversion: 2.1 time: 0.330799 Oct 28 19:16:54.961590 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1188/2391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:54 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:54.999088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7247f55-72ab-42ac-8562-b4e4f93e0bb7 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Action: 'create', calling method: .version_select at 0x7f1d77ce5550>, body: {"keypair": {"name": "tempest-keypair-1181191128", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:55.027147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f7247f55-72ab-42ac-8562-b4e4f93e0bb7 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:55.044038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f7247f55-72ab-42ac-8562-b4e4f93e0bb7 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for user 424ce7f328924665bd17ab151df0e97b and project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:55.085049 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f7247f55-72ab-42ac-8562-b4e4f93e0bb7 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.106062 Oct 28 19:16:55.094280 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1189/2392] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:54 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:55.102932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e309a389-1c57-4959-a4c7-d6f7a4e9b534 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d77b68790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:55.133466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e309a389-1c57-4959-a4c7-d6f7a4e9b534 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181191128" status: 202 len: 0 microversion: 2.1 time: 0.035911 Oct 28 19:16:55.135101 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1190/2393] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181191128 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:55.147876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce358cee-4e2b-4018-802a-96e46b2bef03 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Action: 'create', calling method: .version_select at 0x7f1d7ffd3280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1778637219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVgydINl70a3ScspMxsx+gYKkO3oq0V1bvgWgQaC3EFfRzxnKYLFLRwYHRN2o2ouxDobpYpFJZLlr+WYXCQ1CRL5QVRZWn56U2EUpav3Mw9O016TdlKyg+UsfZh7l7Eyg=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:55.177023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ce358cee-4e2b-4018-802a-96e46b2bef03 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:55.183261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ce358cee-4e2b-4018-802a-96e46b2bef03 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for user 424ce7f328924665bd17ab151df0e97b and project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:55.219583 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce358cee-4e2b-4018-802a-96e46b2bef03 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076910 Oct 28 19:16:55.228618 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1191/2394] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:16:55.242336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-532190c9-3c77-4095-8289-b62248df705c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Action: 'create', calling method: .version_select at 0x7f1d7ffd39d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1920607531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxln/tzQuAq40rF7N/1wFiA9k22hQgCPb657e3iJtq5Fhgf75VEmRmQoLD+KMxI9VV7noEoVxhY3p8ZpyAQ1DZwDVPMZWnyusW9ooW5XGQ7v4tMDiwnEcEBBOe9tjyjpw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:55.260600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-532190c9-3c77-4095-8289-b62248df705c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:55.266446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-532190c9-3c77-4095-8289-b62248df705c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for user 424ce7f328924665bd17ab151df0e97b and project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:55.296941 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-532190c9-3c77-4095-8289-b62248df705c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.062997 Oct 28 19:16:55.297875 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1192/2395] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:55.313082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:55.313970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:55.322440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:55.323323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:55.324073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:55.325264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:55.325876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:55.326453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:55.652252 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-178a5aa5-de94-4a15-a49b-a443d4c05272 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.798451 Oct 28 19:16:55.653256 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1204/2396] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:16:54 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:55.680958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53b98025-c29a-4535-9515-c6f199375d2d tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Action: 'create', calling method: .version_select at 0x7f1d77e4b5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1968212364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9XhPfJ4Nm4DRrhe3wZDjy5JCY7JOfB3xP8dfPFmX8ZoUoTyfyskuZ6GaWi+XXcRvUqcez/IugQm1l1mOAAd0ascsxLNxuh0/yEp6corssk41xQexvUD8MKBgK0OqzUsA=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:55.704858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-53b98025-c29a-4535-9515-c6f199375d2d tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:55.707146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:55.713048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-53b98025-c29a-4535-9515-c6f199375d2d tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Getting quotas for user 424ce7f328924665bd17ab151df0e97b and project ca895cdfd50545848408f608fcd3532e. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:55.749070 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53b98025-c29a-4535-9515-c6f199375d2d tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.094527 Oct 28 19:16:55.751040 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1205/2397] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:55.762075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:55.763353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:55.772109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:55.772800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:55.773980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:55.774880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:55.776292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:55.776896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:56.327883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:56.341622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:56.355688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:56.357101 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f949f370-f94c-41e8-a599-83243a4d08a6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1359 microversion: 2.21 time: 1.048533 Oct 28 19:16:56.358214 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1193/2398] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:16:55 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1359 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:16:56.373815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:56.374977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:56.392216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:56.393980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:56.395110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:56.396879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:56.399544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:56.401697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:56.666621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:56.677815 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e80e0817-c796-45ef-9b3c-1b480f884254 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1284 microversion: 2.1 time: 0.318197 Oct 28 19:16:56.678404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1194/2399] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:56 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1284 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:56.700469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6207fa3-40f3-4af6-bf86-ab321fc0fe85 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d7ff74e50>, body: {"security_group_rule": {"parent_group_id": "b73ba637-aa67-4383-95bd-2d2e4547fa74", "ip_protocol": "tempest-999-1148750997", "from_port": 22, "to_port": 22}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:56.702367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:56.710301 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b784181a-d7b2-496b-8e63-5d36e9c3b0d3 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1314 microversion: 2.1 time: 0.957555 Oct 28 19:16:56.710919 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1206/2400] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:55 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:56.721224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd3830b7-6aee-4531-9288-6b3743c4481c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d779fb820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:56.725280 n-d-862769-3 devstack@n-api.service[120628]: WARNING oslo_db.sqlalchemy.utils [None req-cd3830b7-6aee-4531-9288-6b3743c4481c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 19:16:56.743661 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd3830b7-6aee-4531-9288-6b3743c4481c tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.031578 Oct 28 19:16:56.744909 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1207/2401] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:16:56 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:56.750021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:56.759647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:56.775153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:56.776297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:56.776864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:56.777742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:56.778326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:56.778914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:56.948489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b6207fa3-40f3-4af6-bf86-ab321fc0fe85 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Invalid IP protocol tempest-999-1148750997. Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6207fa3-40f3-4af6-bf86-ab321fc0fe85 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 157 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: {"security_group_rule": {"parent_group_id": "b73ba637-aa67-4383-95bd-2d2e4547fa74", "ip_protocol": "tempest-999-1148750997", "from_port": 22, "to_port": 22}} Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid IP protocol tempest-999-1148750997. Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b73ba637-aa67-4383-95bd-2d2e4547fa74', 'ip_protocol': 'tempest-999-1148750997', 'from_port': 22, 'to_port': 22}}} Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1148750997. Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1148750997. Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:56.950172 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1148750997. Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6207fa3-40f3-4af6-bf86-ab321fc0fe85 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 400 to user: Invalid IP protocol tempest-999-1148750997. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6207fa3-40f3-4af6-bf86-ab321fc0fe85 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.255553 Oct 28 19:16:56.953563 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1195/2402] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:56 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:16:56.958138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ed838bef-80d9-4580-a8f3-fa63ac9562f5 req-78a5fe60-0e94-476c-8d70-b28e7d6da6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0df7cfb-3b55-4ea5-9256-723a8708f88d", "tag": "6992b72d-4531-452b-8521-2d37bb71974c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:56.987728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ed838bef-80d9-4580-a8f3-fa63ac9562f5 req-78a5fe60-0e94-476c-8d70-b28e7d6da6fa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:56.989081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ed838bef-80d9-4580-a8f3-fa63ac9562f5 req-78a5fe60-0e94-476c-8d70-b28e7d6da6fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:56.989652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ed838bef-80d9-4580-a8f3-fa63ac9562f5 req-78a5fe60-0e94-476c-8d70-b28e7d6da6fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:57.008254 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ed838bef-80d9-4580-a8f3-fa63ac9562f5 req-78a5fe60-0e94-476c-8d70-b28e7d6da6fa service nova] Creating event network-changed:6992b72d-4531-452b-8521-2d37bb71974c for instance a0df7cfb-3b55-4ea5-9256-723a8708f88d on n-h1-862769-3 Oct 28 19:16:57.015364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ed838bef-80d9-4580-a8f3-fa63ac9562f5 req-78a5fe60-0e94-476c-8d70-b28e7d6da6fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061301 Oct 28 19:16:57.016606 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1196/2403] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:57.023828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa962ab3-4b9e-4422-ad26-e4c1e01eff5d tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d77bcb1f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:57.048739 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa962ab3-4b9e-4422-ad26-e4c1e01eff5d tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1968212364" status: 202 len: 0 microversion: 2.1 time: 0.029808 Oct 28 19:16:57.049678 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1197/2404] 10.222.0.44 () {58 vars in 1278 bytes} [Fri Oct 28 19:16:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1968212364 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:57.057112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c8128e4-da70-4fda-ad69-a97bbbf4e887 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d77b8bdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-764013141", "description": "tempest-description-746107378"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:57.195851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:57.207936 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e392c2f3-784a-4d0e-9920-267b6e20b322 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1313 microversion: 2.1 time: 0.461363 Oct 28 19:16:57.208822 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1208/2405] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:56 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:57.214681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7963431-b5ad-4c8b-b821-30a98f76dbf0 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d77a3fa60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:57.246071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7963431-b5ad-4c8b-b821-30a98f76dbf0 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1920607531" status: 202 len: 0 microversion: 2.1 time: 0.035794 Oct 28 19:16:57.250852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1209/2406] 10.222.0.44 () {58 vars in 1278 bytes} [Fri Oct 28 19:16:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1920607531 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:57.257551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d094b672-0916-46c7-abc1-481fc86600c3 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] Calling method '.version_select at 0x7f1d777d7310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:57.295707 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d094b672-0916-46c7-abc1-481fc86600c3 tempest-KeyPairsV2TestJSON-311836369 tempest-KeyPairsV2TestJSON-311836369-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1778637219" status: 202 len: 0 microversion: 2.1 time: 0.042999 Oct 28 19:16:57.296670 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1210/2407] 10.222.0.44 () {58 vars in 1278 bytes} [Fri Oct 28 19:16:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1778637219 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:57.394496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:57.396326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:57.424166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:57.425291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:57.430275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:57.432400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:57.434092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:57.435063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:57.707449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c8128e4-da70-4fda-ad69-a97bbbf4e887 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.656403 Oct 28 19:16:57.708490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1198/2408] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:16:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:57.724318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-38ba1f70-3d52-4d41-8df9-20789a437c65 req-9a57f08a-8de1-4c9c-91e4-09f8917d7b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a9adc5-334c-4b5e-b804-3fed340769f4", "tag": "c4d9e8d3-51ad-44f3-8e24-58d12b3521fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:57.736177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38ba1f70-3d52-4d41-8df9-20789a437c65 req-9a57f08a-8de1-4c9c-91e4-09f8917d7b69 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:57.736825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38ba1f70-3d52-4d41-8df9-20789a437c65 req-9a57f08a-8de1-4c9c-91e4-09f8917d7b69 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:57.737430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38ba1f70-3d52-4d41-8df9-20789a437c65 req-9a57f08a-8de1-4c9c-91e4-09f8917d7b69 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:57.749194 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-38ba1f70-3d52-4d41-8df9-20789a437c65 req-9a57f08a-8de1-4c9c-91e4-09f8917d7b69 service nova] Creating event network-changed:c4d9e8d3-51ad-44f3-8e24-58d12b3521fc for instance 47a9adc5-334c-4b5e-b804-3fed340769f4 on n-h1-862769-3 Oct 28 19:16:57.754765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-38ba1f70-3d52-4d41-8df9-20789a437c65 req-9a57f08a-8de1-4c9c-91e4-09f8917d7b69 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044824 Oct 28 19:16:57.756104 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1199/2409] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:57.762463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:57.763378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:57.772891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:57.773592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:57.774162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:57.776799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:57.777418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:57.778137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:57.804861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:57.993467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:58.006514 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bff78f22-407c-4768-8e74-401255817120 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1284 microversion: 2.1 time: 0.248963 Oct 28 19:16:58.007808 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1200/2410] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:57 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:58.025126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9d4da0db-a1da-481c-beaf-7517a364245a tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d77a9c8b0>, body: {"security_group_rule": {"parent_group_id": "6325051a-8cdb-44e7-8fb9-f0b6b5ec42ef", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:58.066308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:58.080359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:58.088289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:58.092065 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-42296397-8174-42f2-950c-07af658fc5ae tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1359 microversion: 2.21 time: 0.710387 Oct 28 19:16:58.096651 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1211/2411] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:16:57 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1359 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:16:58.101767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:58.104701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:58.120348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:58.124138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:58.124528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:58.125281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:58.132524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:58.133219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:58.175895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:58.449446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9d4da0db-a1da-481c-beaf-7517a364245a tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9d4da0db-a1da-481c-beaf-7517a364245a tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 138 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: {"security_group_rule": {"parent_group_id": "6325051a-8cdb-44e7-8fb9-f0b6b5ec42ef", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6325051a-8cdb-44e7-8fb9-f0b6b5ec42ef', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 19:16:58.456659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 19:16:58.459998 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:16:58.461928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9d4da0db-a1da-481c-beaf-7517a364245a tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:16:58.464392 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9d4da0db-a1da-481c-beaf-7517a364245a tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.455242 Oct 28 19:16:58.471363 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1201/2412] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:58 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 463 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:16:58.484736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:58.488146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:58.490731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:58.508218 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ac28c2d-8ffd-45c6-89b1-d69a2fa0cc10 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1501 microversion: 2.1 time: 0.409994 Oct 28 19:16:58.509709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:58.510211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:58.510433 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1212/2413] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:58 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1501 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:58.510646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:58.511390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:58.511847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:58.516045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:58.528519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43d9f275-628d-49ab-bc2f-367a0a6bf9d8 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d777cb0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2089031764", "description": "tempest-description-1647187349"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:59.013760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:59.029532 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6c9fc99f-8dc6-4ef4-8d57-2310f10ae0a1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1313 microversion: 2.1 time: 0.556371 Oct 28 19:16:59.042723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1202/2414] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:58 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:59.042723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:59.042723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:59.043276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.043586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.044177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.051124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.051788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.052302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.105212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lazy-loading 'flavor' on Instance uuid 9d25f8d4-6476-4a63-99e4-45251d6a28cd {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:16:59.298509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43d9f275-628d-49ab-bc2f-367a0a6bf9d8 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.786505 Oct 28 19:16:59.300024 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1213/2415] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:16:58 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:59.305144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:59.305934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:59.321914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.322397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.322849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.323000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04b71f83-9f02-4f31-a912-14a0eedf20f0 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "POST /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd/action" status: 202 len: 0 microversion: 2.1 time: 0.291009 Oct 28 19:16:59.323557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.324042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.327142 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1203/2416] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:59 2022] POST /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:59.332711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.338064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-df50ea16-0f21-4a04-8d2a-900d6686badc req-86bb1791-0ab5-448f-b529-a08eded66892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa4a1f5-9486-4434-92ff-0e89399305d4", "tag": "23a728ff-b081-4ce7-9a13-065d524f317a"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:59.355871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-df50ea16-0f21-4a04-8d2a-900d6686badc req-86bb1791-0ab5-448f-b529-a08eded66892 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.356906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-df50ea16-0f21-4a04-8d2a-900d6686badc req-86bb1791-0ab5-448f-b529-a08eded66892 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.357653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-df50ea16-0f21-4a04-8d2a-900d6686badc req-86bb1791-0ab5-448f-b529-a08eded66892 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.372278 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-df50ea16-0f21-4a04-8d2a-900d6686badc req-86bb1791-0ab5-448f-b529-a08eded66892 service nova] Creating event network-changed:23a728ff-b081-4ce7-9a13-065d524f317a for instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 on n-h2-862769-3 Oct 28 19:16:59.381478 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-df50ea16-0f21-4a04-8d2a-900d6686badc req-86bb1791-0ab5-448f-b529-a08eded66892 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050678 Oct 28 19:16:59.383348 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1204/2417] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:59.391561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:59.392573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:59.400765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.401640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.402305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.403409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.407665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.408355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.830898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:59.838940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:59.844017 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb55f4db-2175-4ba4-b35f-4cfb2c398c25 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1351 microversion: 2.1 time: 0.539723 Oct 28 19:16:59.859522 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1214/2418] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:59 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1351 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:59.866432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-394faf62-3513-4d2c-97b1-f491b875541e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d777dcb80>, body: {"security_group_rule": {"parent_group_id": "2e9a59d0-4f06-4466-8947-22b1f9ad4e8d", "ip_protocol": "tcp", "from_port": 22, "to_port": 1989797577}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:59.886987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:59.897379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:59.901791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:59.905879 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-894aa40b-ca8c-4e51-8b12-48364d0f919e tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1359 microversion: 2.21 time: 0.519428 Oct 28 19:16:59.916065 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1205/2419] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:16:59 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1359 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:16:59.938560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:59.939871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:59.956525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.959175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.959860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:59.961582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:59.964165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:59.964720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.025058 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-394faf62-3513-4d2c-97b1-f491b875541e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Invalid port range 22:1989797577. Valid TCP ports should be between 1-65535 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-394faf62-3513-4d2c-97b1-f491b875541e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 146 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: {"security_group_rule": {"parent_group_id": "2e9a59d0-4f06-4466-8947-22b1f9ad4e8d", "ip_protocol": "tcp", "from_port": 22, "to_port": 1989797577}} Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid port range 22:1989797577. Valid TCP ports should be between 1-65535 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e9a59d0-4f06-4466-8947-22b1f9ad4e8d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1989797577}}} Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1989797577. Valid TCP ports should be between 1-65535 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1989797577. Valid TCP ports should be between 1-65535 Oct 28 19:17:00.026860 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1989797577. Valid TCP ports should be between 1-65535 Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-394faf62-3513-4d2c-97b1-f491b875541e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 400 to user: Invalid port range 22:1989797577. Valid TCP ports should be between 1-65535 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-394faf62-3513-4d2c-97b1-f491b875541e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.179010 Oct 28 19:17:00.033131 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1215/2420] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:16:59 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:17:00.041445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Action: 'create', calling method: .version_select at 0x7f1d777c3f70>, body: {"security_group_rule": {"parent_group_id": "673b12fb-6577-49e7-9011-f5b1165107ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:00.127686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG neutronclient.v2_0.client [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist", "detail": ""}} {{(pid=120628) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:17:00.128501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.security_group_api [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Neutron security group 673b12fb-6577-49e7-9011-f5b1165107ba not found {{(pid=120628) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 19:17:00.129305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.129305 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 138 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: {"security_group_rule": {"parent_group_id": "673b12fb-6577-49e7-9011-f5b1165107ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: exception: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'security_group_rule': {'parent_group_id': '673b12fb-6577-49e7-9011-f5b1165107ba', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:17:00.132523 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] Oct 28 19:17:00.136340 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.139778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 404 to user: Security group 673b12fb-6577-49e7-9011-f5b1165107ba does not exist Oct 28 19:17:00.139778 n-d-862769-3 devstack@n-api.service[120628]: Neutron server returns request_ids: ['req-b134a914-009a-4862-91a4-0c4a3ce9dbed'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:00.140978 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8479014-f25d-417c-8359-ba98d75cfdc5 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.104084 Oct 28 19:17:00.142076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1216/2421] 10.222.0.44 () {60 vars in 1195 bytes} [Fri Oct 28 19:17:00 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:17:00.152658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8e1201eb-4bf8-4a60-a549-7d285407395f req-0da6e6dd-2eae-4d10-afea-9f104875d85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0df7cfb-3b55-4ea5-9256-723a8708f88d", "name": "network-vif-plugged", "status": "completed", "tag": "6992b72d-4531-452b-8521-2d37bb71974c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:00.175545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e1201eb-4bf8-4a60-a549-7d285407395f req-0da6e6dd-2eae-4d10-afea-9f104875d85d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.177042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e1201eb-4bf8-4a60-a549-7d285407395f req-0da6e6dd-2eae-4d10-afea-9f104875d85d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.177877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e1201eb-4bf8-4a60-a549-7d285407395f req-0da6e6dd-2eae-4d10-afea-9f104875d85d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.201348 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8e1201eb-4bf8-4a60-a549-7d285407395f req-0da6e6dd-2eae-4d10-afea-9f104875d85d service nova] Creating event network-vif-plugged:6992b72d-4531-452b-8521-2d37bb71974c for instance a0df7cfb-3b55-4ea5-9256-723a8708f88d on n-h1-862769-3 Oct 28 19:17:00.212588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8e1201eb-4bf8-4a60-a549-7d285407395f req-0da6e6dd-2eae-4d10-afea-9f104875d85d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068398 Oct 28 19:17:00.214579 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1217/2422] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:00.230179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:00.232996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:00.246347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.248044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.249360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.250417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.252648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.253229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.288280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:00.310333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-030f116f-3f06-4102-b16b-1224a14fb0ea tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1492 microversion: 2.1 time: 0.392948 Oct 28 19:17:00.315031 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1206/2423] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:59 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1492 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:00.320417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d77c4d4c0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:00.446438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:17:00.448556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Neutron security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 not found {{(pid=120629) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 28 19:17:00.449542 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] HTTP exception thrown: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.449542 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Request method failure captured: Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-security-group-rules/8fc57dc2-f0c4-4204-8cc2-cdeddc269502 HTTP/1.1 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqfcM6jzrTBvj7w4mZWmyFY4C92-nRF0ZOKzrJKhEde-tPDa0E39f1JGCtNQU9H-A0Hrnhlf3Vv9OwV847NhbwKqEV5sYqUUHf1c-KxA3wCHo6UFGQD-42KA2J8LEkSAJLs7_yLuOn-Z7Qmm-Hhq6RSEw5-s_lex3-P9pzpdP48jD8 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9ee1d7b233e54b3995f3cb31ae1a04a4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9ee1d7b233e54b3995f3cb31ae1a04a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 9ee1d7b233e54b3995f3cb31ae1a04a4 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c932502a64d64e799857e10fecc17ad1 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: exception: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8fc57dc2-f0c4-4204-8cc2-cdeddc269502'} Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:17:00.453786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] Oct 28 19:17:00.457970 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:00.461737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Returning 404 to user: Security group rule 8fc57dc2-f0c4-4204-8cc2-cdeddc269502 does not exist Oct 28 19:17:00.461737 n-d-862769-3 devstack@n-api.service[120629]: Neutron server returns request_ids: ['req-cb1dbdb8-9ace-48a7-b57b-a5099d85a7fd'] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:00.464356 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c42278d-ba2a-4840-bb9b-45664137c073 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-group-rules/8fc57dc2-f0c4-4204-8cc2-cdeddc269502" status: 404 len: 199 microversion: 2.1 time: 0.148216 Oct 28 19:17:00.465484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1207/2424] 10.222.0.44 () {58 vars in 1287 bytes} [Fri Oct 28 19:17:00 2022] DELETE /compute/v2.1/os-security-group-rules/8fc57dc2-f0c4-4204-8cc2-cdeddc269502 => generated 199 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:00.470344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:00.471833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:00.486544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.487249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.487853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.488839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.489460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.490029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.520914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:17:00.621297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:00.630586 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-abd327ea-0e4b-4d49-983e-017267f4eddc tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 204 len: 0 microversion: 2.1 time: 0.163662 Oct 28 19:17:00.631527 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1208/2425] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:00 2022] DELETE /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:17:00.692816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:00.703664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1b3c8f2-c043-4b8a-8ff1-ddd8475c6549 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1313 microversion: 2.1 time: 0.487509 Oct 28 19:17:00.704858 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1218/2426] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:00 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:00.711330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7732f004-9acb-4093-aaa6-afcc8d978d01 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d77831a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:00.840260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-05e1cc69-0729-46d8-b25d-dffa2efb0b64 tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] Calling method '.version_select at 0x7f1d77c3adc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:00.857741 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-05e1cc69-0729-46d8-b25d-dffa2efb0b64 tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.224513 Oct 28 19:17:00.858531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1209/2427] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:17:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:00.863400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:00.864115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:00.873347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.874047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.875205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:00.876158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:00.876918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:00.877479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.127517 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7732f004-9acb-4093-aaa6-afcc8d978d01 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/2e9a59d0-4f06-4466-8947-22b1f9ad4e8d" status: 202 len: 0 microversion: 2.1 time: 0.419343 Oct 28 19:17:01.131000 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1219/2428] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:17:00 2022] DELETE /compute/v2.1/os-security-groups/2e9a59d0-4f06-4466-8947-22b1f9ad4e8d => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:01.139507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:01.140239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fddd14e9-b60f-4d8c-8bfa-a0abf7844852 tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] Action: 'update', calling method: .version_select at 0x7f1d7c993790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:01.151400 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6ee88b63-f7b3-40a2-ba96-56afabe2420c tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1498 microversion: 2.1 time: 0.291596 Oct 28 19:17:01.158743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1210/2429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:00 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1498 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:01.167445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:01.172188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:01.183197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.183870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.184456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.185345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.185948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.186521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.454364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:01.464302 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f2c0f0f-8d83-463e-b646-62c76f95b13d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1351 microversion: 2.1 time: 0.311232 Oct 28 19:17:01.473541 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1211/2430] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:01 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:01.495954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:01.497104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:01.515604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.516089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.516545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.517214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.517655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.518302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.545291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fddd14e9-b60f-4d8c-8bfa-a0abf7844852 tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.412536 Oct 28 19:17:01.557425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1220/2431] 10.222.0.44 () {60 vars in 1206 bytes} [Fri Oct 28 19:17:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:01.563644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-14f3a3b1-4cb9-4ee6-bbc9-e3fca2629c72 req-e1c9c6ab-7657-44a2-acdc-6c46b15cefde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be98aa9-0950-4d39-8f74-df0c2320cba0", "tag": "0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:01.575881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-14f3a3b1-4cb9-4ee6-bbc9-e3fca2629c72 req-e1c9c6ab-7657-44a2-acdc-6c46b15cefde service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.576526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-14f3a3b1-4cb9-4ee6-bbc9-e3fca2629c72 req-e1c9c6ab-7657-44a2-acdc-6c46b15cefde service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.577816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-14f3a3b1-4cb9-4ee6-bbc9-e3fca2629c72 req-e1c9c6ab-7657-44a2-acdc-6c46b15cefde service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.591428 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-14f3a3b1-4cb9-4ee6-bbc9-e3fca2629c72 req-e1c9c6ab-7657-44a2-acdc-6c46b15cefde service nova] Creating event network-changed:0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3 for instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 on n-h1-862769-3 Oct 28 19:17:01.598852 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-14f3a3b1-4cb9-4ee6-bbc9-e3fca2629c72 req-e1c9c6ab-7657-44a2-acdc-6c46b15cefde service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038779 Oct 28 19:17:01.600132 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1221/2432] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:01.606624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c790913-64f2-40a1-942b-38adf38d82e2 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d777e5c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:01.764168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:01.777643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:01.779123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:01.789543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5894258-ca3b-4dde-a01c-8a1ee6de72ef tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1359 microversion: 2.21 time: 0.290637 Oct 28 19:17:01.790483 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1212/2433] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:01 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:17:01.795360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4055003-6219-4ba1-922a-5673541cf1ec tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] Calling method '.version_select at 0x7f1d77a9cb80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:01.818992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4055003-6219-4ba1-922a-5673541cf1ec tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.027178 Oct 28 19:17:01.819962 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1213/2434] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:17:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:01.832539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:01.833362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:01.847621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.853027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.853515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:01.854277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:01.856244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:01.856716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:02.175591 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8c790913-64f2-40a1-942b-38adf38d82e2 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/6325051a-8cdb-44e7-8fb9-f0b6b5ec42ef" status: 202 len: 0 microversion: 2.1 time: 0.573760 Oct 28 19:17:02.180326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1222/2435] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:17:01 2022] DELETE /compute/v2.1/os-security-groups/6325051a-8cdb-44e7-8fb9-f0b6b5ec42ef => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:02.185415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-796bd17b-733f-4ef0-aecf-e7b21331cdb7 tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] Action: 'update', calling method: .version_select at 0x7f1d777e5790>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:02.211516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:02.248771 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b175a1c-ed73-4f40-9dee-fa93f4714eb5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1313 microversion: 2.1 time: 0.421245 Oct 28 19:17:02.279592 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1214/2436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:01 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:02.284961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:02.313388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:02.360948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:02.361834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:02.364655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:02.366158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:02.366978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:02.367643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:02.394803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:UPDATE=22 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:02.439525 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-796bd17b-733f-4ef0-aecf-e7b21331cdb7 tempest-QuotaClassesAdminTestJSON-2012384695 tempest-QuotaClassesAdminTestJSON-2012384695-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.257759 Oct 28 19:17:02.440792 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1223/2437] 10.222.0.44 () {60 vars in 1206 bytes} [Fri Oct 28 19:17:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:02.446979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc6a0c9a-0388-4a0f-9a2e-e18fad6d5581 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d777e94c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:02.967957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:02.978150 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e15eeb8-ccf7-4cf8-a1b0-ac6703ff15bb tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1498 microversion: 2.1 time: 0.697077 Oct 28 19:17:02.995573 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1215/2438] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:02 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1498 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:03.004457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:03.005746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:03.012390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.013203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.013811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:03.014713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.015327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.015931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:03.258434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:03.270929 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-844969d4-489a-49c6-bded-1f5df14ff620 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1351 microversion: 2.1 time: 0.273892 Oct 28 19:17:03.275328 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1216/2439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:02 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:03.290514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:03.292570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:03.304014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.304988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.306206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:03.307620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.308527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.309323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:03.368870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:03.382900 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc6a0c9a-0388-4a0f-9a2e-e18fad6d5581 tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/b73ba637-aa67-4383-95bd-2d2e4547fa74" status: 202 len: 0 microversion: 2.1 time: 0.940350 Oct 28 19:17:03.384966 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1224/2440] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:17:02 2022] DELETE /compute/v2.1/os-security-groups/b73ba637-aa67-4383-95bd-2d2e4547fa74 => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:03.393683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8739f82a-1e18-4ce9-8668-c152566f5094 req-d9325f91-9e5a-4ecf-8131-6350afafb3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa4a1f5-9486-4434-92ff-0e89399305d4", "name": "network-vif-plugged", "status": "completed", "tag": "23a728ff-b081-4ce7-9a13-065d524f317a"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:03.449828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8739f82a-1e18-4ce9-8668-c152566f5094 req-d9325f91-9e5a-4ecf-8131-6350afafb3e3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.451052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8739f82a-1e18-4ce9-8668-c152566f5094 req-d9325f91-9e5a-4ecf-8131-6350afafb3e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.452041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8739f82a-1e18-4ce9-8668-c152566f5094 req-d9325f91-9e5a-4ecf-8131-6350afafb3e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:03.490400 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8739f82a-1e18-4ce9-8668-c152566f5094 req-d9325f91-9e5a-4ecf-8131-6350afafb3e3 service nova] Creating event network-vif-plugged:23a728ff-b081-4ce7-9a13-065d524f317a for instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 on n-h2-862769-3 Oct 28 19:17:03.496791 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8739f82a-1e18-4ce9-8668-c152566f5094 req-d9325f91-9e5a-4ecf-8131-6350afafb3e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109609 Oct 28 19:17:03.499263 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1225/2441] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:03.517966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:03.518748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:03.526883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.527480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.536873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:03.540993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:03.541496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:03.542408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.037442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:04.052704 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-33124d5c-69a8-46b9-9fd9-e67794f0b208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1313 microversion: 2.1 time: 0.552055 Oct 28 19:17:04.053966 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1226/2442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:03 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:04.059886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-441e2445-bd65-4f96-84be-468c91930598 req-2f8c5b52-f619-4a78-92d3-cefdd4f8cb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d25f8d4-6476-4a63-99e4-45251d6a28cd", "name": "network-vif-deleted", "tag": "e9343740-51cb-4c76-9dc3-38f16ecf906b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:04.069398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:04.083299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:04.083626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-441e2445-bd65-4f96-84be-468c91930598 req-2f8c5b52-f619-4a78-92d3-cefdd4f8cb37 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.084205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-441e2445-bd65-4f96-84be-468c91930598 req-2f8c5b52-f619-4a78-92d3-cefdd4f8cb37 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.084877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-441e2445-bd65-4f96-84be-468c91930598 req-2f8c5b52-f619-4a78-92d3-cefdd4f8cb37 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.094150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:04.095641 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4170e753-6844-452b-9e27-c9ba47968208 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1553 microversion: 2.21 time: 0.818982 Oct 28 19:17:04.108062 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1217/2443] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:03 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1553 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:17:04.112010 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-441e2445-bd65-4f96-84be-468c91930598 req-2f8c5b52-f619-4a78-92d3-cefdd4f8cb37 service nova] Creating event network-vif-deleted:e9343740-51cb-4c76-9dc3-38f16ecf906b for instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd on n-h2-862769-3 Oct 28 19:17:04.121267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cecdecbe-5765-4d51-a7e3-9aab7968c72e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d80002c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:04.128947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-441e2445-bd65-4f96-84be-468c91930598 req-2f8c5b52-f619-4a78-92d3-cefdd4f8cb37 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068959 Oct 28 19:17:04.130611 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1227/2444] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:04.139458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:04.140846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:04.148826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.149735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.150836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.151820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.152594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.153270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.198543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.199375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.200036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.200975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lazy-loading 'fault' on Instance uuid 9d25f8d4-6476-4a63-99e4-45251d6a28cd {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:17:04.365121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810c2ad77cf46e39987a29f64c2b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93607878d8054461ac3df081a4803b81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:04.375302 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f982117-2f74-48f2-a045-4c6189033a58 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 200 len: 1304 microversion: 2.1 time: 0.242859 Oct 28 19:17:04.377093 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1228/2445] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:04 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 1304 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:04.382744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:04.383689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:04.398917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.399583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.405614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.406677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.407499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.408058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.493730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:17:04.627339 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-febd0cda-26d5-4025-abbc-af6329f70a99 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 204 len: 0 microversion: 2.21 time: 0.248354 Oct 28 19:17:04.629114 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1229/2446] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:17:04 2022] DELETE /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:17:04.638539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:04.639834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:04.649043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.649894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.651060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:04.652879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:04.654398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:04.656696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.001764 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cecdecbe-5765-4d51-a7e3-9aab7968c72e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/e7842a72-61ed-4de0-b1f2-0bc38217a513" status: 202 len: 0 microversion: 2.1 time: 0.892092 Oct 28 19:17:05.004563 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1218/2447] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:17:04 2022] DELETE /compute/v2.1/os-security-groups/e7842a72-61ed-4de0-b1f2-0bc38217a513 => generated 0 bytes in 895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:05.010225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.011155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.031014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.032227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:05.034183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.037204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.038933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.040531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.041249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.046048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-260482dc-e858-4df4-a0cd-01b7d4af9436 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1351 microversion: 2.1 time: 0.411539 Oct 28 19:17:05.047193 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1230/2448] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:04 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1351 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:05.059234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0ee1227-8ff3-4b6b-be77-a54002ac631e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] Calling method '.version_select at 0x7f1d777e9280>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.089096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:05.334564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:05.349541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:05.351262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:05.353013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7fd2f32f-d018-4f3f-a628-fae4ccb63f7d tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1559 microversion: 2.21 time: 0.347169 Oct 28 19:17:05.366716 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1219/2449] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:05 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1559 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:17:05.366716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.366716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.370638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.371432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.372007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.373345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.374477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.375527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.553048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0ee1227-8ff3-4b6b-be77-a54002ac631e tempest-SecurityGroupRulesNegativeTestJSON-1049112015 tempest-SecurityGroupRulesNegativeTestJSON-1049112015-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/169a24aa-9373-44cd-99f9-007e016b7515" status: 202 len: 0 microversion: 2.1 time: 0.504531 Oct 28 19:17:05.553648 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1231/2450] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:17:05 2022] DELETE /compute/v2.1/os-security-groups/169a24aa-9373-44cd-99f9-007e016b7515 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:05.558484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.559126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.580448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.580955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.581391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.582148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.582603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.583048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.613046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd HTTP/1.1 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9d25f8d4-6476-4a63-99e4-45251d6a28cd'} Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.616739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.620402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.626407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:05.629127 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-96f9f300-6bc6-4a72-8a19-43b99f459139 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 404 len: 111 microversion: 2.1 time: 0.074533 Oct 28 19:17:05.646417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1232/2451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:05 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:05.660251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.663321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.690781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.691897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.694339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.695411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.696890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.698554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.719350 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd HTTP/1.1 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9d25f8d4-6476-4a63-99e4-45251d6a28cd'} Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:05.722756 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.726068 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.730032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:05.733497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:05.735423 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75027d5b-814a-4d22-a221-cc71910799de tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 404 len: 111 microversion: 2.1 time: 0.085499 Oct 28 19:17:05.739848 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1233/2452] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:05 2022] DELETE /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:05.742060 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82d87cb9-ead9-4b90-9550-7398b3520d86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1462 microversion: 2.1 time: 0.386524 Oct 28 19:17:05.743793 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1220/2453] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:05 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1462 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:05.747339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.748212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9d25f8d4-6476-4a63-99e4-45251d6a28cd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.756275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.757071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.757723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.758632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.759351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.760014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.789173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd HTTP/1.1 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9d25f8d4-6476-4a63-99e4-45251d6a28cd'} Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.791073 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. Oct 28 19:17:05.795835 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.799134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 9d25f8d4-6476-4a63-99e4-45251d6a28cd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:05.800240 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-93700c27-c946-427f-b28f-554b8315e4c1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd" status: 404 len: 111 microversion: 2.1 time: 0.058907 Oct 28 19:17:05.801077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1234/2454] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:05 2022] GET /compute/v2.1/servers/9d25f8d4-6476-4a63-99e4-45251d6a28cd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:05.813436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.821739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.837574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.838333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.839459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.840337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.841418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.843613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.882222 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 HTTP/1.1 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'aea55ae1-785f-4e88-810d-6b0ada2a6141'} Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:05.888827 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.892814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.897192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:05.900023 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f6c387c7-e71c-424f-b98e-c37b6cbcc27a tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 404 len: 111 microversion: 2.1 time: 0.093701 Oct 28 19:17:05.901724 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1235/2455] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:05 2022] DELETE /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:05.910454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:05.912041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: aea55ae1-785f-4e88-810d-6b0ada2a6141] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:05.935622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.939948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.941857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.942854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:05.944246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:05.944917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:05.975586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 HTTP/1.1 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'aea55ae1-785f-4e88-810d-6b0ada2a6141'} Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:05.977458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. Oct 28 19:17:05.980873 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:05.985536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance aea55ae1-785f-4e88-810d-6b0ada2a6141 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:05.986587 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1cdc321-5b14-4548-9e10-3d7efcb4abb1 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141" status: 404 len: 111 microversion: 2.1 time: 0.081773 Oct 28 19:17:05.987735 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1236/2456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:05 2022] GET /compute/v2.1/servers/aea55ae1-785f-4e88-810d-6b0ada2a6141 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:06.000209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:06.002511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:06.016855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.025851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.026550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.027458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.028055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.028631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.056034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf HTTP/1.1 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9908d12e-78a2-487f-b024-6b70458c31bf'} Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:06.057928 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.061815 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.063353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:06.065684 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77207017-dda8-41b9-916d-98007044bb4d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 404 len: 111 microversion: 2.1 time: 0.073892 Oct 28 19:17:06.068533 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1237/2457] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:05 2022] DELETE /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:06.084102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:06.085544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:06.101503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.101994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.104314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.105045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.105500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.105920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.283331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:06.292910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'deleted': False, 'project_id': '435faac05a8e477083bf9dcb78a048a9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:06.307273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.312491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.313359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.314684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.316321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.316992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.449316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-84e700a9-aa1e-4350-b525-fd1417aeddaa tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.680774 Oct 28 19:17:06.451644 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1221/2458] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:17:05 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:17:06.457554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:06.458790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 9908d12e-78a2-487f-b024-6b70458c31bf] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:06.476589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.477970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.480965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.482584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.488589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.492471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.531763 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf HTTP/1.1 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9908d12e-78a2-487f-b024-6b70458c31bf'} Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:06.533618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. Oct 28 19:17:06.537544 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:06.540295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 9908d12e-78a2-487f-b024-6b70458c31bf could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:06.541913 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dba135e2-7b90-48d0-91c7-ffc5548b28dd tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf" status: 404 len: 111 microversion: 2.1 time: 0.088628 Oct 28 19:17:06.546825 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1222/2459] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:06 2022] GET /compute/v2.1/servers/9908d12e-78a2-487f-b024-6b70458c31bf => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:06.555964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-36018318-a759-438d-b414-da171e4d6b23 req-d5ee9455-8ae6-4d2d-b24e-85753e6b41bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be98aa9-0950-4d39-8f74-df0c2320cba0", "name": "network-vif-plugged", "status": "completed", "tag": "0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:06.571907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-36018318-a759-438d-b414-da171e4d6b23 req-d5ee9455-8ae6-4d2d-b24e-85753e6b41bc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.572934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-36018318-a759-438d-b414-da171e4d6b23 req-d5ee9455-8ae6-4d2d-b24e-85753e6b41bc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.573953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-36018318-a759-438d-b414-da171e4d6b23 req-d5ee9455-8ae6-4d2d-b24e-85753e6b41bc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.589804 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-36018318-a759-438d-b414-da171e4d6b23 req-d5ee9455-8ae6-4d2d-b24e-85753e6b41bc service nova] Creating event network-vif-plugged:0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3 for instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 on n-h1-862769-3 Oct 28 19:17:06.596106 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-36018318-a759-438d-b414-da171e4d6b23 req-d5ee9455-8ae6-4d2d-b24e-85753e6b41bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047592 Oct 28 19:17:06.597332 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1223/2460] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:06.604319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:06.605156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:06.613747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.614454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.615112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.615964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.616554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.617129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.674000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:06.685465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b11fcd5a-477e-4eec-ab8c-dc6dadf7df3e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1351 microversion: 2.1 time: 0.615112 Oct 28 19:17:06.705291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1238/2461] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:06 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1351 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:06.712789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:06.731212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'deleted': False} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:06.750720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.751505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.752288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.755607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:06.756755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:06.757663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:06.977889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:17:06.978765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:06.991301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:06.992975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:06.994189 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-79192508-6e69-4c82-9e62-5637db013679 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1559 microversion: 2.21 time: 0.395395 Oct 28 19:17:06.995527 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1224/2462] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:06 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1559 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:17:07.014067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.014599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:07.031038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.031531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.031959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.033402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.033863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.034281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.074104 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c HTTP/1.1 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f286edc2-7e69-481a-a2c7-f5810c8a2a5c'} Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:07.075825 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7aadd8d2-a8c8-47d7-9205-e133d03b04f7 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 404 len: 111 microversion: 2.1 time: 0.081518 Oct 28 19:17:07.079180 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1225/2463] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:06 2022] DELETE /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:07.096007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=7 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:07.115981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.116827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.117475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.332986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ec4af04-626f-4b98-bc52-a15a946d4298 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.342752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ec4af04-626f-4b98-bc52-a15a946d4298 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.259143 Oct 28 19:17:07.343932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1226/2464] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:07.358320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.359735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: f286edc2-7e69-481a-a2c7-f5810c8a2a5c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:07.373008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.373815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.374579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.375776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.376471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.377109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.397841 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c HTTP/1.1 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f286edc2-7e69-481a-a2c7-f5810c8a2a5c'} Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.399812 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. Oct 28 19:17:07.403222 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.420765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance f286edc2-7e69-481a-a2c7-f5810c8a2a5c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:07.422367 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-104ae6e5-3a58-49c8-bbf0-379c6cfad25d tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c" status: 404 len: 111 microversion: 2.1 time: 0.077057 Oct 28 19:17:07.425286 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1227/2465] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/servers/f286edc2-7e69-481a-a2c7-f5810c8a2a5c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:07.438745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7c5e771-330e-4adf-96b3-15116de068e7 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.481168 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7c5e771-330e-4adf-96b3-15116de068e7 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.054256 Oct 28 19:17:07.483648 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1228/2466] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:07.489161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.491467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:07.499286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.500127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.501421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.502391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.503235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.503996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.520021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db HTTP/1.1 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '17d7e582-bee3-4782-9f53-bb1672c825db'} Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:07.521711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.525328 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.527528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:07.528402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f810ceb9-347f-4a5a-9b2c-05a78f32fce9 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db" status: 404 len: 111 microversion: 2.1 time: 0.043418 Oct 28 19:17:07.528910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1229/2467] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:07 2022] DELETE /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:07.543238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f112ab9-179c-409d-9334-ec16cacf8bd5 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.551933 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9f112ab9-179c-409d-9334-ec16cacf8bd5 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021095 Oct 28 19:17:07.553393 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1230/2468] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:07.570895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.572805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 17d7e582-bee3-4782-9f53-bb1672c825db] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:07.580600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.581445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.582190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.582937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.583389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.583804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.598405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db HTTP/1.1 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '17d7e582-bee3-4782-9f53-bb1672c825db'} Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:07.600257 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 17d7e582-bee3-4782-9f53-bb1672c825db could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1cac01a4-1a13-4211-825a-7ceff1e6450f tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db" status: 404 len: 111 microversion: 2.1 time: 0.047440 Oct 28 19:17:07.603931 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1231/2469] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/servers/17d7e582-bee3-4782-9f53-bb1672c825db => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:07.626179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f8b479a-356f-4510-b81e-50ec5e34c42a tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.647951 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f8b479a-356f-4510-b81e-50ec5e34c42a tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043179 Oct 28 19:17:07.648723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1232/2470] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:07.666607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5984b394-d909-4cbb-bbb6-b8e59f7ba943 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.764344 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5984b394-d909-4cbb-bbb6-b8e59f7ba943 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.106856 Oct 28 19:17:07.787308 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1233/2471] 10.222.0.44 () {58 vars in 1165 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:07.798761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:07.802189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:07.821163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.822013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.822638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:07.823638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:07.830163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:07.831350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:08.249984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-be354ec6-adc1-472d-8f4f-cd7f32cafbad tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9786 microversion: 2.1 time: 1.540719 Oct 28 19:17:08.250637 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1239/2472] 10.222.0.44 () {58 vars in 1171 bytes} [Fri Oct 28 19:17:06 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9786 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:08.256024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4db2a3b-65ea-49f8-8e68-70d5e6e153aa tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:08.274903 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4db2a3b-65ea-49f8-8e68-70d5e6e153aa tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022879 Oct 28 19:17:08.276512 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1240/2473] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:08.283836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:08.290820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:08.310442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:08.311218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:08.311831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:08.312701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:08.313297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:08.313865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:08.642420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:08.662322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:08.663882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e2e39ce965f4cfaa8ea80ab62898593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f385a5f3e02a40a9ae0f5f4f1f1005ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:08.672155 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02668c92-6b2d-4302-9496-907bb4d35569 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 200 len: 1517 microversion: 2.21 time: 0.387344 Oct 28 19:17:08.681732 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1241/2474] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:08 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 1517 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:17:08.687612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca0e59ee-66e7-408d-bbf1-015a4b6f7645 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:08.742060 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca0e59ee-66e7-408d-bbf1-015a4b6f7645 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.058542 Oct 28 19:17:08.742576 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1242/2475] 10.222.0.44 () {58 vars in 1169 bytes} [Fri Oct 28 19:17:08 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:08.763951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:08.781231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'deleted': False, 'project_id': '435faac05a8e477083bf9dcb78a048a9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:08.799144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:08.799864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:08.800728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:08.807993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:08.808684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:08.809258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:08.976293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:08.997749 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9acf58c-095b-42b5-bdcb-3fe97cf2c6c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1351 microversion: 2.1 time: 1.209020 Oct 28 19:17:08.999004 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1234/2476] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:07 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1351 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.005367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-831ae6bc-2cac-49d3-a6c0-8337f2f2c240 req-e39cea63-3483-4268-b534-cfb94a03ab02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0df7cfb-3b55-4ea5-9256-723a8708f88d", "name": "network-vif-deleted", "tag": "6992b72d-4531-452b-8521-2d37bb71974c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:09.025809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-831ae6bc-2cac-49d3-a6c0-8337f2f2c240 req-e39cea63-3483-4268-b534-cfb94a03ab02 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.026309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-831ae6bc-2cac-49d3-a6c0-8337f2f2c240 req-e39cea63-3483-4268-b534-cfb94a03ab02 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.027883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-831ae6bc-2cac-49d3-a6c0-8337f2f2c240 req-e39cea63-3483-4268-b534-cfb94a03ab02 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.075501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-831ae6bc-2cac-49d3-a6c0-8337f2f2c240 req-e39cea63-3483-4268-b534-cfb94a03ab02 service nova] Creating event network-vif-deleted:6992b72d-4531-452b-8521-2d37bb71974c for instance a0df7cfb-3b55-4ea5-9256-723a8708f88d on n-h1-862769-3 Oct 28 19:17:09.090230 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-831ae6bc-2cac-49d3-a6c0-8337f2f2c240 req-e39cea63-3483-4268-b534-cfb94a03ab02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087832 Oct 28 19:17:09.095767 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1235/2477] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.121585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2a905a0-0622-4377-9019-5e3c98538690 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.128696 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9dfea000-79a4-47eb-89ff-359b5ae0457a tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/detail?tenant_id=046929f0d0b44a3191ed57f9d72d2dff" status: 200 len: 15 microversion: 2.1 time: 0.380908 Oct 28 19:17:09.131127 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1243/2478] 10.222.0.44 () {58 vars in 1231 bytes} [Fri Oct 28 19:17:08 2022] GET /compute/v2.1/servers/detail?tenant_id=046929f0d0b44a3191ed57f9d72d2dff => generated 15 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:17:09.155845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.162488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'tenant_id': '046929f0d0b44a3191ed57f9d72d2dff', 'deleted': False} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:09.177393 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2a905a0-0622-4377-9019-5e3c98538690 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.080277 Oct 28 19:17:09.179697 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1236/2479] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.188073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.188757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.189362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.190371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.193583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca1db09f-9e8c-4273-8982-62b8574e1dfb tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.206141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.206578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.212419 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca1db09f-9e8c-4273-8982-62b8574e1dfb tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022599 Oct 28 19:17:09.222824 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1237/2480] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.236791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-916d6af4-30db-467f-8eee-c27b998cd48f tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.315450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:17:09.345379 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-916d6af4-30db-467f-8eee-c27b998cd48f tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.121014 Oct 28 19:17:09.360052 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1238/2481] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.370411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24d7ebb4-3fab-4477-9e2d-29b18af19c9b tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.387827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24d7ebb4-3fab-4477-9e2d-29b18af19c9b tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026164 Oct 28 19:17:09.408754 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1239/2482] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.423425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8e4d7fb-850b-4dc4-be50-dbb8f336a954 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.465553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a8e4d7fb-850b-4dc4-be50-dbb8f336a954 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.055000 Oct 28 19:17:09.478157 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1240/2483] 10.222.0.44 () {58 vars in 1144 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.493726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c645334f-1920-4d22-87cd-62a73ecfa4a2 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.531772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c645334f-1920-4d22-87cd-62a73ecfa4a2 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048951 Oct 28 19:17:09.540098 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1241/2484] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.542165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.542835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.545070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b84602d5-1332-4466-b0ad-04eaa748eb27 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.550995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.624373 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b84602d5-1332-4466-b0ad-04eaa748eb27 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.080863 Oct 28 19:17:09.625237 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1242/2485] 10.222.0.44 () {58 vars in 1148 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.646445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4cbab28f-bee3-418e-86d6-457d37368805 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.662964 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4cbab28f-bee3-418e-86d6-457d37368805 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026501 Oct 28 19:17:09.663819 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1243/2486] 10.222.0.44 () {58 vars in 1140 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.681424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c5a210c-0d24-4387-a850-1cabc2e2d594 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.690632 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c5a210c-0d24-4387-a850-1cabc2e2d594 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015733 Oct 28 19:17:09.698835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1244/2487] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.707383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47d09a83-fdb1-46bc-81ff-dfb3311356f6 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.752588 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47d09a83-fdb1-46bc-81ff-dfb3311356f6 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.051995 Oct 28 19:17:09.762987 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1245/2488] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.768720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.769758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:09.776794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.777550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.778151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.779342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.780004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.780645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.806855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] HTTP exception thrown: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Request method failure captured: Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d HTTP/1.1 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqdI9N9hG1g_zP6IQFKTv6JzG7nrtFCPVSFSmqnZ3BHo6sOi95vE1W5HwS5bJcEaZEU9QV5lkFFaxU9ZeYhh603_ZdxaSOKY8m9fWx4yl8n45IBwSS-sHPP_YnJ-5OD_V3vfxbUGjdwlyHQstfaTNz7uQaTTsAvKPcKbFyyWEEMI0k Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f385a5f3e02a40a9ae0f5f4f1f1005ee Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f385a5f3e02a40a9ae0f5f4f1f1005ee", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f385a5f3e02a40a9ae0f5f4f1f1005ee Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-InstanceActionsV221TestJSON-2021262028-project Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2e2e39ce965f4cfaa8ea80ab62898593 Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-InstanceActionsV221TestJSON-2021262028-project Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a0df7cfb-3b55-4ea5-9256-723a8708f88d'} Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:09.815637 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Returning 404 to user: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:09.820403 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-162a763c-f1d4-4d3d-935e-3dae03c9f36f tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 404 len: 111 microversion: 2.21 time: 0.050491 Oct 28 19:17:09.823127 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1246/2489] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:17:09.832761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c685f3d-1a85-4c0d-aa64-07a7ed097649 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.870934 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c685f3d-1a85-4c0d-aa64-07a7ed097649 tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046439 Oct 28 19:17:09.871832 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1247/2490] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.899293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '.version_select at 0x7f1d77351670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.902269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:09.909376 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-42a6204a-e9d9-4551-ab96-eb872ef9133c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=046929f0d0b44a3191ed57f9d72d2dff" status: 200 len: 4823 microversion: 2.1 time: 0.757020 Oct 28 19:17:09.910443 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1244/2491] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=046929f0d0b44a3191ed57f9d72d2dff => generated 4823 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:09.917295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e18fb7b1-bd19-45eb-beff-a6297865da0b tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.919804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.922247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.922789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.923519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.923980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.928745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.936680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e18fb7b1-bd19-45eb-beff-a6297865da0b tempest-FlavorsV2TestJSON-303382552 tempest-FlavorsV2TestJSON-303382552-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024407 Oct 28 19:17:09.939481 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1245/2492] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:09.944265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:09.967573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'tenant_id': '435faac05a8e477083bf9dcb78a048a9', 'deleted': False} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:09.981983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.982784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.983678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:09.985373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:09.986528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:09.990243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.092020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af19b46b-520d-46de-b92e-438c748fe47c tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=435faac05a8e477083bf9dcb78a048a9" status: 200 len: 15 microversion: 2.1 time: 0.151319 Oct 28 19:17:10.099606 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1246/2493] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=435faac05a8e477083bf9dcb78a048a9 => generated 15 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:17:10.104946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:10.109303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:10.124993 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1094b27-d5cd-4d8a-b96d-b7147b2f7ab6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.237945 Oct 28 19:17:10.139396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.139763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.140192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.140895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.142009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.142009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.150291 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1248/2494] 10.222.0.44 () {60 vars in 1337 bytes} [Fri Oct 28 19:17:09 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d/os-instance-actions => generated 611 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:17:10.160733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e098af8b-5a85-4468-a6c1-591e618f4e13 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:10.163845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:10.177425 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e098af8b-5a85-4468-a6c1-591e618f4e13 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.025970 Oct 28 19:17:10.193322 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1249/2495] 10.222.0.44 () {58 vars in 1189 bytes} [Fri Oct 28 19:17:10 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:17:10.235939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:10.239297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:10.278041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.279781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.281245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.283835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.285196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.288413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.339610 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] HTTP exception thrown: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Request method failure captured: Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d HTTP/1.1 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqdI9N9hG1g_zP6IQFKTv6JzG7nrtFCPVSFSmqnZ3BHo6sOi95vE1W5HwS5bJcEaZEU9QV5lkFFaxU9ZeYhh603_ZdxaSOKY8m9fWx4yl8n45IBwSS-sHPP_YnJ-5OD_V3vfxbUGjdwlyHQstfaTNz7uQaTTsAvKPcKbFyyWEEMI0k Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f385a5f3e02a40a9ae0f5f4f1f1005ee Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f385a5f3e02a40a9ae0f5f4f1f1005ee", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f385a5f3e02a40a9ae0f5f4f1f1005ee Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-InstanceActionsV221TestJSON-2021262028-project Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2e2e39ce965f4cfaa8ea80ab62898593 Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-InstanceActionsV221TestJSON-2021262028-project Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a0df7cfb-3b55-4ea5-9256-723a8708f88d'} Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:10.345386 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.350049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Returning 404 to user: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:10.352076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e72f02fe-1411-4894-bd59-350eb5c1fbc6 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 404 len: 111 microversion: 2.21 time: 0.156743 Oct 28 19:17:10.356729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1250/2496] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:17:10 2022] DELETE /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:17:10.373230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:10.381912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:10.403787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.407864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.408831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.409729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.410563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.414501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.561177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:10.575468 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8b2f985-7b6b-43d2-9517-f880730e0fad tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1541 microversion: 2.1 time: 0.473370 Oct 28 19:17:10.577571 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1247/2497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:10 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1541 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:10.594810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:10.598752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] [instance: a0df7cfb-3b55-4ea5-9256-723a8708f88d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:10.629562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.630251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.631048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.631895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.634787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.635547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.639009 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ef05b62-1d3c-49b7-9157-852dfe19c0ae tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 0 microversion: 2.1 time: 0.280335 Oct 28 19:17:10.643813 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1251/2498] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:10 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:10.656483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:10.656996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:10.667813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] HTTP exception thrown: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.672005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.675592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.676095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.676907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.677520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.677953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Request method failure captured: Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d HTTP/1.1 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqdI9N9hG1g_zP6IQFKTv6JzG7nrtFCPVSFSmqnZ3BHo6sOi95vE1W5HwS5bJcEaZEU9QV5lkFFaxU9ZeYhh603_ZdxaSOKY8m9fWx4yl8n45IBwSS-sHPP_YnJ-5OD_V3vfxbUGjdwlyHQstfaTNz7uQaTTsAvKPcKbFyyWEEMI0k Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f385a5f3e02a40a9ae0f5f4f1f1005ee Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f385a5f3e02a40a9ae0f5f4f1f1005ee", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f385a5f3e02a40a9ae0f5f4f1f1005ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f385a5f3e02a40a9ae0f5f4f1f1005ee Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2021262028 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceActionsV221TestJSON-2021262028-project Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2e2e39ce965f4cfaa8ea80ab62898593 Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceActionsV221TestJSON-2021262028-project Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a0df7cfb-3b55-4ea5-9256-723a8708f88d'} Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.680446 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. Oct 28 19:17:10.684199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:10.689753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] Returning 404 to user: Instance a0df7cfb-3b55-4ea5-9256-723a8708f88d could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:10.690872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de7d860f-3da8-4fb8-b4cb-d213ecf1cd95 tempest-InstanceActionsV221TestJSON-2021262028 tempest-InstanceActionsV221TestJSON-2021262028-project] 10.222.0.44 "GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d" status: 404 len: 111 microversion: 2.21 time: 0.108108 Oct 28 19:17:10.693427 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1248/2499] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:17:10 2022] GET /compute/v2.1/servers/a0df7cfb-3b55-4ea5-9256-723a8708f88d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:17:10.718284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:10.723849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:10.724773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:10.744664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.745630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.746238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.748554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:10.749183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:10.749749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:10.921847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:17:11.039881 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36abfcea-d8af-46b7-ba1e-a3f19d9b36b0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.331848 Oct 28 19:17:11.048548 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1249/2500] 10.222.0.44 () {58 vars in 1150 bytes} [Fri Oct 28 19:17:10 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:11.056891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:11.061300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:11.070117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:11.070853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:11.072893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:11.074512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:11.075182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:11.075822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:11.213472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd7ff7c0-87bf-4279-8e2a-16c214fca3e7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 0 microversion: 2.1 time: 0.159578 Oct 28 19:17:11.239634 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1250/2501] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:11 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:11.255717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:11.256503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:11.265584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:11.266444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:11.267189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:11.268044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:11.268573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:11.269097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:11.547891 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-abde2960-e215-441c-9206-deee3fb538c1 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.902800 Oct 28 19:17:11.548743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1252/2502] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:17:10 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0/os-interface => generated 284 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:11.821797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a313ca72-70fc-4d41-bd38-16e3418ef241 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1614 microversion: 2.1 time: 0.580873 Oct 28 19:17:11.823088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1251/2503] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:11 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1614 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:11.844444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=60 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:11.849876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:11.850912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:11.858649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:11.859672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:11.860339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:11.861322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:11.862016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:11.862722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.172914 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e90e1ca-43e8-4027-8625-6d82c17643c1 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1614 microversion: 2.1 time: 0.329772 Oct 28 19:17:12.192135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1253/2504] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:11 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1614 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:12.202207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:12.208607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'host': 'n-h2-862769-3', 'deleted': False} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:12.221950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.222496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.230924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.231840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.233911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.234369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.439076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:17:12.565997 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce030be5-f8d1-46e6-a13b-f6e885b48867 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers?host=n-h2-862769-3&all_tenants=1" status: 200 len: 664 microversion: 2.1 time: 0.355076 Oct 28 19:17:12.567432 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1252/2505] 10.222.0.44 () {58 vars in 1190 bytes} [Fri Oct 28 19:17:12 2022] GET /compute/v2.1/servers?host=n-h2-862769-3&all_tenants=1 => generated 664 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:12.579529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:12.585742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:17:12.600746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.601538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.602293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.604760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.605379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.605946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.651803 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f8b7b6c-1f0e-47a9-9154-ac0e569678d0 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.076462 Oct 28 19:17:12.652927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1253/2506] 10.222.0.44 () {58 vars in 1196 bytes} [Fri Oct 28 19:17:12 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:17:12.665251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:12.667764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:12.681242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.685147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.685742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.686647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.687277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.687839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.918969 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e454d89b-2532-450e-8dc6-b43648e4498e tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 0 microversion: 2.1 time: 0.257583 Oct 28 19:17:12.923905 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1254/2507] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:12 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:12.938413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:12.955309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:12.977771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.981506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.982513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:12.985180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:12.985878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:12.986719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.104501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09eb49df-373c-42de-aa9c-4a8d45d25fc1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Action: 'create', calling method: .version_select at 0x7f1d773511f0>, body: {"keypair": {"name": "tempest-keypair-1532209579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHNMsyDLLSdKu0j0+vQc8rog8CcUhv6B9eKiLpH3MKFVbVmLwkdYFAP1EHQhp+3mnYStqg88b/1DsXXFaxYLCwyPa4BSRQMLSKaE6cgLYaCajnbAruph81bxF3CJh3fgw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:13.147911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-09eb49df-373c-42de-aa9c-4a8d45d25fc1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Getting quotas for project 8f7be388a6634235b8bcb8638019cd9a. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:13.158850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-09eb49df-373c-42de-aa9c-4a8d45d25fc1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Getting quotas for user 86560d03a6eb411098f80aed346d4c52 and project 8f7be388a6634235b8bcb8638019cd9a. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:13.162869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:13.181801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:13.182569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:13.184933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:13.185423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:13.188084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:13.202601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09eb49df-373c-42de-aa9c-4a8d45d25fc1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.794415 Oct 28 19:17:13.204044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1254/2508] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:17:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:17:13.376309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:13.397510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.398025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.398462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.399245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.399697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.400119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.462401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:13.463688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:13.474843 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95f06e41-e882-47a0-893d-663e7470deb0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 1067 microversion: 2.1 time: 0.546820 Oct 28 19:17:13.476407 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1255/2509] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:12 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 1067 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 19:17:13.489031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.490179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.492557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.493405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.495914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.496513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.497363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:13.498155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:13.508349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.509066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.510748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.511641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.515297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.519445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.547856 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 HTTP/1.1 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7aa203d5-e7cb-40c8-9d42-be8413b3abe0'} Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:13.558601 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.562062 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.569126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:13.596174 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0eba365e-1a6b-4581-8121-d16bea06a698 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 404 len: 111 microversion: 2.1 time: 0.118373 Oct 28 19:17:13.597717 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1255/2510] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:13 2022] DELETE /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:17:13.628428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:13.635322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 7aa203d5-e7cb-40c8-9d42-be8413b3abe0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:13.662949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.664314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.668807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.679121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.682785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.683670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.746909 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 HTTP/1.1 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7aa203d5-e7cb-40c8-9d42-be8413b3abe0'} Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:13.759142 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. Oct 28 19:17:13.763655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.767977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 7aa203d5-e7cb-40c8-9d42-be8413b3abe0 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:13.782490 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b927b9be-edab-4eed-8624-377b450fce60 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0" status: 404 len: 111 microversion: 2.1 time: 0.180352 Oct 28 19:17:13.784083 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1256/2511] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:13 2022] GET /compute/v2.1/servers/7aa203d5-e7cb-40c8-9d42-be8413b3abe0 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:13.802994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:13.805733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:13.831907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.833110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.835270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.836136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.840603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.841269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.892572 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f HTTP/1.1 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '39c1842b-26c7-4a28-81c8-fcc0506ce16f'} Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:13.894097 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:13.897604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:13.904526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:13.905486 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bec998cb-6501-4d31-9f92-54cd6e6e8491 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "DELETE /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 404 len: 111 microversion: 2.1 time: 0.114453 Oct 28 19:17:13.916178 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1257/2512] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:13 2022] DELETE /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:13.930794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:13.930794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] [instance: 39c1842b-26c7-4a28-81c8-fcc0506ce16f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:13.962900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.963870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.966422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:13.968108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:13.968817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:13.969957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:14.013603 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] HTTP exception thrown: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Request method failure captured: Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f HTTP/1.1 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXClSDmG4Nx7usrpJRZW4E6zKDJkwk_zL9KPEcCFjmxl8T4kyd6RetT8XXAdIcCsHwjE281MJkZfbRQS01BLGEGO7feAbw8HPhaxEWqQchiXvqrRJsj_dBe2JE5axNLqxemFdAFdkJrreC7U0uqEhqSkv4c_eekqtFxhjhZQ3vckI-_c Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/93607878d8054461ac3df081a4803b81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_93607878d8054461ac3df081a4803b81", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/93607878d8054461ac3df081a4803b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 93607878d8054461ac3df081a4803b81 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045156560 Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9810c2ad77cf46e39987a29f64c2b0fe Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1045156560-project Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '39c1842b-26c7-4a28-81c8-fcc0506ce16f'} Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:14.020306 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. Oct 28 19:17:14.023848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:17:14.031414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] Returning 404 to user: Instance 39c1842b-26c7-4a28-81c8-fcc0506ce16f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:14.032702 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f7928786-86c3-4e30-aa43-cea4c7890825 tempest-DeleteServersTestJSON-1045156560 tempest-DeleteServersTestJSON-1045156560-project] 10.222.0.44 "GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f" status: 404 len: 111 microversion: 2.1 time: 0.115503 Oct 28 19:17:14.042237 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1258/2513] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:13 2022] GET /compute/v2.1/servers/39c1842b-26c7-4a28-81c8-fcc0506ce16f => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:14.073656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:14.084224 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57e9e99c-2b7a-4d23-9b04-f4a3be663208 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 0.591141 Oct 28 19:17:14.087708 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1256/2514] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:13 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:14.770567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-aaa32cb8-4985-41d1-83ea-4784ae6132ad req-4463daca-553b-44de-a308-0f002ac1890c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be98aa9-0950-4d39-8f74-df0c2320cba0", "tag": "0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:14.788584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aaa32cb8-4985-41d1-83ea-4784ae6132ad req-4463daca-553b-44de-a308-0f002ac1890c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:14.791247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aaa32cb8-4985-41d1-83ea-4784ae6132ad req-4463daca-553b-44de-a308-0f002ac1890c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:14.791831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aaa32cb8-4985-41d1-83ea-4784ae6132ad req-4463daca-553b-44de-a308-0f002ac1890c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:14.823666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-aaa32cb8-4985-41d1-83ea-4784ae6132ad req-4463daca-553b-44de-a308-0f002ac1890c service nova] Creating event network-changed:0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3 for instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 on n-h1-862769-3 Oct 28 19:17:14.829325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-aaa32cb8-4985-41d1-83ea-4784ae6132ad req-4463daca-553b-44de-a308-0f002ac1890c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062391 Oct 28 19:17:14.830415 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1259/2515] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:15.111633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:15.112770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:15.122198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:15.124642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:15.125300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:15.126989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:15.128360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:15.129203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:16.026362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:16.041423 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b56388f2-5157-4832-9bc9-6572de29677f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 0.933587 Oct 28 19:17:16.054728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1257/2516] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:15 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:17.065647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:17.070514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:17.071267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:17.089346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:17.090335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:17.090961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:17.092966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:17.094164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:17.100338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:18.303733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:18.317847 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e3272aa-3e66-47cf-bdef-95978875dddd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 1.253964 Oct 28 19:17:18.331181 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1260/2517] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:17 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:19.342862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:19.344616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:19.359453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:19.360233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:19.361919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:19.362937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:19.364129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:19.365091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:19.514936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:19.864793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:19.885247 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-095aa29c-fc63-46c5-a790-76452fdd5fc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 0.547420 Oct 28 19:17:19.895853 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1258/2518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:19 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:20.919522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:20.920869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:20.938366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:20.938900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:20.943560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:20.944600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:20.945069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:20.945648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:21.921438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:21.935836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2e7e3a0-0b94-480a-bce9-50d2a71ce67b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 1.020499 Oct 28 19:17:21.937806 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1261/2519] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:20 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:22.966735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:22.968145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:22.973658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=14 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:22.994411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:23.007647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:23.008543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:23.011154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:23.012877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:23.017760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:23.063282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:23.525883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:23.537555 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a7ac3721-39f3-4967-9691-8c3cb970d271 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 0.575158 Oct 28 19:17:23.559643 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1259/2520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:22 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:24.565750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:24.566385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:24.571613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:24.582400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:24.586033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:24.587975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:24.589076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:24.590946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:24.592771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:24.794615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:24.798520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:24.811534 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-96584ded-21c3-40f3-aa2c-2b3c548dd37d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1471 microversion: 2.1 time: 0.249773 Oct 28 19:17:24.812148 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1262/2521] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:24 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:25.837896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:25.838519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:25.864208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:25.864706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:25.865142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:25.865865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:25.877303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:25.881382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:26.469345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:26.487028 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5bd75052-3f42-491c-855a-177d566e5e1b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 0.653513 Oct 28 19:17:26.488278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1260/2522] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:25 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:27.516034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:27.518531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:27.569504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:27.571687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:27.578762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:27.581605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:27.583730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:27.589967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:28.509894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-511030375", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "19daed7d-b820-4d68-8921-99acd41d9e11"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:28.520471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:28.543845 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-923d2ee7-adef-4790-8147-5923d574bd6d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 1.033798 Oct 28 19:17:28.548087 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1263/2523] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:27 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:28.942559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] validate_networks() for [('19daed7d-b820-4d68-8921-99acd41d9e11', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:17:29.571673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:29.572990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:29.580016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:29.586645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:29.587706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:29.588967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:29.592270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:29.593628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:30.947112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:30.947636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:30.947978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:30.948383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:30.948802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:30.956793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:30.970431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:30.985160 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c3a4748-9d5f-4b30-9ad9-b3e4d6d44db0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 1.417562 Oct 28 19:17:31.008044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1264/2524] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:29 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:31.026039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.026513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.034191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:31.037642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.040396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.042116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.047709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:31.050650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.063314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.064156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.065112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.066477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.068236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.068868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.127938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Getting quotas for project 1110dcce71ea40c69fd27c0cf6ce6bfd. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:31.171740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Getting quotas for user f110a281cb6e4577881203ce8382585c and project 1110dcce71ea40c69fd27c0cf6ce6bfd. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:31.172523 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ab32618-b1b3-4480-baba-20182aa8b1da tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/ips" status: 200 len: 146 microversion: 2.1 time: 0.163267 Oct 28 19:17:31.183511 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1265/2525] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:17:31 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/ips => generated 146 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:31.190873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-aa80c874-c4e9-464c-9f7a-519652628667 req-ed78e65e-d3db-4b96-81df-8fd56793a864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "name": "network-vif-unplugged", "status": "completed", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:31.209531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:17:31.216228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:17:31.247428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aa80c874-c4e9-464c-9f7a-519652628667 req-ed78e65e-d3db-4b96-81df-8fd56793a864 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.248271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aa80c874-c4e9-464c-9f7a-519652628667 req-ed78e65e-d3db-4b96-81df-8fd56793a864 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.249916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aa80c874-c4e9-464c-9f7a-519652628667 req-ed78e65e-d3db-4b96-81df-8fd56793a864 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.283661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-aa80c874-c4e9-464c-9f7a-519652628667 req-ed78e65e-d3db-4b96-81df-8fd56793a864 service nova] Creating event network-vif-unplugged:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:17:31.300467 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-aa80c874-c4e9-464c-9f7a-519652628667 req-ed78e65e-d3db-4b96-81df-8fd56793a864 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113241 Oct 28 19:17:31.307503 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1266/2526] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:31.360893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc7c68a8-c21c-4b1d-a4c8-8575f7f6d808 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.053580 Oct 28 19:17:31.367959 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1261/2527] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:17:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:17:31.378882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea18f3df-4cb8-4cae-a972-e3ebe3eea5a8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:31.379446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea18f3df-4cb8-4cae-a972-e3ebe3eea5a8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:31.467939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea18f3df-4cb8-4cae-a972-e3ebe3eea5a8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:31.478718 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea18f3df-4cb8-4cae-a972-e3ebe3eea5a8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1215 microversion: 2.1 time: 0.106718 Oct 28 19:17:31.479313 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1262/2528] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:31 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:31.861538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7321dd5-9729-45af-9068-d9dda8ec89df tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Action: 'create', calling method: .version_select at 0x7f1d77299d30>, body: {"keypair": {"name": "tempest-keypair-527370068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNQDraU/8T/uH1K0w9b8fPd9ikA38czNGzz2IX5aqrU5gVtCJNswk8u7IFl8mis5bnsmhDEONvEpASpRL3iN0utz8RJE9moL8He/sxquYsrWyi45Lr0baQoCujGmP85ew=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:31.919071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c7321dd5-9729-45af-9068-d9dda8ec89df tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Getting quotas for project 2d2e0199a714466e8116715d20e38bb0. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:31.938439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c7321dd5-9729-45af-9068-d9dda8ec89df tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Getting quotas for user efe91cb777334620a6b54688bfd6bd5a and project 2d2e0199a714466e8116715d20e38bb0. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:32.021038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:32.022467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:32.040397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7321dd5-9729-45af-9068-d9dda8ec89df tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.671388 Oct 28 19:17:32.045491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:32.049011 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1267/2529] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:17:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:32.049190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:32.051567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:32.054640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:32.055181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:32.055625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:32.508023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c10e2ae3-6998-46e3-9b4c-f61fd4f07d62 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:32.510255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c10e2ae3-6998-46e3-9b4c-f61fd4f07d62 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:32.759823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:32.769588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-838a57a5-7079-4ed4-938e-c98b6ef47fc4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 0.753715 Oct 28 19:17:32.770313 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1263/2530] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:32 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:32.929781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c10e2ae3-6998-46e3-9b4c-f61fd4f07d62 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:32.959984 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c10e2ae3-6998-46e3-9b4c-f61fd4f07d62 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1215 microversion: 2.1 time: 0.453229 Oct 28 19:17:32.965315 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1268/2531] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:32 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:33.801105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:33.802027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:33.817975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:33.820257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:33.820911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:33.823070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:33.824241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:33.826468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:33.991782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:33.993222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:34.047955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:34.048696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:34.049649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:34.050584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:34.051727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:34.052314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:34.765115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:34.777138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e859192-8a26-4f66-ada3-40d0bc11bdd2 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1275 microversion: 2.1 time: 0.791218 Oct 28 19:17:34.785467 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1269/2532] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:33 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1275 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:34.827672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:34.839998 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30d9a1e7-de25-4d16-8772-3d8496a98dcc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 1.047601 Oct 28 19:17:34.842738 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1264/2533] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:33 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:35.630928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f7b6469-3f07-4ab5-880f-dc3ea19e4c8e"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:35.640575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:35.669207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:35.670042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:35.672395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:35.674613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:35.678428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:35.679132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:35.812315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:35.813321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:35.839242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:35.839927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:35.840262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:35.846649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:35.851424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:35.854643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.125171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:36.145141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59a111c7-895c-4206-a42a-5741b5e96b46 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1273 microversion: 2.1 time: 0.335317 Oct 28 19:17:36.148862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1265/2534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:35 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:36.166742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:36.172158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:36.195482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:36.196261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:36.199683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.201900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:36.202544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:36.210985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.260825 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6389214a-d9de-4950-8279-2bb42c3f43c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633011 Oct 28 19:17:36.262532 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1270/2535] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:17:35 2022] POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:36.308007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1231524128", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a9671732-e661-47b3-b922-12032e657659"}], "security_groups": [{"name": "tempest-securitygroup--1868936307"}], "key_name": "tempest-keypair-527370068", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:36.575820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:36.585826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3f133f8-0202-43f8-a6ac-b5ad8d1a718b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 0.435294 Oct 28 19:17:36.607562 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1266/2536] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:36 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:36.649139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] validate_networks() for [('a9671732-e661-47b3-b922-12032e657659', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:17:37.170420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:37.171871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:37.191906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:37.192711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:37.195241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:37.196181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:37.196791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:37.202733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:37.751060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Getting quotas for project 2d2e0199a714466e8116715d20e38bb0. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:37.767647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Getting quotas for user efe91cb777334620a6b54688bfd6bd5a and project 2d2e0199a714466e8116715d20e38bb0. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:37.805307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:37.811536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:37.812393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:37.813181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:37.813851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:37.814020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:37.828795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:37.829538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:37.830757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:37.832349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:37.833070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:37.834080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:37.842167 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0670efc1-9a75-4593-a28d-733751e8a362 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.668133 Oct 28 19:17:37.862051 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1267/2537] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:37 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:37.883439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:37.888306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:37.903082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Getting quotas for project 2d2e0199a714466e8116715d20e38bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:37.905336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:37.905834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:37.906257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:37.907166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:37.907773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:37.913889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:37.918904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Getting quotas for user efe91cb777334620a6b54688bfd6bd5a and project 2d2e0199a714466e8116715d20e38bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:37.940055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:17:37.944480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:17:38.088279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14da4787-1cb8-4fa7-add1-ae1f0292f6f2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.822500 Oct 28 19:17:38.093442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1271/2538] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:17:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:17:38.117770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a90eac1-da0c-4fe8-9f82-94e3cf7a010a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:38.121136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a90eac1-da0c-4fe8-9f82-94e3cf7a010a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:38.331241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:38.340759 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5af842fc-2cfc-4d1d-b944-7c5e8732bfde tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 0.471725 Oct 28 19:17:38.341356 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1268/2539] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:37 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:38.349382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a90eac1-da0c-4fe8-9f82-94e3cf7a010a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:38.367896 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a90eac1-da0c-4fe8-9f82-94e3cf7a010a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1277 microversion: 2.1 time: 0.263261 Oct 28 19:17:38.378923 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1272/2540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:38 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:38.755302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ec7cef04-e4fa-44f0-9b0b-94222c3ae9df req-3dbab8f3-50f2-4cd2-b2ba-835bb0a6d538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "name": "network-vif-plugged", "status": "completed", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:38.796305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ec7cef04-e4fa-44f0-9b0b-94222c3ae9df req-3dbab8f3-50f2-4cd2-b2ba-835bb0a6d538 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:38.796848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ec7cef04-e4fa-44f0-9b0b-94222c3ae9df req-3dbab8f3-50f2-4cd2-b2ba-835bb0a6d538 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:38.797271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ec7cef04-e4fa-44f0-9b0b-94222c3ae9df req-3dbab8f3-50f2-4cd2-b2ba-835bb0a6d538 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:38.865667 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ec7cef04-e4fa-44f0-9b0b-94222c3ae9df req-3dbab8f3-50f2-4cd2-b2ba-835bb0a6d538 service nova] Creating event network-vif-plugged:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:17:38.871748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:38.872523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:38.883877 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ec7cef04-e4fa-44f0-9b0b-94222c3ae9df req-3dbab8f3-50f2-4cd2-b2ba-835bb0a6d538 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131816 Oct 28 19:17:38.891934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:38.892166 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1269/2541] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:38.901446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:38.922188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:38.924654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:38.929023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:38.931549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.328501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:39.346974 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f73553fb-2060-4675-8652-6edf6b3c1fef tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.480700 Oct 28 19:17:39.350568 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1273/2542] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:38 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:39.373606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:39.374851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:39.392412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.395202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.396027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.406186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:39.407092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:39.412177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.417183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.417982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.420222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.429632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.432000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.433241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.434761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.436445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.846464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:39.860293 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-082f444e-9add-4856-8f62-4e214ac58b8c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1281 microversion: 2.1 time: 0.460532 Oct 28 19:17:39.874717 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1274/2543] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:39 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1281 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:39.915912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:39.925377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f724be38-aa85-4ce8-a39f-bb6016e7e8b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 0.557332 Oct 28 19:17:39.944820 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1270/2544] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:39 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:40.373961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:40.374576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:40.398497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:40.409482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:40.415899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:40.417148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:40.417993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:40.423697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:40.893195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:40.893798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:40.911152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:40.911641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:40.912382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:40.924402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:40.925054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:40.927051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:41.064876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:41.077541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e132fc9-e327-47bc-aeae-2181625c3ad0 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.705643 Oct 28 19:17:41.088397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:41.097265 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1275/2545] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:40 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:41.125204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:41.126638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:41.146579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:41.149169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:41.149861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:41.152995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:41.153828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:41.155328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:41.316813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:41.328523 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee019d51-920a-4903-8886-a3cc3591b556 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1335 microversion: 2.1 time: 0.439424 Oct 28 19:17:41.330863 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1271/2546] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:40 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1335 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:41.573616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:41.590202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f123a03-f05f-49ac-9457-93ba6de19c4b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1477 microversion: 2.1 time: 0.488240 Oct 28 19:17:41.590825 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1276/2547] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:41 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:42.108910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:42.110140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:42.114092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:42.139615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.140264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.140712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.141452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.148631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.149111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.352684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:42.353335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:42.375701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.376229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.376664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.377436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.381442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.383698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.578401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:42.594397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fbbcb8d5-4d01-47bc-b630-fb4f47aabc6c tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1335 microversion: 2.1 time: 0.242988 Oct 28 19:17:42.595864 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1277/2548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:42 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1335 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:42.618464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:42.627408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:42.643928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.646618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.648666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.649457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.649930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.654265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.735099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:42.784060 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bed403e2-c9f8-40c7-b432-c7e47f660250 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.679593 Oct 28 19:17:42.804376 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1272/2549] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:42 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:42.934637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-23e72c89-dcd0-4df6-a059-8c2314b12c3d req-bca6dd44-f978-4c4e-ba34-c028edf440c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fbe126-ca67-4eb6-b7b5-d88a248d0d04", "tag": "9bf6e405-f2d8-4354-ad56-ff3679bf4547"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:42.967568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-23e72c89-dcd0-4df6-a059-8c2314b12c3d req-bca6dd44-f978-4c4e-ba34-c028edf440c6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.967984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-23e72c89-dcd0-4df6-a059-8c2314b12c3d req-bca6dd44-f978-4c4e-ba34-c028edf440c6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.968417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-23e72c89-dcd0-4df6-a059-8c2314b12c3d req-bca6dd44-f978-4c4e-ba34-c028edf440c6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.009990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-23e72c89-dcd0-4df6-a059-8c2314b12c3d req-bca6dd44-f978-4c4e-ba34-c028edf440c6 service nova] Creating event network-changed:9bf6e405-f2d8-4354-ad56-ff3679bf4547 for instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 on n-h2-862769-3 Oct 28 19:17:43.038037 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-23e72c89-dcd0-4df6-a059-8c2314b12c3d req-bca6dd44-f978-4c4e-ba34-c028edf440c6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105785 Oct 28 19:17:43.040175 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1273/2550] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:43.080096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:43.095826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cbec6353-a2ec-4d39-92f4-47862a1ef995 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1463 microversion: 2.1 time: 0.480290 Oct 28 19:17:43.096526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1278/2551] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:42 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1463 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:43.129853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:43.131835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:43.146603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:43.147495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:43.148154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.149154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:43.150024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:43.150668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.576212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:43.585432 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c214a5fa-adc7-4e5d-9755-8c9815240bc3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1463 microversion: 2.1 time: 0.462945 Oct 28 19:17:43.586041 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1274/2552] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:43 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1463 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:43.616689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:43.620259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:43.621046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:43.623546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:43.630379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:43.631105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:43.631678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.632628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:43.633216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:43.633764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.647856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:43.659739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:43.660539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:43.666211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.667432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:43.668840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:43.672218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:43.834311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:43.834793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:43.835493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:43.836897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:43.837487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:43.978600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:43.995972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.000394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.001032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:44.001924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.003377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.003999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:44.040335 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-367b1819-51bf-418b-9808-5a45ff07fc74 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 1067 microversion: 2.1 time: 0.436136 Oct 28 19:17:44.041532 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1279/2553] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:43 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 1067 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 19:17:44.047170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:44.047959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:44.060916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.063322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.063956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:44.066631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.067346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.068007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:44.389805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:44.401634 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ef28730-d733-4439-a219-e0e73aa7a60a tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 0.788085 Oct 28 19:17:44.406013 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1275/2554] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:43 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:44.420996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:44.424102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:44.428975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:44.438988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:44.447256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.448720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ba2c150-4ae6-4e3f-8b66-a7ec74d8aa4f tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.405629 Oct 28 19:17:44.449403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.450102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:44.451112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.451491 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1280/2555] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:44 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:44.453068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.453878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:44.731850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-628357403", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "f2c4c4d7-2247-401c-9812-696fa4b8aeda"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:44.776463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:44.790308 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e63e4c17-c329-4cb1-86f5-21ea02f717e1 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.377093 Oct 28 19:17:44.791807 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1276/2556] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:44 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:44.840910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] validate_networks() for [('f2c4c4d7-2247-401c-9812-696fa4b8aeda', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:17:44.938172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c518f0d4-b995-4094-a3f2-989fc5ae2f31 req-61aa0ce7-e128-467e-8266-befa4c6935e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79fe462c-5e0a-4739-8a8e-adf189fde3e7", "tag": "b244a054-944d-46bc-8f92-1137017c1779"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:44.974879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c518f0d4-b995-4094-a3f2-989fc5ae2f31 req-61aa0ce7-e128-467e-8266-befa4c6935e4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:44.975740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c518f0d4-b995-4094-a3f2-989fc5ae2f31 req-61aa0ce7-e128-467e-8266-befa4c6935e4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:44.976423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c518f0d4-b995-4094-a3f2-989fc5ae2f31 req-61aa0ce7-e128-467e-8266-befa4c6935e4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:45.006420 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c518f0d4-b995-4094-a3f2-989fc5ae2f31 req-61aa0ce7-e128-467e-8266-befa4c6935e4 service nova] Creating event network-changed:b244a054-944d-46bc-8f92-1137017c1779 for instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 on n-h1-862769-3 Oct 28 19:17:45.024750 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c518f0d4-b995-4094-a3f2-989fc5ae2f31 req-61aa0ce7-e128-467e-8266-befa4c6935e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088891 Oct 28 19:17:45.026240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1277/2557] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:45.429401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:45.430479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:45.457539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:45.458218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:45.458979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:45.459898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:45.463364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:45.464774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:46.193935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:46.194964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:46.195614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:46.196920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:46.197519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:46.236095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:46.252015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:46.253850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:46.254920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:46.255558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:46.256132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:46.310090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Getting quotas for project c8932016ab68471ea3e6e4d42bef9c8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:46.328719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Getting quotas for user f14b118724b9445389ede871498bf3e6 and project c8932016ab68471ea3e6e4d42bef9c8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:46.379269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:17:46.381682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:17:46.509915 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9754e1db-c9b1-452f-8c24-0dbf0dd333b4 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057123 Oct 28 19:17:46.511247 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1281/2558] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:17:46.516460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:46.517466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:46.525181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:46.526191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:46.526890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:46.528072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:46.528691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:46.529267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:46.553404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:46.566436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1911d1a6-50bc-4c31-85cd-cc69e512bebe tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 1.141892 Oct 28 19:17:46.568511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1278/2559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:45 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:46.582586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:46.583266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:46.615628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:46.628483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:46.629789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:46.631775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:46.633599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:46.636659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:47.788092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:47.819828 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-45e2d51c-fa81-43a8-8ba8-0ac89d6d438a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 1.307036 Oct 28 19:17:47.820501 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1282/2560] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:46 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:47.843055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:47.846550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:47.897806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:47.898355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:47.898838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:47.899563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:47.900006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:47.900425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:47.947694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:47.952560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:47.958240 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46c62851-0116-4642-b717-45136b95206c tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 1.379489 Oct 28 19:17:47.979124 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1279/2561] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:46 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:47.998519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:47.999189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:48.011424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:48.012371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:48.012820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:48.013542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:48.013998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:48.014892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:48.123931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:48.141642 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-857d973c-61cf-4010-bff9-1a2bbed4d981 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1268 microversion: 2.1 time: 0.319974 Oct 28 19:17:48.155011 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1283/2562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:47 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1268 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:48.423442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:48.437143 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75da9a6e-25c3-4791-b6eb-933dd4cca921 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 0.456785 Oct 28 19:17:48.438897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1280/2563] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:47 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:48.844793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:48.845996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:48.865435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:48.866136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:48.866484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:48.867252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:48.867704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:48.880251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.001389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:49.002681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:49.020047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:49.028995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:49.030046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.030981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:49.031948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:49.032887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.520912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:49.524288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:49.538122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a27f3050-6ea4-4a53-a650-712d3fd7db81 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.698606 Oct 28 19:17:49.539540 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1284/2564] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:48 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:49.555533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:49.556812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:49.566373 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c5258a1-8f87-4314-80d3-342e4030fea2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.560701 Oct 28 19:17:49.578857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1281/2565] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:48 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:49.588692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:49.589449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:49.595932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:49.597454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:49.598306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.605297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:49.606064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:49.606669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.613955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:49.614936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:49.615633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.617629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:49.618499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:49.619328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:49.880315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:49.924794 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9174b1c8-317c-4e06-926b-87be5f3893c2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1274 microversion: 2.1 time: 0.382024 Oct 28 19:17:49.925411 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1285/2566] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:49 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1274 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:50.206051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:50.227867 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-afbdf976-0f08-4756-b0dd-fd4459bcea31 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 0.641837 Oct 28 19:17:50.255509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1282/2567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:49 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:50.343247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:50.344258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:50.356268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:50.358936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:50.359741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:50.360687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:50.364610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:50.365389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:50.435671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:17:50.570203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:50.572227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:50.589804 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e76b355-160d-4eb8-9790-1ddc750eff4d tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 204 len: 0 microversion: 2.1 time: 0.251361 Oct 28 19:17:50.590854 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1286/2568] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:50 2022] DELETE /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:17:50.593703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:50.595261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:50.596636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:50.599912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:50.600647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:50.601965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:50.602552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:50.603744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:50.617270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:50.618004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:50.618580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:50.621464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:50.622133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:50.624040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:51.114130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:51.130441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a6d227c-e23d-4621-92e1-0d99eea3309a tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.568751 Oct 28 19:17:51.131687 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1283/2569] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:50 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:51.142627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:51.144552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:51.155108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:51.155949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:51.156529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:51.157438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:51.158028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:51.158647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:51.204232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:51.216209 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18c3705f-41e4-4629-a095-5e39f813a75e tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1665 microversion: 2.1 time: 0.619292 Oct 28 19:17:51.217371 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1287/2570] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:50 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1665 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:17:51.364922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1340324574", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "00233b51-3d5b-402d-93c1-7b982ca757ee"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:51.436602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] validate_networks() for [('00233b51-3d5b-402d-93c1-7b982ca757ee', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:17:51.445482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:51.456414 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-03c57bab-5798-4579-be97-e91c3fc64b8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.322611 Oct 28 19:17:51.457754 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1284/2571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:51 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:51.463211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:51.464552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:51.472904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:51.473636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:51.474777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:51.477822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:51.478500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:51.479117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:51.770351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:51.784790 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-03bb1827-e216-40b3-b594-d374482cd913 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1316 microversion: 2.1 time: 0.325350 Oct 28 19:17:51.786177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1285/2572] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:51 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:51.806873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:51.810226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:51.828908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:51.830373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:51.831162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:51.832275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:51.832887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:51.833864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.102009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:52.116960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e916b9f-2431-4e86-9486-2579f6b7b9c6 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 0.328140 Oct 28 19:17:52.138662 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1286/2573] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:51 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:52.147115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-18863185-0454-41e5-b303-cb70a824a124 req-9298b1c0-a640-486c-8e93-a5b916b2a62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fbe126-ca67-4eb6-b7b5-d88a248d0d04", "name": "network-vif-plugged", "status": "completed", "tag": "9bf6e405-f2d8-4354-ad56-ff3679bf4547"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:52.166621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-18863185-0454-41e5-b303-cb70a824a124 req-9298b1c0-a640-486c-8e93-a5b916b2a62c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.167768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-18863185-0454-41e5-b303-cb70a824a124 req-9298b1c0-a640-486c-8e93-a5b916b2a62c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.169006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-18863185-0454-41e5-b303-cb70a824a124 req-9298b1c0-a640-486c-8e93-a5b916b2a62c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.188077 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-18863185-0454-41e5-b303-cb70a824a124 req-9298b1c0-a640-486c-8e93-a5b916b2a62c service nova] Creating event network-vif-plugged:9bf6e405-f2d8-4354-ad56-ff3679bf4547 for instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 on n-h2-862769-3 Oct 28 19:17:52.196797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-18863185-0454-41e5-b303-cb70a824a124 req-9298b1c0-a640-486c-8e93-a5b916b2a62c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056166 Oct 28 19:17:52.198601 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1287/2574] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:52.209705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-63824708", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a2e27c53-b1e0-4ac8-925c-8ff03f235e1f"}], "security_groups": [{"name": "tempest-securitygroup--227853583"}], "key_name": "tempest-keypair-1532209579", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0ad09910-665e-441c-bd6c-6c97ceb83fae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:52.286307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:52.286802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:52.287586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:52.288183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:52.289303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:52.301879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.302726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.303623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.304637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.305262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.306105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.326277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Getting quotas for project d8b6caba54bc4650937f592b465a73ab. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:52.332064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Getting quotas for user fcf7141e9816409eb8acbb2288955e24 and project d8b6caba54bc4650937f592b465a73ab. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:52.345964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:17:52.348752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:17:52.423573 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34c22029-0e8b-44ab-bf62-b653b3d5b4de tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204871 Oct 28 19:17:52.424486 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1288/2575] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:17:52.436300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:52.437124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:52.445411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.446405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.447134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.448498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.449165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.449732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.509396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] validate_networks() for [('a2e27c53-b1e0-4ac8-925c-8ff03f235e1f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:17:52.808530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:52.818735 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4cc9350f-0680-4e27-a6a3-b3294205845c tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.386103 Oct 28 19:17:52.820861 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1289/2576] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:52 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:52.931128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f4897635-52b8-4dd4-a7fc-1bd9a9e9e9ed req-38b73903-bb96-4bde-8db9-ff92f8bd946b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98c8871-6eb1-4830-8aea-a4f55de4d47a", "tag": "32744063-eac0-458a-a3b4-6ded8b3c898b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:52.950616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f4897635-52b8-4dd4-a7fc-1bd9a9e9e9ed req-38b73903-bb96-4bde-8db9-ff92f8bd946b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.952087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f4897635-52b8-4dd4-a7fc-1bd9a9e9e9ed req-38b73903-bb96-4bde-8db9-ff92f8bd946b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.952808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f4897635-52b8-4dd4-a7fc-1bd9a9e9e9ed req-38b73903-bb96-4bde-8db9-ff92f8bd946b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:52.970355 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f4897635-52b8-4dd4-a7fc-1bd9a9e9e9ed req-38b73903-bb96-4bde-8db9-ff92f8bd946b service nova] Creating event network-changed:32744063-eac0-458a-a3b4-6ded8b3c898b for instance e98c8871-6eb1-4830-8aea-a4f55de4d47a on n-h2-862769-3 Oct 28 19:17:52.976764 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f4897635-52b8-4dd4-a7fc-1bd9a9e9e9ed req-38b73903-bb96-4bde-8db9-ff92f8bd946b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154062 Oct 28 19:17:52.977722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1290/2577] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:52.983791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:52.984836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:52.996761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:52.997624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:52.999036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.001374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.002106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.003313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.358392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:53.375550 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a40eb46-0f64-4a4a-82a9-05fc58ff10b5 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1665 microversion: 2.1 time: 0.396436 Oct 28 19:17:53.376785 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1291/2578] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:52 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1665 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:53.386491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:53.387321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:53.393993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.394756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.395354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.396208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.397344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.397945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.509533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:53.518093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Getting quotas for project 8f7be388a6634235b8bcb8638019cd9a. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:53.518554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9df81c39-eb5d-4fec-b3c3-7edefcd8ace9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1269 microversion: 2.1 time: 0.140227 Oct 28 19:17:53.518988 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1292/2579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:53 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:53.527715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:53.528338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:53.531110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Getting quotas for user 86560d03a6eb411098f80aed346d4c52 and project 8f7be388a6634235b8bcb8638019cd9a. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:53.536498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.537692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.544695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.547723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:17:53.548492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:17:53.549256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:17:53.550012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:17:53.550481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:17:53.554212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.554539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.554997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.579083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.579567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.582392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.582491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.583064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.583629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.604734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Getting quotas for project 8f7be388a6634235b8bcb8638019cd9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:53.610610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Getting quotas for user 86560d03a6eb411098f80aed346d4c52 and project 8f7be388a6634235b8bcb8638019cd9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:53.695853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:17:53.699322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ad09910-665e-441c-bd6c-6c97ceb83fae',volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:17:53.866541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:53.877394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63d6de95-386a-41f6-894b-41ed58ca7fbb tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.355016 Oct 28 19:17:53.883316 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1293/2580] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:53 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:53.888293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:53.888904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:53.911949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.913312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.915725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.921359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.923511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.924053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.945328 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46cf6583-0fba-496f-bacf-8840da31c86b tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.744284 Oct 28 19:17:53.949240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1288/2581] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:17:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:17:53.963278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:53.964427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:53.976897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.979886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.981204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:53.983518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:53.984670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:53.985196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:54.430917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:54.455248 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5a2bddb-9b11-4396-9757-236687cb545f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1316 microversion: 2.1 time: 0.570675 Oct 28 19:17:54.456480 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1294/2582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:53 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:54.461586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:54.463571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:54.480042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:54.480656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:54.480954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:54.484960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:54.486637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:54.487126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:54.858662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:54.875031 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58fa4c64-c17a-450b-9fdf-6d2c13a17335 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 0.916273 Oct 28 19:17:54.877460 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1289/2583] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:53 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:54.902549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:54.913017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:54.942929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:54.944211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:54.944656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:54.945391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:54.945840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:54.954132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.039632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:55.056052 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5e4d979-5dfa-4eca-947a-3ffd9dbe14f8 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1315 microversion: 2.1 time: 0.597405 Oct 28 19:17:55.071590 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1295/2584] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:54 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:55.089537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9436657a-35ee-4a4e-b42d-416501b3582c req-76ec4bc6-e991-4887-9f84-78535cb2d22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fe462c-5e0a-4739-8a8e-adf189fde3e7", "name": "network-vif-plugged", "status": "completed", "tag": "b244a054-944d-46bc-8f92-1137017c1779"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:55.120962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9436657a-35ee-4a4e-b42d-416501b3582c req-76ec4bc6-e991-4887-9f84-78535cb2d22a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.121459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9436657a-35ee-4a4e-b42d-416501b3582c req-76ec4bc6-e991-4887-9f84-78535cb2d22a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.121880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9436657a-35ee-4a4e-b42d-416501b3582c req-76ec4bc6-e991-4887-9f84-78535cb2d22a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.167999 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9436657a-35ee-4a4e-b42d-416501b3582c req-76ec4bc6-e991-4887-9f84-78535cb2d22a service nova] Creating event network-vif-plugged:b244a054-944d-46bc-8f92-1137017c1779 for instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 on n-h1-862769-3 Oct 28 19:17:55.183092 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9436657a-35ee-4a4e-b42d-416501b3582c req-76ec4bc6-e991-4887-9f84-78535cb2d22a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109999 Oct 28 19:17:55.186167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1296/2585] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:55.208263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:55.209111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:55.227060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.231936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.232124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.232902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.233369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.233794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.358343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.360910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.366156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.367498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lazy-loading 'fault' on Instance uuid 8be98aa9-0950-4d39-8f74-df0c2320cba0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:17:55.700585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:55.708358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3c568261-6ef9-4026-98dd-905abc1095d8 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1170 microversion: 2.1 time: 0.816629 Oct 28 19:17:55.708935 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1290/2586] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:54 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1170 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:55.713531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:55.714313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:55.732973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.733476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.733917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.735266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.735734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.736159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.768686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84a4a12f6a4233864025096fa60dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb49a27a3d4d9e995bd43eb390a147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:55.779219 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8d27f6a-d984-47c1-aa62-c65dac2980ac tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 200 len: 1316 microversion: 2.1 time: 0.591211 Oct 28 19:17:55.779995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1297/2587] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:55 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:55.850256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:55.864130 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7882aa46-5616-4f1d-8d4e-0d3d2bf50376 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1275 microversion: 2.1 time: 0.153760 Oct 28 19:17:55.871252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e238bd22-d44b-4b9d-b6fe-e938959efd34 req-078d6798-44c1-41e3-a287-68b28a6c491c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be98aa9-0950-4d39-8f74-df0c2320cba0", "name": "network-vif-deleted", "tag": "0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:55.875125 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1291/2588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:55 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:55.884928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:55.885695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:55.892643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:55.895403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e238bd22-d44b-4b9d-b6fe-e938959efd34 req-078d6798-44c1-41e3-a287-68b28a6c491c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.895978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e238bd22-d44b-4b9d-b6fe-e938959efd34 req-078d6798-44c1-41e3-a287-68b28a6c491c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.896910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e238bd22-d44b-4b9d-b6fe-e938959efd34 req-078d6798-44c1-41e3-a287-68b28a6c491c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.897678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.898355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.898998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.899915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.900566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.901447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.902944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:55.911460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e238bd22-d44b-4b9d-b6fe-e938959efd34 req-078d6798-44c1-41e3-a287-68b28a6c491c service nova] Creating event network-vif-deleted:0e6ddcc9-58d6-4dd5-81f7-f2ff58188dc3 for instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 on n-h1-862769-3 Oct 28 19:17:55.917358 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e238bd22-d44b-4b9d-b6fe-e938959efd34 req-078d6798-44c1-41e3-a287-68b28a6c491c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133811 Oct 28 19:17:55.918197 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1298/2589] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:55.927523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:55.928421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:55.935791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.936273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.936707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:55.937425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:55.937863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:55.938497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.250718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:56.260013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:56.268036 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5e11342-9a27-4670-b959-8caf3f46cbe0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.387184 Oct 28 19:17:56.268175 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9070a0c-3959-469a-b78e-a48d6b5cd50c tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1316 microversion: 2.1 time: 0.347775 Oct 28 19:17:56.276142 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1299/2590] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:55 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:56.278337 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1292/2591] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:55 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:56.291103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec5b4a43-2b1c-40c9-a212-45e63de44f95 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:56.295872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:56.298770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:56.302722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec5b4a43-2b1c-40c9-a212-45e63de44f95 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.304184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec5b4a43-2b1c-40c9-a212-45e63de44f95 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.304821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec5b4a43-2b1c-40c9-a212-45e63de44f95 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.306042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.306528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.306980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.307671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.308114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.314647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.335692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec5b4a43-2b1c-40c9-a212-45e63de44f95 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Going to try to stop instance {{(pid=120629) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:17:56.392099 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec5b4a43-2b1c-40c9-a212-45e63de44f95 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action" status: 202 len: 0 microversion: 2.1 time: 0.114135 Oct 28 19:17:56.393180 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1300/2592] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:56 2022] POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:56.405907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:56.410344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:56.419608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.421999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.423643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.424749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.425408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.426210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.621953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:56.641669 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b2bac14-1900-4323-9910-41576b9275bc tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1403 microversion: 2.1 time: 0.362032 Oct 28 19:17:56.655932 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1293/2593] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:56 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1403 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:56.664638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:56.672047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:56.692823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.693617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.694254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.701429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.702398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.703169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.904153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:56.915740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a6573e37-b4a7-4b2b-b658-62721f28d6d3 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1502 microversion: 2.1 time: 0.514642 Oct 28 19:17:56.919842 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1301/2594] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:56 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1502 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:56.927623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:56.928450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:56.976278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.977031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.977480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:56.982281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:56.982810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:56.983313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.335506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:57.345555 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1c08d4f-2186-4a6a-a6b1-366ea8bbf7dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.685381 Oct 28 19:17:57.365096 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1294/2595] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:56 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:57.370276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:57.371180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] [instance: 8be98aa9-0950-4d39-8f74-df0c2320cba0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:57.384641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.385412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.388440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.389544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.390231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.392160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.417249 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] HTTP exception thrown: Instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 could not be found. Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Request method failure captured: Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 HTTP/1.1 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqe-xKN6sfgzzvzt-Wn1t8OdeomclfWYQargwGL-i1WAG5Cft7kI2AmAl_Q5R4jyLaZdrOQRUtKWiRLpEPIvUpcJOzfRq_0Fd-gbHNHo7jPbMkD4bkuBTTlUFLmwf9vKpkphXNhaYcTYPwLxG6UTV1z9yxTKPoHtSSsbJSTh4w1J28 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 73cb49a27a3d4d9e995bd43eb390a147 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestFqdnHostnames-1837943600 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/73cb49a27a3d4d9e995bd43eb390a147"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_73cb49a27a3d4d9e995bd43eb390a147", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/73cb49a27a3d4d9e995bd43eb390a147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/73cb49a27a3d4d9e995bd43eb390a147"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestFqdnHostnames-1837943600 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 73cb49a27a3d4d9e995bd43eb390a147 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1837943600 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestFqdnHostnames-1837943600-project Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9f84a4a12f6a4233864025096fa60dc7 Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestFqdnHostnames-1837943600-project Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 could not be found. Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '8be98aa9-0950-4d39-8f74-df0c2320cba0'} Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 could not be found. Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 could not be found. Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:57.428893 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 could not be found. Oct 28 19:17:57.432728 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:17:57.434948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Returning 404 to user: Instance 8be98aa9-0950-4d39-8f74-df0c2320cba0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:57.439755 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70b7b76d-66cd-472d-8162-cee0aaa75b69 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0" status: 404 len: 111 microversion: 2.1 time: 0.073371 Oct 28 19:17:57.441144 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1295/2596] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:57 2022] GET /compute/v2.1/servers/8be98aa9-0950-4d39-8f74-df0c2320cba0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:57.452610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:57.453236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:57.490978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.492032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.494815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.496103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.498066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.499092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.509318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:57.523695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67610b88-3eb7-4146-a72e-03d78523b3f5 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1303 microversion: 2.1 time: 0.602269 Oct 28 19:17:57.524561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1302/2597] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:56 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1303 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:57.532244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:57.535453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:57.546265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.551086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.551742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.552637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.561194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.561932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.606734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:17:57.784921 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b549c9c5-3798-4d7d-8ecf-bc80581f2a5b tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "DELETE /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 204 len: 0 microversion: 2.1 time: 0.257041 Oct 28 19:17:57.788359 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1303/2598] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:57 2022] DELETE /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:17:57.807353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:57.811281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:57.825911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.832086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.832542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.833280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.833742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.834167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.849682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:57.861157 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2deb0e4-02e2-4b2b-b68e-824ff06caa9b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1317 microversion: 2.1 time: 0.418604 Oct 28 19:17:57.865043 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1296/2599] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:57 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:57.885227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:57.886023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:57.892958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.893455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.897769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:57.898724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:57.901059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:57.901531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.194679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:58.202399 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-95bafd44-58c7-41d8-83ea-c4fbc318eac7 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1316 microversion: 2.1 time: 0.406797 Oct 28 19:17:58.217844 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1304/2600] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:57 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:58.228064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ed88ac0-b240-423e-9456-6b2b0f019eb2 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] Calling method '.version_select at 0x7f1d772c3d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:58.245391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:58.254050 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ed88ac0-b240-423e-9456-6b2b0f019eb2 tempest-ServersTestFqdnHostnames-1837943600 tempest-ServersTestFqdnHostnames-1837943600-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230785318" status: 202 len: 0 microversion: 2.1 time: 0.034620 Oct 28 19:17:58.258561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1305/2601] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:17:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230785318 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:58.268548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:58.276189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:58.285643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.289477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.290023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.290958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.291573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.292467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.307741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:58.318936 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0df75282-049a-4183-9a85-b0b6057e7aaa tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.451931 Oct 28 19:17:58.319524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1297/2602] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:57 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:58.324310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:58.325372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:58.331573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.332418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.333060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.334252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.334907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.335341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.366703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:58.658077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:58.669013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-57942f8e-495d-4950-ba42-0b92f6d0d85d tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1589 microversion: 2.1 time: 0.411266 Oct 28 19:17:58.676480 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1306/2603] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:58 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1589 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:58.678886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:58.681639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:58.690969 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f43500f5-8677-46f4-9932-800f3d50c316 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1508 microversion: 2.1 time: 0.369602 Oct 28 19:17:58.692116 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1298/2604] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:58 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:58.702313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6e7b9189-b7fa-4bd0-85c2-e01f90646afe req-3e39fd2f-ad9a-4fd7-9592-21447712d167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb573a3-49a9-44de-b9a7-3d369e445b3d", "tag": "ef9497d5-6cbc-4f85-810a-28ec55936f60"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:58.713743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:58.727027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.727518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.727947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.728651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.729095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.729510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.730562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e7b9189-b7fa-4bd0-85c2-e01f90646afe req-3e39fd2f-ad9a-4fd7-9592-21447712d167 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.737242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e7b9189-b7fa-4bd0-85c2-e01f90646afe req-3e39fd2f-ad9a-4fd7-9592-21447712d167 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.738068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e7b9189-b7fa-4bd0-85c2-e01f90646afe req-3e39fd2f-ad9a-4fd7-9592-21447712d167 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.763316 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6e7b9189-b7fa-4bd0-85c2-e01f90646afe req-3e39fd2f-ad9a-4fd7-9592-21447712d167 service nova] Creating event network-changed:ef9497d5-6cbc-4f85-810a-28ec55936f60 for instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d on n-h2-862769-3 Oct 28 19:17:58.773230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6e7b9189-b7fa-4bd0-85c2-e01f90646afe req-3e39fd2f-ad9a-4fd7-9592-21447712d167 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077043 Oct 28 19:17:58.776396 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1299/2605] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:58.790067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:58.791110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:58.807245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.807980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.810999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.812894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:58.814434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:58.814903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:58.993890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:59.003680 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82d2f8fb-7e80-4516-bb59-99fec5da183c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.325916 Oct 28 19:17:59.007551 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1307/2606] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:58 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:59.026459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:59.027150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:59.041947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.042650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.043261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.044154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.044755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.045321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.211559 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44a225ef-f44a-4d38-9939-d864858034c9 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201282 Oct 28 19:17:59.213182 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1308/2607] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:17:59 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:59.238232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:59.240389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:59.250579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.254227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.255082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.258271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.258960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.259540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.320748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:59.336206 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3afa49c-9300-470d-a6f0-61d3071e2072 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1303 microversion: 2.1 time: 0.558299 Oct 28 19:17:59.339145 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1300/2608] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:58 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1303 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:59.347082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-05b9a860-5935-445c-a836-a1cb98d96ffc req-93a48311-946e-47ec-83c9-3a8fe02491eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98c8871-6eb1-4830-8aea-a4f55de4d47a", "name": "network-vif-plugged", "status": "completed", "tag": "32744063-eac0-458a-a3b4-6ded8b3c898b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:59.365741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05b9a860-5935-445c-a836-a1cb98d96ffc req-93a48311-946e-47ec-83c9-3a8fe02491eb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.366267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05b9a860-5935-445c-a836-a1cb98d96ffc req-93a48311-946e-47ec-83c9-3a8fe02491eb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.366715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-05b9a860-5935-445c-a836-a1cb98d96ffc req-93a48311-946e-47ec-83c9-3a8fe02491eb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.386606 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-05b9a860-5935-445c-a836-a1cb98d96ffc req-93a48311-946e-47ec-83c9-3a8fe02491eb service nova] Creating event network-vif-plugged:32744063-eac0-458a-a3b4-6ded8b3c898b for instance e98c8871-6eb1-4830-8aea-a4f55de4d47a on n-h2-862769-3 Oct 28 19:17:59.392312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-05b9a860-5935-445c-a836-a1cb98d96ffc req-93a48311-946e-47ec-83c9-3a8fe02491eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051700 Oct 28 19:17:59.392919 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1301/2609] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:59.400872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3a4f7137-9844-4487-b305-38a58d95bc2b req-e92d8667-c9bb-419c-b82b-81ecae2cfe6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3786c049-58ee-45ea-bcf3-86096d2d4847", "tag": "d70faf8f-ac62-4e16-82d4-6592813a00e9"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:59.451410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3a4f7137-9844-4487-b305-38a58d95bc2b req-e92d8667-c9bb-419c-b82b-81ecae2cfe6f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.451977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3a4f7137-9844-4487-b305-38a58d95bc2b req-e92d8667-c9bb-419c-b82b-81ecae2cfe6f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.452413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3a4f7137-9844-4487-b305-38a58d95bc2b req-e92d8667-c9bb-419c-b82b-81ecae2cfe6f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.473532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3a4f7137-9844-4487-b305-38a58d95bc2b req-e92d8667-c9bb-419c-b82b-81ecae2cfe6f service nova] Creating event network-changed:d70faf8f-ac62-4e16-82d4-6592813a00e9 for instance 3786c049-58ee-45ea-bcf3-86096d2d4847 on n-h1-862769-3 Oct 28 19:17:59.480778 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3a4f7137-9844-4487-b305-38a58d95bc2b req-e92d8667-c9bb-419c-b82b-81ecae2cfe6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086317 Oct 28 19:17:59.481633 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1302/2610] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:59.489125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:59.491040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:59.505176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.506200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.506806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.507689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.508280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.508863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.855331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:59.886055 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-118c5948-5de7-4fd5-881e-1c3e505f80e6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1317 microversion: 2.1 time: 0.659806 Oct 28 19:17:59.893191 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1309/2611] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:59 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:59.911295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:59.911912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:17:59.922683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.923194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.923617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.924308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:59.924749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:59.925159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:59.975149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:59.988102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4942edc-b3c0-49af-8007-3d9a9d783d5f tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1316 microversion: 2.1 time: 0.504906 Oct 28 19:17:59.989857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1303/2612] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:59 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:59.996343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:59.997231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:00.004862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:00.005549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:00.006859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:00.007761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:00.008929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:00.010181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:00.857191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f110a281cb6e4577881203ce8382585c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1110dcce71ea40c69fd27c0cf6ce6bfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:00.868770 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00bc9388-74cc-4b69-9ac9-f37970eba889 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 200 len: 1508 microversion: 2.1 time: 0.875985 Oct 28 19:18:00.872099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:00.873371 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1304/2613] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:59 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 1508 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:00.878144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:00.882641 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3cca92ec-245c-47ee-8cbc-47bf1b84a633 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.986556 Oct 28 19:18:00.891102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:00.891229 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1310/2614] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:59 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:00.899402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:00.900200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:00.908015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:00.909001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:00.909707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:00.910802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:00.911397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:00.911544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:00.912089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:00.915385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:00.915866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:00.916713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:00.917071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:00.917511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.431064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:01.439997 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dca14f05-f789-458d-9802-4567131ddc2c tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1303 microversion: 2.1 time: 0.547103 Oct 28 19:18:01.440367 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1311/2615] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:00 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1303 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:01.465660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b19a3625-c7b9-4245-a6be-8227a23adfbf req-d2544781-94a6-45aa-963f-3c1dba014bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fbe126-ca67-4eb6-b7b5-d88a248d0d04", "name": "network-vif-deleted", "tag": "9bf6e405-f2d8-4354-ad56-ff3679bf4547"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:01.476848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b19a3625-c7b9-4245-a6be-8227a23adfbf req-d2544781-94a6-45aa-963f-3c1dba014bb6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.477325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b19a3625-c7b9-4245-a6be-8227a23adfbf req-d2544781-94a6-45aa-963f-3c1dba014bb6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.477785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b19a3625-c7b9-4245-a6be-8227a23adfbf req-d2544781-94a6-45aa-963f-3c1dba014bb6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.477871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:01.486721 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2e3aed0-62c1-430d-8416-387322f93a10 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.612172 Oct 28 19:18:01.487315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1305/2616] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:00 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:01.498798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b19a3625-c7b9-4245-a6be-8227a23adfbf req-d2544781-94a6-45aa-963f-3c1dba014bb6 service nova] Creating event network-vif-deleted:9bf6e405-f2d8-4354-ad56-ff3679bf4547 for instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 on n-h2-862769-3 Oct 28 19:18:01.504163 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b19a3625-c7b9-4245-a6be-8227a23adfbf req-d2544781-94a6-45aa-963f-3c1dba014bb6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 Oct 28 19:18:01.505099 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1312/2617] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:01.505671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:01.506449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:01.514055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:01.518859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:01.526899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.528179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.528179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.529142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.529938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.530111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.530661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.530879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.531202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.531924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.532377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.532795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.988346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:02.000810 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1693887-b74e-4b4a-927c-dbfe26153ef6 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1317 microversion: 2.1 time: 0.503422 Oct 28 19:18:02.001410 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1306/2618] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:01 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:02.002579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:02.008396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.011125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.013608 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d53905f-eef3-4db2-b81b-bf7a88762f7e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1504 microversion: 2.1 time: 0.504941 Oct 28 19:18:02.014323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1313/2619] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:01 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:02.030602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.031656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.043088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.043584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.044018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.044725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.045178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.045597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.046866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.047583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.048241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.049155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.049815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.050442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.088109 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 HTTP/1.1 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '11fbe126-ca67-4eb6-b7b5-d88a248d0d04'} Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.090163 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1dc5b529-7bc2-4a6b-8619-9b149ffaf7ab tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 404 len: 111 microversion: 2.1 time: 0.088974 Oct 28 19:18:02.094010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1307/2620] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:02.108073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.108498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.121143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.121639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.122068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.122794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.123245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.123663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.174912 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a6068cc-8182-46a2-873a-7765af23ecc2 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a/ips" status: 200 len: 108 microversion: 2.1 time: 0.080156 Oct 28 19:18:02.189459 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1308/2621] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a/ips => generated 108 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:02.195030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-765935166", "metadata": {"image_type": "test"}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:02.200068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.217596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.218107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.218539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.219291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.219923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.220500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.244824 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04/action HTTP/1.1 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 111 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-765935166", "metadata": {"image_type": "test"}}} Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '11fbe126-ca67-4eb6-b7b5-d88a248d0d04', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-765935166', 'metadata': {'image_type': 'test'}}}} Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:18:02.246662 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:02.250262 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.252673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:02.255542 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-97743fcd-7e0a-4b91-913b-60ddba8ed2dc tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "POST /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04/action" status: 404 len: 111 microversion: 2.1 time: 0.064348 Oct 28 19:18:02.256807 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1309/2622] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Oct 28 19:18:02 2022] POST /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:02.262154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.262965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.276140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.278777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.279993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.281384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.282040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.282671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.317617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:02.331274 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-129d443a-c806-4f44-9f57-d49635f45af9 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a/ips" status: 200 len: 108 microversion: 2.1 time: 0.073105 Oct 28 19:18:02.332551 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1310/2623] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a/ips => generated 108 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:02.339431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=30 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:02.354393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3da7d5b-00d0-4100-aaa7-0c696aa627d1 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-357764565", "metadata": {"image_type": "test"}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:02.360165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3da7d5b-00d0-4100-aaa7-0c696aa627d1 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Failed to fetch instance by id tempest-invalid-1691344708 {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:18:02.360877 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b3da7d5b-00d0-4100-aaa7-0c696aa627d1 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance tempest-invalid-1691344708 could not be found. Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3da7d5b-00d0-4100-aaa7-0c696aa627d1 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/tempest-invalid-1691344708/action HTTP/1.1 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 111 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-357764565", "metadata": {"image_type": "test"}}} Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance tempest-invalid-1691344708 could not be found. Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'tempest-invalid-1691344708', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-357764565', 'metadata': {'image_type': 'test'}}}} Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1691344708 could not be found. Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:02.362944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1691344708 could not be found. Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1691344708 could not be found. Oct 28 19:18:02.368294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.371964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3da7d5b-00d0-4100-aaa7-0c696aa627d1 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance tempest-invalid-1691344708 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:02.374546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3da7d5b-00d0-4100-aaa7-0c696aa627d1 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "POST /compute/v2.1/servers/tempest-invalid-1691344708/action" status: 404 len: 101 microversion: 2.1 time: 0.040419 Oct 28 19:18:02.375337 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1311/2624] 10.222.0.44 () {60 vars in 1249 bytes} [Fri Oct 28 19:18:02 2022] POST /compute/v2.1/servers/tempest-invalid-1691344708/action => generated 101 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:02.384230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.384981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.396588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.397424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.398006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.399092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.399700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.400949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.461622 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebe11211-10a2-4a90-bec6-600a3de29d92 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a/ips/tempest-ServerAddressesTestJSON-431926670-network" status: 200 len: 93 microversion: 2.1 time: 0.084818 Oct 28 19:18:02.462463 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1312/2625] 10.222.0.44 () {58 vars in 1398 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a/ips/tempest-ServerAddressesTestJSON-431926670-network => generated 93 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:18:02.468450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04ba19c0-5485-4068-98e1-42eecb9dc902 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-117490882"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:02.472385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04ba19c0-5485-4068-98e1-42eecb9dc902 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:18:02.473238 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-04ba19c0-5485-4068-98e1-42eecb9dc902 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04ba19c0-5485-4068-98e1-42eecb9dc902 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 56 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: {"createImage": {"name": "tempest-test-snap-117490882"}} Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-117490882'}}} Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.477197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.481716 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.483898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04ba19c0-5485-4068-98e1-42eecb9dc902 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:02.485468 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04ba19c0-5485-4068-98e1-42eecb9dc902 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.021656 Oct 28 19:18:02.485614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:02.487297 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1313/2626] 10.222.0.44 () {60 vars in 1275 bytes} [Fri Oct 28 19:18:02 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:02.493428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.494374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:02.494793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.505166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.505777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.506569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.506976 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73f33d9c-bce8-42f1-ad6c-302b53522b86 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.491275 Oct 28 19:18:02.507596 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1314/2627] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:02.519835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.520492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.521151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.521604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.525359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.550875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.555152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.555605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.556351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.556968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.565824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.607848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:02.769560 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-795fa2af-e113-4520-910d-1991310cab6b tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 204 len: 0 microversion: 2.1 time: 0.260224 Oct 28 19:18:02.770167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1315/2628] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:02 2022] DELETE /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:02.783512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-869f2b13-fc45-457c-9543-5b0897c77f54 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2125334472"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:02.788877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-869f2b13-fc45-457c-9543-5b0897c77f54 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:18:02.790639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-869f2b13-fc45-457c-9543-5b0897c77f54 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-869f2b13-fc45-457c-9543-5b0897c77f54 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 57 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: {"createImage": {"name": "tempest-test-snap-2125334472"}} Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2125334472'}}} Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.796648 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-869f2b13-fc45-457c-9543-5b0897c77f54 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:02.800336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-869f2b13-fc45-457c-9543-5b0897c77f54 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027420 Oct 28 19:18:02.801042 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1316/2629] 10.222.0.44 () {60 vars in 1281 bytes} [Fri Oct 28 19:18:02 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:02.814903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.817761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:02.833695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.837648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.838271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.842967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.844328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.844933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.411659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:03.424493 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13a41369-dc03-4f65-b1fd-ed1218a797da tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1303 microversion: 2.1 time: 0.935846 Oct 28 19:18:03.438725 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1314/2630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1303 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:03.438725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:03.438725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:03.441096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.443007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.443007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.445303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.445909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.446339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.510486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:03.528745 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aab4418e-fba6-4513-b87f-722b942ccead tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.724672 Oct 28 19:18:03.529504 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1317/2631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:03.535472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:03.536267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:03.543591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.544389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.545126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.546329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.547348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.548028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.565566 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 HTTP/1.1 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '11fbe126-ca67-4eb6-b7b5-d88a248d0d04'} Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:03.567599 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:03.571134 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:03.573166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:03.574205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82149ddc-8d85-4d84-a11a-ca2b5d161fa4 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "DELETE /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 404 len: 111 microversion: 2.1 time: 0.043484 Oct 28 19:18:03.575117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1318/2632] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:03 2022] DELETE /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:03.579864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:03.580673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:03.587057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.587589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.588033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.588697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.589320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.589963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.595975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:03.621439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:03.743449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:03.770020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e65c5ef5-ac15-45c7-a0b7-6c882645be76 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1510 microversion: 2.1 time: 0.342848 Oct 28 19:18:03.771692 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1315/2633] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:03 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:03.778343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:03.779237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:03.788412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.790311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.791239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.792836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.793480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.794371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.859164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:03.872524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-675733ab-f8b7-47e7-ace5-905bee30899b tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1317 microversion: 2.1 time: 0.295487 Oct 28 19:18:03.873840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1319/2634] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:03 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:03.891368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7dd84a47-69bf-4344-b1f9-c6e3c15cd9e4 req-e5b8c60e-23d2-4eec-82ab-5bad3b1c0e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79fe462c-5e0a-4739-8a8e-adf189fde3e7", "tag": "b244a054-944d-46bc-8f92-1137017c1779"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:03.919190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7dd84a47-69bf-4344-b1f9-c6e3c15cd9e4 req-e5b8c60e-23d2-4eec-82ab-5bad3b1c0e53 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.919302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7dd84a47-69bf-4344-b1f9-c6e3c15cd9e4 req-e5b8c60e-23d2-4eec-82ab-5bad3b1c0e53 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.919673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7dd84a47-69bf-4344-b1f9-c6e3c15cd9e4 req-e5b8c60e-23d2-4eec-82ab-5bad3b1c0e53 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.935029 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7dd84a47-69bf-4344-b1f9-c6e3c15cd9e4 req-e5b8c60e-23d2-4eec-82ab-5bad3b1c0e53 service nova] Creating event network-changed:b244a054-944d-46bc-8f92-1137017c1779 for instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 on n-h1-862769-3 Oct 28 19:18:03.940820 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7dd84a47-69bf-4344-b1f9-c6e3c15cd9e4 req-e5b8c60e-23d2-4eec-82ab-5bad3b1c0e53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065299 Oct 28 19:18:03.942314 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1320/2635] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:03.949411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:03.950722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:03.958467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.959233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.959814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.960688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.961786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.962355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.250724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:04.260709 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-93c89c69-31ab-4977-8f60-b0932f63d63e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1589 microversion: 2.1 time: 0.487702 Oct 28 19:18:04.261430 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1316/2636] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:03 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1589 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:04.287735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:04.288884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] [instance: 11fbe126-ca67-4eb6-b7b5-d88a248d0d04] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:04.297005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.297494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.297914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.298863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.299458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.300019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.315811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] HTTP exception thrown: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Request method failure captured: Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 HTTP/1.1 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCrIkwB5K27bWRuLSmEiiHVFPSZxtFvNmm9-5kyYqsVRZPGlsMyedVdnezr4CBFTLv2tAzWet4bFUicb6H-4hAwR4PKw3Q_0H6cWIJytt9KJ1MBJjNzr3S9AvXvOuVGMZuA85jbQdvI2DEXgBVND7bsBMmGvZO8dUuWE4gznIcsHg8o Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1110dcce71ea40c69fd27c0cf6ce6bfd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1110dcce71ea40c69fd27c0cf6ce6bfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1110dcce71ea40c69fd27c0cf6ce6bfd Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-696431429 Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f110a281cb6e4577881203ce8382585c Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesNegativeTestJSON-696431429-project Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '11fbe126-ca67-4eb6-b7b5-d88a248d0d04'} Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:04.317757 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] Returning 404 to user: Instance 11fbe126-ca67-4eb6-b7b5-d88a248d0d04 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b21b56c-9ef0-47a3-ba45-cd299f3c6d22 tempest-ImagesNegativeTestJSON-696431429 tempest-ImagesNegativeTestJSON-696431429-project] 10.222.0.44 "GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04" status: 404 len: 111 microversion: 2.1 time: 0.041944 Oct 28 19:18:04.325610 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1317/2637] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:04 2022] GET /compute/v2.1/servers/11fbe126-ca67-4eb6-b7b5-d88a248d0d04 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:04.328277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:04.344690 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-32acfb7a-99cc-4ff7-9fa6-c9324f23cb89 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.400656 Oct 28 19:18:04.361455 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1321/2638] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:03 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:04.453744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:04.458795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:04.467514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.468252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.468832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.469683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.470281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.470946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.560918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:04.563089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:04.571348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.572366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.573041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.574012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.574784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.576038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:05.433986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:05.442827 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1323f3cc-3c0e-46b9-bd26-b3aeeb845734 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.995088 Oct 28 19:18:05.443350 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1318/2639] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:04 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:05.448113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:05.448990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:05.456345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:05.457510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:05.457617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:05.458211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:05.459424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:05.460860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:05.462376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:05.473319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93e132c5-152e-4fa2-8ac9-dc529df29f87 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.919509 Oct 28 19:18:05.473924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1322/2640] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:04 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:05.478673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:05.479490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:05.485565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:05.486284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:05.486984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:05.487848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:05.488501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:05.489075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.090001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:06.098240 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bea540fd-c885-4cd2-96a5-8982898ae43a tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1317 microversion: 2.1 time: 0.623082 Oct 28 19:18:06.099021 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1323/2641] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:05 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:06.103862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:06.104412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:06.107845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:06.110485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.111020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.111450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.112329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.112921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.113520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.120379 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a45a59c-22f3-4964-b933-ef76fcf0a79e tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1510 microversion: 2.1 time: 0.675819 Oct 28 19:18:06.121094 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1319/2642] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:05 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1510 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:06.126170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5687b9f1-2d71-4cbc-b8bb-db2459c1bbde req-58e204ea-ea0f-4349-a5f4-6f0a02eeb9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3786c049-58ee-45ea-bcf3-86096d2d4847", "name": "network-vif-plugged", "status": "completed", "tag": "d70faf8f-ac62-4e16-82d4-6592813a00e9"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:06.136201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5687b9f1-2d71-4cbc-b8bb-db2459c1bbde req-58e204ea-ea0f-4349-a5f4-6f0a02eeb9cb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.136931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5687b9f1-2d71-4cbc-b8bb-db2459c1bbde req-58e204ea-ea0f-4349-a5f4-6f0a02eeb9cb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.137457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5687b9f1-2d71-4cbc-b8bb-db2459c1bbde req-58e204ea-ea0f-4349-a5f4-6f0a02eeb9cb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.149293 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5687b9f1-2d71-4cbc-b8bb-db2459c1bbde req-58e204ea-ea0f-4349-a5f4-6f0a02eeb9cb service nova] Creating event network-vif-plugged:d70faf8f-ac62-4e16-82d4-6592813a00e9 for instance 3786c049-58ee-45ea-bcf3-86096d2d4847 on n-h1-862769-3 Oct 28 19:18:06.155387 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5687b9f1-2d71-4cbc-b8bb-db2459c1bbde req-58e204ea-ea0f-4349-a5f4-6f0a02eeb9cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032829 Oct 28 19:18:06.156423 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1320/2643] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:06.470172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:06.471121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:06.477560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.478126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.478625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.479456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.479932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.480407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.759874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:06.767783 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db453757-e4f6-4e67-8ed1-a7990bc418be tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.667540 Oct 28 19:18:06.783207 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1324/2644] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:06 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:06.788972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:06.790434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:06.797245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.798065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.798889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.799750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.800197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.800607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.917899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:06.930713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99decb41-6ba9-4a2d-b623-c3c543c530ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.464716 Oct 28 19:18:06.943695 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1321/2645] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:06 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:06.991251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c07d4b47-ba61-418e-9207-4a18e2d8c66b req-7ae0ddce-850f-4173-8116-e8682b8d3e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98c8871-6eb1-4830-8aea-a4f55de4d47a", "name": "network-vif-deleted", "tag": "32744063-eac0-458a-a3b4-6ded8b3c898b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:07.012182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c07d4b47-ba61-418e-9207-4a18e2d8c66b req-7ae0ddce-850f-4173-8116-e8682b8d3e22 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.012871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c07d4b47-ba61-418e-9207-4a18e2d8c66b req-7ae0ddce-850f-4173-8116-e8682b8d3e22 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.013445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c07d4b47-ba61-418e-9207-4a18e2d8c66b req-7ae0ddce-850f-4173-8116-e8682b8d3e22 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.029801 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c07d4b47-ba61-418e-9207-4a18e2d8c66b req-7ae0ddce-850f-4173-8116-e8682b8d3e22 service nova] Creating event network-vif-deleted:32744063-eac0-458a-a3b4-6ded8b3c898b for instance e98c8871-6eb1-4830-8aea-a4f55de4d47a on n-h2-862769-3 Oct 28 19:18:07.035159 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c07d4b47-ba61-418e-9207-4a18e2d8c66b req-7ae0ddce-850f-4173-8116-e8682b8d3e22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061159 Oct 28 19:18:07.036273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1322/2646] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:18:07.115343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:07.125591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:07.127092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:07.134453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1bd8b82b-f762-422d-9cdb-0f96e3e73b69 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.349856 Oct 28 19:18:07.138942 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1325/2647] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:06 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:07.145151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.145648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.146085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.146191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:07.146744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:07.146848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.147270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.147694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.152757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.153465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.154070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.154988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.155640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.156240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.168699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:07.200933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.201417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.201844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.202495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lazy-loading 'fault' on Instance uuid e98c8871-6eb1-4830-8aea-a4f55de4d47a {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:18:07.291888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14b118724b9445389ede871498bf3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8932016ab68471ea3e6e4d42bef9c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:07.301411 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8842981f-5910-4ead-8aed-a7c405bd4439 tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 200 len: 1306 microversion: 2.1 time: 0.161190 Oct 28 19:18:07.302311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1326/2648] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:07 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:07.418585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:07.428034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-62eb5a48-83b7-4e5e-a6d7-453b19e438f7 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1317 microversion: 2.1 time: 0.310318 Oct 28 19:18:07.428597 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1323/2649] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:07 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:07.796689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:07.797625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:07.815615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.817018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.817635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.819117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.819869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.820895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.953508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:07.954816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:07.962048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.962957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.963577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.964478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:07.965121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:07.965729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.468038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:08.481411 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-64470ec4-ad7a-4d2c-ab44-71fc6614a664 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.530387 Oct 28 19:18:08.483059 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1324/2650] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:07 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:08.488237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:08.489136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:08.495994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:08.497514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.498264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.498799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.499595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.500160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.500806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.522553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0500c1da-7af4-4914-95c8-a9b5c760b7b2 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.731813 Oct 28 19:18:08.531038 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1327/2651] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:07 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:08.536239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:08.537121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] [instance: e98c8871-6eb1-4830-8aea-a4f55de4d47a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:08.553380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.554155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.554590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.555330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.555778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.556191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.579336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] HTTP exception thrown: Instance e98c8871-6eb1-4830-8aea-a4f55de4d47a could not be found. Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Request method failure captured: Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a HTTP/1.1 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCrXq6tdyA71ztROaQIFI6wOPEONQYynwiH8qdVRlUrKcwUVJ3CL7oFO7C3SN6paH3rGZdTnMb-kiN9kHt9dWyJXpQIWYmbV7hzB1glmMX_IpLh3Dq7440CWYE__TJTrolZP7e1-VIlbL89Zu_OaM-wL1ajaylUI-U_xoCE8UP1IdPU Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: c8932016ab68471ea3e6e4d42bef9c8b Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerAddressesTestJSON-1175816591 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c8932016ab68471ea3e6e4d42bef9c8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c8932016ab68471ea3e6e4d42bef9c8b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c8932016ab68471ea3e6e4d42bef9c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c8932016ab68471ea3e6e4d42bef9c8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerAddressesTestJSON-1175816591 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: c8932016ab68471ea3e6e4d42bef9c8b Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1175816591 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerAddressesTestJSON-1175816591-project Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: f14b118724b9445389ede871498bf3e6 Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerAddressesTestJSON-1175816591-project Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e98c8871-6eb1-4830-8aea-a4f55de4d47a could not be found. Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e98c8871-6eb1-4830-8aea-a4f55de4d47a'} Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98c8871-6eb1-4830-8aea-a4f55de4d47a could not be found. Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98c8871-6eb1-4830-8aea-a4f55de4d47a could not be found. Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:08.581016 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98c8871-6eb1-4830-8aea-a4f55de4d47a could not be found. Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] Returning 404 to user: Instance e98c8871-6eb1-4830-8aea-a4f55de4d47a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:08.585800 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bbf49a07-de6e-4c58-9408-24dfab46aa7d tempest-ServerAddressesTestJSON-1175816591 tempest-ServerAddressesTestJSON-1175816591-project] 10.222.0.44 "GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a" status: 404 len: 111 microversion: 2.1 time: 0.050150 Oct 28 19:18:08.590466 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1328/2652] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:08 2022] GET /compute/v2.1/servers/e98c8871-6eb1-4830-8aea-a4f55de4d47a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:08.595588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:08.596800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:08.603395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.604237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.604900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.606109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.606955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.607727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.901356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:08.912915 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0cf4d99-1694-4e09-8a4e-735b0aa181dc tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1506 microversion: 2.1 time: 0.320852 Oct 28 19:18:08.927735 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1329/2653] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:08 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:08.942019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:08.942557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:08.946510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:08.956302 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a11a75be-d43a-4e5d-aaf1-3a9f87974aff tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.471889 Oct 28 19:18:08.977665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1325/2654] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:08 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:08.978675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.979553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.980158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.981030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.981631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.982195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.018027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:09.019049 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-346a9469-12eb-4168-bc46-be3cadf5ec6e tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847/os-instance-actions/req-34c22029-0e8b-44ab-bf62-b653b3d5b4de" status: 200 len: 313 microversion: 2.1 time: 0.086242 Oct 28 19:18:09.019821 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1330/2655] 10.222.0.44 () {58 vars in 1419 bytes} [Fri Oct 28 19:18:08 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847/os-instance-actions/req-34c22029-0e8b-44ab-bf62-b653b3d5b4de => generated 313 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:09.035013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:09.038231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:09.044995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.045479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.045901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.046873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.047321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.047731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.137887 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1d1c2a9-1862-4d5d-b2a3-59856f3c5258 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "POST /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847/action" status: 202 len: 0 microversion: 2.1 time: 0.107808 Oct 28 19:18:09.139007 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1326/2656] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:09 2022] POST /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:18:09.149511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:09.150554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:09.160731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.161499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.162256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.164343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.165018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.165675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.406604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:09.419444 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f092ed8-27e0-40fb-a05d-a234e6065c73 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1508 microversion: 2.1 time: 0.275770 Oct 28 19:18:09.422608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1331/2657] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:09 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:09.505325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:09.506719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:09.517456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.517951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.518383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.519116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.519690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.520107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.560379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:09.560967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:09.567967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.568779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.569413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.570312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.570999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.571750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.598717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:09.844477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:09.856059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d596a95-0e7c-48bf-b385-dfaff6932ee2 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.354877 Oct 28 19:18:09.858450 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1327/2658] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:09 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:09.987794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:09.994409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:10.017621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:10.032136 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d818a6fd-9001-4d61-af7e-01a8d00f45ab tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.475498 Oct 28 19:18:10.038042 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1332/2659] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:09 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:10.041951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.042933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.043627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.044709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.045978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.046600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.441266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:10.446655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:10.447643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:10.455143 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04a92fea-d611-47c4-ad13-b4f1c610b5be tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.474218 Oct 28 19:18:10.455929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1328/2660] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:09 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:10.477823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.479140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.480020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.480939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.484355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.485123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.885212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:10.886078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:10.927879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.928585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.929055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.929801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.930251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.930669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.073322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:11.090254 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee81649b-ecc3-41c4-82fb-9fc441cea09c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1508 microversion: 2.1 time: 0.642642 Oct 28 19:18:11.091018 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1333/2661] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:10 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:11.110495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:11.111138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:11.127077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:11.127727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:11.127964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.128849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:11.129388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:11.135748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.473732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:11.482122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7853e168-0455-4168-8114-c807aa5df4cc tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1472 microversion: 2.1 time: 0.389189 Oct 28 19:18:11.482720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1334/2662] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:11 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:11.486357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:11.488136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:11.488792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:11.494800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:11.495478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:11.496143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.496570 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3aa5dc26-3ed3-4e77-a663-b49281fc05e7 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.613881 Oct 28 19:18:11.497349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:11.497959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:11.502746 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1329/2663] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:10 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:11.503756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.969491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:11.996405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-86135e3e-f7bb-4971-8cfe-796879d8e299 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.511800 Oct 28 19:18:12.008178 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1335/2664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:11 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:12.113682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:12.114992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:12.122233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:12.123917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:12.124376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:12.131413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:12.131892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:12.132642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:12.507458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:12.509052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:12.524195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:12.524917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:12.525569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:12.526507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:12.529387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:12.530053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.074816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:13.088974 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6bda3f82-f0f8-41a6-b17d-1dd3524f596c tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1506 microversion: 2.1 time: 0.979313 Oct 28 19:18:13.098147 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1330/2665] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:12 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1506 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:13.123163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:13.124182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:13.134416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.135114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.135615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.136639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.137295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.138518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.180180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:13.190999 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-feabfc7f-0189-4282-a74d-810071a20269 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1478 microversion: 2.1 time: 0.689830 Oct 28 19:18:13.202712 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1336/2666] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:12 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1478 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:13.202712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:13.202712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:13.205280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.205993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.208641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.209544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.210655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.211263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.652858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:13.667817 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aad99cfe-9b38-4be0-b4cf-0481fcf88b80 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.565805 Oct 28 19:18:13.668509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1331/2667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:13 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:13.689462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '.version_select at 0x7f1d77409ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:13.691381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:13.707287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.711013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.711751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.713934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.715017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.717448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.793589 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0c6b933-0169-47b3-9ee6-169e4c812e87 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.108684 Oct 28 19:18:13.803898 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1332/2668] 10.222.0.44 () {58 vars in 1296 bytes} [Fri Oct 28 19:18:13 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847/os-instance-actions => generated 611 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:13.809751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:13.840507 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-837a5610-aac4-4d41-9469-601eb212a559 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.647440 Oct 28 19:18:13.845321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:13.849149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:13.857931 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1337/2669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:13 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:13.859763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.860507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.861077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.861939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.862560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.863314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.915243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:14.075666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-472cb188-c11e-4d09-96ad-93a5e3a4a838 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 204 len: 0 microversion: 2.1 time: 0.270094 Oct 28 19:18:14.093327 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1333/2670] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:13 2022] DELETE /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:14.098759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:14.100066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:14.116221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.135379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.139386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.140526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.145518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.146343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.223074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:14.223947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:14.238658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.239224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.239676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.240409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.240867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.241291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.606666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:14.617694 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e17a99ea-299d-41f3-88e6-7b45c74e23d0 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1463 microversion: 2.1 time: 0.404330 Oct 28 19:18:14.619012 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1334/2671] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:14 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1463 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:14.624472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:14.640390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ed94f3c-7d40-46cf-b356-9e785dfd7509 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1512 microversion: 2.1 time: 0.545741 Oct 28 19:18:14.644800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:14.647242 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1338/2672] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:14 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:14.647569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:14.653517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.654186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.654890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.655748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.656339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.658203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.691095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:14.692401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:14.699298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.700036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.700619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.701484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.702076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.702630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.769009 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10f5bda3-7e69-423d-8246-6d86620bf31b tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 0 microversion: 2.1 time: 0.127912 Oct 28 19:18:14.773798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1335/2673] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:14 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:18:14.780956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:14.781852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:14.790038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.790763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.791482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.793521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.794291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.795029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.819177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:14.837275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.838004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.838753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.839507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lazy-loading 'fault' on Instance uuid 4f131269-d1fb-4779-a11f-f35a87fd1c87 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:18:14.951120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:14.959688 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3aaf576-5d3d-4a6b-adb9-84907fc71a14 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.272292 Oct 28 19:18:14.963446 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1339/2674] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:14 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:14.969950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:14.978653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:14.991866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.993114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:14.993748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:14.998989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:14.999725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.001764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.031629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6bc0a243-fea7-4aab-b1b5-3bdf99fe6fbf tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1597 microversion: 2.1 time: 0.255426 Oct 28 19:18:15.033518 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1336/2675] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:14 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1597 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:15.057525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:15.062490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:15.069896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.070493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.071053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.071853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.072408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.073146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.277169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e50aa44-2548-4fff-8d9f-082a4afec4c7 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action" status: 202 len: 0 microversion: 2.1 time: 0.223652 Oct 28 19:18:15.279328 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1337/2676] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:15 2022] POST /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:18:15.309417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:15.311200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:15.327784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:15.333552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.334456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.335280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.338302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.339110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.340024 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6273f60c-d7c3-447b-9817-d06441cfc5f7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.373351 Oct 28 19:18:15.341024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.355642 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1340/2677] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:14 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:15.623155 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7084999-e2be-4545-b948-5cd5f7c02d47 tempest-ServersAdminTestJSON-2004197794 tempest-ServersAdminTestJSON-2004197794-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1614 microversion: 2.1 time: 0.334369 Oct 28 19:18:15.626245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1338/2678] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:15 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1614 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:15.661972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:15.663487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:15.664753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:15.665416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:15.681868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.682662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.683287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.684161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.684761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.685436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.686010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.686503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.691887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.693536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.696573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.699173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.781602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:15.947395 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56d54682-58eb-4fd8-813f-2f9933801a8d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 204 len: 0 microversion: 2.1 time: 0.300027 Oct 28 19:18:15.954658 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1341/2679] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:15 2022] DELETE /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:16.163331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:16.174610 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b93da10-d604-4576-93e8-8197c0a6fc77 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1512 microversion: 2.1 time: 0.512688 Oct 28 19:18:16.176296 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1339/2680] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:15 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1512 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:16.186945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:16.189555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:16.198231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:16.208886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.210273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.211514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:16.212747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.215549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.216060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:16.343954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-62df1e2c-2b61-42bd-b1f0-36686dd577ec req-e722e189-a29b-4c89-8825-d0615df848a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "name": "network-vif-unplugged", "status": "completed", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:16.359216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-62df1e2c-2b61-42bd-b1f0-36686dd577ec req-e722e189-a29b-4c89-8825-d0615df848a6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.360214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-62df1e2c-2b61-42bd-b1f0-36686dd577ec req-e722e189-a29b-4c89-8825-d0615df848a6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.360826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-62df1e2c-2b61-42bd-b1f0-36686dd577ec req-e722e189-a29b-4c89-8825-d0615df848a6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:16.380481 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-62df1e2c-2b61-42bd-b1f0-36686dd577ec req-e722e189-a29b-4c89-8825-d0615df848a6 service nova] Creating event network-vif-unplugged:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:18:16.387087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-62df1e2c-2b61-42bd-b1f0-36686dd577ec req-e722e189-a29b-4c89-8825-d0615df848a6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.430120 Oct 28 19:18:16.388268 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1342/2681] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:16.401270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:16.402408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:16.417858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.418457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.419947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:16.422585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.423894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.425872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:16.854305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:16.871570 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f13a819b-d6bb-4b2f-ae44-fecb412ab802 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1468 microversion: 2.1 time: 0.693740 Oct 28 19:18:16.875578 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1340/2682] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:16 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1468 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:16.886025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:16.887457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:16.902799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.904660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.905290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:16.906237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:16.906941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:16.907532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.063491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:17.074343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-645d117f-232f-4b51-9882-843770357bd6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.683581 Oct 28 19:18:17.074874 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1343/2683] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:16 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:17.216254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:17.236615 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5e5e31aa-c932-42cc-84e5-e23f777518dc tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.359749 Oct 28 19:18:17.258793 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1341/2684] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:16 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:17.266810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8325e8de-2053-4914-a76b-bf32579894fd req-68b658a7-e437-431f-893c-340cbd5e9903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3786c049-58ee-45ea-bcf3-86096d2d4847", "name": "network-vif-deleted", "tag": "d70faf8f-ac62-4e16-82d4-6592813a00e9"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:17.280277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8325e8de-2053-4914-a76b-bf32579894fd req-68b658a7-e437-431f-893c-340cbd5e9903 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:17.280938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8325e8de-2053-4914-a76b-bf32579894fd req-68b658a7-e437-431f-893c-340cbd5e9903 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:17.281519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8325e8de-2053-4914-a76b-bf32579894fd req-68b658a7-e437-431f-893c-340cbd5e9903 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.298158 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8325e8de-2053-4914-a76b-bf32579894fd req-68b658a7-e437-431f-893c-340cbd5e9903 service nova] Creating event network-vif-deleted:d70faf8f-ac62-4e16-82d4-6592813a00e9 for instance 3786c049-58ee-45ea-bcf3-86096d2d4847 on n-h1-862769-3 Oct 28 19:18:17.309033 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8325e8de-2053-4914-a76b-bf32579894fd req-68b658a7-e437-431f-893c-340cbd5e9903 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048619 Oct 28 19:18:17.314445 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1342/2685] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:17.328860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:17.331025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:17.340690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:17.341993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:17.342894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.343767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:17.344386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:17.345554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.404736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:17.409425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:17.409907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.410476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lazy-loading 'fault' on Instance uuid 3786c049-58ee-45ea-bcf3-86096d2d4847 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:18:17.481482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f161d2f0-1a8c-4537-9ef9-5e72a6f6793a tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d77296b80>, body: {"keypair": {"name": "tempest-keypair-1108135988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhn68soxlpqA9VxcUzy727MRLedKDIrad+e2mINAWGeOB3MGumkvXJkBhDBW6IaZjVVSXCfWpa2f7FEShaLYXkIryB6rN1h+ekkMMpKINvufCigP5+CDPOhtBKBK0ceYw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:17.541215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f161d2f0-1a8c-4537-9ef9-5e72a6f6793a tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:17.551587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f161d2f0-1a8c-4537-9ef9-5e72a6f6793a tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:17.564470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcf7141e9816409eb8acbb2288955e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b6caba54bc4650937f592b465a73ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:17.580425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06abb9cb-0e8c-41ce-855e-c0ec36f3f47f tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 200 len: 1307 microversion: 2.1 time: 0.258684 Oct 28 19:18:17.582336 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1343/2686] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:17 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 1307 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:17.594326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:17.618378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f161d2f0-1a8c-4537-9ef9-5e72a6f6793a tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.537636 Oct 28 19:18:17.619348 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1344/2687] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 540 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:18:17.630006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91f7e453-7cc8-4d5b-82bc-aa23ad3d6d69 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d77538040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:17.650472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91f7e453-7cc8-4d5b-82bc-aa23ad3d6d69 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs/tempest-keypair-1108135988" status: 200 len: 513 microversion: 2.2 time: 0.024299 Oct 28 19:18:17.651426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1344/2688] 10.222.0.44 () {60 vars in 1258 bytes} [Fri Oct 28 19:18:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1108135988 => generated 513 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:17.670792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-119d8e44-2939-4a06-97b2-e391127bb1ec tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d7722b9d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:17.718739 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-119d8e44-2939-4a06-97b2-e391127bb1ec tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108135988" status: 204 len: 0 microversion: 2.2 time: 0.059429 Oct 28 19:18:17.719631 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1345/2689] 10.222.0.44 () {60 vars in 1261 bytes} [Fri Oct 28 19:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108135988 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:17.731925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc920b5a-d092-4b1e-a9ec-da6ea2bb1249 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d774a84c0>, body: {"keypair": {"name": "tempest-keypair-2024291546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTZvmEDk/W95azCp0HSZSCqroJ7Ll3GPihZ44w8v5nF0dnvJZNa1JhD3IrEyavKbmFdh956+wk8IhWKzi/iXIGfzPj9+vffUcsuSGFNa8WsxDlQS8uCYMn+E8wKq/5bSw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:17.755698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-fc920b5a-d092-4b1e-a9ec-da6ea2bb1249 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:17.766347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-fc920b5a-d092-4b1e-a9ec-da6ea2bb1249 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:17.818002 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc920b5a-d092-4b1e-a9ec-da6ea2bb1249 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.086817 Oct 28 19:18:17.819172 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1345/2690] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:18:17.831695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-856e444a-f877-4d9f-931b-69b6581e7be0 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d771d5af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:17.872025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-856e444a-f877-4d9f-931b-69b6581e7be0 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024291546" status: 204 len: 0 microversion: 2.2 time: 0.046230 Oct 28 19:18:17.872638 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1346/2691] 10.222.0.44 () {60 vars in 1261 bytes} [Fri Oct 28 19:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024291546 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:17.884247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e6530ba-83a0-4956-91cf-b5e2293b554c tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d77535700>, body: {"keypair": {"name": "tempest-keypair-27229944", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:17.913376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:17.914100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:17.941639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:17.942184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:17.942652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.946069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-7e6530ba-83a0-4956-91cf-b5e2293b554c tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:17.950007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:17.950464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:17.950939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:17.966177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-7e6530ba-83a0-4956-91cf-b5e2293b554c tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:18.001075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e6530ba-83a0-4956-91cf-b5e2293b554c tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.122602 Oct 28 19:18:18.001735 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1346/2692] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:17 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:18:18.013849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b587345-5dac-4f24-97d6-0f0301436a01 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d77538310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:18.039534 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b587345-5dac-4f24-97d6-0f0301436a01 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27229944" status: 204 len: 0 microversion: 2.2 time: 0.030214 Oct 28 19:18:18.041047 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1347/2693] 10.222.0.44 () {60 vars in 1255 bytes} [Fri Oct 28 19:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27229944 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:18.055264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ef04856-2428-4585-ac96-3461af8f0beb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d77409430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2061494028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPaBaam1yhsJ8Wvjlr2JVjRFys3cohOEEZYPs0GPs6nkCiqdAQDKtantpyLG7Fs6DhOgdMmEtn1BYr1ZzkNMdCRdfMCL9LXUpD5BH2WawzCkFV+lniKA+YAoKdzWJ95TQ=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:18.078440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2ef04856-2428-4585-ac96-3461af8f0beb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:18.088963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2ef04856-2428-4585-ac96-3461af8f0beb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:18.135170 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ef04856-2428-4585-ac96-3461af8f0beb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.085192 Oct 28 19:18:18.136247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1348/2694] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:18 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:18:18.142410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:18.143115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:18.151173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.152646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.153239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.154112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.154728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.155321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.354480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:18.368045 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9572475a-7f07-4a93-a9b1-edae84eccbec tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 200 len: 1468 microversion: 2.1 time: 0.471584 Oct 28 19:18:18.368674 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1347/2695] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:17 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 1468 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:18.384396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97ba1ce7-5a8f-45d3-8a48-d4f669801535 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d771d44c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2079412153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbymFt/T7dWsc0nm9dIWKctwDjj8kdFVHag2NyA/16U/YrAVB5nEjxFkrPCEdJ2Z+p5FbRRVwQa6Ea4FEbbCGInx0KW1DUhdwnGs+ubd5VMmQkXnuGz37yM7Q76XYVTvw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:18.402588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-97ba1ce7-5a8f-45d3-8a48-d4f669801535 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:18.408240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-97ba1ce7-5a8f-45d3-8a48-d4f669801535 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:18.436880 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97ba1ce7-5a8f-45d3-8a48-d4f669801535 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.063343 Oct 28 19:18:18.438610 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1348/2696] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:18 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:18:18.463180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:18.494593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28571e6f-b42c-4fa1-bbfe-ab3984f22c0e tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 0.356890 Oct 28 19:18:18.495206 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1349/2697] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:18 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:18.515352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:18.515958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:18.533172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.534645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.538571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.539541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.545830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.546174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.705236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3634d384-2430-4f6e-8686-254c2f054d6f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Action: 'create', calling method: .version_select at 0x7f1d77230790>, body: {"keypair": {"name": "tempest-keypair-881921229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOFXlHuO8klxh/TI3ilsSH7Kv/iC/2u6maXPuC7wjUJCAaQBZiaDg/VCB0nIFE6vaY7p/Avr1OeeerKXtUofpknaEdPJrXlFOv+fY2Q/sqvazL5CBMCqjRku6aUJY6hyg=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:18.731429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3634d384-2430-4f6e-8686-254c2f054d6f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Getting quotas for project 890750a4bcb04482810d9e8b1b5ac004. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:18.738612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3634d384-2430-4f6e-8686-254c2f054d6f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Getting quotas for user 9f6831b10255460085b80eff60795e43 and project 890750a4bcb04482810d9e8b1b5ac004. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:18.779525 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3634d384-2430-4f6e-8686-254c2f054d6f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.339447 Oct 28 19:18:18.780560 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1349/2698] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:18:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:18.796060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-79f8cb21-eb2a-4738-aa42-edd76bd3734f req-9b163d4a-d644-40ac-bd08-aa1cb800c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb573a3-49a9-44de-b9a7-3d369e445b3d", "name": "network-vif-plugged", "status": "completed", "tag": "ef9497d5-6cbc-4f85-810a-28ec55936f60"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:18.811671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-79f8cb21-eb2a-4738-aa42-edd76bd3734f req-9b163d4a-d644-40ac-bd08-aa1cb800c1ee service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.812245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-79f8cb21-eb2a-4738-aa42-edd76bd3734f req-9b163d4a-d644-40ac-bd08-aa1cb800c1ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.812733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-79f8cb21-eb2a-4738-aa42-edd76bd3734f req-9b163d4a-d644-40ac-bd08-aa1cb800c1ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.836770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-79f8cb21-eb2a-4738-aa42-edd76bd3734f req-9b163d4a-d644-40ac-bd08-aa1cb800c1ee service nova] Creating event network-vif-plugged:ef9497d5-6cbc-4f85-810a-28ec55936f60 for instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d on n-h2-862769-3 Oct 28 19:18:18.845924 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-79f8cb21-eb2a-4738-aa42-edd76bd3734f req-9b163d4a-d644-40ac-bd08-aa1cb800c1ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063437 Oct 28 19:18:18.847200 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1350/2699] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:18.855326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0404bb0f-0e99-4a43-b744-713bda214ef5 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d77230dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1006893178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5Qb8pbtwkxE1KVXEoVRyBqG8yW1viBzo0voFz/BP43k55GtZmz902uMAoRGYA2iqFXsE89sZNqVbUc3MhKLER5vylt6pl8nBBzN0jFmGecdD+s4T2Ab5DUC1/27BhILA=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:18.891656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0404bb0f-0e99-4a43-b744-713bda214ef5 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:18.898197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:18.899576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0404bb0f-0e99-4a43-b744-713bda214ef5 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:18.912982 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-209c16fb-ed38-4709-85ca-2e74aeeffeca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.404670 Oct 28 19:18:18.915215 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1350/2700] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:18 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:18.924792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:18.926129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] [instance: 3786c049-58ee-45ea-bcf3-86096d2d4847] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:18.941163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.941812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.942448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.943266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:18.944318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:18.944744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:18.950283 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0404bb0f-0e99-4a43-b744-713bda214ef5 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.101374 Oct 28 19:18:18.951295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1351/2701] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:18 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:18:18.966627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22e9db10-4628-48d3-8f33-b01a41c5ebfb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d771d49d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:18.967907 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] HTTP exception thrown: Instance 3786c049-58ee-45ea-bcf3-86096d2d4847 could not be found. Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Request method failure captured: Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 HTTP/1.1 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCreJuwOoEjZ0G65GShjYLnHGXWU-D4nmhNSqNuZZfUY8JYgGIv5XTX4qEPyM2K6QfC390M-JKAxX829Ah6jXi7xI_Sn5MkS0l92SLsHiBjdbh97S-SNKqnohrsy9mkHQeVqlKDKb8Zu4SejkuwAxzq1KKsTeKRk680fGkDFfR2Ygf0 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d8b6caba54bc4650937f592b465a73ab Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceActionsTestJSON-186468858 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d8b6caba54bc4650937f592b465a73ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d8b6caba54bc4650937f592b465a73ab", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d8b6caba54bc4650937f592b465a73ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d8b6caba54bc4650937f592b465a73ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceActionsTestJSON-186468858 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d8b6caba54bc4650937f592b465a73ab Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceActionsTestJSON-186468858 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceActionsTestJSON-186468858-project Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: fcf7141e9816409eb8acbb2288955e24 Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceActionsTestJSON-186468858-project Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 3786c049-58ee-45ea-bcf3-86096d2d4847 could not be found. Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '3786c049-58ee-45ea-bcf3-86096d2d4847'} Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3786c049-58ee-45ea-bcf3-86096d2d4847 could not be found. Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3786c049-58ee-45ea-bcf3-86096d2d4847 could not be found. Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:18.969620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3786c049-58ee-45ea-bcf3-86096d2d4847 could not be found. Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:18.974232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] Returning 404 to user: Instance 3786c049-58ee-45ea-bcf3-86096d2d4847 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:18.976525 n-d-862769-3 devstack@n-api.service[120629]: WARNING oslo_db.sqlalchemy.utils [None req-22e9db10-4628-48d3-8f33-b01a41c5ebfb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 19:18:18.979272 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2b9605b-5361-4f13-84bb-d4a6811b26e9 tempest-InstanceActionsTestJSON-186468858 tempest-InstanceActionsTestJSON-186468858-project] 10.222.0.44 "GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847" status: 404 len: 111 microversion: 2.1 time: 0.054677 Oct 28 19:18:18.980187 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1351/2702] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:18 2022] GET /compute/v2.1/servers/3786c049-58ee-45ea-bcf3-86096d2d4847 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:19.012394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22e9db10-4628-48d3-8f33-b01a41c5ebfb tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.052699 Oct 28 19:18:19.015902 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1352/2703] 10.222.0.44 () {60 vars in 1177 bytes} [Fri Oct 28 19:18:18 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:19.026900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8b72663b-3911-4132-8e51-76ce5864837d tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d774f6160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.065160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8b72663b-3911-4132-8e51-76ce5864837d tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1006893178" status: 204 len: 0 microversion: 2.2 time: 0.042036 Oct 28 19:18:19.066182 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1352/2704] 10.222.0.44 () {60 vars in 1321 bytes} [Fri Oct 28 19:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1006893178 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:19.081204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-940fe047-5de5-4c05-8316-ad3b9fef8f96 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d7723a670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.133144 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-940fe047-5de5-4c05-8316-ad3b9fef8f96 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2079412153" status: 204 len: 0 microversion: 2.2 time: 0.061192 Oct 28 19:18:19.135336 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1353/2705] 10.222.0.44 () {60 vars in 1321 bytes} [Fri Oct 28 19:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2079412153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:19.145481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec7deee1-63b6-4fa7-9b9e-bf57ad8d6113 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d77450160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.183323 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec7deee1-63b6-4fa7-9b9e-bf57ad8d6113 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2061494028" status: 204 len: 0 microversion: 2.2 time: 0.042693 Oct 28 19:18:19.184857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1353/2706] 10.222.0.44 () {60 vars in 1321 bytes} [Fri Oct 28 19:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2061494028 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:19.199454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-893d5461-8984-4386-9720-78215d1f6325 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d771ff700>, body: {"keypair": {"name": "tempest-keypair-488981716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6vD9CDCVYCtXTQHtm95/DwfAI+gsUAMqdveD8pZXuf0xoVeNkfqZdknqUj5yPZW3TG8ZY45mI7oiBbmKdUWQcs12q/apOcGIRN+Dk4sp31OCNOytjEtBAZDz3sL+7Low=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:19.246203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-893d5461-8984-4386-9720-78215d1f6325 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:19.255335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-893d5461-8984-4386-9720-78215d1f6325 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:19.297470 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-893d5461-8984-4386-9720-78215d1f6325 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.104768 Oct 28 19:18:19.298771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1354/2707] 10.222.0.44 () {62 vars in 1199 bytes} [Fri Oct 28 19:18:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 19:18:19.312065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82b8bc81-e7fc-417a-bf84-4f1dd2e533b6 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d77450dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.339343 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82b8bc81-e7fc-417a-bf84-4f1dd2e533b6 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs/tempest-keypair-488981716" status: 200 len: 512 microversion: 2.2 time: 0.033063 Oct 28 19:18:19.356645 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1354/2708] 10.222.0.44 () {60 vars in 1255 bytes} [Fri Oct 28 19:18:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-488981716 => generated 512 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:19.374199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a5098f51-a2d8-42bc-9b71-b8c338fe0960 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d77230d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.379383 n-d-862769-3 devstack@n-api.service[120629]: WARNING oslo_db.sqlalchemy.utils [None req-a5098f51-a2d8-42bc-9b71-b8c338fe0960 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 19:18:19.385228 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a5098f51-a2d8-42bc-9b71-b8c338fe0960 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.029783 Oct 28 19:18:19.386408 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1355/2709] 10.222.0.44 () {60 vars in 1177 bytes} [Fri Oct 28 19:18:19 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:18:19.396302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.396836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 1aa4a1f5-9486-4434-92ff-0e89399305d4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:19.405246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.409084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:19.414903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:19.426035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1df68bbc-d6a8-4ac1-a50f-767f8f277c2a tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d771d4160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.435981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.437112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:19.442414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:19.468499 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1df68bbc-d6a8-4ac1-a50f-767f8f277c2a tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488981716" status: 204 len: 0 microversion: 2.2 time: 0.062361 Oct 28 19:18:19.469394 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1356/2710] 10.222.0.44 () {60 vars in 1258 bytes} [Fri Oct 28 19:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488981716 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:19.482899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-23ef1b62-1ee1-4352-a966-8469ec80d301 req-f40ef712-cf99-4bb7-93a7-1a6c110b8828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa4a1f5-9486-4434-92ff-0e89399305d4", "name": "network-vif-deleted", "tag": "23a728ff-b081-4ce7-9a13-065d524f317a"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:19.492845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] HTTP exception thrown: Instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 could not be found. Oct 28 19:18:19.496878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-23ef1b62-1ee1-4352-a966-8469ec80d301 req-f40ef712-cf99-4bb7-93a7-1a6c110b8828 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.499645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-23ef1b62-1ee1-4352-a966-8469ec80d301 req-f40ef712-cf99-4bb7-93a7-1a6c110b8828 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:19.500726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-23ef1b62-1ee1-4352-a966-8469ec80d301 req-f40ef712-cf99-4bb7-93a7-1a6c110b8828 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Request method failure captured: Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 HTTP/1.1 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqBEnCV5DL9iY8sZPbNZW2QuJyISGK1ixVXuP3XRqXJSRs18ejGHEREx1iG0FSezulb24GrTpDrQXRsIwUj-iYI2JbUcZESZY6T-OEf1vc3kAea2KdMm8RbBf5xxNzaY4JwJ8ziVD6UmrV_Rzl076c6aI3rcECOESiyLnOnV_L5G4Q Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 046929f0d0b44a3191ed57f9d72d2dff Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_046929f0d0b44a3191ed57f9d72d2dff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 046929f0d0b44a3191ed57f9d72d2dff Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminTestJSON-488330071-project Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: fe4df4ef5bf94c9393f0f8b82c86eb1d Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminTestJSON-488330071-project Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 could not be found. Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1aa4a1f5-9486-4434-92ff-0e89399305d4'} Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 could not be found. Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 could not be found. Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:19.501250 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 could not be found. Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:19.505739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Returning 404 to user: Instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:19.506396 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6ddad98-49b9-42ac-a08e-d261da6ed2f5 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4" status: 404 len: 111 microversion: 2.1 time: 0.114635 Oct 28 19:18:19.510554 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1355/2711] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:19 2022] GET /compute/v2.1/servers/1aa4a1f5-9486-4434-92ff-0e89399305d4 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:19.522484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Action: 'create', calling method: .version_select at 0x7f1d7748a820>, body: {"keypair": {"name": "tempest-keypair-705555735", "type": "x509"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:19.544429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:19.546873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-23ef1b62-1ee1-4352-a966-8469ec80d301 req-f40ef712-cf99-4bb7-93a7-1a6c110b8828 service nova] Creating event network-vif-deleted:23a728ff-b081-4ce7-9a13-065d524f317a for instance 1aa4a1f5-9486-4434-92ff-0e89399305d4 on n-h2-862769-3 Oct 28 19:18:19.552497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:19.556395 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-23ef1b62-1ee1-4352-a966-8469ec80d301 req-f40ef712-cf99-4bb7-93a7-1a6c110b8828 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085265 Oct 28 19:18:19.557404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1357/2712] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:19.565016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.565879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:19.575345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.575959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:19.577310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.processutils [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpzb7fkvgp/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpzb7fkvgp/temp.key -subj /CN=db3209b137d84dbf8ede2e6b93f2c5fc -extensions v3_req_client {{(pid=120628) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 19:18:19.587781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:19.588791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.589280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:19.589771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:19.755777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.processutils [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpzb7fkvgp/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpzb7fkvgp/temp.key -subj /CN=db3209b137d84dbf8ede2e6b93f2c5fc -extensions v3_req_client" returned: 0 in 0.178s {{(pid=120628) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 19:18:19.757522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.processutils [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpzb7fkvgp/temp.key -password pass: {{(pid=120628) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 19:18:19.831088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.processutils [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpzb7fkvgp/temp.key -password pass:" returned: 0 in 0.073s {{(pid=120628) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 19:18:19.922641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:19.936681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Getting quotas for user db3209b137d84dbf8ede2e6b93f2c5fc and project ab79d58ed5a344e7a0b40186ebba80a8. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:19.966231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12c6f661-261c-42ce-83dc-49b8237d76db tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.453204 Oct 28 19:18:19.973588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1356/2713] 10.222.0.44 () {62 vars in 1198 bytes} [Fri Oct 28 19:18:19 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 462 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:19.982788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:19.983668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:19.994523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.995504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:19.996161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:19.997937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:19.999130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:20.000212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:20.056774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:20.232523 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-655f19e7-3217-47f8-be7e-5b965242485d tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 204 len: 0 microversion: 2.1 time: 0.256384 Oct 28 19:18:20.233714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1357/2714] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:19 2022] DELETE /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:20.245173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:20.247193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:20.260765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:20.274653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:20.275619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:20.277008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:20.277921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:20.279368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:20.280599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:20.701317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:20.718965 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f3f6085b-9565-4465-b411-aca0fb496cbd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1291 microversion: 2.1 time: 1.160144 Oct 28 19:18:20.731665 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1358/2715] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:19 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1291 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:20.740752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdf7396f-23c8-47ee-8a3c-ddc39840960f tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d77232dc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:20.761397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdf7396f-23c8-47ee-8a3c-ddc39840960f tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs/tempest-keypair-705555735" status: 200 len: 1533 microversion: 2.2 time: 0.028435 Oct 28 19:18:20.768676 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1359/2716] 10.222.0.44 () {60 vars in 1255 bytes} [Fri Oct 28 19:18:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-705555735 => generated 1533 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:20.772927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:20.773683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:20.796578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:20.797078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:20.797510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:20.798230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:20.798681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:20.799128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:21.168425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:21.181863 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36582c8b-86b4-4c59-b58f-b15cab063e6f tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1724 microversion: 2.1 time: 0.946157 Oct 28 19:18:21.184176 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1358/2717] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:20 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1724 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:21.198791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b458991-d464-4c3f-9fcc-062d4771a825 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d774d21f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:21.214224 n-d-862769-3 devstack@n-api.service[120628]: WARNING oslo_db.sqlalchemy.utils [None req-1b458991-d464-4c3f-9fcc-062d4771a825 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 19:18:21.246340 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b458991-d464-4c3f-9fcc-062d4771a825 tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.058968 Oct 28 19:18:21.255866 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1359/2718] 10.222.0.44 () {60 vars in 1177 bytes} [Fri Oct 28 19:18:21 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:21.267146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-16927a0b-f044-416e-8d01-69b8d546d603 req-a3c56d1a-ac22-49f9-9b09-695710dec5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "name": "network-vif-plugged", "status": "completed", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:21.280574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:21.292198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-16927a0b-f044-416e-8d01-69b8d546d603 req-a3c56d1a-ac22-49f9-9b09-695710dec5b8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:21.293047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-16927a0b-f044-416e-8d01-69b8d546d603 req-a3c56d1a-ac22-49f9-9b09-695710dec5b8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:21.293846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-16927a0b-f044-416e-8d01-69b8d546d603 req-a3c56d1a-ac22-49f9-9b09-695710dec5b8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:21.295981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-019adfa1-865e-4a67-92ab-0751147cbb9f tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1468 microversion: 2.1 time: 0.531821 Oct 28 19:18:21.296910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1360/2719] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:20 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1468 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:21.308230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-16927a0b-f044-416e-8d01-69b8d546d603 req-a3c56d1a-ac22-49f9-9b09-695710dec5b8 service nova] Creating event network-vif-plugged:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:18:21.310273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f695ac4-b5a1-4cb4-b420-ffc0af4a738e tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] Calling method '.version_select at 0x7f1d772fe8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:21.315252 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-16927a0b-f044-416e-8d01-69b8d546d603 req-a3c56d1a-ac22-49f9-9b09-695710dec5b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057208 Oct 28 19:18:21.316809 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1360/2720] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:21.335643 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f695ac4-b5a1-4cb4-b420-ffc0af4a738e tempest-KeyPairsV22TestJSON-1665596651 tempest-KeyPairsV22TestJSON-1665596651-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705555735" status: 204 len: 0 microversion: 2.2 time: 0.037532 Oct 28 19:18:21.336949 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1361/2721] 10.222.0.44 () {60 vars in 1258 bytes} [Fri Oct 28 19:18:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705555735 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:21.747614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:21.748658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:21.758684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:21.759222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:21.759887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:21.760642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:21.761285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:21.761990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:21.799356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:22.224235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:22.225701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:22.233522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:22.234377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:22.235101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:22.236221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:22.236889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:22.237513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:22.268719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:22.396416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:22.409537 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e9a6099-b1a5-4592-ac8f-9325ad3772d4 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1481 microversion: 2.1 time: 0.667180 Oct 28 19:18:22.410743 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1361/2722] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:21 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1481 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:22.430227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:22.430227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:22.438812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:22.439543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:22.442833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:22.443812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:22.444458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:22.445073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:23.016701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:23.027649 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5cf1ab2-bba2-42a6-9ac3-cefc024b7d74 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1701 microversion: 2.1 time: 0.816587 Oct 28 19:18:23.031313 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1362/2723] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:22 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1701 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:23.044219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:23.046548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:23.061870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:23.064289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:23.064966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:23.065854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:23.072118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:23.073124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:23.161154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:23.173890 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58a8334e-68e1-486f-bf4d-68639d72491e tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1468 microversion: 2.1 time: 0.761711 Oct 28 19:18:23.178334 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1362/2724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:22 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1468 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:23.196461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7b6a579-0fe7-4528-bdcb-11ea6c67b54b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:23.214836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b6a579-0fe7-4528-bdcb-11ea6c67b54b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:23.215703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b6a579-0fe7-4528-bdcb-11ea6c67b54b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:23.216450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b6a579-0fe7-4528-bdcb-11ea6c67b54b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:23.266414 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a137abca-47fc-4c88-8f45-94762463c6df tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233144 Oct 28 19:18:23.276515 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1363/2725] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:18:23 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:23.282330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1836329910", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "63c80202-741c-49bd-b890-0a931cff382e"}], "security_groups": [{"name": "tempest-securitygroup--1138984628"}], "key_name": "tempest-keypair-881921229", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:23.421028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7b6a579-0fe7-4528-bdcb-11ea6c67b54b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Going to try to start instance {{(pid=120628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:18:23.509937 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7b6a579-0fe7-4528-bdcb-11ea6c67b54b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action" status: 202 len: 0 microversion: 2.1 time: 0.329955 Oct 28 19:18:23.513146 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1363/2726] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:23 2022] POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:18:23.527219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:23.527852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:23.545539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:23.546970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:23.547412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:23.548140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:23.550949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:23.551451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:24.175082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] validate_networks() for [('63c80202-741c-49bd-b890-0a931cff382e', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:24.309767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:24.325669 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb714e1f-a052-40f4-ae9f-660ccdb096a8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1710 microversion: 2.1 time: 0.807898 Oct 28 19:18:24.327065 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1364/2727] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:23 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1710 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:24.335753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:24.336624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:24.351288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:24.351999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:24.352916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:24.356501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:24.356995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:24.357436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:25.110055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:25.124374 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a5b7e49-0439-43db-9d19-75be770c1212 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1426 microversion: 2.1 time: 0.796031 Oct 28 19:18:25.125651 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1365/2728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:24 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1426 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:25.339612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:25.341202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:25.341694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:25.342114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:25.342882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:25.343334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:25.343751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:25.387036 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5e83cd32-d0d0-4f62-b27f-f296394d120a tempest-AZV2TestJSON-199439541 tempest-AZV2TestJSON-199439541-project] 10.222.0.44 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.260042 Oct 28 19:18:25.395889 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1366/2729] 10.222.0.44 () {58 vars in 1164 bytes} [Fri Oct 28 19:18:25 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:18:25.406949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:25.409770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:25.416533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:25.417289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:25.417885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:25.418793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:25.419397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:25.420393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:26.445534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:26.457378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3856177c-5ac1-4376-824f-705a247edf5e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1710 microversion: 2.1 time: 1.057698 Oct 28 19:18:26.463570 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1367/2730] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:25 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1710 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:26.474882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5008c27f-b5cd-464a-ae0c-79adf466651f req-09af2648-1f6d-4304-b4a2-a7c36acfd37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15db0f7-62a1-454f-b58a-acb2c5104395", "name": "network-vif-deleted", "tag": "6b41e8e6-f74f-45b2-80a7-2be709385a87"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:26.521775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5008c27f-b5cd-464a-ae0c-79adf466651f req-09af2648-1f6d-4304-b4a2-a7c36acfd37e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:26.524403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5008c27f-b5cd-464a-ae0c-79adf466651f req-09af2648-1f6d-4304-b4a2-a7c36acfd37e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:26.525039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5008c27f-b5cd-464a-ae0c-79adf466651f req-09af2648-1f6d-4304-b4a2-a7c36acfd37e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:26.568345 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5008c27f-b5cd-464a-ae0c-79adf466651f req-09af2648-1f6d-4304-b4a2-a7c36acfd37e service nova] Creating event network-vif-deleted:6b41e8e6-f74f-45b2-80a7-2be709385a87 for instance a15db0f7-62a1-454f-b58a-acb2c5104395 on n-h1-862769-3 Oct 28 19:18:26.588271 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5008c27f-b5cd-464a-ae0c-79adf466651f req-09af2648-1f6d-4304-b4a2-a7c36acfd37e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119523 Oct 28 19:18:26.589415 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1368/2731] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:26.608952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:26.610010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:26.630030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:26.630615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:26.639248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:26.640146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:26.640756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:26.641199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:26.719119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:26.722014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:26.726185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:26.726975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lazy-loading 'fault' on Instance uuid a15db0f7-62a1-454f-b58a-acb2c5104395 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:18:26.899020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:26.910556 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aba09b69-0c4e-4f33-bebd-18bb21e716b4 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 200 len: 1303 microversion: 2.1 time: 0.319642 Oct 28 19:18:26.913451 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1369/2732] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:26 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:27.345623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Getting quotas for project 890750a4bcb04482810d9e8b1b5ac004. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:27.355025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Getting quotas for user 9f6831b10255460085b80eff60795e43 and project 890750a4bcb04482810d9e8b1b5ac004. Resources: dict_keys(['metadata_items']) {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:27.370169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=90,nova_api:DELETE=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:27.373210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:27.373945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:27.374634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:27.375420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:27.376052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:27.397260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:27.398016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:27.398645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:27.399645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:27.400959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:27.401585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:27.430649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Getting quotas for project 890750a4bcb04482810d9e8b1b5ac004. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:27.438405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Getting quotas for user 9f6831b10255460085b80eff60795e43 and project 890750a4bcb04482810d9e8b1b5ac004. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:27.495654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:27.496364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:27.508468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:27.524240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:27.533788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:27.544981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:27.545683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:27.546609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:27.547690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:27.548375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:27.650138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10711a3c-224e-4779-b50d-6d2cfd1e574f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.372372 Oct 28 19:18:27.655007 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1364/2733] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 4374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:18:27.664160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-937ea43a-3eb6-4d17-a304-b8c48e392ae9 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:27.668953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-937ea43a-3eb6-4d17-a304-b8c48e392ae9 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:27.884295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-937ea43a-3eb6-4d17-a304-b8c48e392ae9 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:27.893143 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-937ea43a-3eb6-4d17-a304-b8c48e392ae9 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1269 microversion: 2.1 time: 0.234496 Oct 28 19:18:27.900008 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1365/2734] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:27 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:27.905169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:27.907821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:27.920713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:27.921223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:27.921638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:27.928232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:27.928974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:27.930295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.240937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:28.256583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d91ffc68-68c1-4514-8ff8-d75a6561b743 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1710 microversion: 2.1 time: 0.767273 Oct 28 19:18:28.259748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1370/2735] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:27 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1710 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:28.276390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:28.277422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: a15db0f7-62a1-454f-b58a-acb2c5104395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:28.290124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.292442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.293084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.293957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.295707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.310718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.362620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] HTTP exception thrown: Instance a15db0f7-62a1-454f-b58a-acb2c5104395 could not be found. Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Request method failure captured: Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 HTTP/1.1 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCqBEnCV5DL9iY8sZPbNZW2QuJyISGK1ixVXuP3XRqXJSRs18ejGHEREx1iG0FSezulb24GrTpDrQXRsIwUj-iYI2JbUcZESZY6T-OEf1vc3kAea2KdMm8RbBf5xxNzaY4JwJ8ziVD6UmrV_Rzl076c6aI3rcECOESiyLnOnV_L5G4Q Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 046929f0d0b44a3191ed57f9d72d2dff Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_046929f0d0b44a3191ed57f9d72d2dff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 046929f0d0b44a3191ed57f9d72d2dff Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminTestJSON-488330071-project Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: fe4df4ef5bf94c9393f0f8b82c86eb1d Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminTestJSON-488330071-project Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a15db0f7-62a1-454f-b58a-acb2c5104395 could not be found. Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a15db0f7-62a1-454f-b58a-acb2c5104395'} Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15db0f7-62a1-454f-b58a-acb2c5104395 could not be found. Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15db0f7-62a1-454f-b58a-acb2c5104395 could not be found. Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:28.364719 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15db0f7-62a1-454f-b58a-acb2c5104395 could not be found. Oct 28 19:18:28.369586 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:18:28.374674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Returning 404 to user: Instance a15db0f7-62a1-454f-b58a-acb2c5104395 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:28.375849 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-287ad765-b6d2-4b82-a94b-829aaebfb9fd tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395" status: 404 len: 111 microversion: 2.1 time: 0.113938 Oct 28 19:18:28.378369 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1371/2736] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:28 2022] GET /compute/v2.1/servers/a15db0f7-62a1-454f-b58a-acb2c5104395 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:28.388988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:28.391382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:28.406945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.408599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.409201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.412646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.414477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.415792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.449755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:28.458589 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a8d6ee9-4b4a-4e3f-b94c-656eaf024668 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1481 microversion: 2.1 time: 0.557061 Oct 28 19:18:28.459237 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1366/2737] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:27 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1481 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:28.485202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:28.626216 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe75cdd4-0012-4c65-bc66-a7769f5de724 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 204 len: 0 microversion: 2.1 time: 0.240583 Oct 28 19:18:28.635842 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1372/2738] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:28 2022] DELETE /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:28.643505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:28.644393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:28.655199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.655991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.656602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.665085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.666820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.667804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.670468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e5a87b97-01c7-4b68-9d55-29e472c1cf16 req-2490ad71-5262-4766-b94d-3abaeabae76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb573a3-49a9-44de-b9a7-3d369e445b3d", "tag": "ef9497d5-6cbc-4f85-810a-28ec55936f60"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:28.703545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e5a87b97-01c7-4b68-9d55-29e472c1cf16 req-2490ad71-5262-4766-b94d-3abaeabae76b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.704040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e5a87b97-01c7-4b68-9d55-29e472c1cf16 req-2490ad71-5262-4766-b94d-3abaeabae76b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.704473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e5a87b97-01c7-4b68-9d55-29e472c1cf16 req-2490ad71-5262-4766-b94d-3abaeabae76b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.776199 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e5a87b97-01c7-4b68-9d55-29e472c1cf16 req-2490ad71-5262-4766-b94d-3abaeabae76b service nova] Creating event network-changed:ef9497d5-6cbc-4f85-810a-28ec55936f60 for instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d on n-h2-862769-3 Oct 28 19:18:28.793471 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e5a87b97-01c7-4b68-9d55-29e472c1cf16 req-2490ad71-5262-4766-b94d-3abaeabae76b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136505 Oct 28 19:18:28.794589 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1373/2739] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:28.929578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:28.931891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:28.976783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.979339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.979887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:28.985171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:28.985680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:28.986120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:29.052186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:29.066664 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-984235e5-de84-4699-acfc-76de75e94b0b tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1469 microversion: 2.1 time: 0.426682 Oct 28 19:18:29.072641 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1367/2740] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:28 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:29.225179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:29.234311 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20b94227-01d1-4b64-8e20-22889cd7e290 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1265 microversion: 2.1 time: 0.315130 Oct 28 19:18:29.235541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1374/2741] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:28 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:29.285983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:29.288970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:29.306073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:29.311385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:29.313387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:29.330921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:29.333250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:29.334655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:29.702319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:29.718070 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99060b75-4509-4f62-a8c7-d87a3a9d32ab tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1714 microversion: 2.1 time: 0.436094 Oct 28 19:18:29.720364 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1368/2742] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:29 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1714 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:29.948795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=20 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:30.100277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1555344309", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "93cc270c-8402-4556-90de-ac62603836d7"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:30.114247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:30.115675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:30.136928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:30.138128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:30.140017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:30.141676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:30.143230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:30.143926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:30.254756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] validate_networks() for [('93cc270c-8402-4556-90de-ac62603836d7', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:31.340358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4df4ef5bf94c9393f0f8b82c86eb1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046929f0d0b44a3191ed57f9d72d2dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:31.376395 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-efb3ab0e-cb1e-40fb-9553-299b6adfa1e3 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 200 len: 1469 microversion: 2.1 time: 1.284031 Oct 28 19:18:31.402570 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1369/2743] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:30 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 1469 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:31.440530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:31.442127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:31.476455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:31.478593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:31.482249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:31.484255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:31.485360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:31.487138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:31.708044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:31.740030 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c969bce3-8a8b-4dda-bd9c-c49e655c8e34 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1327 microversion: 2.1 time: 0.334634 Oct 28 19:18:31.742315 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1370/2744] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:31 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1327 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:31.770755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4be9f5df-098c-49c2-80f7-ee2681632a26 req-864bc895-609b-4624-b994-22f00614e34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f131269-d1fb-4779-a11f-f35a87fd1c87", "name": "network-vif-deleted", "tag": "dc882187-16cc-4aee-b996-f49e8a9af2ce"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:31.809790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4be9f5df-098c-49c2-80f7-ee2681632a26 req-864bc895-609b-4624-b994-22f00614e34a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:31.810608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4be9f5df-098c-49c2-80f7-ee2681632a26 req-864bc895-609b-4624-b994-22f00614e34a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:31.811622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4be9f5df-098c-49c2-80f7-ee2681632a26 req-864bc895-609b-4624-b994-22f00614e34a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:31.838350 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4be9f5df-098c-49c2-80f7-ee2681632a26 req-864bc895-609b-4624-b994-22f00614e34a service nova] Creating event network-vif-deleted:dc882187-16cc-4aee-b996-f49e8a9af2ce for instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 on n-h2-862769-3 Oct 28 19:18:31.848650 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4be9f5df-098c-49c2-80f7-ee2681632a26 req-864bc895-609b-4624-b994-22f00614e34a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104671 Oct 28 19:18:31.879323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1371/2745] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:32.206491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:32.207743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:32.208585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:32.209280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:32.209861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:32.221723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:32.222443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:32.231442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:32.232309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:32.236276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:32.237508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:32.277086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Getting quotas for project def864cdf0a54fb580ce65a4c5c3b1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:32.293362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Getting quotas for user 5ed5d39a8de44a37b721b084c1459309 and project def864cdf0a54fb580ce65a4c5c3b1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:32.317078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:32.320061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:32.399579 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb43bff2-cc9c-4fab-804e-6dc2c45e6de0 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.781432 Oct 28 19:18:32.401009 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1375/2746] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:18:32.419252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1853d120-0591-403f-a4ce-e41a990cf2d6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:32.420219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1853d120-0591-403f-a4ce-e41a990cf2d6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:32.421172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:32.424420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] [instance: 4f131269-d1fb-4779-a11f-f35a87fd1c87] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:32.449283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:32.450074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:32.452264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:32.453682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:32.454780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:32.455539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:32.516427 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] HTTP exception thrown: Instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 could not be found. Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Request method failure captured: Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 HTTP/1.1 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCqBEnCV5DL9iY8sZPbNZW2QuJyISGK1ixVXuP3XRqXJSRs18ejGHEREx1iG0FSezulb24GrTpDrQXRsIwUj-iYI2JbUcZESZY6T-OEf1vc3kAea2KdMm8RbBf5xxNzaY4JwJ8ziVD6UmrV_Rzl076c6aI3rcECOESiyLnOnV_L5G4Q Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 046929f0d0b44a3191ed57f9d72d2dff Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_046929f0d0b44a3191ed57f9d72d2dff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/046929f0d0b44a3191ed57f9d72d2dff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 046929f0d0b44a3191ed57f9d72d2dff Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersAdminTestJSON-488330071 Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersAdminTestJSON-488330071-project Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: fe4df4ef5bf94c9393f0f8b82c86eb1d Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersAdminTestJSON-488330071-project Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 could not be found. Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4f131269-d1fb-4779-a11f-f35a87fd1c87'} Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 could not be found. Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 could not be found. Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:32.520548 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 could not be found. Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:32.526773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] Returning 404 to user: Instance 4f131269-d1fb-4779-a11f-f35a87fd1c87 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:32.528817 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d55805e3-2fe6-4cd8-8346-15dcafe723e6 tempest-ServersAdminTestJSON-488330071 tempest-ServersAdminTestJSON-488330071-project] 10.222.0.44 "GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87" status: 404 len: 111 microversion: 2.1 time: 0.119328 Oct 28 19:18:32.530812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1372/2747] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:32 2022] GET /compute/v2.1/servers/4f131269-d1fb-4779-a11f-f35a87fd1c87 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:32.589899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1853d120-0591-403f-a4ce-e41a990cf2d6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:32.600356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1853d120-0591-403f-a4ce-e41a990cf2d6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1225 microversion: 2.1 time: 0.190904 Oct 28 19:18:32.600948 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1376/2748] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:32 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:32.765106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:32.765735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:32.775739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:32.779699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:32.780687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:32.781602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:32.783336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:32.783766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:33.222936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:33.235568 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48482251-ea19-4816-9791-9f25460e4db1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1395 microversion: 2.1 time: 0.474488 Oct 28 19:18:33.237947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1373/2749] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:32 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1395 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:33.626796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:33.628170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:33.659440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:33.659946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:33.660469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:33.661195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:33.661652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:33.662072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:33.725516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1401515409", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "d5f027ee-5d5f-4ff8-a35a-875f15b307c2"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:33.831576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] validate_networks() for [('d5f027ee-5d5f-4ff8-a35a-875f15b307c2', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:33.896167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:33.916492 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-230cd0a9-ebe8-42e9-995f-30ae715f8dbd tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1221 microversion: 2.1 time: 0.293874 Oct 28 19:18:33.919396 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1374/2750] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:33 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1221 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:34.265637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:34.266465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:34.276650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:34.278448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:34.279413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:34.281520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:34.282758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:34.283421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:34.897837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:34.912426 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d15b61d3-9592-4a58-ad58-03ddabf98d0f tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1395 microversion: 2.1 time: 0.654753 Oct 28 19:18:34.913402 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1375/2751] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:34 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1395 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:34.927819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9bf62a5e-75b5-4da5-bebb-1ad88b25fdea req-6a087f8c-a90e-4d2e-af9a-0a9c01486211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4896fa-53d8-4349-a4f1-cc62f6b37248", "tag": "1541c8d4-e345-4399-8c45-1ef178005238"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:34.954417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9bf62a5e-75b5-4da5-bebb-1ad88b25fdea req-6a087f8c-a90e-4d2e-af9a-0a9c01486211 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:34.954947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9bf62a5e-75b5-4da5-bebb-1ad88b25fdea req-6a087f8c-a90e-4d2e-af9a-0a9c01486211 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:34.955604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9bf62a5e-75b5-4da5-bebb-1ad88b25fdea req-6a087f8c-a90e-4d2e-af9a-0a9c01486211 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:34.984592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9bf62a5e-75b5-4da5-bebb-1ad88b25fdea req-6a087f8c-a90e-4d2e-af9a-0a9c01486211 service nova] Creating event network-changed:1541c8d4-e345-4399-8c45-1ef178005238 for instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 on n-h1-862769-3 Oct 28 19:18:35.001141 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9bf62a5e-75b5-4da5-bebb-1ad88b25fdea req-6a087f8c-a90e-4d2e-af9a-0a9c01486211 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084116 Oct 28 19:18:35.002513 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1376/2752] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:35.009155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:35.017105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:35.037747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:35.038570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:35.039037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:35.039757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:35.040205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:35.040636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:35.143769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:35.146641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:35.147193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:35.148137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:35.148924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:35.198439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:35.202548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:35.203708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:35.207201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:35.209781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:35.211997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:35.267160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Getting quotas for project 2ffe6acc10ea43f296ad26f8f69208f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:35.284783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:35.294495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Getting quotas for user 0784c6e961584101931de320c6a0d6e3 and project 2ffe6acc10ea43f296ad26f8f69208f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:35.298939 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26dd3866-e45c-4b83-b1cb-79ef861c3482 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1283 microversion: 2.1 time: 0.294951 Oct 28 19:18:35.304287 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1377/2753] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:35 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1283 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:35.330105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:35.333967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:35.442329 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-be710a62-a5bf-4e3e-b365-063bfe6d2ac8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.154788 Oct 28 19:18:35.444219 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1377/2754] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:18:35.648854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1555432102", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "d5f027ee-5d5f-4ff8-a35a-875f15b307c2"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:35.753616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] validate_networks() for [('d5f027ee-5d5f-4ff8-a35a-875f15b307c2', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:35.950241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:35.954280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:35.979045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:35.980147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:35.981763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:35.984658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:35.985769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:35.988857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:36.873761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:36.890059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bbf18685-31dd-4c97-89c8-f1184a545831 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1395 microversion: 2.1 time: 0.950358 Oct 28 19:18:36.891436 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1378/2755] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:35 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1395 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:36.908996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:36.909644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:36.924576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:36.925125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:36.925563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:36.934115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:36.935354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:36.937986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:37.122154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:37.152099 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3ec62cf-b06a-4bb7-a1ce-0fb39025f62c tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1283 microversion: 2.1 time: 0.256716 Oct 28 19:18:37.163924 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1379/2756] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:36 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:37.386497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:37.387038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:37.387391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:37.387964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:37.388520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:37.404880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:37.410731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:37.411886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:37.413372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:37.414771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:37.415208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:37.430400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:37.465891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Getting quotas for project 2ffe6acc10ea43f296ad26f8f69208f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:37.480953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Getting quotas for user 0784c6e961584101931de320c6a0d6e3 and project 2ffe6acc10ea43f296ad26f8f69208f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:37.526008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:37.533788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:37.650085 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22f401c3-598b-4ac6-b0f9-421bcfd23009 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007057 Oct 28 19:18:37.653184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1378/2757] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:18:37.818047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:37.827242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:37.829430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Searching by: {'deleted': False, 'project_id': '2d2e0199a714466e8116715d20e38bb0'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:18:37.854162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:37.854740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:37.855260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:37.862168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:37.864042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:37.864499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:37.917349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-758467276", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "451", "networks": [{"uuid": "d5f027ee-5d5f-4ff8-a35a-875f15b307c2"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:37.918380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:37.921623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:18:37.960698 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25f2e097-55c8-459c-9bcd-c7e1381bf2ef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.147797 Oct 28 19:18:37.962092 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1380/2758] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:18:37 2022] GET /compute/v2.1/servers => generated 340 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:37.969804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:37.970763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:37.981066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:37.981825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:37.982399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:37.983668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:37.984885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:37.986177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:38.066398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] validate_networks() for [('d5f027ee-5d5f-4ff8-a35a-875f15b307c2', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:38.596507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:38.615961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99c23618-e148-4f06-b8b1-ea37f0408ca1 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1395 microversion: 2.1 time: 0.652195 Oct 28 19:18:38.617257 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1381/2759] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:37 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1395 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:38.634743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:38.639948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:38.647891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Searching by: {'deleted': False, 'project_id': '2d2e0199a714466e8116715d20e38bb0'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:18:38.661815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:38.662303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:38.662755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:38.663791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:38.664421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:38.665035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:39.011713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:18:39.126104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:39.135219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:39.138922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:39.140995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:39.859414 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc3333d6-3d95-4da2-a288-9f3a6e511714 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.240465 Oct 28 19:18:39.871608 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1382/2760] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:18:38 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:39.882050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:39.890559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:39.914809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:39.915899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:39.916675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:39.919616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:39.920485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:39.921104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.173424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:40.174434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:40.180513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:40.181607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:40.183480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:40.198326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:40.207575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:40.208421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.209491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:40.210142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:40.210895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.254905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Getting quotas for project 2ffe6acc10ea43f296ad26f8f69208f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:40.262116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Getting quotas for user 0784c6e961584101931de320c6a0d6e3 and project 2ffe6acc10ea43f296ad26f8f69208f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:40.302116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:40.307046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:40.370267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:40.387377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-304d4fd5-f821-466e-9091-e8da719267d3 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1325 microversion: 2.1 time: 0.509465 Oct 28 19:18:40.396900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc6b6f5a-e33a-4b5a-99c4-f0f8b2358295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.487756 Oct 28 19:18:40.400035 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1379/2761] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:18:40.414165 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1383/2762] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:39 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1325 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:40.415183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:40.416978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:40.442167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4546e84-93b6-4d48-b6ca-87b7ef56d5b2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:40.444048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:40.445473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:40.445955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.446727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:40.447178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:40.447606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.461372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4546e84-93b6-4d48-b6ca-87b7ef56d5b2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044573 Oct 28 19:18:40.463379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1384/2763] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:18:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:40.468558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71a7896b-6430-4d26-806e-7081b45579e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:40.469567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71a7896b-6430-4d26-806e-7081b45579e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:40.643674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71a7896b-6430-4d26-806e-7081b45579e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:40.656357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71a7896b-6430-4d26-806e-7081b45579e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1220 microversion: 2.1 time: 0.191590 Oct 28 19:18:40.656963 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1385/2764] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:40 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1220 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:40.736520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:40.737367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:40.741539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:40.757156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:40.758125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:40.758774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.759694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:40.760316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:40.760921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:40.830311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:41.083457 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bdf022fe-c1aa-47aa-a912-16963a810cef tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "DELETE /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 204 len: 0 microversion: 2.1 time: 0.344417 Oct 28 19:18:41.091208 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1386/2765] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:40 2022] DELETE /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:41.105696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:41.116760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:41.137454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:41.138136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:41.138678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:41.141871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:41.142490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:41.143781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:41.837996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:41.848845 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e91a74a-47c0-4e90-9926-62dc0ff2658c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1395 microversion: 2.1 time: 1.445287 Oct 28 19:18:41.849432 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1380/2766] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:40 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1395 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:41.869742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:41.870311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:41.876798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:41.877291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:41.877719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:41.878422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:41.879726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:41.881033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:42.254158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:42.282630 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29655806-cdcd-4d56-99a5-5735b9ce8adb tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1714 microversion: 2.1 time: 1.185253 Oct 28 19:18:42.284049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1387/2767] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:41 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1714 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:42.299968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:42.300715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:42.311543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:42.315517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:42.316272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:42.317304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:42.318078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:42.318679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:42.847493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:42.859460 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0a4de4a-10cc-4902-9ccd-c01a3ec585ab tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1224 microversion: 2.1 time: 0.574217 Oct 28 19:18:42.864798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1388/2768] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:42 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1224 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:42.873963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-34aeabfa-ac6e-469b-8990-565cbeafe1fa req-f5d3c04f-311f-4d0b-9c0f-6787950483b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0270c13-413e-4612-8f28-0639f416afb3", "tag": "b265ff56-b1f7-48fc-87d9-2fa909ae4bda"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:42.909521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-34aeabfa-ac6e-469b-8990-565cbeafe1fa req-f5d3c04f-311f-4d0b-9c0f-6787950483b1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:42.929147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-34aeabfa-ac6e-469b-8990-565cbeafe1fa req-f5d3c04f-311f-4d0b-9c0f-6787950483b1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:42.929707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-34aeabfa-ac6e-469b-8990-565cbeafe1fa req-f5d3c04f-311f-4d0b-9c0f-6787950483b1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:42.956027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-34aeabfa-ac6e-469b-8990-565cbeafe1fa req-f5d3c04f-311f-4d0b-9c0f-6787950483b1 service nova] Creating event network-changed:b265ff56-b1f7-48fc-87d9-2fa909ae4bda for instance c0270c13-413e-4612-8f28-0639f416afb3 on n-h2-862769-3 Oct 28 19:18:42.975343 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-34aeabfa-ac6e-469b-8990-565cbeafe1fa req-f5d3c04f-311f-4d0b-9c0f-6787950483b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107358 Oct 28 19:18:42.980814 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1389/2769] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:42.989237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:42.990281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:43.005040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:43.006659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:43.007386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:43.010796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:43.011555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:43.012227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:43.188232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:43.201502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2d49b25-ded0-410e-97e5-72495c0c84c6 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1325 microversion: 2.1 time: 1.335670 Oct 28 19:18:43.214798 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1381/2770] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:41 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1325 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:43.217186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-acc07513-c280-42b3-88e7-48fc43e02069 req-b025623a-9d47-4dca-90f3-1e62e3796249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4896fa-53d8-4349-a4f1-cc62f6b37248", "name": "network-vif-plugged", "status": "completed", "tag": "1541c8d4-e345-4399-8c45-1ef178005238"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:43.246880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-acc07513-c280-42b3-88e7-48fc43e02069 req-b025623a-9d47-4dca-90f3-1e62e3796249 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:43.250562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-acc07513-c280-42b3-88e7-48fc43e02069 req-b025623a-9d47-4dca-90f3-1e62e3796249 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:43.251168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-acc07513-c280-42b3-88e7-48fc43e02069 req-b025623a-9d47-4dca-90f3-1e62e3796249 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:43.275448 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-acc07513-c280-42b3-88e7-48fc43e02069 req-b025623a-9d47-4dca-90f3-1e62e3796249 service nova] Creating event network-vif-plugged:1541c8d4-e345-4399-8c45-1ef178005238 for instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 on n-h1-862769-3 Oct 28 19:18:43.292108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-acc07513-c280-42b3-88e7-48fc43e02069 req-b025623a-9d47-4dca-90f3-1e62e3796249 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084332 Oct 28 19:18:43.294039 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1382/2771] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:43.311156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:43.312444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:43.329712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:43.330900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:43.331835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:43.334652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:43.335690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:43.336814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:44.490884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:44.505693 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b827d6e-ba9e-4a22-8c57-638ca6c8a584 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1395 microversion: 2.1 time: 1.522986 Oct 28 19:18:44.508914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1390/2772] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:42 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1395 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:44.526368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:44.528345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:44.542835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:44.544092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:44.545412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:44.546725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:44.548064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:44.548795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:44.767384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:44.779477 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a5dc499f-8ca8-488e-9248-74b47e4893dd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1278 microversion: 2.1 time: 0.266770 Oct 28 19:18:44.790782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:44.805262 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1391/2773] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:44 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:44.811549 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-38136304-f9e6-47c2-a3d5-164e324564e1 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1714 microversion: 2.1 time: 1.506134 Oct 28 19:18:44.812581 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1383/2774] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:43 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1714 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:44.834377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:44.837988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:44.853246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:44.854156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:44.854870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:44.855787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:44.856580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:44.857176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:45.398943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1274791085", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "6607f431-fc21-4edb-8bec-e96ee2ca7832"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:45.523940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] validate_networks() for [('6607f431-fc21-4edb-8bec-e96ee2ca7832', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:46.047855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:46.064766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-afe56cc4-219a-496e-90b2-c68e726383a8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1325 microversion: 2.1 time: 1.257291 Oct 28 19:18:46.066006 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1392/2775] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:44 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1325 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:46.071202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:46.072103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:46.079638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:46.081197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:46.081835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:46.082876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:46.085532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:46.086186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:46.710023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:46.743795 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6560ed4-0610-4050-aa2d-db116253fd7c tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1576 microversion: 2.1 time: 0.674156 Oct 28 19:18:46.746855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1393/2776] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:46 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1576 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:46.762849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:46.762849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:46.768996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:46.770111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:46.770823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:46.771603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:46.772287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:46.772844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:47.732232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:47.743002 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44b15fd3-ec91-400a-aba0-548dc0d84558 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.994188 Oct 28 19:18:47.757328 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1394/2777] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:46 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:47.763947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:47.765127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:47.771830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:47.772682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:47.773340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:47.774276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:47.776157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:47.776848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.383190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe91cb777334620a6b54688bfd6bd5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e0199a714466e8116715d20e38bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:48.392738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f76eb15-55f7-45a8-9de1-3525bec18686 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 200 len: 1646 microversion: 2.1 time: 0.636301 Oct 28 19:18:48.393550 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1395/2778] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:47 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 1646 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:48.398945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5e1ab4d8-8526-4751-a74b-1a8df25c1dde req-3ff73e93-26a5-4ecc-a29e-cd16b036ffad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab62524b-214b-4803-8eb9-f5c69b3255ec", "tag": "cb1ac442-4b71-46e3-bb07-541819d89cb5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:48.409984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e1ab4d8-8526-4751-a74b-1a8df25c1dde req-3ff73e93-26a5-4ecc-a29e-cd16b036ffad service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.410681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e1ab4d8-8526-4751-a74b-1a8df25c1dde req-3ff73e93-26a5-4ecc-a29e-cd16b036ffad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.411137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e1ab4d8-8526-4751-a74b-1a8df25c1dde req-3ff73e93-26a5-4ecc-a29e-cd16b036ffad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.427767 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5e1ab4d8-8526-4751-a74b-1a8df25c1dde req-3ff73e93-26a5-4ecc-a29e-cd16b036ffad service nova] Creating event network-changed:cb1ac442-4b71-46e3-bb07-541819d89cb5 for instance ab62524b-214b-4803-8eb9-f5c69b3255ec on n-h2-862769-3 Oct 28 19:18:48.432992 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5e1ab4d8-8526-4751-a74b-1a8df25c1dde req-3ff73e93-26a5-4ecc-a29e-cd16b036ffad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038061 Oct 28 19:18:48.433909 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1396/2779] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:48.445929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:48.446640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:48.453818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.454599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.455291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.456008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.456457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.456884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.475203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:48.651028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:48.652396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:48.653019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:48.653806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:48.654356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:48.666654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=45 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:48.670682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.671307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.671810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.672882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.673576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.674247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.700247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Getting quotas for project 26a62c49e4044872a41bbdae1339e0d7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:48.706157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Getting quotas for user 6fb38e8f3cdd48adab7c38a6bac9220d and project 26a62c49e4044872a41bbdae1339e0d7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:48.725146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:48.729256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:48.732141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1a67cf3-ae1c-4898-a370-fbd13787ae04 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.291652 Oct 28 19:18:48.745075 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1397/2780] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:18:48 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:48.754797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:48.761233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:48.778976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.779909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.781270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.784665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.785200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.785643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.797066 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1891f553-902d-41fb-ad24-c7e470c27e53 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.590338 Oct 28 19:18:48.802777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1384/2781] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:18:48.810518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:48.815629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:48.819965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:48.831210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.848670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.851465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.868224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:48.871648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:48.874814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:48.965004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:50.140436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:50.150219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7ed8ac81-d4a1-463d-a032-01f81a386455 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1325 microversion: 2.1 time: 1.403689 Oct 28 19:18:50.155774 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1398/2782] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:48 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1325 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:50.164492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:50.168090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:50.182379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.183221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.183817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.185050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.185693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.186930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.322715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:50.333434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44783765-c22e-4574-9990-32e9ff505195 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1221 microversion: 2.1 time: 0.176313 Oct 28 19:18:50.340592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1399/2783] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:50 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:50.341233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:50.344773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:50.349768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-68fd5aec-ef85-44dd-ba29-ea2134b254f7 req-611e82f8-e6eb-4339-9d48-8a79da2875f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59b4805-6225-4a3f-8210-6bf4151c37ca", "tag": "55a78294-3722-470e-96ce-77a368080c45"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:50.351613 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df280340-f29d-4ca4-bd5d-09addc63e5c8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 1.547566 Oct 28 19:18:50.353280 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1385/2784] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:48 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:50.367529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:50.368468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] [instance: 79fe462c-5e0a-4739-8a8e-adf189fde3e7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:50.378032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.379312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.382952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-68fd5aec-ef85-44dd-ba29-ea2134b254f7 req-611e82f8-e6eb-4339-9d48-8a79da2875f3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.383651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.384625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.385347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-68fd5aec-ef85-44dd-ba29-ea2134b254f7 req-611e82f8-e6eb-4339-9d48-8a79da2875f3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.385719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.385932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-68fd5aec-ef85-44dd-ba29-ea2134b254f7 req-611e82f8-e6eb-4339-9d48-8a79da2875f3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.386816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.416539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] HTTP exception thrown: Instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 could not be found. Oct 28 19:18:50.421055 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-68fd5aec-ef85-44dd-ba29-ea2134b254f7 req-611e82f8-e6eb-4339-9d48-8a79da2875f3 service nova] Creating event network-changed:55a78294-3722-470e-96ce-77a368080c45 for instance e59b4805-6225-4a3f-8210-6bf4151c37ca on n-h1-862769-3 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Request method failure captured: Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 HTTP/1.1 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCrLJBXrCIagx2lnD0LBx_8kJzQFswL4EK08dFhraMPG3HZAOQKk17O1agESkArtqrnloJZoAxSS-jdWk7n8M8CX9qjPrVpym6-aTGLsrTl0RGR1URdhRYDJ_7MHxU_byZ2s7IrO6UeHWJr60usS63zp6_dr8E3pu3sa3vkmoqmfBA8 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2d2e0199a714466e8116715d20e38bb0 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestManualDisk-1346717691 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2d2e0199a714466e8116715d20e38bb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2d2e0199a714466e8116715d20e38bb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2d2e0199a714466e8116715d20e38bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2d2e0199a714466e8116715d20e38bb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestManualDisk-1346717691 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2d2e0199a714466e8116715d20e38bb0 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestManualDisk-1346717691 Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestManualDisk-1346717691-project Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: efe91cb777334620a6b54688bfd6bd5a Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestManualDisk-1346717691-project Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 could not be found. Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '79fe462c-5e0a-4739-8a8e-adf189fde3e7'} Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 could not be found. Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 could not be found. Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:50.422518 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 could not be found. Oct 28 19:18:50.426665 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:50.428683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Returning 404 to user: Instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:50.428933 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-68fd5aec-ef85-44dd-ba29-ea2134b254f7 req-611e82f8-e6eb-4339-9d48-8a79da2875f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086299 Oct 28 19:18:50.429967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec303d9b-2c13-45b7-9c5a-34e792db78d2 tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7" status: 404 len: 111 microversion: 2.1 time: 0.066452 Oct 28 19:18:50.430907 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1400/2785] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:50.431681 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1386/2786] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:50 2022] GET /compute/v2.1/servers/79fe462c-5e0a-4739-8a8e-adf189fde3e7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:18:50.449701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22836ed8-2e40-420b-8071-aab356bb0f4e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] Calling method '.version_select at 0x7f1d774d21f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:50.465548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-174a9c71-dc61-41e0-b56c-fa33d8179dfe req-99e2a3af-7090-4678-9e14-4777b67f1f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425abd2d-234d-41c5-9114-599f3685bc69", "tag": "229f2d86-d8f9-4a0b-8b77-312235129e3a"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:50.483852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-174a9c71-dc61-41e0-b56c-fa33d8179dfe req-99e2a3af-7090-4678-9e14-4777b67f1f93 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.484507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-174a9c71-dc61-41e0-b56c-fa33d8179dfe req-99e2a3af-7090-4678-9e14-4777b67f1f93 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.485178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-174a9c71-dc61-41e0-b56c-fa33d8179dfe req-99e2a3af-7090-4678-9e14-4777b67f1f93 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.508036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-174a9c71-dc61-41e0-b56c-fa33d8179dfe req-99e2a3af-7090-4678-9e14-4777b67f1f93 service nova] Creating event network-changed:229f2d86-d8f9-4a0b-8b77-312235129e3a for instance 425abd2d-234d-41c5-9114-599f3685bc69 on n-h1-862769-3 Oct 28 19:18:50.520943 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22836ed8-2e40-420b-8071-aab356bb0f4e tempest-ServersTestManualDisk-1346717691 tempest-ServersTestManualDisk-1346717691-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527370068" status: 202 len: 0 microversion: 2.1 time: 0.080947 Oct 28 19:18:50.522453 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1401/2787] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:18:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527370068 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:18:50.524392 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-174a9c71-dc61-41e0-b56c-fa33d8179dfe req-99e2a3af-7090-4678-9e14-4777b67f1f93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062291 Oct 28 19:18:50.525476 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1387/2788] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:50.686601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:50.687821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:50.711507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=18 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:50.713977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.716991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.717851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.719385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:50.720877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:50.722774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.190940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:51.192731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:51.202309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.203019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.203637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.204514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.205372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.205948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.630049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:51.642575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-acd874a3-b87a-4cce-80ca-99063bde7749 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1576 microversion: 2.1 time: 0.963067 Oct 28 19:18:51.656402 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1402/2789] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:50 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1576 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:51.673051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:51.674050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:51.681570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.682395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.683020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.683889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.684846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.685514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.843262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:51.869468 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c69155db-3fb1-474a-923b-dd4c823af022 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1283 microversion: 2.1 time: 0.206853 Oct 28 19:18:51.870569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1403/2790] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:51 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:51.875472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:51.876387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:51.884801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.885531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.886153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.887213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.887873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.888436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.040904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:52.049992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-849f173f-a58c-494b-aa3b-dd30d42edc44 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1325 microversion: 2.1 time: 0.870229 Oct 28 19:18:52.052105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1388/2791] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:51 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1325 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:52.057155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-361305da-31a0-47bd-8b20-a811ad02e3ef req-1966dcdd-769f-440d-b2c3-18f083bebc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0270c13-413e-4612-8f28-0639f416afb3", "name": "network-vif-plugged", "status": "completed", "tag": "b265ff56-b1f7-48fc-87d9-2fa909ae4bda"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:52.078864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-361305da-31a0-47bd-8b20-a811ad02e3ef req-1966dcdd-769f-440d-b2c3-18f083bebc40 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.079633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-361305da-31a0-47bd-8b20-a811ad02e3ef req-1966dcdd-769f-440d-b2c3-18f083bebc40 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.080216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-361305da-31a0-47bd-8b20-a811ad02e3ef req-1966dcdd-769f-440d-b2c3-18f083bebc40 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.105663 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-361305da-31a0-47bd-8b20-a811ad02e3ef req-1966dcdd-769f-440d-b2c3-18f083bebc40 service nova] Creating event network-vif-plugged:b265ff56-b1f7-48fc-87d9-2fa909ae4bda for instance c0270c13-413e-4612-8f28-0639f416afb3 on n-h2-862769-3 Oct 28 19:18:52.117444 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-361305da-31a0-47bd-8b20-a811ad02e3ef req-1966dcdd-769f-440d-b2c3-18f083bebc40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063797 Oct 28 19:18:52.118782 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1389/2792] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:52.284534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:52.293780 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79b11ae2-3ff6-4479-ac2d-f20b32e49faf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.421867 Oct 28 19:18:52.296019 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1404/2793] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:51 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:52.455997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-babfdd39-ff3d-4ec1-94f4-85e2fbf97952 req-9508b58a-3d30-4c5b-9dbe-f1c111ebcb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79fe462c-5e0a-4739-8a8e-adf189fde3e7", "name": "network-vif-deleted", "tag": "b244a054-944d-46bc-8f92-1137017c1779"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:52.477037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-babfdd39-ff3d-4ec1-94f4-85e2fbf97952 req-9508b58a-3d30-4c5b-9dbe-f1c111ebcb02 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.477525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-babfdd39-ff3d-4ec1-94f4-85e2fbf97952 req-9508b58a-3d30-4c5b-9dbe-f1c111ebcb02 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.477968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-babfdd39-ff3d-4ec1-94f4-85e2fbf97952 req-9508b58a-3d30-4c5b-9dbe-f1c111ebcb02 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.575475 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-babfdd39-ff3d-4ec1-94f4-85e2fbf97952 req-9508b58a-3d30-4c5b-9dbe-f1c111ebcb02 service nova] Creating event network-vif-deleted:b244a054-944d-46bc-8f92-1137017c1779 for instance 79fe462c-5e0a-4739-8a8e-adf189fde3e7 on n-h1-862769-3 Oct 28 19:18:52.593644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8c4e5ee8-5757-4b23-baca-743e97359d16 req-9418ea05-bef5-4655-806e-a0f24c3f1af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4896fa-53d8-4349-a4f1-cc62f6b37248", "tag": "1541c8d4-e345-4399-8c45-1ef178005238"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:52.598405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-babfdd39-ff3d-4ec1-94f4-85e2fbf97952 req-9508b58a-3d30-4c5b-9dbe-f1c111ebcb02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150372 Oct 28 19:18:52.616955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c4e5ee8-5757-4b23-baca-743e97359d16 req-9418ea05-bef5-4655-806e-a0f24c3f1af4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.617453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c4e5ee8-5757-4b23-baca-743e97359d16 req-9418ea05-bef5-4655-806e-a0f24c3f1af4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.617878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1390/2794] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:52.618020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c4e5ee8-5757-4b23-baca-743e97359d16 req-9418ea05-bef5-4655-806e-a0f24c3f1af4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.640137 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8c4e5ee8-5757-4b23-baca-743e97359d16 req-9418ea05-bef5-4655-806e-a0f24c3f1af4 service nova] Creating event network-changed:1541c8d4-e345-4399-8c45-1ef178005238 for instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 on n-h1-862769-3 Oct 28 19:18:52.648888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8c4e5ee8-5757-4b23-baca-743e97359d16 req-9418ea05-bef5-4655-806e-a0f24c3f1af4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056948 Oct 28 19:18:52.652898 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1405/2795] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:18:52.904072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:52.927452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:52.945973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.946461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.946916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.955889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.956389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.956822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:53.078916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:53.079821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:53.094014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:53.100899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:53.101377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:53.102160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:53.105135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:53.105626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:53.821694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:53.839102 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af2d8f04-9ac2-43e7-96a3-40abd3ecb7a6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.943897 Oct 28 19:18:53.840570 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1391/2796] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:52 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:53.860590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:53.861395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:53.870283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:53.876250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:53.876811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:53.877253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:53.881403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:53.881952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:53.882394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:53.883115 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-16f509cf-9bc3-4bd4-9563-115e086e8816 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1325 microversion: 2.1 time: 0.808561 Oct 28 19:18:53.894717 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1406/2797] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:53 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1325 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:54.135634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:54.145574 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ebe5121b-e1d5-416f-b6e7-08b097ae827a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.303366 Oct 28 19:18:54.146652 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1392/2798] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:53 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:54.866438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:54.867096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:54.877365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:54.878069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:54.878306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:54.879096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:54.879560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:54.879971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:54.912679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:54.914024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:54.945434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:54.945935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:54.946461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:54.947266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:54.947720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:54.948144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.135080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:55.143940 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a80507b9-9b3b-49d6-8976-82318a81ac66 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.281490 Oct 28 19:18:55.150451 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1407/2799] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:54 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:55.169350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.169966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:55.179136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.179863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.182235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.184205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.184869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.185574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.207634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:55.216910 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a5a83d4-f4fc-4354-9669-771349c1065b tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1521 microversion: 2.1 time: 0.310990 Oct 28 19:18:55.229729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1393/2800] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:54 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:55.229729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-33dddcc6-d039-4a2a-8baa-9f2021eac9e2 req-58f368da-30cd-4b80-accc-219e371a962a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab62524b-214b-4803-8eb9-f5c69b3255ec", "name": "network-vif-plugged", "status": "completed", "tag": "cb1ac442-4b71-46e3-bb07-541819d89cb5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:55.255858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-33dddcc6-d039-4a2a-8baa-9f2021eac9e2 req-58f368da-30cd-4b80-accc-219e371a962a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.256327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-33dddcc6-d039-4a2a-8baa-9f2021eac9e2 req-58f368da-30cd-4b80-accc-219e371a962a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.256816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-33dddcc6-d039-4a2a-8baa-9f2021eac9e2 req-58f368da-30cd-4b80-accc-219e371a962a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.276694 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-33dddcc6-d039-4a2a-8baa-9f2021eac9e2 req-58f368da-30cd-4b80-accc-219e371a962a service nova] Creating event network-vif-plugged:cb1ac442-4b71-46e3-bb07-541819d89cb5 for instance ab62524b-214b-4803-8eb9-f5c69b3255ec on n-h2-862769-3 Oct 28 19:18:55.286063 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-33dddcc6-d039-4a2a-8baa-9f2021eac9e2 req-58f368da-30cd-4b80-accc-219e371a962a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064413 Oct 28 19:18:55.286723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1394/2801] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:55.301560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.302166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:55.318260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.318812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.319256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.319975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.324809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.325144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.385456 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] HTTP exception thrown: Instance is not a member of specified network Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Request method failure captured: Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3/ips/invalid HTTP/1.1 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCsFKxmMIq4AKppKMOWezLo3CbpQNlHC9bTIUm8vWwCDocB5P_H2ZyjqmTi18gwji3D0nW-uP4sHk_sEui7i9DIndT_sVwe7LLEj4kKpaoXhmQgh-ZsiO7nXK3KyrlkC4gpTdCBrAtXgKwJj2XSSGM3e897dG2YvNdJzrCCIFoE8Cys Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: def864cdf0a54fb580ce65a4c5c3b1fa Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def864cdf0a54fb580ce65a4c5c3b1fa", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: def864cdf0a54fb580ce65a4c5c3b1fa Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerAddressesNegativeTestJSON-268211253-project Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 5ed5d39a8de44a37b721b084c1459309 Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-268211253-project Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance is not a member of specified network Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': 'c0270c13-413e-4612-8f28-0639f416afb3', 'id': 'invalid'} Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 28 19:18:55.395436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.399507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:55.399507 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e9fe4e4-82db-4d39-b1c9-0773bb65f761 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.108207 Oct 28 19:18:55.399507 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1395/2802] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:18:55 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3/ips/invalid => generated 91 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:18:55.409823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-764ed082-fb6b-41a3-b999-cda31e699bce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.410271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-764ed082-fb6b-41a3-b999-cda31e699bce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Failed to fetch instance by id 999 {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:18:55.420197 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-764ed082-fb6b-41a3-b999-cda31e699bce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] HTTP exception thrown: Instance 999 could not be found. Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-764ed082-fb6b-41a3-b999-cda31e699bce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Request method failure captured: Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCsFKxmMIq4AKppKMOWezLo3CbpQNlHC9bTIUm8vWwCDocB5P_H2ZyjqmTi18gwji3D0nW-uP4sHk_sEui7i9DIndT_sVwe7LLEj4kKpaoXhmQgh-ZsiO7nXK3KyrlkC4gpTdCBrAtXgKwJj2XSSGM3e897dG2YvNdJzrCCIFoE8Cys Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: def864cdf0a54fb580ce65a4c5c3b1fa Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def864cdf0a54fb580ce65a4c5c3b1fa", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: def864cdf0a54fb580ce65a4c5c3b1fa Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerAddressesNegativeTestJSON-268211253-project Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 5ed5d39a8de44a37b721b084c1459309 Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-268211253-project Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 999 could not be found. Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': '999'} Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 19:18:55.422269 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:18:55.428793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-764ed082-fb6b-41a3-b999-cda31e699bce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:55.428793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-764ed082-fb6b-41a3-b999-cda31e699bce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017954 Oct 28 19:18:55.428793 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1396/2803] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:18:55 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:18:55.438519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:55.450219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.450861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:55.453342 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea4f9a4f-b0c1-4701-8851-958ecbfdb6f1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.288174 Oct 28 19:18:55.454121 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1408/2804] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:55 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:55.479713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.480211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.480646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.487514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.488017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.488504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.517169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:18:55.622172 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d87560a-7178-416e-a13c-05ab76ce3303 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 204 len: 0 microversion: 2.1 time: 0.189557 Oct 28 19:18:55.627076 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1397/2805] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:55 2022] DELETE /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:55.642711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.644430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:55.656732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.657876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.659213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.659937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.660286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.660887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.837047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:55.847174 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9683bf94-f676-43b7-850b-5a2854d0a3ce tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1527 microversion: 2.1 time: 0.216077 Oct 28 19:18:55.848145 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1409/2806] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:55 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:56.180907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:56.181914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:56.190975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.191808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.192604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.193333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.193964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.194388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.389093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c3ca602d-8d42-4215-a6cb-bb4ba9514e81 req-f9298bdc-7846-44ad-b433-cd8893e05a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad180777-b248-434e-b995-d2175230ee3a", "tag": "15339a5e-9ad1-4459-ad49-a7515c51720b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:56.443404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3ca602d-8d42-4215-a6cb-bb4ba9514e81 req-f9298bdc-7846-44ad-b433-cd8893e05a2b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.447201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3ca602d-8d42-4215-a6cb-bb4ba9514e81 req-f9298bdc-7846-44ad-b433-cd8893e05a2b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.447858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3ca602d-8d42-4215-a6cb-bb4ba9514e81 req-f9298bdc-7846-44ad-b433-cd8893e05a2b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.450599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:56.459971 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eaea30fb-fe1f-47a1-a6c6-bf685ce340df tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.286072 Oct 28 19:18:56.462031 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1398/2807] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:56 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:56.469645 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c3ca602d-8d42-4215-a6cb-bb4ba9514e81 req-f9298bdc-7846-44ad-b433-cd8893e05a2b service nova] Creating event network-changed:15339a5e-9ad1-4459-ad49-a7515c51720b for instance ad180777-b248-434e-b995-d2175230ee3a on n-h2-862769-3 Oct 28 19:18:56.488575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:56.488896 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c3ca602d-8d42-4215-a6cb-bb4ba9514e81 req-f9298bdc-7846-44ad-b433-cd8893e05a2b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107124 Oct 28 19:18:56.489822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:56.493786 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1410/2808] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:56.497394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.498041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.498849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.499663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.500255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.500994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.753253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:56.765569 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7fb0cd9-c5dc-4f80-ad6d-37ac3a2b386e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.286387 Oct 28 19:18:56.782904 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1399/2809] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:56 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:56.873618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:56.875231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:56.886909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.887428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.887830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.888656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.889114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.889525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:57.123771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:57.132882 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e896baa-8fea-490d-a0aa-bb2a9c84f6e8 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1527 microversion: 2.1 time: 0.265097 Oct 28 19:18:57.133978 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1411/2810] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:56 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:57.485960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:57.503656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:57.547370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:57.557405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:57.561361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:57.564254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:57.565671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:57.570622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:57.608260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-bcadd441-6e0c-4c6b-8318-0d1a194205d4 req-2e7b7ad4-648f-4dca-8ab7-6395d3f569ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425abd2d-234d-41c5-9114-599f3685bc69", "name": "network-vif-plugged", "status": "completed", "tag": "229f2d86-d8f9-4a0b-8b77-312235129e3a"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:57.633177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bcadd441-6e0c-4c6b-8318-0d1a194205d4 req-2e7b7ad4-648f-4dca-8ab7-6395d3f569ce service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:57.635019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bcadd441-6e0c-4c6b-8318-0d1a194205d4 req-2e7b7ad4-648f-4dca-8ab7-6395d3f569ce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:57.638307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bcadd441-6e0c-4c6b-8318-0d1a194205d4 req-2e7b7ad4-648f-4dca-8ab7-6395d3f569ce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:57.672603 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-bcadd441-6e0c-4c6b-8318-0d1a194205d4 req-2e7b7ad4-648f-4dca-8ab7-6395d3f569ce service nova] Creating event network-vif-plugged:229f2d86-d8f9-4a0b-8b77-312235129e3a for instance 425abd2d-234d-41c5-9114-599f3685bc69 on n-h1-862769-3 Oct 28 19:18:57.683988 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-bcadd441-6e0c-4c6b-8318-0d1a194205d4 req-2e7b7ad4-648f-4dca-8ab7-6395d3f569ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080037 Oct 28 19:18:57.687875 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1412/2811] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:57.792516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:57.793729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:57.813784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:57.816711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:57.817507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:57.820689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:57.822140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:57.823643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:58.111348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:58.135372 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-06f902eb-3482-45c2-b08a-29063468fea9 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.653513 Oct 28 19:18:58.137586 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1400/2812] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:57 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:58.159524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:58.160823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:58.180029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:58.182052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:58.183985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:58.186272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:58.186814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:58.188336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:58.298795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:58.312737 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-409febbc-5661-4e64-9aa8-da5dd5ff2295 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.526252 Oct 28 19:18:58.314536 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1413/2813] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:57 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:58.653696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:58.669310 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-978925c3-0815-498e-8900-f7a5f076cb11 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1527 microversion: 2.1 time: 0.513515 Oct 28 19:18:58.669924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1401/2814] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:58 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1527 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:59.169628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:59.170257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:59.177748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.178469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.179117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.180016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.180637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.181223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.327430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-014bf71e-0dcd-40d5-ae6d-4d79b63760fc req-d4b2f8b0-5f66-4e2c-ac60-7101bc10174e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0270c13-413e-4612-8f28-0639f416afb3", "name": "network-vif-deleted", "tag": "b265ff56-b1f7-48fc-87d9-2fa909ae4bda"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:59.353573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:59.354556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:59.359354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-014bf71e-0dcd-40d5-ae6d-4d79b63760fc req-d4b2f8b0-5f66-4e2c-ac60-7101bc10174e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.363698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-014bf71e-0dcd-40d5-ae6d-4d79b63760fc req-d4b2f8b0-5f66-4e2c-ac60-7101bc10174e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.364142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-014bf71e-0dcd-40d5-ae6d-4d79b63760fc req-d4b2f8b0-5f66-4e2c-ac60-7101bc10174e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.410141 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-014bf71e-0dcd-40d5-ae6d-4d79b63760fc req-d4b2f8b0-5f66-4e2c-ac60-7101bc10174e service nova] Creating event network-vif-deleted:b265ff56-b1f7-48fc-87d9-2fa909ae4bda for instance c0270c13-413e-4612-8f28-0639f416afb3 on n-h2-862769-3 Oct 28 19:18:59.420762 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-014bf71e-0dcd-40d5-ae6d-4d79b63760fc req-d4b2f8b0-5f66-4e2c-ac60-7101bc10174e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098899 Oct 28 19:18:59.431346 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1402/2815] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:59.446962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:59.451083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:59.475484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.477287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.482940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.484130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.484777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.485378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.901844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:59.921535 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0728c9b6-980f-4914-b9da-84a7f61cbd6e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1320 microversion: 2.1 time: 0.483534 Oct 28 19:18:59.928157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:59.936233 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1403/2816] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:59 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:59.937178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d64d3c6b-9f35-4e27-a8f0-a50cca08575e tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.771499 Oct 28 19:18:59.938252 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1414/2817] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:59 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:59.943181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7ed4cd9b-de00-4565-8d87-ee1071665946 req-bab5bdc1-3e59-4c9e-bcbe-9103873d0566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59b4805-6225-4a3f-8210-6bf4151c37ca", "name": "network-vif-plugged", "status": "completed", "tag": "55a78294-3722-470e-96ce-77a368080c45"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:59.945163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:59.946430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:18:59.954079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.954453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ed4cd9b-de00-4565-8d87-ee1071665946 req-bab5bdc1-3e59-4c9e-bcbe-9103873d0566 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.954596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.954998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.955565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ed4cd9b-de00-4565-8d87-ee1071665946 req-bab5bdc1-3e59-4c9e-bcbe-9103873d0566 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.956219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ed4cd9b-de00-4565-8d87-ee1071665946 req-bab5bdc1-3e59-4c9e-bcbe-9103873d0566 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.956932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.957575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.958000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.970307 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7ed4cd9b-de00-4565-8d87-ee1071665946 req-bab5bdc1-3e59-4c9e-bcbe-9103873d0566 service nova] Creating event network-vif-plugged:55a78294-3722-470e-96ce-77a368080c45 for instance e59b4805-6225-4a3f-8210-6bf4151c37ca on n-h1-862769-3 Oct 28 19:18:59.976736 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7ed4cd9b-de00-4565-8d87-ee1071665946 req-bab5bdc1-3e59-4c9e-bcbe-9103873d0566 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036332 Oct 28 19:18:59.977852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1415/2818] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:59.998994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.999576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:00.000003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:00.000953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lazy-loading 'fault' on Instance uuid c0270c13-413e-4612-8f28-0639f416afb3 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:19:00.093835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed5d39a8de44a37b721b084c1459309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def864cdf0a54fb580ce65a4c5c3b1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:00.101971 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a1415ce-93cd-4aca-8256-f3a65f11be59 tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 200 len: 1315 microversion: 2.1 time: 0.164092 Oct 28 19:19:00.119370 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1404/2819] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:59 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:00.957499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:00.958061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:00.963960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:00.964689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:00.969403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:00.970004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:00.972172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:00.975995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:00.976826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:00.977792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:00.992631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:01.017225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:01.017225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:01.017225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:01.017225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:01.017225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:01.904615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:01.916982 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3213226-c276-448c-b52a-600a2bd87b6c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1511 microversion: 2.1 time: 0.972017 Oct 28 19:19:01.918473 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1416/2820] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:00 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1511 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:01.937823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:01.959064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:01.959908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Searching by: {'deleted': False, 'project_id': '8f7be388a6634235b8bcb8638019cd9a'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:01.980536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:01.983791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:01.984107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:01.984904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:01.989971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:01.990437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.043634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:02.081134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:02.085976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:02.095858 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15fddd66-532f-4aea-9bcb-80c9121c8e58 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 1.135991 Oct 28 19:19:02.097169 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1405/2821] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:00 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:02.103203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.103815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] [instance: c0270c13-413e-4612-8f28-0639f416afb3] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:02.122170 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-643862bf-22c8-41d4-a9a5-8baaf121a45f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200611 Oct 28 19:19:02.128000 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1417/2822] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:19:01 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:02.144228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.145314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:02.146244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.146948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.147639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.149784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.150558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.151628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.170064 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] HTTP exception thrown: Instance c0270c13-413e-4612-8f28-0639f416afb3 could not be found. Oct 28 19:19:02.171400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.171907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.172511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Request method failure captured: Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 HTTP/1.1 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCsFKxmMIq4AKppKMOWezLo3CbpQNlHC9bTIUm8vWwCDocB5P_H2ZyjqmTi18gwji3D0nW-uP4sHk_sEui7i9DIndT_sVwe7LLEj4kKpaoXhmQgh-ZsiO7nXK3KyrlkC4gpTdCBrAtXgKwJj2XSSGM3e897dG2YvNdJzrCCIFoE8Cys Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: def864cdf0a54fb580ce65a4c5c3b1fa Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def864cdf0a54fb580ce65a4c5c3b1fa", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def864cdf0a54fb580ce65a4c5c3b1fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: def864cdf0a54fb580ce65a4c5c3b1fa Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-268211253 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerAddressesNegativeTestJSON-268211253-project Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 5ed5d39a8de44a37b721b084c1459309 Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-268211253-project Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c0270c13-413e-4612-8f28-0639f416afb3 could not be found. Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c0270c13-413e-4612-8f28-0639f416afb3'} Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0270c13-413e-4612-8f28-0639f416afb3 could not be found. Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0270c13-413e-4612-8f28-0639f416afb3 could not be found. Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:02.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0270c13-413e-4612-8f28-0639f416afb3 could not be found. Oct 28 19:19:02.176922 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:02.177427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.177993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.178620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.179900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] Returning 404 to user: Instance c0270c13-413e-4612-8f28-0639f416afb3 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:02.180848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff55d63a-07a2-4e5f-a55f-97fd8d1877eb tempest-ServerAddressesNegativeTestJSON-268211253 tempest-ServerAddressesNegativeTestJSON-268211253-project] 10.222.0.44 "GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3" status: 404 len: 111 microversion: 2.1 time: 0.082101 Oct 28 19:19:02.181504 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1406/2823] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:02 2022] GET /compute/v2.1/servers/c0270c13-413e-4612-8f28-0639f416afb3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:19:02.187270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.193723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:02.194958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Searching by: {'deleted': False, 'project_id': '8f7be388a6634235b8bcb8638019cd9a'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:02.200937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.201706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.202363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.203315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.204004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.204629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.228282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:02.258669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:02.374583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:02.380858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.381341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.381772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.563714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:02.580010 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1bdd67c6-c4db-4548-a082-bdeaa70ec59e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1513 microversion: 2.1 time: 0.448215 Oct 28 19:19:02.592043 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1418/2824] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:02 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1513 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:02.605226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.608898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:02.622516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.623351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.624035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.624958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.625485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.625973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.635275 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b271341-86d9-4fad-9991-692afaeed73f tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 1602 microversion: 2.1 time: 0.451951 Oct 28 19:19:02.636017 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1407/2825] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:19:02 2022] GET /compute/v2.1/servers/detail => generated 1602 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:02.664373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73921f68-b24c-4e18-85f1-3a31c89d05bd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.681378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73921f68-b24c-4e18-85f1-3a31c89d05bd tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021257 Oct 28 19:19:02.681960 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1408/2826] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:19:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:19:02.874260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:02.891764 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7070262-53b1-4d2d-ab38-0695cfc99267 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 200 len: 1512 microversion: 2.1 time: 0.293403 Oct 28 19:19:02.897671 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1419/2827] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:02 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:02.920691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.927590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:02.928753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:02.945996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.946919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.947491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.948580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:02.949756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:02.950335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:02.988178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:02.989342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:03.006936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.007727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.014595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.015454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.015930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.016362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.068718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:19:03.165189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:03.271789 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-67b42174-73e8-454d-b686-c62eb4bee853 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 204 len: 0 microversion: 2.1 time: 0.285283 Oct 28 19:19:03.276432 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1420/2828] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:19:02 2022] DELETE /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:19:03.294138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:03.296575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:03.330865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.333544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.336705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:03.339882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.340816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.341316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.344245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.356139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.358810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.359404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.821547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:03.835777 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-621e7110-ab6f-46fa-b98e-d72988c3d899 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.554760 Oct 28 19:19:03.838020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1421/2829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:03 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:03.858375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:03.859209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:03.878548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.879480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.880161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.881142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.881908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.882941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.912732 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c58c677d-1a85-4d99-9122-1ad52078c003 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.996078 Oct 28 19:19:03.913949 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1409/2830] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:19:02 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:03.919668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:03.920290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:03.944959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.947105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.949144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:03.951472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:03.951950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:03.956643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:04.115000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lazy-loading 'services' on Instance uuid 47a9adc5-334c-4b5e-b804-3fed340769f4 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:19:04.239670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:04.253623 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f10f081-5084-4457-a128-f38bd6457c82 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1605 microversion: 2.1 time: 0.335314 Oct 28 19:19:04.266747 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1410/2831] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:03 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1605 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:04.266747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:04.273630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:04.274483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1401515409', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:04.280643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:04.281361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:04.282012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:04.282979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:04.283639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:04.284291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:04.334480 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6f4d1f8-eb96-4cb6-ab82-d2eff18e5467 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-volume_attachments/5f7b6469-3f07-4ab5-880f-dc3ea19e4c8e" status: 202 len: 0 microversion: 2.1 time: 0.494716 Oct 28 19:19:04.352807 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1422/2832] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:19:03 2022] DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-volume_attachments/5f7b6469-3f07-4ab5-880f-dc3ea19e4c8e => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:04.449819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:04.837293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:04.844008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:04.844716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:04.845301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:04.861371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:04.862326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:04.873992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:04.875639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:04.878058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:04.880337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:04.881024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:04.882082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:05.450172 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-054e7b7c-d70f-42d9-be5a-4541df0eaa45 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1401515409" status: 200 len: 1516 microversion: 2.1 time: 1.194043 Oct 28 19:19:05.450769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1411/2833] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:19:04 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1401515409 => generated 1516 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:05.455423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:05.456161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:05.476242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:05.476899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:05.479336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:05.480239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:05.482039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:05.484622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:05.582187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:05.609629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebd49f2c-3f3a-4eaa-8bfb-b92d9cc6b754 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.753247 Oct 28 19:19:05.610673 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1423/2834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:04 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:05.626645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:05.633567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:05.634634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:05.646332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:05.650317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:05.651559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:05.654370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:05.655965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:05.657525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:05.842574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:05.930225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:05.939566 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-041ef09b-3c6a-4278-9b36-e4093e3442a9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1605 microversion: 2.1 time: 0.487777 Oct 28 19:19:05.948954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1412/2835] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:05 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1605 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:05.979804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:06.002517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:06.003055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:06.003494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:06.283558 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9479c40e-1764-4f50-9eb0-f34583888974 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.671611 Oct 28 19:19:06.284609 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1424/2836] 10.222.0.44 () {58 vars in 1173 bytes} [Fri Oct 28 19:19:05 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:06.319215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:06.332492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:06.332962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.servers [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Removing options 'limit' from query {{(pid=120629) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 19:19:06.333750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:06.378020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:06.384575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:06.385304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:06.387008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:06.392371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:06.399396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:06.485476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:06.495330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:06.497589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:06.498265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:06.635139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:06.636095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:06.645066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:06.645066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:06.650817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:06.651715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:06.652193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:06.652630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.148789 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a669b99d-1468-401f-b226-1faa12e90804 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.833507 Oct 28 19:19:07.164317 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1413/2837] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 19:19:06 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:07.184718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:07.185393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:07.210053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.210555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.211023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.244003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.244532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.244976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.326544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:07.341800 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd494cfd-3194-4b7d-9e1c-a612373d1285 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.710784 Oct 28 19:19:07.349540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1425/2838] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:06 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:07.355610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:07.373263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:07.374208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:07.386049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.389159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.389811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.392951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.393829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.394413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.466871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:07.535546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-720dfaa8-60c0-409a-a6a8-5561622257c6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.184614 Oct 28 19:19:07.542082 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1426/2839] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:19:07 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:07.559956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:07.569026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:07.572405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:07.576479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.servers [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Removing options 'limit' from query {{(pid=120628) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 19:19:07.579725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:07.583553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d661609c-65f8-4dcb-a7ff-ab5c507cdb83 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1538 microversion: 2.1 time: 0.417180 Oct 28 19:19:07.584163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1414/2840] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:07 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1538 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:07.591137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.593371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.595803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.596791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.598667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.603043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.666100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:07.743868 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e52e1b5c-f849-4b90-9ab7-b9ccf8c5c9aa tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.187513 Oct 28 19:19:07.745163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1427/2841] 10.222.0.44 () {58 vars in 1150 bytes} [Fri Oct 28 19:19:07 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:07.757133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:07.783010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:07.786495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:07.813613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.818832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.821331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.831518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.833666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.834290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.924299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:08.023720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b01450f-fd1a-4c46-8ee2-b8a3f2c40ef6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.270649 Oct 28 19:19:08.029243 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1415/2842] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:19:07 2022] GET /compute/v2.1/servers => generated 1011 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:08.040215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:08.051911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:08.067043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:08.088379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-28d0eaf5-07b0-4610-9ee8-74ee249c05ee req-a1340571-8bc7-4ab8-8dd6-2b382dfc3213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb573a3-49a9-44de-b9a7-3d369e445b3d", "name": "network-vif-deleted", "tag": "ef9497d5-6cbc-4f85-810a-28ec55936f60"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:08.098214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:08.104094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.111266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.112383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.113714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.114506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.115172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.124737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-28d0eaf5-07b0-4610-9ee8-74ee249c05ee req-a1340571-8bc7-4ab8-8dd6-2b382dfc3213 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.125552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-28d0eaf5-07b0-4610-9ee8-74ee249c05ee req-a1340571-8bc7-4ab8-8dd6-2b382dfc3213 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.126746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-28d0eaf5-07b0-4610-9ee8-74ee249c05ee req-a1340571-8bc7-4ab8-8dd6-2b382dfc3213 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.205289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-28d0eaf5-07b0-4610-9ee8-74ee249c05ee req-a1340571-8bc7-4ab8-8dd6-2b382dfc3213 service nova] Creating event network-vif-deleted:ef9497d5-6cbc-4f85-810a-28ec55936f60 for instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d on n-h2-862769-3 Oct 28 19:19:08.215993 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-28d0eaf5-07b0-4610-9ee8-74ee249c05ee req-a1340571-8bc7-4ab8-8dd6-2b382dfc3213 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131875 Oct 28 19:19:08.233641 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1416/2843] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:19:08.351532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:08.372714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:08.378117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:08.397912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.398879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.403647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.404828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.406712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.408092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.422932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ee4a63a-fa4b-4329-87f7-f700ff65eedd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.386731 Oct 28 19:19:08.432113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1428/2844] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:19:08 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:08.437247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:08.443020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:08.443482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.servers [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Removing options 'limit' from query {{(pid=120628) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 19:19:08.444226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:08.449632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.450116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.450553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.451315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.452210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.452654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.496886 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d600c0c0-df0e-4af4-b4fc-913d02ff8f46 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.063515 Oct 28 19:19:08.497677 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1429/2845] 10.222.0.44 () {58 vars in 1140 bytes} [Fri Oct 28 19:19:08 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:08.536322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:08.546894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:08.557241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1401515409', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:08.573814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.574449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.575026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.576040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.576593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.577116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.772700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:08.895220 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e4ac6399-e6b9-48d5-8502-052e2cd00464 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1401515409" status: 200 len: 346 microversion: 2.1 time: 0.383782 Oct 28 19:19:08.896136 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1430/2846] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:19:08 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1401515409 => generated 346 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:08.909828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:08.910593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:08.917341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.918134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.918798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.919690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:08.920324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:08.921376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:08.954592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:09.305663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:09.316201 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ca950da-da86-4c1d-ae38-f9b80568f8a3 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.418830 Oct 28 19:19:09.317719 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1431/2847] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:08 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:09.323987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5075c5a8-e810-4f5f-b083-4916264f8813 req-fece6e28-07f9-4a75-8b7d-e85f6007a588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad180777-b248-434e-b995-d2175230ee3a", "name": "network-vif-plugged", "status": "completed", "tag": "15339a5e-9ad1-4459-ad49-a7515c51720b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:09.341013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:09.351456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5075c5a8-e810-4f5f-b083-4916264f8813 req-fece6e28-07f9-4a75-8b7d-e85f6007a588 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:09.351456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5075c5a8-e810-4f5f-b083-4916264f8813 req-fece6e28-07f9-4a75-8b7d-e85f6007a588 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:09.352131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5075c5a8-e810-4f5f-b083-4916264f8813 req-fece6e28-07f9-4a75-8b7d-e85f6007a588 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:09.359076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27beca58-6925-4318-9f01-2b68d1b825a3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.990698 Oct 28 19:19:09.360509 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1417/2848] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:08 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:09.365500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ac0d387-424f-4c47-8fd8-6aa91e70cc84 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:09.382132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ac0d387-424f-4c47-8fd8-6aa91e70cc84 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:09.391535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ac0d387-424f-4c47-8fd8-6aa91e70cc84 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:09.392256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ac0d387-424f-4c47-8fd8-6aa91e70cc84 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:09.399627 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5075c5a8-e810-4f5f-b083-4916264f8813 req-fece6e28-07f9-4a75-8b7d-e85f6007a588 service nova] Creating event network-vif-plugged:15339a5e-9ad1-4459-ad49-a7515c51720b for instance ad180777-b248-434e-b995-d2175230ee3a on n-h2-862769-3 Oct 28 19:19:09.411771 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5075c5a8-e810-4f5f-b083-4916264f8813 req-fece6e28-07f9-4a75-8b7d-e85f6007a588 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092427 Oct 28 19:19:09.415494 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1432/2849] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:09.449855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9ac0d387-424f-4c47-8fd8-6aa91e70cc84 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Going to try to stop instance {{(pid=120629) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:19:09.573963 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9ac0d387-424f-4c47-8fd8-6aa91e70cc84 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "POST /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca/action" status: 202 len: 0 microversion: 2.1 time: 0.210580 Oct 28 19:19:09.574708 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1418/2850] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:19:09 2022] POST /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:09.595912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:09.597026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:09.607188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:09.607707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:09.608157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:09.608877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:09.609331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:09.609846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.312102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:10.325041 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1286245e-482d-43d8-bfb3-1153b283baac tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.736698 Oct 28 19:19:10.328223 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1433/2851] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:09 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:10.343463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:10.344357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:10.353701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:10.357671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:10.358500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.359451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:10.361842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:10.363328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.514197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:10.532726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d8c6c74-cc19-4beb-b22d-b8b4a7bce5a1 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.188387 Oct 28 19:19:10.533456 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1434/2852] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:10 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:10.542819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:10.551674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:10.564492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:10.567690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:10.568343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.569285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:10.571819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:10.572480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.700899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c0842b43-dfac-41f9-9460-9c3db47bde5c tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Action: 'create', calling method: .version_select at 0x7f1d771fe160>, body: {"keypair": {"name": "tempest-keypair-1553816268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOuDJoJJjNi2KnIsa+Q69aYO2Gl+/L9VDlVkE9O+BsiIOHFv3Hsu4w/psnkdAilewBuoSeyztta1bVoBqwY6Dx1j1GZm6u7Ngs/VIY3GtO7YACHJQ+VeWSD5OvksHqvpw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:10.726596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c0842b43-dfac-41f9-9460-9c3db47bde5c tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Getting quotas for project c3084e2b5c2a49a9887a6f9ebf8a2993. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:10.734230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c0842b43-dfac-41f9-9460-9c3db47bde5c tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Getting quotas for user e14650c88086424cb2f7e27ffe97d6c2 and project c3084e2b5c2a49a9887a6f9ebf8a2993. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:10.775038 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c0842b43-dfac-41f9-9460-9c3db47bde5c tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.648446 Oct 28 19:19:10.783457 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1419/2853] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:19:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:19:11.284842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:11.304034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d83cf5a3-515a-4c1d-b3ba-2f53ae3296d3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1325 microversion: 2.1 time: 0.765602 Oct 28 19:19:11.322722 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1435/2854] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:10 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1325 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:11.353144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:11.353828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:11.378147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:11.382237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:11.383470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:11.386375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:11.390903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:11.392877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:11.560216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:11.561236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:11.581229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:11.584277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:11.585282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:11.598169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:11.600096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:11.601905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:11.870909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:11.887831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b982ee6e-e55f-4884-a868-e948ebeb6f68 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.332044 Oct 28 19:19:11.888459 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1436/2855] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:11 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:12.031604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:12.052147 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-565c5074-7eac-46f2-8eab-716607ae85fd tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.703362 Oct 28 19:19:12.067647 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1420/2856] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:11 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:12.340450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:12.341142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:12.356982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:12.357518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:12.357913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:12.358633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:12.368291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:12.368754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:12.911826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:12.912728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:12.930086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:12.933013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:12.935800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:12.938375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:12.941130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:12.943404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:12.970147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:12.980231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1323f300-9c4e-4f07-ad74-58d13ceace3b tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1521 microversion: 2.1 time: 0.642449 Oct 28 19:19:12.981114 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1437/2857] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:12 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:13.008529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:13.009371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:13.022477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.031418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.035625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.041009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.049211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.049960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.164578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] HTTP exception thrown: Action 999 not found Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Request method failure captured: Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a/os-instance-actions/999 HTTP/1.1 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCsVbtMA08lDWYXtRK17XJWqKoTCm02yxavUSD0R7HgSLe-3wguSRmMb4bqCCvhAeqz8e2aEisJkng67EiqSq4i5OW03erJuBUL97XcssIyGrUS6Lbl1eKbg9EJ-peIqLVBPbfeZgqThSDGVgWTUvisqmqKeMYKzvsINuiZcEeRV2MA Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 26a62c49e4044872a41bbdae1339e0d7 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_26a62c49e4044872a41bbdae1339e0d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 26a62c49e4044872a41bbdae1339e0d7 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceActionsNegativeTestJSON-1764520372-project Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fb38e8f3cdd48adab7c38a6bac9220d Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1764520372-project Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: exception: Action 999 not found Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': 'ad180777-b248-434e-b995-d2175230ee3a', 'id': '999'} Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 28 19:19:13.183294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.188595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Returning 404 to user: Action 999 not found {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:13.189993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee2cb317-8baa-4c96-9b0c-9514405be4b3 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.185500 Oct 28 19:19:13.191603 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1438/2858] 10.222.0.44 () {58 vars in 1308 bytes} [Fri Oct 28 19:19:13 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a/os-instance-actions/999 => generated 66 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:19:13.202747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:13.204482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:13.213200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.214019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.215067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.218990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.219730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.220605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.414761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:13.427442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4b9b7c8-5248-4c99-addc-2aeb2145a428 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.520487 Oct 28 19:19:13.448649 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1421/2859] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:12 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:13.457247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1900948c-2ffc-432c-9fb5-ca649a047520 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '.version_select at 0x7f1d771ffdc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:13.458159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1900948c-2ffc-432c-9fb5-ca649a047520 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: 768a304c-1bf5-4792-b928-f306e3d99d00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:13.461782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:13.488405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1900948c-2ffc-432c-9fb5-ca649a047520 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] HTTP exception thrown: Instance 768a304c-1bf5-4792-b928-f306e3d99d00 could not be found. Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1900948c-2ffc-432c-9fb5-ca649a047520 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Request method failure captured: Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/768a304c-1bf5-4792-b928-f306e3d99d00/os-instance-actions HTTP/1.1 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCsVbtMA08lDWYXtRK17XJWqKoTCm02yxavUSD0R7HgSLe-3wguSRmMb4bqCCvhAeqz8e2aEisJkng67EiqSq4i5OW03erJuBUL97XcssIyGrUS6Lbl1eKbg9EJ-peIqLVBPbfeZgqThSDGVgWTUvisqmqKeMYKzvsINuiZcEeRV2MA Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 26a62c49e4044872a41bbdae1339e0d7 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_26a62c49e4044872a41bbdae1339e0d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 26a62c49e4044872a41bbdae1339e0d7 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-InstanceActionsNegativeTestJSON-1764520372-project Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fb38e8f3cdd48adab7c38a6bac9220d Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1764520372-project Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 768a304c-1bf5-4792-b928-f306e3d99d00 could not be found. Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': '768a304c-1bf5-4792-b928-f306e3d99d00'} Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768a304c-1bf5-4792-b928-f306e3d99d00 could not be found. Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:19:13.492896 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768a304c-1bf5-4792-b928-f306e3d99d00 could not be found. Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768a304c-1bf5-4792-b928-f306e3d99d00 could not be found. Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1900948c-2ffc-432c-9fb5-ca649a047520 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Returning 404 to user: Instance 768a304c-1bf5-4792-b928-f306e3d99d00 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:13.497186 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1900948c-2ffc-432c-9fb5-ca649a047520 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/768a304c-1bf5-4792-b928-f306e3d99d00/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.045936 Oct 28 19:19:13.499327 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1422/2860] 10.222.0.44 () {58 vars in 1296 bytes} [Fri Oct 28 19:19:13 2022] GET /compute/v2.1/servers/768a304c-1bf5-4792-b928-f306e3d99d00/os-instance-actions => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:19:13.510598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:13.515564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:13.535429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.535844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.536281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.538609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.539632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.540074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.610141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:19:13.615743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:13.761008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:13.770574 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa651d0b-c7ca-4236-aa54-b8fb47b7af7b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.577568 Oct 28 19:19:13.772149 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1439/2861] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:13 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:13.784330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c933d053-128a-4f49-b58a-132451276853 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:13.796098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c933d053-128a-4f49-b58a-132451276853 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.802748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c933d053-128a-4f49-b58a-132451276853 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.803426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c933d053-128a-4f49-b58a-132451276853 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.849794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c933d053-128a-4f49-b58a-132451276853 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Going to try to stop instance {{(pid=120628) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:19:13.857386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55b5dc63-bee0-4134-abd8-6105b26a1aa6 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 204 len: 0 microversion: 2.1 time: 0.352014 Oct 28 19:19:13.859308 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1423/2862] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:19:13 2022] DELETE /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:19:13.876193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:13.876888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:13.894287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.895148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.896117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.897102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.897699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.898264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.952623 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c933d053-128a-4f49-b58a-132451276853 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action" status: 202 len: 0 microversion: 2.1 time: 0.179137 Oct 28 19:19:13.953247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1440/2863] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:19:13 2022] POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:13.969029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:13.969754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:13.986380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.989701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.990359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.991339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.992151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.997721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:14.556696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:14.574128 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78de99ab-b8d6-4838-9f7f-38f75be166ba tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1678 microversion: 2.1 time: 0.607995 Oct 28 19:19:14.575489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1441/2864] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:13 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1678 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:14.590725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:14.591564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:14.597852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:14.608275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:14.609140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:14.610854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:14.612530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:14.613183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:14.613787 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1e5c8cb-5619-4c11-8fa9-529323d32a9c tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1527 microversion: 2.1 time: 0.741629 Oct 28 19:19:14.614995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:14.665152 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1424/2865] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:13 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1527 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:14.682233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1300683274", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b3e2bd2d-4c61-42fb-a801-89dc4711a217"}], "security_groups": [{"name": "tempest-securitygroup--1159421604"}], "key_name": "tempest-keypair-1553816268", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:14.966150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:14.979926 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-218c361b-b21d-444e-9ea8-730deb765c19 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.401158 Oct 28 19:19:14.982590 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1442/2866] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:14 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:14.993682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:14.994655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:15.013173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:15.013676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:15.014111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:15.019222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:15.019804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:15.020306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:15.134205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] validate_networks() for [('b3e2bd2d-4c61-42fb-a801-89dc4711a217', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:19:15.597682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:15.612205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-696325a8-88de-4588-b0a4-ac01d690f62f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.622444 Oct 28 19:19:15.627149 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1443/2867] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:14 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:15.640678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:15.641301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:15.655731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:15.656611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:15.657562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:15.659253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:15.660014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:15.662595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:15.977142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:16.474601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:16.484588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cee6144-f241-4795-b6da-ca1bd3d8da0c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1678 microversion: 2.1 time: 0.856199 Oct 28 19:19:16.506981 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1444/2868] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:15 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1678 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:16.522160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:16.523122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:16.529199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:19:16.530789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:19:16.531437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:19:16.532008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:19:16.532577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:19:16.549758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.550526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.551281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.554000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.554728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.557696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.559621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.560278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.562167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.564793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.571210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.571911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.600547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Getting quotas for project c3084e2b5c2a49a9887a6f9ebf8a2993. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:16.622458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Getting quotas for user e14650c88086424cb2f7e27ffe97d6c2 and project c3084e2b5c2a49a9887a6f9ebf8a2993. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:16.663494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:19:16.666295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:19:16.818490 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0be53220-06ad-4469-94ff-8a7f295099b3 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.151984 Oct 28 19:19:16.829631 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1425/2869] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:19:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:19:16.842830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:16.843671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:16.860887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.862882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.865449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.870989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.874534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.875910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.008444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb38e8f3cdd48adab7c38a6bac9220d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a62c49e4044872a41bbdae1339e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:17.025969 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-732a6aa3-dd0e-47d2-b631-07163252a5c4 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 200 len: 1485 microversion: 2.1 time: 0.517510 Oct 28 19:19:17.028049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1445/2870] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:16 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 1485 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:17.069008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:17.070041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:17.102751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.106425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.107232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.113808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.114214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.114651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.288213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:17.307139 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-898e3737-4537-4b7e-913e-b2a3a2d77411 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.474536 Oct 28 19:19:17.308088 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1426/2871] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:16 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:17.331572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f5437c77-bf15-4502-a82d-a09877768fca req-7997b0fc-f9f4-4730-abe0-3d2acd0c3944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad180777-b248-434e-b995-d2175230ee3a", "name": "network-vif-deleted", "tag": "15339a5e-9ad1-4459-ad49-a7515c51720b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:17.367047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f5437c77-bf15-4502-a82d-a09877768fca req-7997b0fc-f9f4-4730-abe0-3d2acd0c3944 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.367466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f5437c77-bf15-4502-a82d-a09877768fca req-7997b0fc-f9f4-4730-abe0-3d2acd0c3944 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.372675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f5437c77-bf15-4502-a82d-a09877768fca req-7997b0fc-f9f4-4730-abe0-3d2acd0c3944 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.415915 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f5437c77-bf15-4502-a82d-a09877768fca req-7997b0fc-f9f4-4730-abe0-3d2acd0c3944 service nova] Creating event network-vif-deleted:15339a5e-9ad1-4459-ad49-a7515c51720b for instance ad180777-b248-434e-b995-d2175230ee3a on n-h2-862769-3 Oct 28 19:19:17.422070 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f5437c77-bf15-4502-a82d-a09877768fca req-7997b0fc-f9f4-4730-abe0-3d2acd0c3944 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110848 Oct 28 19:19:17.423294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1427/2872] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:17.430749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0d2e97a-c3d2-4f38-be80-a86647af0d87 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:17.432071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b0d2e97a-c3d2-4f38-be80-a86647af0d87 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:17.707029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b0d2e97a-c3d2-4f38-be80-a86647af0d87 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:17.714682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0d2e97a-c3d2-4f38-be80-a86647af0d87 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1242 microversion: 2.1 time: 0.289460 Oct 28 19:19:17.718247 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1428/2873] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:17 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1242 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:17.737711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:17.738314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:17.752117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.755103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.755760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.758061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.758735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.761257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.009615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:18.025631 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df19ee2f-1786-4afe-9c86-4c487c0d6fa5 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.988194 Oct 28 19:19:18.026307 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1446/2874] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:17 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:18.052901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:18.053620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] [instance: ad180777-b248-434e-b995-d2175230ee3a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:18.067389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.069287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.071687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.073971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.074570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.077210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.142325 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] HTTP exception thrown: Instance ad180777-b248-434e-b995-d2175230ee3a could not be found. Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Request method failure captured: Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a HTTP/1.1 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCsVbtMA08lDWYXtRK17XJWqKoTCm02yxavUSD0R7HgSLe-3wguSRmMb4bqCCvhAeqz8e2aEisJkng67EiqSq4i5OW03erJuBUL97XcssIyGrUS6Lbl1eKbg9EJ-peIqLVBPbfeZgqThSDGVgWTUvisqmqKeMYKzvsINuiZcEeRV2MA Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 26a62c49e4044872a41bbdae1339e0d7 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_26a62c49e4044872a41bbdae1339e0d7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/26a62c49e4044872a41bbdae1339e0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 26a62c49e4044872a41bbdae1339e0d7 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1764520372 Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-InstanceActionsNegativeTestJSON-1764520372-project Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fb38e8f3cdd48adab7c38a6bac9220d Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1764520372-project Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance ad180777-b248-434e-b995-d2175230ee3a could not be found. Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'ad180777-b248-434e-b995-d2175230ee3a'} Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad180777-b248-434e-b995-d2175230ee3a could not be found. Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad180777-b248-434e-b995-d2175230ee3a could not be found. Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:18.160709 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad180777-b248-434e-b995-d2175230ee3a could not be found. Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:18.165888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] Returning 404 to user: Instance ad180777-b248-434e-b995-d2175230ee3a could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:18.167079 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9dafc633-74f4-4e1e-a5b0-0de613d90685 tempest-InstanceActionsNegativeTestJSON-1764520372 tempest-InstanceActionsNegativeTestJSON-1764520372-project] 10.222.0.44 "GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a" status: 404 len: 111 microversion: 2.1 time: 0.118701 Oct 28 19:19:18.171171 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1447/2875] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:18 2022] GET /compute/v2.1/servers/ad180777-b248-434e-b995-d2175230ee3a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:19:18.331642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:18.332423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:18.343394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.352400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.353033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.353877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.359082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.369626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.401470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:18.636636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=14 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:18.651451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:18.661629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-253437be-35e7-4a91-b16c-a28025ee90f9 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.333825 Oct 28 19:19:18.662290 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1448/2876] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:18 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:18.667853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:18.676986 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf5163df-d04a-4673-a72c-e5875667b4fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1678 microversion: 2.1 time: 0.953474 Oct 28 19:19:18.677566 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1429/2877] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:17 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1678 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:18.746341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:18.747646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:18.754728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.755647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.756354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.757884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.760037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.761036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.007790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:19.022069 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5f0e960b-32b1-4e26-bc00-45ddafb6390f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1294 microversion: 2.1 time: 0.281108 Oct 28 19:19:19.022722 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1449/2878] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:18 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1294 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:19.057335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:19.058603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:19.071355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.077287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.080197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.081041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.081575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.082499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.429519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:19.440460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fb2d2c1-79c7-4835-8b74-590a8225c7da tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.390257 Oct 28 19:19:19.441046 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1430/2879] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:19 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:19.686953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:19.687570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:19.700529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:19.700805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.701578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:19.705691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.706433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.708968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.711050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.711812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.716246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.716673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.717241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.718167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.720191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.721179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.991358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:20.003717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a4396f2-f89f-4629-9948-f1a33eb194ae tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.321097 Oct 28 19:19:20.019801 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1450/2880] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:19 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:20.051038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:20.051756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:20.077582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:20.078223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:20.087684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:20.090240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:20.091500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:20.099971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:20.328346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:20.346848 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca7fc3f1-0767-48c4-93a6-08d85e5d7a4d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1300 microversion: 2.1 time: 0.299551 Oct 28 19:19:20.347410 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1451/2881] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:20 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1300 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:20.373965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:20.382917 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a16b732d-8cf8-4fa8-957a-1fd3982126ca tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1678 microversion: 2.1 time: 0.687024 Oct 28 19:19:20.398048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1431/2882] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:19 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1678 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:20.465521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:20.466237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:20.477246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:20.478874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:20.479978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:20.484552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:20.485374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:20.486011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.028869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:21.029927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:21.040298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.040941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.042487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.047894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.049795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.051726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.214444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.219707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.232778 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-08ad2473-8442-4e60-a1c2-0e3733d843ca tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.199557 Oct 28 19:19:21.234205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe12ed10-dbff-4442-9e6d-23d148f1686f tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.772491 Oct 28 19:19:21.235078 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1452/2883] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:20 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:21.255403 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1432/2884] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:21 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:21.375118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:21.376041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:21.388950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.390273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.393322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.394535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.398971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.399745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.410282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:21.410928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:21.419820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.424104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.424803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.425753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.433895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.434724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.556710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.569446 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e198a53e-a5e1-4cf9-89b4-a5af84409b92 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1300 microversion: 2.1 time: 0.199264 Oct 28 19:19:21.572241 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1453/2885] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:21 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:21.795187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.809223 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b5ffe37-d697-4747-8e3b-8d910f4f1dcd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1678 microversion: 2.1 time: 0.399534 Oct 28 19:19:21.810266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1433/2886] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:21 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1678 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:22.258232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:22.259428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:22.275792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:22.280074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:22.280931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:22.282552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:22.289590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:22.293010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:22.293671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:22.294214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:22.295146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:22.297709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:22.298352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:22.299447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:22.301832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:22.303174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:22.779591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:22.799710 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea29ee24-90a2-43c4-a142-fb57f3dfa5a6 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1251 microversion: 2.1 time: 0.522249 Oct 28 19:19:22.805504 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1434/2887] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:22 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1251 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:22.822546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:22.827479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:22.847911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:22.849454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:22.850100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:22.851986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:22.854174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:22.855721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.184116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:23.197720 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a24e8d4e-6ba1-4b13-8119-a0d09154625c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.943265 Oct 28 19:19:23.200855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1454/2888] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:22 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:23.215675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:23.216519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:23.229813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.234901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.235365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.241113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.241761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.242210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.336098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:23.348502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eaffeacd-6954-475c-9727-ee3cedb26d2d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1368 microversion: 2.1 time: 0.541475 Oct 28 19:19:23.353319 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1435/2889] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:22 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1368 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:23.833899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:23.834804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:23.864838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.867638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.874521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.877895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.878655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.879430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.899456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:23.920541 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-98d8521a-5418-4847-9d60-bc2d409675d9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1678 microversion: 2.1 time: 0.715038 Oct 28 19:19:23.925139 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1455/2890] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:23 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1678 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:23.952458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.953134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.953676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.954266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lazy-loading 'fault' on Instance uuid 6fb573a3-49a9-44de-b9a7-3d369e445b3d {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:19:24.156886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-91c00301-0b87-4cfa-a66c-9ec19e301e7d req-e0ba3ac4-00ff-469f-bf58-f69b8451ff2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667", "tag": "c9f2928e-7ee1-46a5-a904-0f018cf7d4b4"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:24.178121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560d03a6eb411098f80aed346d4c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7be388a6634235b8bcb8638019cd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:24.191615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27f80f75-711b-469d-9063-96fd9b262829 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 200 len: 1210 microversion: 2.1 time: 0.366227 Oct 28 19:19:24.193222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-91c00301-0b87-4cfa-a66c-9ec19e301e7d req-e0ba3ac4-00ff-469f-bf58-f69b8451ff2a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.193842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-91c00301-0b87-4cfa-a66c-9ec19e301e7d req-e0ba3ac4-00ff-469f-bf58-f69b8451ff2a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.199797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-91c00301-0b87-4cfa-a66c-9ec19e301e7d req-e0ba3ac4-00ff-469f-bf58-f69b8451ff2a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:24.203281 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1436/2891] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:23 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 1210 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:24.233337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:24.233972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:24.254457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.254989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.255504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:24.256134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.256609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.257019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:24.263114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-91c00301-0b87-4cfa-a66c-9ec19e301e7d req-e0ba3ac4-00ff-469f-bf58-f69b8451ff2a service nova] Creating event network-changed:c9f2928e-7ee1-46a5-a904-0f018cf7d4b4 for instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 on n-h2-862769-3 Oct 28 19:19:24.290106 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-91c00301-0b87-4cfa-a66c-9ec19e301e7d req-e0ba3ac4-00ff-469f-bf58-f69b8451ff2a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139363 Oct 28 19:19:24.296481 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1456/2892] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:24.374765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:24.379851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:24.394231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.399365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.402090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:24.403235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.403873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.406567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:25.315878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:25.327315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c610a76-bdd7-4d71-a67b-b8715c2a5a59 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 1.097929 Oct 28 19:19:25.336578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:25.341426 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1437/2893] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:24 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:25.348232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8328f14a-6dbd-43f8-ad0f-4c6b5a3d12ac tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1368 microversion: 2.1 time: 0.977802 Oct 28 19:19:25.363947 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1457/2894] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:24 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1368 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:25.373412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:25.377221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:25.381741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:25.387906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] [instance: 6fb573a3-49a9-44de-b9a7-3d369e445b3d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:25.406153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:25.407169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:25.407825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:25.408817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:25.409308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:25.409538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:25.409739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:25.410553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:25.410959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:25.411098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:25.411446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:25.411903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:25.454535 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] HTTP exception thrown: Instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d could not be found. Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Request method failure captured: Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d HTTP/1.1 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCq4BZB6FXTmss3rJs0h6iYL-_stS3O8Pt-0qQnFM6_PVMAWTG3Unw8sNPOluepamMEeI_2lNZTVwaIsOfd9FaWVxDNEGhKQCs77_6EYH0cPbWOb3LnovXnxeOu9lF3i2uyjRmqcIzeDIBZRKB19gofBsnawBV7vDxrPbAFLYw9R160 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8f7be388a6634235b8bcb8638019cd9a Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestBootFromVolume-591254746 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8f7be388a6634235b8bcb8638019cd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8f7be388a6634235b8bcb8638019cd9a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f7be388a6634235b8bcb8638019cd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f7be388a6634235b8bcb8638019cd9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestBootFromVolume-591254746 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8f7be388a6634235b8bcb8638019cd9a Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestBootFromVolume-591254746 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestBootFromVolume-591254746-project Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 86560d03a6eb411098f80aed346d4c52 Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestBootFromVolume-591254746-project Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d could not be found. Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '6fb573a3-49a9-44de-b9a7-3d369e445b3d'} Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d could not be found. Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d could not be found. Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:25.456268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d could not be found. Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Returning 404 to user: Instance 6fb573a3-49a9-44de-b9a7-3d369e445b3d could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:25.461535 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0aa9f04b-cbb0-4009-a9af-77d6ed487d95 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d" status: 404 len: 111 microversion: 2.1 time: 0.092417 Oct 28 19:19:25.465146 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1458/2895] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:25 2022] GET /compute/v2.1/servers/6fb573a3-49a9-44de-b9a7-3d369e445b3d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:19:25.470238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3dfb425-1184-4b47-b31d-d3749c1e8b24 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] Calling method '.version_select at 0x7f1d77df5310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:25.519809 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3dfb425-1184-4b47-b31d-d3749c1e8b24 tempest-ServersTestBootFromVolume-591254746 tempest-ServersTestBootFromVolume-591254746-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532209579" status: 202 len: 0 microversion: 2.1 time: 0.053361 Oct 28 19:19:25.524673 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1459/2896] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532209579 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:26.098993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:26.108031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:26.108822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Searching by: {'deleted': False, 'project_id': '890750a4bcb04482810d9e8b1b5ac004'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:26.138366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.140801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.141500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.143809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.146538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.147844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.216316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:26.307813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de701dd3-8313-485f-8c55-a7e266d3ca0b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.214247 Oct 28 19:19:26.308480 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1460/2897] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:19:26 2022] GET /compute/v2.1/servers => generated 334 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:26.327784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:26.340651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:26.343725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Searching by: {'deleted': False, 'project_id': '890750a4bcb04482810d9e8b1b5ac004'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:26.356079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.357905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.361319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.365938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.368808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.369534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.427333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:26.515394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:26.530939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.531509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.532974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.577083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:26.740440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:26.753295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-745a2b67-3900-4b6a-a1e2-099d0d27d9fb tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1655 microversion: 2.1 time: 1.407024 Oct 28 19:19:26.759602 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1438/2898] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:25 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1655 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:26.795066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:26.798787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:26.826808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.827746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.830375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.832830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:26.835045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:26.835740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:27.714325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=20 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:27.810001 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1f3bfd3-36cd-49fc-8b3b-c42bfc6a1192 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 1.491849 Oct 28 19:19:27.810665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1461/2899] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:19:26 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:27.820230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:27.827958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:27.853851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:27.855714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:27.858217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:27.859289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:27.861856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:27.865372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:27.916176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:27.940611 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-452ea3f5-078e-43b5-aa81-b7370130d133 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 1.175173 Oct 28 19:19:27.943057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1439/2900] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:26 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:27.957994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5036ad7b-b47a-4c5c-ae04-10ec0de9add7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:27.985244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5036ad7b-b47a-4c5c-ae04-10ec0de9add7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:27.986258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5036ad7b-b47a-4c5c-ae04-10ec0de9add7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:27.989742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5036ad7b-b47a-4c5c-ae04-10ec0de9add7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:28.053931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5036ad7b-b47a-4c5c-ae04-10ec0de9add7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Going to try to start instance {{(pid=120629) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:19:28.065410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:28.152146 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5036ad7b-b47a-4c5c-ae04-10ec0de9add7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action" status: 202 len: 0 microversion: 2.1 time: 0.205549 Oct 28 19:19:28.152764 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1440/2901] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:19:27 2022] POST /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:28.400539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d57e2c45-6954-483c-8038-29ae8e9fdc30 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Action: 'create', calling method: .version_select at 0x7f1d772b89d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:28.460248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d57e2c45-6954-483c-8038-29ae8e9fdc30 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Getting quotas for project 1d4dda41242641fda1e437d0866866f8. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:28.481894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d57e2c45-6954-483c-8038-29ae8e9fdc30 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Getting quotas for user 128167445b914ac88c7a161267f57384 and project 1d4dda41242641fda1e437d0866866f8. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:28.581094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d57e2c45-6954-483c-8038-29ae8e9fdc30 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Getting quotas for project 1d4dda41242641fda1e437d0866866f8. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:28.590256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d57e2c45-6954-483c-8038-29ae8e9fdc30 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Getting quotas for user 128167445b914ac88c7a161267f57384 and project 1d4dda41242641fda1e437d0866866f8. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:28.631023 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d57e2c45-6954-483c-8038-29ae8e9fdc30 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.464480 Oct 28 19:19:28.631688 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1441/2902] 10.222.0.44 () {62 vars in 1214 bytes} [Fri Oct 28 19:19:28 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:19:28.644928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb2b54cf-d8d4-4e0f-800e-93e58c1db07b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:28.660689 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb2b54cf-d8d4-4e0f-800e-93e58c1db07b tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020141 Oct 28 19:19:28.666436 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1442/2903] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:19:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:28.680982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:28.682831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:28.695538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:28.696379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:28.697052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:28.698014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:28.698681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:28.699616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:29.824808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:29.841704 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d23e40d8-501d-448b-beb2-45e421a7f741 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1368 microversion: 2.1 time: 2.024095 Oct 28 19:19:29.842378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1462/2904] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:27 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1368 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:29.859941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb51858d-4bce-44d6-b49e-8acaa8b0f8f7 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:29.906455 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb51858d-4bce-44d6-b49e-8acaa8b0f8f7 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.062917 Oct 28 19:19:29.913276 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1463/2905] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Oct 28 19:19:29 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:19:29.926489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:29.927395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:29.944649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:29.945557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:29.946813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:29.947440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:29.948363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:29.949201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:29.951817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:29.953397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-45fc3537-634a-4fab-b114-be8e7e305389 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1664 microversion: 2.1 time: 1.285423 Oct 28 19:19:29.954081 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1443/2906] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:28 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1664 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:29.985064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:29.985603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:29.997098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:29.997641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:29.998104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:29.998899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:29.999387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:29.999862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.068033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:19:30.254953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:30.287040 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-669d7bd1-7595-41de-9f55-694432816cb7 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 204 len: 0 microversion: 2.1 time: 0.330493 Oct 28 19:19:30.290047 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1444/2907] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:19:29 2022] DELETE /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:19:30.303126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f60b6c59-1dc5-4bf5-b663-43f3010b4d40 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.324134 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f60b6c59-1dc5-4bf5-b663-43f3010b4d40 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66" status: 200 len: 235 microversion: 2.64 time: 0.027672 Oct 28 19:19:30.324708 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1445/2908] 10.222.0.44 () {60 vars in 1304 bytes} [Fri Oct 28 19:19:30 2022] GET /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66 => generated 235 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:19:30.345343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.347619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:30.362437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.365181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.368082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.369789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.370486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.372716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.633621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:30.646375 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56346bda-039d-43fc-86a2-58865bcb2fbf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.731294 Oct 28 19:19:30.647761 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1464/2909] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:29 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:30.655235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83badbb9-1884-4d18-a92f-56d992aa29a6 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.700548 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-83badbb9-1884-4d18-a92f-56d992aa29a6 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66" status: 204 len: 0 microversion: 2.64 time: 0.049743 Oct 28 19:19:30.706936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1465/2910] 10.222.0.44 () {60 vars in 1307 bytes} [Fri Oct 28 19:19:30 2022] DELETE /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:19:30.719864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8cb9b375-3e34-4e3a-a49a-26a408282841 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.751878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8cb9b375-3e34-4e3a-a49a-26a408282841 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] HTTP exception thrown: Instance group f6f8b352-c5b6-4c7d-b60b-874986d53a66 could not be found. Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8cb9b375-3e34-4e3a-a49a-26a408282841 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Request method failure captured: Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66 HTTP/1.1 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCs_oW0OOpfXbOS0-85LzprvwFY1QKJRIuRtiak-0-qKGvWTM4kZsABYNfKybdYS5lu1zAxh-rxzR10SQswvSDSxD024xFA5RjZMbTD6j3eyjc3i-FjPcOhraAlAsE51kAXSb3QpMIWeNRocsVeSYIH6EPfqwcDPCoro5EdEjZr4D4A Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.64 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1d4dda41242641fda1e437d0866866f8 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerGroup264TestJSON-134903959 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d4dda41242641fda1e437d0866866f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d4dda41242641fda1e437d0866866f8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d4dda41242641fda1e437d0866866f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d4dda41242641fda1e437d0866866f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerGroup264TestJSON-134903959 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1d4dda41242641fda1e437d0866866f8 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerGroup264TestJSON-134903959 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerGroup264TestJSON-134903959-project Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 128167445b914ac88c7a161267f57384 Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerGroup264TestJSON-134903959-project Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance group f6f8b352-c5b6-4c7d-b60b-874986d53a66 could not be found. Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'f6f8b352-c5b6-4c7d-b60b-874986d53a66'} Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f6f8b352-c5b6-4c7d-b60b-874986d53a66 could not be found. Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f6f8b352-c5b6-4c7d-b60b-874986d53a66 could not be found. Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:30.766894 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:30.772316 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:30.772316 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:30.772316 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:30.772316 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:30.772316 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f6f8b352-c5b6-4c7d-b60b-874986d53a66 could not be found. Oct 28 19:19:30.772316 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:30.777188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8cb9b375-3e34-4e3a-a49a-26a408282841 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] Returning 404 to user: Instance group f6f8b352-c5b6-4c7d-b60b-874986d53a66 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:30.778318 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8cb9b375-3e34-4e3a-a49a-26a408282841 tempest-ServerGroup264TestJSON-134903959 tempest-ServerGroup264TestJSON-134903959-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66" status: 404 len: 117 microversion: 2.64 time: 0.069648 Oct 28 19:19:30.779965 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1466/2911] 10.222.0.44 () {60 vars in 1307 bytes} [Fri Oct 28 19:19:30 2022] DELETE /compute/v2.1/os-server-groups/f6f8b352-c5b6-4c7d-b60b-874986d53a66 => generated 117 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:19:30.857680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:30.867003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ea2c854-225c-4f34-899d-fd2301be0d83 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1700 microversion: 2.1 time: 0.532318 Oct 28 19:19:30.869645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.870425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:30.880766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.883709 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1446/2912] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:30 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1700 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:30.887760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.887760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.887760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.887760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.898215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.983750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.985603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:30.996151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.996702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.997140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.004302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.005040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.005683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.344899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:31.359956 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e188a7b5-a894-454c-898d-3725681b9537 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1368 microversion: 2.1 time: 0.494456 Oct 28 19:19:31.362610 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1467/2913] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:30 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:31.669917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:31.670759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:31.681402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.682266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.683057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.684041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.684858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.685555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.900576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:31.914905 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3390f022-78f4-49be-82ef-89337afc08c1 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1664 microversion: 2.1 time: 0.934406 Oct 28 19:19:31.916269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1447/2914] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:30 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1664 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:31.923331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-25a516dc-c3b0-442d-982f-05e5c5980e04 req-3212baa0-c0a4-4671-b4b4-5f98afbdada1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667", "name": "network-vif-plugged", "status": "completed", "tag": "c9f2928e-7ee1-46a5-a904-0f018cf7d4b4"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:31.938037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-25a516dc-c3b0-442d-982f-05e5c5980e04 req-3212baa0-c0a4-4671-b4b4-5f98afbdada1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.938965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-25a516dc-c3b0-442d-982f-05e5c5980e04 req-3212baa0-c0a4-4671-b4b4-5f98afbdada1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.939674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-25a516dc-c3b0-442d-982f-05e5c5980e04 req-3212baa0-c0a4-4671-b4b4-5f98afbdada1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.956077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-25a516dc-c3b0-442d-982f-05e5c5980e04 req-3212baa0-c0a4-4671-b4b4-5f98afbdada1 service nova] Creating event network-vif-plugged:c9f2928e-7ee1-46a5-a904-0f018cf7d4b4 for instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 on n-h2-862769-3 Oct 28 19:19:31.964002 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-25a516dc-c3b0-442d-982f-05e5c5980e04 req-3212baa0-c0a4-4671-b4b4-5f98afbdada1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045079 Oct 28 19:19:31.966236 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1448/2915] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:31.976175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:31.977321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:31.986884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.988546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.989238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.991738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.992509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.993590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:32.163191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:32.175237 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d9aaaaa-faeb-4e1d-b244-cbe077625f8b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.509154 Oct 28 19:19:32.177324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1468/2916] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:31 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:32.386149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:32.392332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:32.406602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:32.407627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:32.409118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:32.412015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:32.412682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:32.413129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:32.435492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:32.458911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:32.482849 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41a817cc-0154-4170-b9aa-d58cd260090a tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1700 microversion: 2.1 time: 0.505455 Oct 28 19:19:32.483490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1449/2917] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:31 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1700 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:32.879616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:32.888887 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00155a0e-8701-47db-abe0-0bb736ecf866 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1368 microversion: 2.1 time: 0.507372 Oct 28 19:19:32.895321 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1469/2918] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:32 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1368 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:32.940780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:32.941491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:32.953886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:32.954578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:32.955211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:32.956084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:32.956699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:32.957320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:33.201825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:33.203112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:33.210524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:33.211596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:33.212250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:33.213222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:33.213853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:33.214482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.077589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:34.088309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:34.090498 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-32ec44b9-8d76-4dc4-985f-54db3d45a9fc tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.892915 Oct 28 19:19:34.092045 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1470/2919] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:33 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:34.105768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:34.106629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:34.116446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.118967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.120471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ee1f9ee-2b90-4a3a-9844-b2687c7e9f15 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1668 microversion: 2.1 time: 1.184104 Oct 28 19:19:34.121347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.124258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.124904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.126430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.130899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1450/2920] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:32 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1668 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:34.145801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0f30b878-c403-470e-a088-b6066011ad9d req-befde2df-6b74-42bb-9325-9505e6fddec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4896fa-53d8-4349-a4f1-cc62f6b37248", "name": "network-vif-deleted", "tag": "1541c8d4-e345-4399-8c45-1ef178005238"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:34.170289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0f30b878-c403-470e-a088-b6066011ad9d req-befde2df-6b74-42bb-9325-9505e6fddec4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.170980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0f30b878-c403-470e-a088-b6066011ad9d req-befde2df-6b74-42bb-9325-9505e6fddec4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.171731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0f30b878-c403-470e-a088-b6066011ad9d req-befde2df-6b74-42bb-9325-9505e6fddec4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.178863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:34.181757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.183414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.184126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.184802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lazy-loading 'fault' on Instance uuid 2c4896fa-53d8-4349-a4f1-cc62f6b37248 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:19:34.203420 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0f30b878-c403-470e-a088-b6066011ad9d req-befde2df-6b74-42bb-9325-9505e6fddec4 service nova] Creating event network-vif-deleted:1541c8d4-e345-4399-8c45-1ef178005238 for instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 on n-h1-862769-3 Oct 28 19:19:34.212345 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0f30b878-c403-470e-a088-b6066011ad9d req-befde2df-6b74-42bb-9325-9505e6fddec4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080104 Oct 28 19:19:34.215062 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1451/2921] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:34.241668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:34.242994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:34.251686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.252579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.253173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.254392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.255237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.255953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.462926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6831b10255460085b80eff60795e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890750a4bcb04482810d9e8b1b5ac004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:34.484990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af9a93c3-6528-45bd-9b1a-4cf30e810302 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 200 len: 1359 microversion: 2.1 time: 0.391637 Oct 28 19:19:34.487587 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1471/2922] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:34 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:34.973231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:34.985412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bcd77a55-6d14-420e-b6db-1c4110c3136f tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1557 microversion: 2.1 time: 0.749691 Oct 28 19:19:34.995870 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1452/2923] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:34 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1557 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:35.018404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:35.018953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:35.030039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.030934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.035516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.036691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.037322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.037912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.117914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:35.119177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:35.129991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.133921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.134393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.138567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.139123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.139565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.168380 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bfbf42a3-8bc6-4520-892a-919c41aa525e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153859 Oct 28 19:19:35.178875 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1472/2924] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:19:35 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:35.514283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:35.516375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] [instance: 2c4896fa-53d8-4349-a4f1-cc62f6b37248] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:35.528541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.529323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.530061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.531662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.532128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.532560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.571914 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] HTTP exception thrown: Instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 could not be found. Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Request method failure captured: Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 HTTP/1.1 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCr6arghZU9C4hRtuhzPrfs6LkAFGNQq6ngbxj6QDagC90w3d6ZAVI_CxsMw6Vq5qYX4jzVNIbkeLXkbZip1XhezacDL2OtpxhDuAh5sOKB4FSCtNb20tbo5RuoJRBdis0d0B7gxuq8Ua-Vgpqnz5ZeP00yY6-gtljfB7GrFS3dQjf0 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 890750a4bcb04482810d9e8b1b5ac004 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestJSON-1854631551 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/890750a4bcb04482810d9e8b1b5ac004"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_890750a4bcb04482810d9e8b1b5ac004", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/890750a4bcb04482810d9e8b1b5ac004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/890750a4bcb04482810d9e8b1b5ac004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestJSON-1854631551 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 890750a4bcb04482810d9e8b1b5ac004 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestJSON-1854631551 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestJSON-1854631551-project Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9f6831b10255460085b80eff60795e43 Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestJSON-1854631551-project Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 could not be found. Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '2c4896fa-53d8-4349-a4f1-cc62f6b37248'} Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 could not be found. Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 could not be found. Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:19:35.573472 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 could not be found. Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Returning 404 to user: Instance 2c4896fa-53d8-4349-a4f1-cc62f6b37248 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-98b2b2fa-c637-42a7-a856-2560aacf0fea tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248" status: 404 len: 111 microversion: 2.1 time: 0.067797 Oct 28 19:19:35.578268 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1473/2925] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:35 2022] GET /compute/v2.1/servers/2c4896fa-53d8-4349-a4f1-cc62f6b37248 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:19:35.594411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2449729-315f-418e-aaea-0190cb732775 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] Calling method '.version_select at 0x7f1d777dc8b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:35.645283 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2449729-315f-418e-aaea-0190cb732775 tempest-ServersTestJSON-1854631551 tempest-ServersTestJSON-1854631551-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-881921229" status: 202 len: 0 microversion: 2.1 time: 0.062963 Oct 28 19:19:35.647982 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1474/2926] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:19:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-881921229 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:35.849930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:35.871005 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09044652-f45b-4983-9fb8-066911cd0202 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.759168 Oct 28 19:19:35.873654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1453/2927] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:35 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:36.900423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:36.901657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:36.908158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:36.909662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:36.912694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:36.913395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:36.913992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:36.915214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:36.915834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:36.916411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:37.754403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d6ceb78d-f109-43a8-89c0-e3824dd7aed1 req-b54927bc-8fb3-4a06-9793-c9155ff8f8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667", "tag": "c9f2928e-7ee1-46a5-a904-0f018cf7d4b4"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:37.775513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d6ceb78d-f109-43a8-89c0-e3824dd7aed1 req-b54927bc-8fb3-4a06-9793-c9155ff8f8a1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:37.779830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d6ceb78d-f109-43a8-89c0-e3824dd7aed1 req-b54927bc-8fb3-4a06-9793-c9155ff8f8a1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:37.780432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d6ceb78d-f109-43a8-89c0-e3824dd7aed1 req-b54927bc-8fb3-4a06-9793-c9155ff8f8a1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:37.804084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d6ceb78d-f109-43a8-89c0-e3824dd7aed1 req-b54927bc-8fb3-4a06-9793-c9155ff8f8a1 service nova] Creating event network-changed:c9f2928e-7ee1-46a5-a904-0f018cf7d4b4 for instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 on n-h2-862769-3 Oct 28 19:19:37.812240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:37.814847 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d6ceb78d-f109-43a8-89c0-e3824dd7aed1 req-b54927bc-8fb3-4a06-9793-c9155ff8f8a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064063 Oct 28 19:19:37.815493 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1454/2928] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:19:37.827838 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-912d1268-8443-4510-adf6-95be4584dae7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.931559 Oct 28 19:19:37.831299 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1475/2929] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:36 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:38.850763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:38.856748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:38.862375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:38.884514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:38.885011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:38.885632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:38.886343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:38.886827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:38.887225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:39.490593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:39.499460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f64daec4-ab7d-431f-b25c-9c58532f89e8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1523 microversion: 2.1 time: 0.649620 Oct 28 19:19:39.505386 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1455/2930] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:38 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:40.528413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:40.531016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:40.553612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:40.554116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:40.557960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:40.563194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:40.563319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:40.563737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.380271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:41.413855 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e126dc8c-382d-4e48-8cf9-462b2fe5645b tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1500 microversion: 2.1 time: 0.889135 Oct 28 19:19:41.415498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1476/2931] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:40 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1500 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:41.452734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:41.474984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:41.476471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:41.490287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:41.493784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:41.495517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.508736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:41.510204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:41.510858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.645616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:41.772127 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7a9a991-ee9d-4c13-956a-c0086785a94e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.330705 Oct 28 19:19:41.774244 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1456/2932] 10.222.0.44 () {58 vars in 1154 bytes} [Fri Oct 28 19:19:41 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:41.785823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7eca1e31-b992-4b77-8ea9-fde9a5d3aa76 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:41.820822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eca1e31-b992-4b77-8ea9-fde9a5d3aa76 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:41.821314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eca1e31-b992-4b77-8ea9-fde9a5d3aa76 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:41.821750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7eca1e31-b992-4b77-8ea9-fde9a5d3aa76 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.864767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7eca1e31-b992-4b77-8ea9-fde9a5d3aa76 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Going to try to start instance {{(pid=120628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:19:41.983568 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7eca1e31-b992-4b77-8ea9-fde9a5d3aa76 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "POST /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca/action" status: 202 len: 0 microversion: 2.1 time: 0.181231 Oct 28 19:19:41.993285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:41.994178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:42.003405 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1477/2933] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:19:41 2022] POST /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:19:42.014948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:42.016893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:42.019330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:42.031691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:42.032669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:42.034524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:42.563610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:42.574579 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a4ae961-e3d9-4b7a-ba60-b9f8c334372d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1509 microversion: 2.1 time: 0.585723 Oct 28 19:19:42.577784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1457/2934] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:41 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1509 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:43.605611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:43.607225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:43.623704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:43.624217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:43.624654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:43.625385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:43.625834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:43.632148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:44.331351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:44.340448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a73c9997-6504-40b1-b827-34d33206d7a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1509 microversion: 2.1 time: 0.740425 Oct 28 19:19:44.345580 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1478/2935] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:43 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:45.128331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1821987612", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:45.259502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] validate_networks() for [('ea268399-3b60-4894-aab5-225e095faf04', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:19:45.379900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:45.381414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:45.398188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:45.398716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:45.399152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:45.399862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:45.400313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:45.406709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:46.389043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:46.406128 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6d09963-00d5-4666-9bb2-5c49b6710e8d tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1509 microversion: 2.1 time: 1.030277 Oct 28 19:19:46.412603 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1479/2936] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:45 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1509 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:46.941726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:19:46.942708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:19:46.943980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:19:46.944624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:19:46.945247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:19:46.969638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:46.970141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:46.970586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:46.971355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:46.978912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:46.982384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:47.059181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Getting quotas for project 23996b3594d34bc3a9e5dbb5ba426fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:47.083724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Getting quotas for user 9191a0b3b773465aafa4513f13138a68 and project 23996b3594d34bc3a9e5dbb5ba426fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:47.133814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:19:47.139993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:19:47.280224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d592edb-6305-4941-b23f-9bef6956dda9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.475616 Oct 28 19:19:47.296432 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1458/2937] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:19:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:19:47.301021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5e52a8a9-7467-447f-ae57-91a9bd89612a tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:47.301639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5e52a8a9-7467-447f-ae57-91a9bd89612a tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:47.439318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:47.440533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:47.454017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:47.455690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:47.457590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:47.459682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e52a8a9-7467-447f-ae57-91a9bd89612a tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:47.461077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:47.462284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:47.464572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:47.469024 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5e52a8a9-7467-447f-ae57-91a9bd89612a tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1224 microversion: 2.1 time: 0.172831 Oct 28 19:19:47.479608 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1480/2938] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:47 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1224 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:48.202320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:48.229665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3aeb94f3-4e12-4cd7-9701-6fb4ed6c91eb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1513 microversion: 2.1 time: 0.800642 Oct 28 19:19:48.252718 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1459/2939] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:47 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1513 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:48.273256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:48.281396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:48.298793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.servers [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Removing options 'limit' from query {{(pid=120628) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 19:19:48.299721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:48.301013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:48.301510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:48.301977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:48.306657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:48.307394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:48.307857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:48.309452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e8b90f2-b22c-4bf5-a1ee-d340ead90db0 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.049809 Oct 28 19:19:48.320021 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1481/2940] 10.222.0.44 () {58 vars in 1140 bytes} [Fri Oct 28 19:19:48 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:19:48.339116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:48.340077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:48.352952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:48.354778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:48.356163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:48.362189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:48.364575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:48.365925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:48.373235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:48.495968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:48.497224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:48.519871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:48.520437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:48.522912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:48.526549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:48.527552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:48.530045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:48.772208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:48.786828 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09f5f1f4-22b1-42ae-9db3-21b1ab9c9d3e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1228 microversion: 2.1 time: 0.294740 Oct 28 19:19:48.789890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1482/2941] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:48 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1228 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:48.943694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:48.963665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fc3186b-cce6-40b7-a2db-02322a4411a6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1513 microversion: 2.1 time: 0.635991 Oct 28 19:19:48.964266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1460/2942] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:48 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:48.990733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:48.991869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:49.003186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:49.016064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:49.017900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:49.020510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:49.023089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:49.023743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:49.815954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:49.816469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:49.847388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:49.852599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:49.854097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:49.858428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:49.861816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:49.864140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:50.250043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:50.259341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:50.263944 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f69ba881-ae7e-41f5-9d6c-4da19f8095b2 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1294 microversion: 2.1 time: 0.452201 Oct 28 19:19:50.279267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1461/2943] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:49 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1294 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:50.285804 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b40f8e6f-cb01-4826-95a1-e61a85a6f27e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 200 len: 1512 microversion: 2.1 time: 1.298606 Oct 28 19:19:50.303097 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1483/2944] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:48 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 1512 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:50.314229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:50.315275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:50.328120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:50.328902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:50.329532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:50.330426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:50.331079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:50.334000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:50.820690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:50.834502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-079851f1-940f-4f01-92fb-32b4c796f500 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1511 microversion: 2.1 time: 0.526935 Oct 28 19:19:50.840844 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1462/2945] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:50 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:50.865241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:50.876439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:50.877650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:51.134650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:51.135345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:51.140078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:51.141183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:51.141784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:51.142376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:51.292225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:51.292859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:51.312624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:51.313124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:51.313752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:51.314769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:51.315371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:51.315943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:51.415413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:51.549809 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea975b0f-d09e-4ca3-ac9d-76c46b1e81e7 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.688204 Oct 28 19:19:51.563732 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1484/2946] 10.222.0.44 () {58 vars in 1154 bytes} [Fri Oct 28 19:19:50 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:51.585746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:51.593472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:51.610513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:51.612014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:51.613335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:51.617569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:51.620053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:51.622011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:52.166049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:52.181743 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b935abfa-7398-4567-8303-9b0b6eb75ba5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.893875 Oct 28 19:19:52.184410 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1463/2947] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:51 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:52.271152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:52.283938 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f996f49-cede-43c9-8180-794d33242e67 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1513 microversion: 2.1 time: 0.712830 Oct 28 19:19:52.293190 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1485/2948] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:51 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1513 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:52.312276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:52.312899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:52.322608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:52.323132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:52.323554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:52.324261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:52.331267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:52.331718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:52.931500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:52.962323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47de11e1-8a92-48c7-b7ce-b44e4e0280e1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 200 len: 1512 microversion: 2.1 time: 0.646342 Oct 28 19:19:52.964949 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1464/2949] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:52 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 1512 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:52.991321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:52.992077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:53.004180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.004282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.004712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.005414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.005862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.006280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.208170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:53.208746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:53.232589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.240311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.240901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.241539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.242011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.242436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.510092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:53.520359 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-381903fe-cea1-453c-beb2-cdc299428936 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1511 microversion: 2.1 time: 0.532838 Oct 28 19:19:53.525198 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1486/2950] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:52 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:53.557087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:53.567677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:53.569075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:53.602147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.605127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.609931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.611049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.611801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.614160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.716862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:53.718821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:53.741129 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8d553e0-b681-40a3-b20b-33f66e3376ba tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.536877 Oct 28 19:19:53.742378 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1465/2951] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:53 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:53.806492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:53.827256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:53.828094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:53.828882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:53.837621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:54.165426 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7d5ba7a3-348f-4766-8b13-5b83abd269fb tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.615512 Oct 28 19:19:54.190892 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1487/2952] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:19:53 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:54.204689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:54.212840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:54.229920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:54.385377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:54.385919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:54.387277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:54.388036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:54.388490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:54.388916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:54.721640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:54.766758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:54.767421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:54.777051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:54.780483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:54.780882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:54.784357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:54.784855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:54.786641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:54.955336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5f3f6d4c-af97-4550-82a3-954655b50e68 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.754611 Oct 28 19:19:54.956072 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1466/2953] 10.222.0.44 () {58 vars in 1150 bytes} [Fri Oct 28 19:19:54 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:54.980738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:55.001094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:55.003721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:55.033862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.034370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.041858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:55.043065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.050460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.052049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:55.262161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:55.407152 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aaaca8f7-2f74-4a48-a78e-21326eeacdd2 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.437835 Oct 28 19:19:55.412490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1467/2954] 10.222.0.44 () {58 vars in 1212 bytes} [Fri Oct 28 19:19:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:55.425706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2edca455-ecf5-4123-97ec-064713b444b1 req-ed7c76ea-77dc-4b02-b2d9-008edc78868f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb2a35b-c12b-49ca-a675-d9cddab9b81d", "tag": "04e715e9-7158-42dc-b229-8cf0e6603efc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:55.454505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2edca455-ecf5-4123-97ec-064713b444b1 req-ed7c76ea-77dc-4b02-b2d9-008edc78868f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.455019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2edca455-ecf5-4123-97ec-064713b444b1 req-ed7c76ea-77dc-4b02-b2d9-008edc78868f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.455445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2edca455-ecf5-4123-97ec-064713b444b1 req-ed7c76ea-77dc-4b02-b2d9-008edc78868f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:55.485081 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2edca455-ecf5-4123-97ec-064713b444b1 req-ed7c76ea-77dc-4b02-b2d9-008edc78868f service nova] Creating event network-changed:04e715e9-7158-42dc-b229-8cf0e6603efc for instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d on n-h1-862769-3 Oct 28 19:19:55.496349 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2edca455-ecf5-4123-97ec-064713b444b1 req-ed7c76ea-77dc-4b02-b2d9-008edc78868f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082072 Oct 28 19:19:55.503193 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1468/2955] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:55.512172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:55.525070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:55.525853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:55.541720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.544804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.545272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:55.546036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.546766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.547524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:55.791340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:55.920264 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-13e06884-faa5-4249-897b-8bbef940b779 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.414754 Oct 28 19:19:55.921733 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1469/2956] 10.222.0.44 () {58 vars in 1196 bytes} [Fri Oct 28 19:19:55 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:55.937507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:55.956612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:55.957799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': '1401515409', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:55.977732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.978496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.979321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:55.981548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:55.982175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:55.982791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:56.137566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:56.236267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:56.253495 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e04fdee6-79dc-430e-bc28-8557c0cb3fb5 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 1.491394 Oct 28 19:19:56.256691 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca7f8696-7c9c-42a2-aad4-7ed8a6fe884c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?name=1401515409" status: 200 len: 346 microversion: 2.1 time: 0.324938 Oct 28 19:19:56.257412 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1470/2957] 10.222.0.44 () {58 vars in 1156 bytes} [Fri Oct 28 19:19:55 2022] GET /compute/v2.1/servers?name=1401515409 => generated 346 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:19:56.260593 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1488/2958] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:54 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:56.284527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:56.293636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:56.298290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:56.312274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:56.314361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:56.315812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:56.318665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:56.319436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:56.320158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:56.500138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:56.673233 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75358b12-3c53-4edb-8618-e73f05530477 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.392609 Oct 28 19:19:56.693960 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1471/2959] 10.222.0.44 () {58 vars in 1154 bytes} [Fri Oct 28 19:19:56 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:56.707124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:56.714255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:56.716173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-140151540', 'deleted': False, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:19:56.731315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:56.736036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:56.737618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:56.739903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:56.742362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:56.743082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:56.968117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:19:57.121830 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f398362-e160-4496-9004-5a2d81c4c0f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-140151540" status: 200 len: 346 microversion: 2.1 time: 0.419522 Oct 28 19:19:57.129990 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1489/2960] 10.222.0.44 () {58 vars in 1228 bytes} [Fri Oct 28 19:19:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-140151540 => generated 346 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:57.135671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:57.136535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:57.138940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:57.148645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.154218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.154714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.156010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.156010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.156324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.213606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:19:57.283010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:57.284279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:57.303738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.319073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.321391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.326859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.330969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.334232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.461404 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ac93fc8-4de8-4842-9ba7-adcb12707b53 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "DELETE /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 204 len: 0 microversion: 2.1 time: 0.328964 Oct 28 19:19:57.464649 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1472/2961] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:19:57 2022] DELETE /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:19:57.497069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:57.497069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:57.517317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.518590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.519167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.519830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.520286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.520708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:58.104586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:58.115995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e91d629-9b9f-42f8-aaf4-f58258d16303 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1517 microversion: 2.1 time: 0.643842 Oct 28 19:19:58.130783 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1473/2962] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:57 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1517 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:58.143438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:58.155979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-abd18ae2-422e-4f44-9e4e-3cbcc214aaca tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.877330 Oct 28 19:19:58.169768 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1490/2963] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:57 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:59.145088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:59.147442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:59.168539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:59.169304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:59.170085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:59.188337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:59.190177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:59.198456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:59.199331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:59.207945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:59.219364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:59.224196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:59.224894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:59.225826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:59.227490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:59.232338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:59.306397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:59.656134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:59.669983 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4bde873-856c-4fcb-8115-f254541bb088 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1517 microversion: 2.1 time: 0.527009 Oct 28 19:19:59.670920 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1474/2964] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:59 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1517 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:59.854868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:59.864375 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-34a0ec29-dae1-4db6-8358-b2d011f83e76 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.681702 Oct 28 19:19:59.864964 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1491/2965] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:59 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:00.694478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:00.695225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:00.700542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:00.723792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:00.724436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:00.724741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:00.733856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:00.735317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:00.735975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:00.890203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:00.890854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:00.913635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:00.918234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:00.922581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:00.927222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:00.931782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:00.932511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:01.364208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:01.373182 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63349559-8eb7-457b-8609-7c8939b2bd7c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1517 microversion: 2.1 time: 0.683491 Oct 28 19:20:01.379497 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1475/2966] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:00 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1517 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:01.504710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:01.521655 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5f463441-b83b-4ceb-834b-1ef5795d0b53 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.635482 Oct 28 19:20:01.525075 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1492/2967] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:00 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:01.804736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5feccf62-3b73-4b71-9372-40ee43c1bc66 req-758049d2-5930-4b39-a52b-6f260ef8003c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425abd2d-234d-41c5-9114-599f3685bc69", "name": "network-vif-deleted", "tag": "229f2d86-d8f9-4a0b-8b77-312235129e3a"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:01.826863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5feccf62-3b73-4b71-9372-40ee43c1bc66 req-758049d2-5930-4b39-a52b-6f260ef8003c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:01.827694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5feccf62-3b73-4b71-9372-40ee43c1bc66 req-758049d2-5930-4b39-a52b-6f260ef8003c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:01.828343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5feccf62-3b73-4b71-9372-40ee43c1bc66 req-758049d2-5930-4b39-a52b-6f260ef8003c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:01.866298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5feccf62-3b73-4b71-9372-40ee43c1bc66 req-758049d2-5930-4b39-a52b-6f260ef8003c service nova] Creating event network-vif-deleted:229f2d86-d8f9-4a0b-8b77-312235129e3a for instance 425abd2d-234d-41c5-9114-599f3685bc69 on n-h1-862769-3 Oct 28 19:20:01.881699 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5feccf62-3b73-4b71-9372-40ee43c1bc66 req-758049d2-5930-4b39-a52b-6f260ef8003c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082630 Oct 28 19:20:01.884145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1476/2968] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:02.408585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:02.409217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:02.440463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:02.440962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:02.441439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:02.457838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:02.458334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:02.458809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:02.594516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:02.595054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:02.595497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:02.595963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lazy-loading 'fault' on Instance uuid 425abd2d-234d-41c5-9114-599f3685bc69 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:02.817402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1406979246", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:02.839919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:02.853588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-31b72cd1-5143-48b9-88fe-7db88884a2f9 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 200 len: 1310 microversion: 2.1 time: 0.446333 Oct 28 19:20:02.883689 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1493/2969] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:02 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 1310 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:02.907002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:02.907640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:02.933004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:02.936255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:02.940532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:02.942101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:02.948355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:02.949665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:02.987084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] validate_networks() for [('8bc07b19-8281-4c7d-be78-251a99f71ed5', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:03.775916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:03.797734 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dab8205b-34bb-4258-a612-4fdde4117e40 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.911674 Oct 28 19:20:03.811228 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1494/2970] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:02 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:03.899267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:03.900073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: 425abd2d-234d-41c5-9114-599f3685bc69] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:03.902914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:03.915943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:03.916695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:03.917445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:03.920338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:03.921163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:03.922427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:03.975632 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] HTTP exception thrown: Instance 425abd2d-234d-41c5-9114-599f3685bc69 could not be found. Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Request method failure captured: Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 HTTP/1.1 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCsI8NEI5UFLc8nkXExMfLGkwng4UajT0OgoxhiMCXoGI0WsWcliPNkP60hVBDnb3zfXGN_heNS8p8cmETzWR2UkKZYtIxGUC0b4qbZuJZjcsiRlULDWnpqnOulXgvHbTjdDEmr1Xumu3iv2ScBNq2-vd6r9nIESiEwQgO2o3ldd82Y Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2ffe6acc10ea43f296ad26f8f69208f9 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2ffe6acc10ea43f296ad26f8f69208f9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2ffe6acc10ea43f296ad26f8f69208f9 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServerFiltersTestJSON-1814080795-project Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0784c6e961584101931de320c6a0d6e3 Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServerFiltersTestJSON-1814080795-project Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 425abd2d-234d-41c5-9114-599f3685bc69 could not be found. Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '425abd2d-234d-41c5-9114-599f3685bc69'} Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425abd2d-234d-41c5-9114-599f3685bc69 could not be found. Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425abd2d-234d-41c5-9114-599f3685bc69 could not be found. Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:03.980061 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425abd2d-234d-41c5-9114-599f3685bc69 could not be found. Oct 28 19:20:03.984304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:03.987586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Returning 404 to user: Instance 425abd2d-234d-41c5-9114-599f3685bc69 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:03.990559 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8367d9b-40f6-4791-b4ce-06d09eca687a tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69" status: 404 len: 111 microversion: 2.1 time: 0.096917 Oct 28 19:20:04.006238 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1495/2971] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:03 2022] GET /compute/v2.1/servers/425abd2d-234d-41c5-9114-599f3685bc69 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:20:04.016999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:04.018338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:04.034851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:04.038255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:04.040833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:04.042242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:04.044369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:04.045543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:04.114467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:20:04.307683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:04.374844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f968f444-11e9-4394-b373-db1fdab184bf tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 204 len: 0 microversion: 2.1 time: 0.360923 Oct 28 19:20:04.378652 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1496/2972] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:20:04 2022] DELETE /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:20:04.394096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:04.395039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:04.420289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:04.421088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:04.421752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:04.422750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:04.423443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:04.424134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:04.482106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:04.482613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:04.483037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:04.483449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:04.483859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:04.523104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:04.523976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:04.526423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:04.531938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:04.537859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:04.538470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:04.602583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:04.609684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for user de03197eac374bf09c19018aa1417e88 and project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:04.661081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:04.667214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:04.786055 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4dc5c45c-0916-4906-a5cc-738fca92c6a6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.320155 Oct 28 19:20:04.804871 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1477/2973] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:20:04.810305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e237bea-e7a6-4c36-96e2-ccafe1633f87 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:04.811246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e237bea-e7a6-4c36-96e2-ccafe1633f87 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:05.048910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e237bea-e7a6-4c36-96e2-ccafe1633f87 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:05.058561 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e237bea-e7a6-4c36-96e2-ccafe1633f87 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1222 microversion: 2.1 time: 0.252166 Oct 28 19:20:05.083558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1478/2974] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:04 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:05.104256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:05.105122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:05.116163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:05.116795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:05.117361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:05.118226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:05.124416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:05.126427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:06.186358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:06.196584 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82715800-f914-43a9-be43-7fb80754bab8 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 200 len: 1518 microversion: 2.1 time: 1.815111 Oct 28 19:20:06.197438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1497/2975] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:04 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 1518 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:06.237114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2080916753", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:06.343974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] validate_networks() for [('8bc07b19-8281-4c7d-be78-251a99f71ed5', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:06.358783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:06.373354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f041518-fc13-4f5d-bab9-bca75193f591 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 1.287956 Oct 28 19:20:06.373945 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1479/2976] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:05 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:06.807056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:06.809534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:06.812280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:06.823555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:06.824049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:06.828273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:06.830335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:06.831947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:06.832353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:06.919405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c10131c9-f760-4a92-bfe1-63883eed93b8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116337 Oct 28 19:20:06.938227 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1480/2977] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:06 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:20:07.025250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:07.026866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:07.034439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.035921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.036565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.038071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.038872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.039508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.101727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:20:07.299393 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf44d983-e44a-4df0-887d-c27641fce7fa tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 204 len: 0 microversion: 2.1 time: 0.277020 Oct 28 19:20:07.305514 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1481/2978] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:20:07 2022] DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:20:07.321298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:07.324271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:07.337932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.340588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.342309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.344373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.346427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.348183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.550664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:07.551365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:07.551571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:07.551984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:07.552396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:07.573452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.573949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.574384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.583068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.583676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.584126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.638837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:07.655296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for user de03197eac374bf09c19018aa1417e88 and project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:07.693049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:07.699470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:07.823005 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d83904fb-d3e2-4b1f-a9df-a4ffa3e921b8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.608725 Oct 28 19:20:07.839268 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1498/2979] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:20:07.855752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:07.859288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:07.898250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.901311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.904015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:07.907006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:07.911596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:07.912085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:08.059894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:08.072107 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4b1d9360-1053-443f-a4b6-1890352093d6 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 200 len: 1518 microversion: 2.1 time: 0.762118 Oct 28 19:20:08.072770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1482/2980] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:07 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 1518 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:08.097351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:08.099476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:08.116676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:08.117329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:08.118547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:08.122602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:08.135123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:08.136600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:08.658321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:08.668710 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a48413d-83b2-4035-841d-897291a370d5 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1674 microversion: 2.1 time: 0.828110 Oct 28 19:20:08.669310 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1499/2981] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:07 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1674 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:08.698100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-16d22aa4-11d5-434c-83cd-aa98437e37d7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:08.699276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-16d22aa4-11d5-434c-83cd-aa98437e37d7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:08.912868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:08.927618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bfe022a-3c1f-4208-90a6-3a8badc8b763 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 0.851298 Oct 28 19:20:08.928406 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1483/2982] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:08 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:08.933198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d71c5183-1f88-44ff-8b41-5376ad154f43 req-79370931-bc96-4938-8db4-b18faa88e9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb2a35b-c12b-49ca-a675-d9cddab9b81d", "name": "network-vif-plugged", "status": "completed", "tag": "04e715e9-7158-42dc-b229-8cf0e6603efc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:08.972603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d71c5183-1f88-44ff-8b41-5376ad154f43 req-79370931-bc96-4938-8db4-b18faa88e9e7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:08.975823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d71c5183-1f88-44ff-8b41-5376ad154f43 req-79370931-bc96-4938-8db4-b18faa88e9e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:08.985294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d71c5183-1f88-44ff-8b41-5376ad154f43 req-79370931-bc96-4938-8db4-b18faa88e9e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.010445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-16d22aa4-11d5-434c-83cd-aa98437e37d7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:09.029364 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-16d22aa4-11d5-434c-83cd-aa98437e37d7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1222 microversion: 2.1 time: 0.344424 Oct 28 19:20:09.030039 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1500/2983] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:08 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1222 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:09.046315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d71c5183-1f88-44ff-8b41-5376ad154f43 req-79370931-bc96-4938-8db4-b18faa88e9e7 service nova] Creating event network-vif-plugged:04e715e9-7158-42dc-b229-8cf0e6603efc for instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d on n-h1-862769-3 Oct 28 19:20:09.069885 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d71c5183-1f88-44ff-8b41-5376ad154f43 req-79370931-bc96-4938-8db4-b18faa88e9e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140048 Oct 28 19:20:09.076552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1484/2984] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:09.100298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:09.100915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:09.123747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-789766d2-be5e-4ac5-a934-9e2367f44dd8 req-b46cae6b-6916-4b76-99b1-7daa748c2a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab62524b-214b-4803-8eb9-f5c69b3255ec", "name": "network-vif-deleted", "tag": "cb1ac442-4b71-46e3-bb07-541819d89cb5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:09.143030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.143696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.148279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.149406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.150044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.151199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.156790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-789766d2-be5e-4ac5-a934-9e2367f44dd8 req-b46cae6b-6916-4b76-99b1-7daa748c2a55 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.157255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-789766d2-be5e-4ac5-a934-9e2367f44dd8 req-b46cae6b-6916-4b76-99b1-7daa748c2a55 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.171115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-789766d2-be5e-4ac5-a934-9e2367f44dd8 req-b46cae6b-6916-4b76-99b1-7daa748c2a55 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.218209 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-789766d2-be5e-4ac5-a934-9e2367f44dd8 req-b46cae6b-6916-4b76-99b1-7daa748c2a55 service nova] Creating event network-vif-deleted:cb1ac442-4b71-46e3-bb07-541819d89cb5 for instance ab62524b-214b-4803-8eb9-f5c69b3255ec on n-h2-862769-3 Oct 28 19:20:09.244501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-789766d2-be5e-4ac5-a934-9e2367f44dd8 req-b46cae6b-6916-4b76-99b1-7daa748c2a55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124752 Oct 28 19:20:09.255999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1485/2985] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:20:09.359861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:09.371438 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1925a03d-0062-4752-be3e-8be959815e7e tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 200 len: 1476 microversion: 2.1 time: 0.274983 Oct 28 19:20:09.382879 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1501/2986] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:09 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:09.694409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:09.695464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:09.711438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.712254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.712995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.713912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.714546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.717544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.951784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:09.952634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:09.964132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.967213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.967775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:09.969688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:09.970273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:09.971380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:10.830419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:10.850001 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41b45044-3f58-4bb7-8842-1021b6b908c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1674 microversion: 2.1 time: 1.159354 Oct 28 19:20:10.854878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1486/2987] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:09 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1674 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:10.885975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:10.889263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:10.925172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:10.927457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:10.929662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:10.932384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:10.932864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:10.935088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.166441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:11.181108 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b59c9459-2e46-45bb-88d5-48a05ba71e20 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1324 microversion: 2.1 time: 1.233521 Oct 28 19:20:11.186281 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1502/2988] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:09 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1324 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:11.205257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:11.206901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: ab62524b-214b-4803-8eb9-f5c69b3255ec] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:11.253708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.254300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.255849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.256644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.257107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.266175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.360614 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] HTTP exception thrown: Instance ab62524b-214b-4803-8eb9-f5c69b3255ec could not be found. Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Request method failure captured: Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec HTTP/1.1 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCsI8NEI5UFLc8nkXExMfLGkwng4UajT0OgoxhiMCXoGI0WsWcliPNkP60hVBDnb3zfXGN_heNS8p8cmETzWR2UkKZYtIxGUC0b4qbZuJZjcsiRlULDWnpqnOulXgvHbTjdDEmr1Xumu3iv2ScBNq2-vd6r9nIESiEwQgO2o3ldd82Y Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2ffe6acc10ea43f296ad26f8f69208f9 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2ffe6acc10ea43f296ad26f8f69208f9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2ffe6acc10ea43f296ad26f8f69208f9 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServerFiltersTestJSON-1814080795-project Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0784c6e961584101931de320c6a0d6e3 Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServerFiltersTestJSON-1814080795-project Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance ab62524b-214b-4803-8eb9-f5c69b3255ec could not be found. Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'ab62524b-214b-4803-8eb9-f5c69b3255ec'} Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab62524b-214b-4803-8eb9-f5c69b3255ec could not be found. Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab62524b-214b-4803-8eb9-f5c69b3255ec could not be found. Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:11.364237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab62524b-214b-4803-8eb9-f5c69b3255ec could not be found. Oct 28 19:20:11.369020 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:11.382978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Returning 404 to user: Instance ab62524b-214b-4803-8eb9-f5c69b3255ec could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:11.384546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc2a9f49-1c92-4cfd-885c-b7da21072c99 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec" status: 404 len: 111 microversion: 2.1 time: 0.196797 Oct 28 19:20:11.387926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1503/2989] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:11 2022] GET /compute/v2.1/servers/ab62524b-214b-4803-8eb9-f5c69b3255ec => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:20:11.403462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:11.406955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:11.439090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.439594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.445722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.450461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.451341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.451955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.537728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:20:11.569277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:11.577308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:11.583206 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5ff52234-699e-4acc-b9d1-a9f3369c6d73 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1282 microversion: 2.1 time: 0.724739 Oct 28 19:20:11.608447 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1487/2990] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:10 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1282 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:11.757180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3dce80ff-1865-4378-a5d7-fe4f922ab083 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 204 len: 0 microversion: 2.1 time: 0.364519 Oct 28 19:20:11.759283 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1504/2991] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:20:11 2022] DELETE /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:20:11.767660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:11.768551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:11.782531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.783388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.783984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.786179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.788006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.788690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.875063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:11.875994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:11.891351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.892043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.892605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:11.895055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:11.896798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:11.898428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:12.549006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:12.579676 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce74d806-7797-4815-8973-973ca567b183 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1606 microversion: 2.1 time: 0.708127 Oct 28 19:20:12.598163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1505/2992] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:11 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1606 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:12.623777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:12.624992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:12.645741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:12.646987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:12.648115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:12.650083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:12.651581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:12.653696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:13.766374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:13.778286 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7490a87-fe47-4bb8-93b9-5690bea10b4e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1519 microversion: 2.1 time: 1.171615 Oct 28 19:20:13.779774 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1506/2993] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:12 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1519 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:13.796971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:13.801034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:13.812447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:13.813204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:13.814165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:13.824888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:13.826704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:13.828226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:13.830196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:13.842234 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a67f2508-c63f-4f40-b001-5776f52238ca tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1519 microversion: 2.1 time: 2.078542 Oct 28 19:20:13.854725 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1488/2994] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:11 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1519 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:14.125668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c3a1e19-598c-4e79-b9a0-8a022336b422 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'create', calling method: .version_select at 0x7f1d77dd8e50>, body: {"keypair": {"name": "tempest-keypair-236544143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJuozEOOAGqKcyhgeJIH4bQQenY1TgRaTrlEkFAT97IVawcWwseASKrBBuh5yUeSy7f+L7OcErcCvblcbDH8bM7+y3399TRuVscrcMKNLMpNYj+SXhW7EUO/HnwZXVG+w=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:14.199030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0c3a1e19-598c-4e79-b9a0-8a022336b422 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for project 488f01035c694382b597fcadb399bccc. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:14.212967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-0c3a1e19-598c-4e79-b9a0-8a022336b422 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for user 42f0003698694056b69b98933c84cd8a and project 488f01035c694382b597fcadb399bccc. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:14.305503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c3a1e19-598c-4e79-b9a0-8a022336b422 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.459733 Oct 28 19:20:14.306146 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1489/2995] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:20:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:14.335929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d561f8b-a7ba-4ae3-8084-d712284649eb"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:14.345407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:14.363429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:14.366112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:14.366758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:14.367664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:14.370417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:14.370995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:14.562140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:15.201808 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3eb56f7-cee5-4141-941b-54468080dde1 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "POST /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.887768 Oct 28 19:20:15.221065 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1490/2996] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:20:14 2022] POST /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:15.256445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:15.258225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:15.272347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:15.273256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:15.273930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:15.274973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:15.275871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:15.276840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:15.580269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:15.598466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5bbbc92-f9de-4573-b4da-9cb4dc596fdd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1606 microversion: 2.1 time: 0.366246 Oct 28 19:20:15.608765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1491/2997] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:15 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1606 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:15.630737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c9a5dbb-60ef-4423-bb9e-40e07d860fd9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-306815708", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c9a5dbb-60ef-4423-bb9e-40e07d860fd9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 242 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-306815708", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-306815708', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'ea268399-3b60-4894-aab5-225e095faf04'}]}}} Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:15.638537 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:15.642878 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:15.652845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c9a5dbb-60ef-4423-bb9e-40e07d860fd9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:15.653921 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7c9a5dbb-60ef-4423-bb9e-40e07d860fd9 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027251 Oct 28 19:20:15.654761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1492/2998] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:15 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:20:15.678852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:15.681418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:15.726300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:15.727401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:15.728854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:15.731406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:15.737902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:15.738194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:15.786797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:16.165421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:16.179739 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99a76158-a7cd-464f-b45c-740e4be9b423 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1477 microversion: 2.1 time: 0.511225 Oct 28 19:20:16.193930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1493/2999] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:15 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1477 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:16.207694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d901d1f6-fe3a-4b4e-9dcf-bad29f79d759 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:16.208377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d901d1f6-fe3a-4b4e-9dcf-bad29f79d759 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:16.224653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d901d1f6-fe3a-4b4e-9dcf-bad29f79d759 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] HTTP exception thrown: Instance 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa could not be found. Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d901d1f6-fe3a-4b4e-9dcf-bad29f79d759 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa/metadata HTTP/1.1 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa could not be found. Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': '4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa'} Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa could not be found. Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa could not be found. Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.235125 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.240018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:16.240018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:16.240018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa could not be found. Oct 28 19:20:16.240018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.240018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d901d1f6-fe3a-4b4e-9dcf-bad29f79d759 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 404 to user: Instance 4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:16.240018 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d901d1f6-fe3a-4b4e-9dcf-bad29f79d759 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa/metadata" status: 404 len: 111 microversion: 2.1 time: 0.041764 Oct 28 19:20:16.251365 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1494/3000] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:20:16 2022] GET /compute/v2.1/servers/4842ad8f-b6cc-462a-8345-3c0f7eb6b6fa/metadata => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:20:16.261234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-38ea77b0-77eb-4d07-b95e-1e5c95682bed req-c704fdea-6abe-456e-8ec9-98080f88e76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a9adc5-334c-4b5e-b804-3fed340769f4", "name": "network-vif-deleted", "tag": "c4d9e8d3-51ad-44f3-8e24-58d12b3521fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:16.283414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38ea77b0-77eb-4d07-b95e-1e5c95682bed req-c704fdea-6abe-456e-8ec9-98080f88e76e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:16.294250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38ea77b0-77eb-4d07-b95e-1e5c95682bed req-c704fdea-6abe-456e-8ec9-98080f88e76e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:16.294816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38ea77b0-77eb-4d07-b95e-1e5c95682bed req-c704fdea-6abe-456e-8ec9-98080f88e76e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:16.318366 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-38ea77b0-77eb-4d07-b95e-1e5c95682bed req-c704fdea-6abe-456e-8ec9-98080f88e76e service nova] Creating event network-vif-deleted:c4d9e8d3-51ad-44f3-8e24-58d12b3521fc for instance 47a9adc5-334c-4b5e-b804-3fed340769f4 on n-h1-862769-3 Oct 28 19:20:16.328531 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-38ea77b0-77eb-4d07-b95e-1e5c95682bed req-c704fdea-6abe-456e-8ec9-98080f88e76e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075657 Oct 28 19:20:16.336929 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1495/3001] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:16.345425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:16.348531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77228c4d-55dc-47fe-bfd6-caa4bff13d35 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-24685131", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:16.360011 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7895e90f-181f-4d06-aacd-76d91f0ab731 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 2.575658 Oct 28 19:20:16.360943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1507/3002] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:13 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 2577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77228c4d-55dc-47fe-bfd6-caa4bff13d35 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 497 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-24685131", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-24685131', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ea268399-3b60-4894-aab5-225e095faf04'}]}}} Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:20:16.362798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.365682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.368728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77228c4d-55dc-47fe-bfd6-caa4bff13d35 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:16.369730 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77228c4d-55dc-47fe-bfd6-caa4bff13d35 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031391 Oct 28 19:20:16.382466 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1496/3003] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:16 2022] POST /compute/v2.1/servers => generated 687 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:20:16.457904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c2c5e50e-42e1-4748-9516-200838a945d0 req-7eb7588a-7e78-4035-8de4-3c3343d77078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59b4805-6225-4a3f-8210-6bf4151c37ca", "name": "network-vif-deleted", "tag": "55a78294-3722-470e-96ce-77a368080c45"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:16.503000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50f0a87a-526b-461b-ab17-54fbc7e98d62 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-335399116", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50f0a87a-526b-461b-ab17-54fbc7e98d62 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 499 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-335399116", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-335399116', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ea268399-3b60-4894-aab5-225e095faf04'}]}}} Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:20:16.521727 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.525223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50f0a87a-526b-461b-ab17-54fbc7e98d62 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:16.528920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c2c5e50e-42e1-4748-9516-200838a945d0 req-7eb7588a-7e78-4035-8de4-3c3343d77078 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:16.528920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c2c5e50e-42e1-4748-9516-200838a945d0 req-7eb7588a-7e78-4035-8de4-3c3343d77078 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:16.528920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c2c5e50e-42e1-4748-9516-200838a945d0 req-7eb7588a-7e78-4035-8de4-3c3343d77078 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:16.538458 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50f0a87a-526b-461b-ab17-54fbc7e98d62 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.036602 Oct 28 19:20:16.546206 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1497/3004] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:16 2022] POST /compute/v2.1/servers => generated 689 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:20:16.621694 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c2c5e50e-42e1-4748-9516-200838a945d0 req-7eb7588a-7e78-4035-8de4-3c3343d77078 service nova] Creating event network-vif-deleted:55a78294-3722-470e-96ce-77a368080c45 for instance e59b4805-6225-4a3f-8210-6bf4151c37ca on n-h1-862769-3 Oct 28 19:20:16.632624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:16.633373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:16.644527 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c2c5e50e-42e1-4748-9516-200838a945d0 req-7eb7588a-7e78-4035-8de4-3c3343d77078 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187944 Oct 28 19:20:16.646077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1508/3005] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:16.649307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:16.650039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:16.650681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:16.651660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:16.652538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:16.654166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:16.718464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d5cba46-f306-4d2e-a79b-21645e342444 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2130305804", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d5cba46-f306-4d2e-a79b-21645e342444 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 754 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2130305804", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2130305804', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ea268399-3b60-4894-aab5-225e095faf04'}]}}} Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:20:16.745270 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:20:16.748360 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:20:16.752814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.752814 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.752814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d5cba46-f306-4d2e-a79b-21645e342444 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:16.754527 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d5cba46-f306-4d2e-a79b-21645e342444 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.040513 Oct 28 19:20:16.757871 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1509/3006] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:16 2022] POST /compute/v2.1/servers => generated 1197 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 28 19:20:16.795416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:16.796173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:16.798149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:16.801075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lazy-loading 'fault' on Instance uuid 47a9adc5-334c-4b5e-b804-3fed340769f4 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:16.886948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32eb749f-b09a-4dde-a698-2176f1d9005f tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1913982647", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32eb749f-b09a-4dde-a698-2176f1d9005f tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 1266 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1913982647", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ea268399-3b60-4894-aab5-225e095faf04"}]}} Oct 28 19:20:16.901997 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1913982647', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ea268399-3b60-4894-aab5-225e095faf04'}]}}} Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.904458 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:20:16.905658 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:20:16.909692 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 19:20:16.909692 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:16.915796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32eb749f-b09a-4dde-a698-2176f1d9005f tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:16.919406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-32eb749f-b09a-4dde-a698-2176f1d9005f tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.038231 Oct 28 19:20:16.930514 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1510/3007] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Oct 28 19:20:16 2022] POST /compute/v2.1/servers => generated 2221 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 19:20:17.013037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b6ef57f-9ba0-4a58-ad66-bf9929a6ce8c tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:17.020677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b6ef57f-9ba0-4a58-ad66-bf9929a6ce8c tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 965cfd68-778e-4280-8577-60d4d3887a38] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:17.053939 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-3b6ef57f-9ba0-4a58-ad66-bf9929a6ce8c tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] HTTP exception thrown: Instance 965cfd68-778e-4280-8577-60d4d3887a38 could not be found. Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b6ef57f-9ba0-4a58-ad66-bf9929a6ce8c tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/965cfd68-778e-4280-8577-60d4d3887a38/metadata/test2 HTTP/1.1 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 965cfd68-778e-4280-8577-60d4d3887a38 could not be found. Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '965cfd68-778e-4280-8577-60d4d3887a38', 'id': 'test2'} Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965cfd68-778e-4280-8577-60d4d3887a38 could not be found. Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965cfd68-778e-4280-8577-60d4d3887a38 could not be found. Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:17.080602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:17.084637 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:17.084637 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:17.084637 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965cfd68-778e-4280-8577-60d4d3887a38 could not be found. Oct 28 19:20:17.084637 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:17.087280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b6ef57f-9ba0-4a58-ad66-bf9929a6ce8c tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 404 to user: Instance 965cfd68-778e-4280-8577-60d4d3887a38 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:17.095110 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b6ef57f-9ba0-4a58-ad66-bf9929a6ce8c tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/965cfd68-778e-4280-8577-60d4d3887a38/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.157368 Oct 28 19:20:17.103436 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1511/3008] 10.222.0.44 () {58 vars in 1281 bytes} [Fri Oct 28 19:20:16 2022] GET /compute/v2.1/servers/965cfd68-778e-4280-8577-60d4d3887a38/metadata/test2 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:20:17.142306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:17.143013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:17.162893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.167955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.169190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.175095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.175981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.178029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.189659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:17.211155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e5b724b-7cbb-47b9-8006-60eda829b407 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 200 len: 1327 microversion: 2.1 time: 0.582372 Oct 28 19:20:17.213591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1498/3009] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:16 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 1327 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:17.226347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:17.228079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:17.260860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.267024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.269682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.271833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.276466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:20:17.276822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.278407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.369421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.369899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.375849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.376565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lazy-loading 'fault' on Instance uuid e59b4805-6225-4a3f-8210-6bf4151c37ca {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:17.500307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:17.504487 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46d83554-af12-4467-9c75-42b067c49f85 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 204 len: 0 microversion: 2.1 time: 0.366767 Oct 28 19:20:17.508068 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1512/3010] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:20:17 2022] DELETE /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:20:17.509867 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1b6d8e5-de80-47b1-9a37-40b4cd851374 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1311 microversion: 2.1 time: 0.294156 Oct 28 19:20:17.521267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1499/3011] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:17 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:17.521953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:17.527386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:17.539312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:17.539964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:17.543181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.545021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.545844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.547044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.548960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.550080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.564714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.565634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.568693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.571066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:17.571711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:17.577474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:17.620917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:18.592216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:18.605043 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8ce788fe-6d6d-4ee7-bc66-be0152738894 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1525 microversion: 2.1 time: 1.082239 Oct 28 19:20:18.608962 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1500/3012] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:17 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1525 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:18.625416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:18.626347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:18.648802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:18.649050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:18.653291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:18.654452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:18.655117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:18.655694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:18.683551 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] HTTP exception thrown: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Request method failure captured: Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 HTTP/1.1 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCp82Adc7qqPkC-sdL2YUgHdFrDIql7Ra6_NxzQltMaHipruNFir9x_lbl6sxAwKxZbbuJpov1u7nDrKFbuyysYAmSy4yYaL4BT42JH1PVM14_qv6u8pjNEgGc4taU7xoTNmoa_fgRThgt6S1_8hxgU6ZHykYT0ZPGTc4FjubFDBsZg Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdd7944caa7b47adb4bc10f2804ad2cd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 7a3f354a00cf468ca48261a56f68c410 Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '47a9adc5-334c-4b5e-b804-3fed340769f4'} Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:18.693102 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Returning 404 to user: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:18.697076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc892c00-4999-4f7c-847f-3c1eb99be9af tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 404 len: 111 microversion: 2.1 time: 0.083367 Oct 28 19:20:18.703193 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1501/3013] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:18 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:20:18.710397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:18.722533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:18.734487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:18.739047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:18.739724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:18.742990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:18.743673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:18.744283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:18.857342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:18.857972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:18.859715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:18.863546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lazy-loading 'fault' on Instance uuid e59b4805-6225-4a3f-8210-6bf4151c37ca {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:18.936682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:18.951564 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e250b050-7e2c-4a62-8d00-454a641beecc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 1.438385 Oct 28 19:20:18.952247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1513/3014] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:17 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:18.962897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6a2c81f5-9b31-4667-a1f7-6e13f6d0597f req-41f562f8-79d5-4b0c-9e97-b716ffee272b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1db064-f45c-4a74-8a9b-8f3c9cd85570", "tag": "d9abd8d1-f438-426e-bd2e-e10cddaf5b5d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:19.028508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6a2c81f5-9b31-4667-a1f7-6e13f6d0597f req-41f562f8-79d5-4b0c-9e97-b716ffee272b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:19.033346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6a2c81f5-9b31-4667-a1f7-6e13f6d0597f req-41f562f8-79d5-4b0c-9e97-b716ffee272b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:19.034480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6a2c81f5-9b31-4667-a1f7-6e13f6d0597f req-41f562f8-79d5-4b0c-9e97-b716ffee272b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:19.071454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:19.079852 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6a2c81f5-9b31-4667-a1f7-6e13f6d0597f req-41f562f8-79d5-4b0c-9e97-b716ffee272b service nova] Creating event network-changed:d9abd8d1-f438-426e-bd2e-e10cddaf5b5d for instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 on n-h2-862769-3 Oct 28 19:20:19.091914 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6a2c81f5-9b31-4667-a1f7-6e13f6d0597f req-41f562f8-79d5-4b0c-9e97-b716ffee272b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138353 Oct 28 19:20:19.094279 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1514/3015] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:19.107148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0784c6e961584101931de320c6a0d6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffe6acc10ea43f296ad26f8f69208f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:19.111678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b605336-4b00-4c06-bc7d-b4eb9bcababd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '.version_select at 0x7f1d7c4251f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:19.115584 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b968ba0b-e122-4653-ab8c-efff5028008c tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 200 len: 1311 microversion: 2.1 time: 0.409441 Oct 28 19:20:19.118778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1502/3016] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:18 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 1311 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:19.167462 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b605336-4b00-4c06-bc7d-b4eb9bcababd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220413427" status: 202 len: 0 microversion: 2.1 time: 0.070708 Oct 28 19:20:19.168368 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1515/3017] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220413427 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:20:19.646873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:19.647488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:19.658391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:19.661939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:19.662815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:19.663719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:19.664315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:19.665662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:19.976844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:19.978433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:19.994272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:19.995159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:20.001088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:20.002117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:20.003231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:20.003922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:20.460750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:20.471889 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af9702fd-278e-41f0-b52b-1389b41289fa tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1525 microversion: 2.1 time: 0.829171 Oct 28 19:20:20.474926 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1503/3018] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:19 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1525 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:20.502515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:20.508661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] [instance: e59b4805-6225-4a3f-8210-6bf4151c37ca] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:20.536787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:20.537407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:20.537860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:20.538621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:20.542820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:20.543444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:20.568742 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] HTTP exception thrown: Instance e59b4805-6225-4a3f-8210-6bf4151c37ca could not be found. Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Request method failure captured: Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca HTTP/1.1 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCsI8NEI5UFLc8nkXExMfLGkwng4UajT0OgoxhiMCXoGI0WsWcliPNkP60hVBDnb3zfXGN_heNS8p8cmETzWR2UkKZYtIxGUC0b4qbZuJZjcsiRlULDWnpqnOulXgvHbTjdDEmr1Xumu3iv2ScBNq2-vd6r9nIESiEwQgO2o3ldd82Y Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2ffe6acc10ea43f296ad26f8f69208f9 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2ffe6acc10ea43f296ad26f8f69208f9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2ffe6acc10ea43f296ad26f8f69208f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2ffe6acc10ea43f296ad26f8f69208f9 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1814080795 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ListServerFiltersTestJSON-1814080795-project Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 0784c6e961584101931de320c6a0d6e3 Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ListServerFiltersTestJSON-1814080795-project Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e59b4805-6225-4a3f-8210-6bf4151c37ca could not be found. Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e59b4805-6225-4a3f-8210-6bf4151c37ca'} Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59b4805-6225-4a3f-8210-6bf4151c37ca could not be found. Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59b4805-6225-4a3f-8210-6bf4151c37ca could not be found. Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:20.570977 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59b4805-6225-4a3f-8210-6bf4151c37ca could not be found. Oct 28 19:20:20.576549 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:20.579620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] Returning 404 to user: Instance e59b4805-6225-4a3f-8210-6bf4151c37ca could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:20.580811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-260799a6-b37d-4b42-9715-814f9ca658a1 tempest-ListServerFiltersTestJSON-1814080795 tempest-ListServerFiltersTestJSON-1814080795-project] 10.222.0.44 "GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca" status: 404 len: 111 microversion: 2.1 time: 0.102065 Oct 28 19:20:20.585489 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1504/3019] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:20 2022] GET /compute/v2.1/servers/e59b4805-6225-4a3f-8210-6bf4151c37ca => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:20:20.688257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-469713548", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e4640cd-261b-42b5-9b7b-42f460667021"}], "security_groups": [{"name": "tempest-securitygroup--952515867"}], "key_name": "tempest-keypair-236544143", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:20.859302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:20.880665 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7ecdba6d-f72f-4004-bec7-5f385f32ac93 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 0.903508 Oct 28 19:20:20.881913 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1516/3020] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:19 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:21.065824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] validate_networks() for [('4e4640cd-261b-42b5-9b7b-42f460667021', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:21.497174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:21.497793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:21.511833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:21.512347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:21.512785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:21.515698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:21.516661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:21.518107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:22.274397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:22.284987 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f2309c4-3334-4247-92cb-6bdaa2d15b75 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1525 microversion: 2.1 time: 0.791665 Oct 28 19:20:22.292136 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1517/3021] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:21 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1525 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:22.300813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:22.312865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:22.339785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:22.340557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:22.341227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:22.342192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:22.343127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:22.343786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:23.782095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:23.795965 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1cdecd7b-86d5-414d-ab52-e165955350ba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 1.496449 Oct 28 19:20:23.800934 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1518/3022] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:22 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:23.811081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9bd29d23-dd84-4464-9cc6-149d497fe18f req-f955d194-49cf-4407-91c6-e45d58d36acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68acfcf-a0cf-4f77-af94-6426cdb03c6d", "tag": "8d92b33f-bc8d-46df-83e6-4a0fdc60e24f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:23.832385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9bd29d23-dd84-4464-9cc6-149d497fe18f req-f955d194-49cf-4407-91c6-e45d58d36acf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:23.832886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9bd29d23-dd84-4464-9cc6-149d497fe18f req-f955d194-49cf-4407-91c6-e45d58d36acf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:23.833318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9bd29d23-dd84-4464-9cc6-149d497fe18f req-f955d194-49cf-4407-91c6-e45d58d36acf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:23.884727 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9bd29d23-dd84-4464-9cc6-149d497fe18f req-f955d194-49cf-4407-91c6-e45d58d36acf service nova] Creating event network-changed:8d92b33f-bc8d-46df-83e6-4a0fdc60e24f for instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d on n-h1-862769-3 Oct 28 19:20:23.892371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9bd29d23-dd84-4464-9cc6-149d497fe18f req-f955d194-49cf-4407-91c6-e45d58d36acf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089857 Oct 28 19:20:23.893035 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1519/3023] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:23.912928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:23.913706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:23.945567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:23.946094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:23.946553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:23.954023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:23.954590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:23.963205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:24.035009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:24.035534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:24.036013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:24.036561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lazy-loading 'fault' on Instance uuid 3eb2a35b-c12b-49ca-a675-d9cddab9b81d {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:24.241655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:25.067129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9191a0b3b773465aafa4513f13138a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23996b3594d34bc3a9e5dbb5ba426fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:25.078725 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85d971b7-95ee-4670-a00a-dda237203ae8 tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 200 len: 1314 microversion: 2.1 time: 1.184417 Oct 28 19:20:25.079320 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1520/3024] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:23 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:25.087745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9440ab3f-c990-46ca-b0a5-9bfaf6137d4e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: .version_select at 0x7f1d77a1c5e0>, body: {"keypair": {"name": "tempest-keypair-1386699405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3ERV6ch511GHBpONhkcI7/KAlRat9QW5oqzA5Cinr2mHvJbvF88wvc9GmirxjKVBHzOGi8TOtfr5ClALatriEwG6z/L+10X61ohkn86Dc+vwt5dqt7UIZQHNqqPzZWqQ=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:25.129577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9440ab3f-c990-46ca-b0a5-9bfaf6137d4e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:25.138406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9440ab3f-c990-46ca-b0a5-9bfaf6137d4e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for user 7a3f354a00cf468ca48261a56f68c410 and project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:25.208414 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9440ab3f-c990-46ca-b0a5-9bfaf6137d4e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127399 Oct 28 19:20:25.210236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1521/3025] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:20:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:25.229495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:25.230530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:25.245603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:25.246419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:25.247151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:25.251774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:25.252773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:25.253497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:26.302670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:26.311371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3820475-db0a-49ed-8e57-a91264c4e8df tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 1.099803 Oct 28 19:20:26.312000 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1522/3026] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:25 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:26.333792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7ccc97a0-28e1-492d-9b26-517ec61677fd req-66723543-eff5-437a-bb2a-16d48c062abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1db064-f45c-4a74-8a9b-8f3c9cd85570", "name": "network-vif-plugged", "status": "completed", "tag": "d9abd8d1-f438-426e-bd2e-e10cddaf5b5d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:26.370983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ccc97a0-28e1-492d-9b26-517ec61677fd req-66723543-eff5-437a-bb2a-16d48c062abe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:26.371383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ccc97a0-28e1-492d-9b26-517ec61677fd req-66723543-eff5-437a-bb2a-16d48c062abe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:26.371822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ccc97a0-28e1-492d-9b26-517ec61677fd req-66723543-eff5-437a-bb2a-16d48c062abe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:26.389002 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7ccc97a0-28e1-492d-9b26-517ec61677fd req-66723543-eff5-437a-bb2a-16d48c062abe service nova] Creating event network-vif-plugged:d9abd8d1-f438-426e-bd2e-e10cddaf5b5d for instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 on n-h2-862769-3 Oct 28 19:20:26.413018 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7ccc97a0-28e1-492d-9b26-517ec61677fd req-66723543-eff5-437a-bb2a-16d48c062abe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099661 Oct 28 19:20:26.414239 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1523/3027] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:26.429587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:26.430342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] [instance: 3eb2a35b-c12b-49ca-a675-d9cddab9b81d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:26.437272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:26.437781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:26.438231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:26.438996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:26.439460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:26.439877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:26.472562 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] HTTP exception thrown: Instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d could not be found. Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Request method failure captured: Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d HTTP/1.1 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtQKM_Ye6a5bMTutAs2pqxVjxcsMj4kglj73PWMp296rG8jXWjtCPoQ88PCud_nVoogY752_RZWTlatCjpkHHke3qYsvp2L-igs81IDI3bbvcHAEhBVj5Fvwv0taYpzMBeA2EJDq6Ptec7MkpI8vf9zrAF5ZT-0DnyQ5sQuD-rdxrY Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23996b3594d34bc3a9e5dbb5ba426fdf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23996b3594d34bc3a9e5dbb5ba426fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 23996b3594d34bc3a9e5dbb5ba426fdf Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1417885203 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 9191a0b3b773465aafa4513f13138a68 Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1417885203-project Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d could not be found. Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '3eb2a35b-c12b-49ca-a675-d9cddab9b81d'} Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d could not be found. Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d could not be found. Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:26.480122 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d could not be found. Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:20:26.486050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] Returning 404 to user: Instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:26.491235 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b74cdb18-31e5-438a-b7e5-7f9040bf743e tempest-ServerMetadataNegativeTestJSON-1417885203 tempest-ServerMetadataNegativeTestJSON-1417885203-project] 10.222.0.44 "GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d" status: 404 len: 111 microversion: 2.1 time: 0.066468 Oct 28 19:20:26.492315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1524/3028] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:26 2022] GET /compute/v2.1/servers/3eb2a35b-c12b-49ca-a675-d9cddab9b81d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:20:26.578277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:26.579356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:26.580421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:26.582355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:26.583646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:26.625959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:26.629524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:26.631563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:26.634603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:26.636688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:26.644826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:26.686506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:26.695937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:26.699353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for user 42f0003698694056b69b98933c84cd8a and project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:26.732505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:26.738123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:26.851905 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75d08d3a-2a8f-45d4-a5e3-5ba660ddb29f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.171352 Oct 28 19:20:26.861955 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1505/3029] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 6176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:20:26.865650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c696dfd-040d-4a83-afff-0b8e274fc353 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:26.866313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c696dfd-040d-4a83-afff-0b8e274fc353 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:26.870222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:27.026934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-810c2f58-c53f-4054-9b1f-aa486cb35625 req-682991ba-b171-4012-bad3-5c9785783fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb2a35b-c12b-49ca-a675-d9cddab9b81d", "name": "network-vif-deleted", "tag": "04e715e9-7158-42dc-b229-8cf0e6603efc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:27.050060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-810c2f58-c53f-4054-9b1f-aa486cb35625 req-682991ba-b171-4012-bad3-5c9785783fdd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.054199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-810c2f58-c53f-4054-9b1f-aa486cb35625 req-682991ba-b171-4012-bad3-5c9785783fdd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.056292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-810c2f58-c53f-4054-9b1f-aa486cb35625 req-682991ba-b171-4012-bad3-5c9785783fdd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:27.088345 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-810c2f58-c53f-4054-9b1f-aa486cb35625 req-682991ba-b171-4012-bad3-5c9785783fdd service nova] Creating event network-vif-deleted:04e715e9-7158-42dc-b229-8cf0e6603efc for instance 3eb2a35b-c12b-49ca-a675-d9cddab9b81d on n-h1-862769-3 Oct 28 19:20:27.097733 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-810c2f58-c53f-4054-9b1f-aa486cb35625 req-682991ba-b171-4012-bad3-5c9785783fdd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074742 Oct 28 19:20:27.102637 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1506/3030] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:27.251332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c696dfd-040d-4a83-afff-0b8e274fc353 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:27.262372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c696dfd-040d-4a83-afff-0b8e274fc353 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1237 microversion: 2.1 time: 0.400542 Oct 28 19:20:27.265183 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1525/3031] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:26 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1237 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:27.349370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:27.350629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:27.390142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.392824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.394730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:27.395601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.399267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.399863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:28.292561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:28.294076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:28.305257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:28.305944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:28.307285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:28.311645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:28.312340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:28.313821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:28.676857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:28.685403 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a812feb8-8093-477f-995a-6501e11e29f1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1289 microversion: 2.1 time: 0.399093 Oct 28 19:20:28.688592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1526/3032] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:28 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1289 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:28.691281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:28.710015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-798fe132-d487-4a9e-abfb-c4c4ec596112 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 1.374540 Oct 28 19:20:28.710727 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1507/3033] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:27 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:29.712572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:29.713778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:29.721925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:29.723140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:29.723724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:29.724847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:29.725459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:29.726026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:29.737541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:29.739189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:29.757094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:29.758102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:29.766575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:29.767840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:29.768538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:29.769306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:29.795646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:30.367001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:30.383012 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ac5156a-cde4-4795-9e61-44a98d8f5b87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1295 microversion: 2.1 time: 0.673639 Oct 28 19:20:30.384365 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1527/3034] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:29 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1295 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:30.682779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:30.692313 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e88bf30f-d6ec-4e2f-93a1-e123ed824e2a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 0.958591 Oct 28 19:20:30.707600 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1508/3035] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:29 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:31.406394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:31.407124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:31.422084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:31.422235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:31.423097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:31.424073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:31.424773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:31.425265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:31.716778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:31.717398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:31.730811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:31.731506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:31.732113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:31.733009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:31.735629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:31.736074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:32.054409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:32.068245 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a0fa040-1fe0-453a-97ea-6d7b4e7bcf44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1295 microversion: 2.1 time: 0.663975 Oct 28 19:20:32.074783 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1528/3036] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:31 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1295 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:32.452916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-493315645", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c18f971-8016-410f-b296-e7a7c373023b"}], "security_groups": [{"name": "tempest-securitygroup--1476691233"}], "key_name": "tempest-keypair-1386699405", "user_data": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:32.910592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:32.927673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72ec99e3-0b06-463f-8c0e-6d43ed132c22 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 1.214672 Oct 28 19:20:32.943049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1509/3037] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:31 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:32.985348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] validate_networks() for [('3c18f971-8016-410f-b296-e7a7c373023b', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:33.383509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "43a280d1-533d-4dfb-b995-f28281a21b9c"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:33.385931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:33.406351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:33.415238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:33.416001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:33.422547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:33.423310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:33.424016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:33.746153 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] HTTP exception thrown: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Request method failure captured: Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments/2d561f8b-a7ba-4ae3-8084-d712284649eb HTTP/1.1 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 74 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCstsn8BMNeDZAuxoVbGqE7Dz7dvsa1wM73iW3yjFiv20LGaVM8McwEMi58T2Vj1Q1hcKKBw3qi01N1JJJzjFzvHjLnnPhqTwMe1NcGcBNFdAaN-ozTLIZPBVIBTGtuO5GecPwzUUijYmUohM1CH2u28H0ClJQAu-LCLUdbqo9dwjV4 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b1aff794e27541d990f3c83f05dab3bc Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesAdminNegativeTest-881100260 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1aff794e27541d990f3c83f05dab3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1aff794e27541d990f3c83f05dab3bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1aff794e27541d990f3c83f05dab3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1aff794e27541d990f3c83f05dab3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesAdminNegativeTest-881100260 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b1aff794e27541d990f3c83f05dab3bc Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-881100260 Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesAdminNegativeTest-881100260-project-admin Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 67682c986ce84d008acf3ac3a50bc00f Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesAdminNegativeTest-881100260-project-admin Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: {"volumeAttachment": {"volumeId": "43a280d1-533d-4dfb-b995-f28281a21b9c"}} Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: exception: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': 'd98ec0f4-85ad-4a57-8ef4-fabd9dc2f667', 'id': '2d561f8b-a7ba-4ae3-8084-d712284649eb', 'body': {'volumeAttachment': {'volumeId': '43a280d1-533d-4dfb-b995-f28281a21b9c'}}} Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. (HTTP 404) (Request-ID: req-c1c569e4-26eb-4a41-900a-bcb53629404f) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:20:33.878235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Returning 400 to user: Volume 43a280d1-533d-4dfb-b995-f28281a21b9c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:20:33.882420 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4ab06c2-77f7-4bc9-9cbc-bd1e5e6423be tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] 10.222.0.44 "PUT /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments/2d561f8b-a7ba-4ae3-8084-d712284649eb" status: 400 len: 107 microversion: 2.1 time: 0.936647 Oct 28 19:20:33.892722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1510/3038] 10.222.0.44 () {60 vars in 1433 bytes} [Fri Oct 28 19:20:32 2022] PUT /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments/2d561f8b-a7ba-4ae3-8084-d712284649eb => generated 107 bytes in 949 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:20:33.904419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:33.910226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:33.928286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:33.929562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:33.930527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:33.944802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:33.945342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:33.945788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:34.946146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:34.958024 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bafd6c64-c106-4f5b-8c42-51833707f5b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 1.061493 Oct 28 19:20:34.958647 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1511/3039] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:33 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:34.969183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:34.969860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:34.988032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:34.988809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:34.989592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:34.990487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:34.992892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:34.993760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:35.666116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:35.667344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:35.668513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:35.671599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:35.672311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:35.712408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:35.714074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:35.715908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:35.732971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:35.733618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:35.735098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:35.747346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:35.757449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f8fe76a1-d333-42a5-a8a1-ab4675e41eb6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 0.794024 Oct 28 19:20:35.758624 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1512/3040] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:34 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:35.780351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50e3ee98-8600-4e2f-b948-26a6e99c98b4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Action: 'create', calling method: .version_select at 0x7f1d77209c10>, body: {"keypair": {"name": "tempest-keypair-803210710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqZvyQuCOEUNpXXggYDvz+jXixWSPKYwXjAPucRBcG73OtTwSH+Jk3TavcYsPLDR/PtjNh3CPcZ/qwUPQWFR5k3Q9OR9RIiY1fbvO3kxh5vL/2tj1NFwT5UXdQ7LHL+xA=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:35.810510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:35.833661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Getting quotas for user 7a3f354a00cf468ca48261a56f68c410 and project fdd7944caa7b47adb4bc10f2804ad2cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:35.842934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-50e3ee98-8600-4e2f-b948-26a6e99c98b4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Getting quotas for project 2cca9c74aea5452981c3f96381b05cae. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:35.882491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-50e3ee98-8600-4e2f-b948-26a6e99c98b4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Getting quotas for user e71e79dfbf1c413d9c3d5c3ab45299cf and project 2cca9c74aea5452981c3f96381b05cae. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:35.907051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:35.914610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:35.982848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50e3ee98-8600-4e2f-b948-26a6e99c98b4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.222496 Oct 28 19:20:35.992520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1513/3041] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:20:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 233 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:20:36.004943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:36.009013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:36.018303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.024738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.025449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.029931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.031992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.041403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.102481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce62605f-ff04-45d7-ad7f-6ff51e8007ac tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.655070 Oct 28 19:20:36.113347 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1529/3042] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 3666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:20:36.126407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2f80448f-d060-44a4-b898-522ace8af04a req-7d903c88-350c-4add-929b-2ebdb1706806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68acfcf-a0cf-4f77-af94-6426cdb03c6d", "name": "network-vif-plugged", "status": "completed", "tag": "8d92b33f-bc8d-46df-83e6-4a0fdc60e24f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:36.172165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2f80448f-d060-44a4-b898-522ace8af04a req-7d903c88-350c-4add-929b-2ebdb1706806 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.177608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2f80448f-d060-44a4-b898-522ace8af04a req-7d903c88-350c-4add-929b-2ebdb1706806 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.179244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2f80448f-d060-44a4-b898-522ace8af04a req-7d903c88-350c-4add-929b-2ebdb1706806 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.214450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2f80448f-d060-44a4-b898-522ace8af04a req-7d903c88-350c-4add-929b-2ebdb1706806 service nova] Creating event network-vif-plugged:8d92b33f-bc8d-46df-83e6-4a0fdc60e24f for instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d on n-h1-862769-3 Oct 28 19:20:36.242656 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2f80448f-d060-44a4-b898-522ace8af04a req-7d903c88-350c-4add-929b-2ebdb1706806 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126065 Oct 28 19:20:36.245143 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1530/3043] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:36.257838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:36.258563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:36.280449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lazy-loading 'services' on Instance uuid d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:36.286164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.289078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.289792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.292324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.293019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.295270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.486161 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fa0e7f0-751f-451c-ae68-7778c2260df7 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments/2d561f8b-a7ba-4ae3-8084-d712284649eb" status: 202 len: 0 microversion: 2.1 time: 0.489781 Oct 28 19:20:36.502049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1514/3044] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:20:35 2022] DELETE /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments/2d561f8b-a7ba-4ae3-8084-d712284649eb => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:20:36.525406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2dd50fd-91a1-4e0e-bfc4-98dd57074674 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:36.526731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2dd50fd-91a1-4e0e-bfc4-98dd57074674 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:36.669967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:37.055607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d2dd50fd-91a1-4e0e-bfc4-98dd57074674 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:37.073350 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2dd50fd-91a1-4e0e-bfc4-98dd57074674 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1237 microversion: 2.1 time: 0.569057 Oct 28 19:20:37.075119 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1515/3045] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:36 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1237 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:37.095153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-94be5e12-e9a5-4f42-b302-ed806cb73bef req-1d7a1bd4-1bb4-45dd-b81a-9aea3018c6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:37.131157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-94be5e12-e9a5-4f42-b302-ed806cb73bef req-1d7a1bd4-1bb4-45dd-b81a-9aea3018c6a2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.131157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-94be5e12-e9a5-4f42-b302-ed806cb73bef req-1d7a1bd4-1bb4-45dd-b81a-9aea3018c6a2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.131157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-94be5e12-e9a5-4f42-b302-ed806cb73bef req-1d7a1bd4-1bb4-45dd-b81a-9aea3018c6a2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.165146 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-94be5e12-e9a5-4f42-b302-ed806cb73bef req-1d7a1bd4-1bb4-45dd-b81a-9aea3018c6a2 service nova] Creating event network-changed:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:20:37.178543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-94be5e12-e9a5-4f42-b302-ed806cb73bef req-1d7a1bd4-1bb4-45dd-b81a-9aea3018c6a2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101174 Oct 28 19:20:37.181484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1516/3046] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:37.198671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:37.205643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:37.222433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.228342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.229008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.233205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.237172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.238703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.351427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:37.360118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:37.364343 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a22cc6cc-0f31-4f65-8d15-81553809079c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 1.115503 Oct 28 19:20:37.364967 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1531/3047] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:36 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:37.372057 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-30fd2169-b501-415e-8632-3fd6e80a821e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183040 Oct 28 19:20:37.383370 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1517/3048] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:37 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:37.396913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:37.397788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:37.412795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.414194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.415125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.416647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.417896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.418834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.844892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:37.864597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0d65a3d-ca0e-4e9d-a483-1de407d0cc82 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1322 microversion: 2.1 time: 0.494357 Oct 28 19:20:37.865210 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1532/3049] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:37 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:38.103073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:38.104308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:38.151597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.159077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.162068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.163451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.167051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.167715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.316128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:38.332956 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b9d8fbd-6668-4011-83a0-96cb8d442e62 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1297 microversion: 2.1 time: 0.234937 Oct 28 19:20:38.353873 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1518/3050] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:38 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:38.393390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:38.394262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:38.395775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:38.398017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:38.406031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.409158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.409801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.410763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.412526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.415866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.437450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.438019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.438475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.451854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.455584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.456897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.557202 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a47a8fe2-4fa8-4f21-8625-c1e836bfe555 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170559 Oct 28 19:20:38.570882 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1533/3051] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:38 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:38.730145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:38.740013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b7b3d813-00a8-4f3a-92e0-70a2db2dc579 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 0.351674 Oct 28 19:20:38.744112 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1519/3052] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:38 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:38.888576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:38.889257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:38.903759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.905329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.905859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.906523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.910320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.911249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.183409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:39.193085 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-db6186df-437c-4e1d-9c21-6938253b0913 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1514 microversion: 2.1 time: 0.309028 Oct 28 19:20:39.196427 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1534/3053] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:38 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:39.216580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:39.220434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:39.246576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.247513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.248456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.249524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.250435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.251203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.289982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lazy-loading 'flavor' on Instance uuid f68acfcf-a0cf-4f77-af94-6426cdb03c6d {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:20:39.363262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:39.364119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:39.374706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.376292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.378347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.379802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.381725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.383902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.477071 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f30f04d1-2609-4189-96d6-9ff7a486f944 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action" status: 200 len: 32 microversion: 2.1 time: 0.263570 Oct 28 19:20:39.479120 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1520/3054] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:20:39 2022] POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:20:39.500561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:39.504098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:39.528967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.533392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.534483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.536824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.537458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.539387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.779043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:39.791149 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9139a140-b24f-47ba-9b9f-14cf83ddb635 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1295 microversion: 2.1 time: 0.431615 Oct 28 19:20:39.794638 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1535/3055] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:39 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1295 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:39.805131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:39.814062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:39.830977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.831700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.835100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.835929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.836413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.841503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.926279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e82b2d6-d9ff-4a92-a432-5860c25f89de tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130254 Oct 28 19:20:39.936443 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1536/3056] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:39 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:39.945379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:39.950856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:39.965848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.966344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.971022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.972161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.972838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.973872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:40.917479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:40.926112 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42db2128-5d47-4bd3-b664-99a7b87aa716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 1.441921 Oct 28 19:20:40.938836 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1521/3057] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:39 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:40.947181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:40.948120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:40.961425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:40.966878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:40.967867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:40.969060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:40.970719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:40.980116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:42.081982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:42.098306 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eaac0331-5298-4553-adce-65244b50aa61 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 2.160578 Oct 28 19:20:42.098879 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1537/3058] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:39 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:42.113397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:42.125543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:42.145777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:42.146286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:42.146747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:42.147477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:42.147936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:42.148379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:42.253312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c74a2028-0a21-4dbb-b50f-f00cf0188c98 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146917 Oct 28 19:20:42.255971 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1538/3059] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:42 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:42.266247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:42.271079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:42.284526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:42.288255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:42.292879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:42.294493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:42.296629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:42.298577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:42.538643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:42.563911 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e110474-c84c-4452-8888-3c0e02901a3d tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1363 microversion: 2.1 time: 1.623595 Oct 28 19:20:42.567170 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1522/3060] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:40 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1363 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:43.124415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:43.125031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:43.143120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.143617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.144051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.152886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.154361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.155720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.634892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:43.655768 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e0c9e5e0-c30e-4bf7-93c5-e27620c20aa3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 1.394169 Oct 28 19:20:43.657790 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1539/3061] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:42 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:43.691077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:43.705323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:43.729581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.730105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.730566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.731297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.739319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.740040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.845685 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-941764fc-ef55-4b23-b1f2-e433ed81573e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167155 Oct 28 19:20:43.847367 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1540/3062] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:43 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:43.868635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d4b760e0-0541-462f-a2be-a739028f65f1 req-76c9200e-fa7b-4cde-aefa-9a200926adcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1382020a-761f-4edd-902f-ceb8944d0585", "tag": "62150461-e199-4de2-af0f-34998e176ea8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:43.896052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d4b760e0-0541-462f-a2be-a739028f65f1 req-76c9200e-fa7b-4cde-aefa-9a200926adcb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.898290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d4b760e0-0541-462f-a2be-a739028f65f1 req-76c9200e-fa7b-4cde-aefa-9a200926adcb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.908822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:43.910117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d4b760e0-0541-462f-a2be-a739028f65f1 req-76c9200e-fa7b-4cde-aefa-9a200926adcb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.923674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a27c817-22b7-4a88-b26e-dedd3aa978dc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 0.803242 Oct 28 19:20:43.926449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1523/3063] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:43 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:43.946548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:43.947633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:43.952654 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d4b760e0-0541-462f-a2be-a739028f65f1 req-76c9200e-fa7b-4cde-aefa-9a200926adcb service nova] Creating event network-changed:62150461-e199-4de2-af0f-34998e176ea8 for instance 1382020a-761f-4edd-902f-ceb8944d0585 on n-h2-862769-3 Oct 28 19:20:43.963036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.967033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.968847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.969992 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d4b760e0-0541-462f-a2be-a739028f65f1 req-76c9200e-fa7b-4cde-aefa-9a200926adcb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113433 Oct 28 19:20:43.972590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:43.973349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:43.974224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:43.975526 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1541/3064] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:44.685497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:44.686956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:44.705451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:44.708714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:44.710325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:44.712324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:44.715033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:44.720048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:44.868746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:44.893257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b53e6b9f-6be9-4d08-ae73-ce74355b1f2a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1363 microversion: 2.1 time: 0.965343 Oct 28 19:20:44.908773 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1524/3065] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:43 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1363 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:44.933774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:44.936237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:44.982284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:44.982810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:44.983473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:44.987482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:44.988047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:44.988487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:45.097723 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f67f48fb-b2af-4af1-ac98-338ee3ed940e tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187478 Oct 28 19:20:45.098333 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1525/3066] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:44 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:45.118530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:45.121893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:45.145258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:45.145769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:45.146201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:45.159845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:45.160597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:45.161195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:45.270933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:45.291980 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01348a8d-2bb2-47ca-92a8-256511d56030 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.601701 Oct 28 19:20:45.293308 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1542/3067] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:44 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:45.460562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1638188709", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dc5db5a6-0010-4ed2-b7f2-492ea2c09dec"}, {"port": "8863b8c0-1e3b-4e0c-9702-077d59002e68", "tag": "port-1"}, {"port": "fd46a76b-d76c-49eb-b708-b512909cfaf3", "tag": "port-2"}, {"uuid": "09a374e2-3e5f-4033-b0b4-110e70607994", "tag": "net-1"}, {"uuid": "09a374e2-3e5f-4033-b0b4-110e70607994"}, {"uuid": "fa706963-6a2c-485a-93ac-d14c573f8506", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fa706963-6a2c-485a-93ac-d14c573f8506", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "42e369ed-9391-4691-9e28-9331a950b522", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "42fa56a2-097d-4d83-b81f-cf2437fc53a4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4ddc27b4-830f-4b93-9168-19c9aa15d6d0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1690411589"}], "key_name": "tempest-keypair-803210710", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:45.665104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:45.676006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53607b63-1ea9-4fdc-8200-a0c7e81df0e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 0.573767 Oct 28 19:20:45.680417 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1526/3068] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:45 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:45.733511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] validate_networks() for [('dc5db5a6-0010-4ed2-b7f2-492ea2c09dec', None, None, None, None, None), (None, None, '8863b8c0-1e3b-4e0c-9702-077d59002e68', None, None, None), (None, None, 'fd46a76b-d76c-49eb-b708-b512909cfaf3', None, None, None), ('09a374e2-3e5f-4033-b0b4-110e70607994', None, None, None, None, None), ('09a374e2-3e5f-4033-b0b4-110e70607994', None, None, None, None, None), ('fa706963-6a2c-485a-93ac-d14c573f8506', '10.2.2.100', None, None, None, None), ('fa706963-6a2c-485a-93ac-d14c573f8506', '10.2.2.200', None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:45.760858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:45.879696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:45.936402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:45.937601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:45.952397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:45.953103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:45.953966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:45.954887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:45.955495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:45.956068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:46.486596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:46.500059 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b1c903d3-6b0a-4e08-99d4-254455aa8ccd tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1363 microversion: 2.1 time: 0.564502 Oct 28 19:20:46.514802 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1527/3069] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:45 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:46.514802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:46.516766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:46.533945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:46.535133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:46.535774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:46.536760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:46.537448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:46.538198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:46.591100 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22941e24-bbca-4321-b6bc-341f696d3106 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087054 Oct 28 19:20:46.592175 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1528/3070] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:46 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:46.598166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:46.598953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:46.605956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:46.606565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:46.607123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:46.608381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:46.609857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:46.610535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:47.001437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:47.022812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e44734e-2ab0-4ab1-9105-ea03ce8c7bb2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.422876 Oct 28 19:20:47.037508 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1529/3071] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:46 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:47.065509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:47.327559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-756441974", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7db868fe-f747-42bf-8e1d-4e71adf40fa7"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:47.433107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] validate_networks() for [('7db868fe-f747-42bf-8e1d-4e71adf40fa7', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:48.264109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:48.265835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:48.266521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:48.267243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:48.270350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:48.287879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:48.288663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:48.289548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:48.292068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:48.293059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:48.294708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:48.326483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Getting quotas for project e3fef86a6de14e1a9f37d3aa5b3dce77. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:48.334215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Getting quotas for user 2b85316cfd644d49b7350b33a102f6d3 and project e3fef86a6de14e1a9f37d3aa5b3dce77. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:48.362324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Going to run 3 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:48.365455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:48.423009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:48.467846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=df6dd28b-dfb3-45e6-94c9-500cb8597591,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:48.548077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8693ea9-9335-47d2-acd4-b6d145ac5b86 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508986 Oct 28 19:20:48.555909 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1530/3072] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:20:48.561423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:48.562057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:48.568467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:48.568969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:48.569661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:48.570373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:48.570877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:48.571302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:48.871943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:48.885318 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe417a2e-3e0e-4ac3-9ad8-5dcba219c29e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 0.327991 Oct 28 19:20:48.887304 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1531/3073] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:48 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:49.014111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17c4dfb4-7313-49ca-adec-b322a920c611 tempest-ComputeTenantNetworksTest-1787058914 tempest-ComputeTenantNetworksTest-1787058914-project] Calling method '.version_select at 0x7f1d7c177430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:49.418949 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17c4dfb4-7313-49ca-adec-b322a920c611 tempest-ComputeTenantNetworksTest-1787058914 tempest-ComputeTenantNetworksTest-1787058914-project] 10.222.0.44 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.530319 Oct 28 19:20:49.422791 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1532/3074] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:20:48 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:49.428558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-8f932ac1-2e04-4e3a-9ec0-c2124d076ae8 req-ca16a159-2924-4598-b390-91a94336ed08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-plugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:49.452902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8f932ac1-2e04-4e3a-9ec0-c2124d076ae8 req-ca16a159-2924-4598-b390-91a94336ed08 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:49.453353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8f932ac1-2e04-4e3a-9ec0-c2124d076ae8 req-ca16a159-2924-4598-b390-91a94336ed08 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:49.454155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8f932ac1-2e04-4e3a-9ec0-c2124d076ae8 req-ca16a159-2924-4598-b390-91a94336ed08 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:49.471713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-8f932ac1-2e04-4e3a-9ec0-c2124d076ae8 req-ca16a159-2924-4598-b390-91a94336ed08 service nova] Creating event network-vif-plugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:20:49.484233 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-8f932ac1-2e04-4e3a-9ec0-c2124d076ae8 req-ca16a159-2924-4598-b390-91a94336ed08 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059530 Oct 28 19:20:49.485460 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1533/3075] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:49.493026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:49.494083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:49.501977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:49.502741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:49.503451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:49.504422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:49.505112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:49.505746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:49.893513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:49.897980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:49.912853 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-239e3fed-5f78-48c9-813a-b2ee7d6e4174 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1363 microversion: 2.1 time: 0.425450 Oct 28 19:20:49.928582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1534/3076] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:49 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:49.938456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:49.942442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:49.959705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:49.973499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:49.974303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:49.976270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:49.977267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:49.979391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:49.980171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.041200 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd326c4f-05be-4893-be09-8baba6f7f632 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110579 Oct 28 19:20:50.041890 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1535/3077] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:20:49 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:20:50.047147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:50.058987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:50.076369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.076845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.077267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.077961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.078468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.078855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.175340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:50.187311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:50.187965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:50.195673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:50.198007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:50.209549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.210599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.211306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.212349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.213017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.213687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.259286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Getting quotas for project 2cca9c74aea5452981c3f96381b05cae. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:50.267033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Getting quotas for user e71e79dfbf1c413d9c3d5c3ab45299cf and project 2cca9c74aea5452981c3f96381b05cae. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:50.347472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:50.356684 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bcc8839f-72a2-4d46-8758-0cd777e95c23 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.313478 Oct 28 19:20:50.365249 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1536/3078] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:50 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:50.375712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:50.383772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:50.383897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:20:50.394069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.395464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.396222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.397555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.398203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.398842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.451296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:20:50.511763 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6449ff37-0e6c-45c0-99c2-8abeaedf6cf4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.145285 Oct 28 19:20:50.512479 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1537/3079] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:20:50 2022] GET /compute/v2.1/servers => generated 1015 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:50.520344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8c7e6e4-7e83-403e-83d3-aebc27b37d6c tempest-ComputeTenantNetworksTest-1787058914 tempest-ComputeTenantNetworksTest-1787058914-project] Calling method '.version_select at 0x7f1d7c1ea940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:50.626609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:50.631216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='42e369ed-9391-4691-9e28-9331a950b522',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='42fa56a2-097d-4d83-b81f-cf2437fc53a4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ddc27b4-830f-4b93-9168-19c9aa15d6d0',volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:50.701124 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8c7e6e4-7e83-403e-83d3-aebc27b37d6c tempest-ComputeTenantNetworksTest-1787058914 tempest-ComputeTenantNetworksTest-1787058914-project] 10.222.0.44 "GET /compute/v2.1/os-tenant-networks/ef9fa8ad-1536-4394-8cf6-a726f8879b8c" status: 200 len: 140 microversion: 2.1 time: 0.185282 Oct 28 19:20:50.701778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1538/3080] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:20:50 2022] GET /compute/v2.1/os-tenant-networks/ef9fa8ad-1536-4394-8cf6-a726f8879b8c => generated 140 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:50.708665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:50.710241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:50.729230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.730541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.731179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:50.736497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:50.738075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:50.739615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:51.316390 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f6e3951e-e457-44eb-9396-b88d4d81e9ca tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.859787 Oct 28 19:20:51.323630 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1543/3081] 10.222.0.44 () {62 vars in 1189 bytes} [Fri Oct 28 19:20:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 5868 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 19:20:51.331265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1286306339", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "b3e2bd2d-4c61-42fb-a801-89dc4711a217"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:51.418259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] validate_networks() for [('b3e2bd2d-4c61-42fb-a801-89dc4711a217', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:20:51.505053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:51.518900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98e9a99e-7e7c-48c5-b36f-c055e736590a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1362 microversion: 2.1 time: 0.815502 Oct 28 19:20:51.524166 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1539/3082] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:50 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:51.534612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:51.535577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:51.548373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:51.549152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:51.549750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:51.552098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:51.552738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:51.553664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:52.335454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:52.344908 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af939dd7-f2a3-4081-bf26-0a80bbf4125e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1218 microversion: 2.1 time: 0.817918 Oct 28 19:20:52.345841 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1540/3083] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:51 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1218 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:52.362093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:52.363361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:52.399022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:52.401948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:52.416833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:52.417618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:52.418092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:52.427656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.068487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:53.078639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-477f8c3f-43c9-41e8-b5fd-ca7d2b395596 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1363 microversion: 2.1 time: 0.731231 Oct 28 19:20:53.080181 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1541/3084] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:52 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1363 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:53.086282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:53.087196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:53.094661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.095867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.096823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.097839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.098497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.099234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.264268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:20:53.264736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:20:53.265164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:20:53.265574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:20:53.265985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:20:53.292647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.293672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.294371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.300339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.301292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.301905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.329066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Getting quotas for project c3084e2b5c2a49a9887a6f9ebf8a2993. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:20:53.341114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Getting quotas for user e14650c88086424cb2f7e27ffe97d6c2 and project c3084e2b5c2a49a9887a6f9ebf8a2993. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:20:53.363247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:20:53.376524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:20:53.419768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:53.449381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:53.454536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:53.456768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-074005cf-c899-460e-81fe-2e22fbab3779 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1519 microversion: 2.32 time: 0.375226 Oct 28 19:20:53.459968 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1542/3085] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:20:53 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1519 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:20:53.483620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:53.486391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:53.507723 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5baa29a-126e-4c9a-9658-1c72abfc0d90 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179135 Oct 28 19:20:53.516741 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1544/3086] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:20:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:20:53.525613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.527913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.529936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.532741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.536903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e7955ccc-e4dc-4209-979c-ce4b53d9152e req-e83c0085-bd5c-4f78-a0d4-32d16263e7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1382020a-761f-4edd-902f-ceb8944d0585", "name": "network-vif-plugged", "status": "completed", "tag": "62150461-e199-4de2-af0f-34998e176ea8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:53.549170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.549632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.550994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e7955ccc-e4dc-4209-979c-ce4b53d9152e req-e83c0085-bd5c-4f78-a0d4-32d16263e7da service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.551577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e7955ccc-e4dc-4209-979c-ce4b53d9152e req-e83c0085-bd5c-4f78-a0d4-32d16263e7da service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.552261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e7955ccc-e4dc-4209-979c-ce4b53d9152e req-e83c0085-bd5c-4f78-a0d4-32d16263e7da service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.584866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e7955ccc-e4dc-4209-979c-ce4b53d9152e req-e83c0085-bd5c-4f78-a0d4-32d16263e7da service nova] Creating event network-vif-plugged:62150461-e199-4de2-af0f-34998e176ea8 for instance 1382020a-761f-4edd-902f-ceb8944d0585 on n-h2-862769-3 Oct 28 19:20:53.591855 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e7955ccc-e4dc-4209-979c-ce4b53d9152e req-e83c0085-bd5c-4f78-a0d4-32d16263e7da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071569 Oct 28 19:20:53.597592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1545/3087] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:53.605436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:53.606394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:53.614957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.615671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.616266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:53.617148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:53.617757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:53.618331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.217607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:54.231155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4651a2f6-49a0-4179-91ad-f25e98e1627b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.766996 Oct 28 19:20:54.232627 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1543/3088] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:53 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:54.238331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:54.239136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:54.245541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.247628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.248537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.250260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.252506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.255579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.342901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:54.358084 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0150a6f-5ca1-46b0-b05d-53e82e30028c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1548 microversion: 2.1 time: 0.755323 Oct 28 19:20:54.360053 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1546/3089] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:53 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1548 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:54.380067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:54.407251 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0a048dd-1ede-451a-a6a7-3e8fec523567 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1280 microversion: 2.1 time: 0.169183 Oct 28 19:20:54.408899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:54.409905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:54.427520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1544/3090] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:54 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:54.439170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.451762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:54.451762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:54.454440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.456919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.458070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.458925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.461197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.461988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.475151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.475708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.478258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.479980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.481055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.736820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:54.748690 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efe2a6f1-6e88-4d0c-8c45-1e6d7c45a9b9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1222 microversion: 2.1 time: 0.371874 Oct 28 19:20:54.749890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1547/3091] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:54 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1222 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:54.759891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:54.765238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:54.780846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.782062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.784989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.786811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:54.789894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:54.790665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:54.805622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:54.994467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:55.003106 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f8d812b-b95e-4a43-822d-3d86746b9d67 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1363 microversion: 2.1 time: 0.573335 Oct 28 19:20:55.018506 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1545/3092] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:54 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1363 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:55.024174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:55.025188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:55.031887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:55.032759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:55.033423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:55.034392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:55.035452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:55.036418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:55.087565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-86b89122-596f-4ce1-acf4-5943a1d99a69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335590 Oct 28 19:20:55.088774 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1548/3093] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:20:54 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:55.259802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:55.260583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:55.271092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:55.274030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:55.274779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:55.275643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:55.280007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:55.284261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:55.292641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:55.299414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:55.302660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:55.308612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e4eab23-c8e0-4cd2-a56c-eb141ac6f700 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1593 microversion: 2.32 time: 0.288575 Oct 28 19:20:55.312170 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1546/3094] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:20:55 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1593 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:20:55.438529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:55.439717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:55.465901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:55.467110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:55.468330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:55.469670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:55.471996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:55.474040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:56.626015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:56.641658 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-042d8f59-86b3-41b7-85ae-a8d02b618e65 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1280 microversion: 2.1 time: 1.209520 Oct 28 19:20:56.645079 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1547/3095] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:55 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1280 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:56.664351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:56.665306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:56.685863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:56.686395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:56.686907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:56.687657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:56.688769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:56.689906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:56.953509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:56.962302 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c2131ac-1c5d-49a7-a285-a0c4413057a5 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1276 microversion: 2.1 time: 0.315855 Oct 28 19:20:56.975639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1548/3096] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:56 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:56.982837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:56.983851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:57.017810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:57.018887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:57.019599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:57.020538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:57.021158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:57.021753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:57.629827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:57.645093 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8a96b8ee-f4bd-46cf-8e61-1d91807b60b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 2.382585 Oct 28 19:20:57.645959 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1549/3097] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:55 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:57.674160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:57.674988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:57.691771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:57.693332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:57.693863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:57.694316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:57.695140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:57.695600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:57.696664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:58.344302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:58.430440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:58.449878 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a63164f-ca03-4474-8997-c7e82cdb3340 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1549 microversion: 2.1 time: 1.472401 Oct 28 19:20:58.450833 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1549/3098] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:56 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1549 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:58.458276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a9daf28b-5528-4a7e-8bc3-7ed1d7ffc74b req-e37cd9ef-ddd0-4490-8206-99ca721b7378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6dd28b-dfb3-45e6-94c9-500cb8597591", "tag": "376fab2b-1597-45d7-93d8-b95eb9f27f56"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:58.504255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a9daf28b-5528-4a7e-8bc3-7ed1d7ffc74b req-e37cd9ef-ddd0-4490-8206-99ca721b7378 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:58.505878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a9daf28b-5528-4a7e-8bc3-7ed1d7ffc74b req-e37cd9ef-ddd0-4490-8206-99ca721b7378 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:58.506331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a9daf28b-5528-4a7e-8bc3-7ed1d7ffc74b req-e37cd9ef-ddd0-4490-8206-99ca721b7378 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:58.541669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a9daf28b-5528-4a7e-8bc3-7ed1d7ffc74b req-e37cd9ef-ddd0-4490-8206-99ca721b7378 service nova] Creating event network-changed:376fab2b-1597-45d7-93d8-b95eb9f27f56 for instance df6dd28b-dfb3-45e6-94c9-500cb8597591 on n-h2-862769-3 Oct 28 19:20:58.563447 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a9daf28b-5528-4a7e-8bc3-7ed1d7ffc74b req-e37cd9ef-ddd0-4490-8206-99ca721b7378 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110904 Oct 28 19:20:58.564228 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1550/3099] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:20:58.575247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:58.575247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:20:58.614212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:58.626895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:58.628702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:58.629475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:58.629969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:58.630407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:59.974078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:59.986357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:59.988288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:59.990463 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0aa0595d-4806-49bb-8eb1-75df06de31ea tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1661 microversion: 2.32 time: 2.342663 Oct 28 19:21:00.006746 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1550/3100] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:20:57 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1661 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:00.022511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:00.025892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:00.051235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.052160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.055861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.057483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.058538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.060915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.187288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:00.208774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-791a22bc-d19e-4951-80f4-1ec320de7705 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 1.643425 Oct 28 19:21:00.209380 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1551/3101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:58 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:00.214258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:00.214788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:00.246505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.247028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.247458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.248170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.248627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.249045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.405832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:00.635646 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b951b4e-6c6a-42bf-baa6-fa4651dbb5a7 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.424287 Oct 28 19:21:00.642866 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1552/3102] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:21:00 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-interface => generated 284 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:00.667532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1f3ac66-5153-4655-804a-840ed2fdabfa tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d77dc7940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:00.798612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1f3ac66-5153-4655-804a-840ed2fdabfa tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/7bf61446-f637-4e71-b70a-5bc889ffd61b" status: 200 len: 351 microversion: 2.1 time: 0.152274 Oct 28 19:21:00.799351 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1553/3103] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:21:00 2022] GET /compute/v2.1/os-volumes/7bf61446-f637-4e71-b70a-5bc889ffd61b => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:00.805580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:00.807455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:00.837928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.839763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.840265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.843745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.844259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.844698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.854629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:00.887920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:00.899703 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f365bba-e5d7-4951-8f2b-edaa9e683268 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 0.892388 Oct 28 19:21:00.900863 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1551/3104] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:00 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:00.907582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-cadb85d3-a207-46d6-9c29-069555f58313 req-3ce3b745-77f9-4ec9-87f9-91d6f69659f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8630beb-6d10-42f0-8862-979dde98c74c", "tag": "abee9c23-0008-4980-b817-d2d1e84210b1"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:00.931487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cadb85d3-a207-46d6-9c29-069555f58313 req-3ce3b745-77f9-4ec9-87f9-91d6f69659f1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:00.932584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cadb85d3-a207-46d6-9c29-069555f58313 req-3ce3b745-77f9-4ec9-87f9-91d6f69659f1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:00.936174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cadb85d3-a207-46d6-9c29-069555f58313 req-3ce3b745-77f9-4ec9-87f9-91d6f69659f1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:00.965762 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-cadb85d3-a207-46d6-9c29-069555f58313 req-3ce3b745-77f9-4ec9-87f9-91d6f69659f1 service nova] Creating event network-changed:abee9c23-0008-4980-b817-d2d1e84210b1 for instance d8630beb-6d10-42f0-8862-979dde98c74c on n-h1-862769-3 Oct 28 19:21:00.976813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-cadb85d3-a207-46d6-9c29-069555f58313 req-3ce3b745-77f9-4ec9-87f9-91d6f69659f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074037 Oct 28 19:21:00.979671 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1552/3105] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:01.022424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:01.024220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:01.033813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:01.034810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:01.036785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:01.039434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:01.041117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:01.044448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:01.701954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:01.713681 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62d023d2-41c6-4c5b-a30b-28c5b9d08c9b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.912873 Oct 28 19:21:01.717977 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1554/3106] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:00 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:01.723202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:01.723826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:01.746998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:01.746998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:01.747388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:01.748128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:01.748589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:01.749011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:02.031318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:02.054783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:02.059469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:02.064476 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-17d45d2f-0d07-4602-8b82-ac715b710e5f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1661 microversion: 2.32 time: 1.046458 Oct 28 19:21:02.065330 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1553/3107] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:01 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1661 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:02.075282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:02.085635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:02.117078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:02.117883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:02.118509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:02.122125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:02.126554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:02.127360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:03.311922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:03.316303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:03.326726 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8bd218c8-d3d3-44f1-97a1-ec135223a221 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 1.607358 Oct 28 19:21:03.327900 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1555/3108] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:01 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:03.334682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4b30c7a3-159c-4bab-a7c7-3adb0cb3bc09 req-4d3efc56-7015-4c2d-86f4-0b5fb5562eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6dd28b-dfb3-45e6-94c9-500cb8597591", "name": "network-vif-plugged", "status": "completed", "tag": "376fab2b-1597-45d7-93d8-b95eb9f27f56"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:03.356382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:03.360128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4b30c7a3-159c-4bab-a7c7-3adb0cb3bc09 req-4d3efc56-7015-4c2d-86f4-0b5fb5562eaa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:03.360627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4b30c7a3-159c-4bab-a7c7-3adb0cb3bc09 req-4d3efc56-7015-4c2d-86f4-0b5fb5562eaa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:03.361069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4b30c7a3-159c-4bab-a7c7-3adb0cb3bc09 req-4d3efc56-7015-4c2d-86f4-0b5fb5562eaa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:03.393856 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4b30c7a3-159c-4bab-a7c7-3adb0cb3bc09 req-4d3efc56-7015-4c2d-86f4-0b5fb5562eaa service nova] Creating event network-vif-plugged:376fab2b-1597-45d7-93d8-b95eb9f27f56 for instance df6dd28b-dfb3-45e6-94c9-500cb8597591 on n-h2-862769-3 Oct 28 19:21:03.410857 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4b30c7a3-159c-4bab-a7c7-3adb0cb3bc09 req-4d3efc56-7015-4c2d-86f4-0b5fb5562eaa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080538 Oct 28 19:21:03.415095 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1556/3109] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:03.421455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:03.423348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:03.440558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:03.441148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:03.441587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:03.442290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:03.443046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:03.444403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:03.591974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:03.602358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-914fec93-e108-4cb4-9688-78fff6828efd tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 1.532661 Oct 28 19:21:03.603746 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1554/3110] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:02 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:03.608946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:03.609892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:03.616255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:03.617307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:03.617985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:03.618934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:03.619603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:03.620255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:04.386227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:04.414248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:04.418845 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3484eae2-b697-4312-a4aa-80e06b0dd519 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 1.001427 Oct 28 19:21:04.421928 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1557/3111] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:03 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:04.430470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:04.432684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7fb41919-1ced-46e7-bade-7f61b988e49c tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d7c1778b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:04.437168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:04.438390 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3ac80a9-f735-46de-bb56-1a57c63c5eaf tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1708 microversion: 2.32 time: 0.833460 Oct 28 19:21:04.454736 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1555/3112] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:03 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1708 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:04.454736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d7215d02-3bbb-460c-b543-e9f208e9d942 req-aff79a87-b89a-4545-aa92-72cbed79ade8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1382020a-761f-4edd-902f-ceb8944d0585", "tag": "62150461-e199-4de2-af0f-34998e176ea8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:04.491490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d7215d02-3bbb-460c-b543-e9f208e9d942 req-aff79a87-b89a-4545-aa92-72cbed79ade8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:04.491988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d7215d02-3bbb-460c-b543-e9f208e9d942 req-aff79a87-b89a-4545-aa92-72cbed79ade8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:04.492423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d7215d02-3bbb-460c-b543-e9f208e9d942 req-aff79a87-b89a-4545-aa92-72cbed79ade8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:04.523362 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d7215d02-3bbb-460c-b543-e9f208e9d942 req-aff79a87-b89a-4545-aa92-72cbed79ade8 service nova] Creating event network-changed:62150461-e199-4de2-af0f-34998e176ea8 for instance 1382020a-761f-4edd-902f-ceb8944d0585 on n-h2-862769-3 Oct 28 19:21:04.540298 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d7215d02-3bbb-460c-b543-e9f208e9d942 req-aff79a87-b89a-4545-aa92-72cbed79ade8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092034 Oct 28 19:21:04.541273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1556/3113] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:04.558086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e959e5ab-b85c-4021-999d-5b7f16c5a219 req-34b04b48-8704-4b86-9dc2-31cdeba13c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b91a78-37e5-45b4-882c-28fa94cbf587", "tag": "645c15b9-9053-49f5-bc5a-9f83255db076"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:04.577513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e959e5ab-b85c-4021-999d-5b7f16c5a219 req-34b04b48-8704-4b86-9dc2-31cdeba13c92 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:04.580298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e959e5ab-b85c-4021-999d-5b7f16c5a219 req-34b04b48-8704-4b86-9dc2-31cdeba13c92 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:04.580921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e959e5ab-b85c-4021-999d-5b7f16c5a219 req-34b04b48-8704-4b86-9dc2-31cdeba13c92 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:04.615429 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e959e5ab-b85c-4021-999d-5b7f16c5a219 req-34b04b48-8704-4b86-9dc2-31cdeba13c92 service nova] Creating event network-changed:645c15b9-9053-49f5-bc5a-9f83255db076 for instance 90b91a78-37e5-45b4-882c-28fa94cbf587 on n-h1-862769-3 Oct 28 19:21:04.622012 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e959e5ab-b85c-4021-999d-5b7f16c5a219 req-34b04b48-8704-4b86-9dc2-31cdeba13c92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079247 Oct 28 19:21:04.623091 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1557/3114] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:04.628233 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7fb41919-1ced-46e7-bade-7f61b988e49c tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f049341d-21dc-4930-b80c-db7121ab265f" status: 200 len: 350 microversion: 2.1 time: 0.203539 Oct 28 19:21:04.628928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:04.629826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1558/3115] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:21:04 2022] GET /compute/v2.1/os-volumes/f049341d-21dc-4930-b80c-db7121ab265f => generated 350 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:04.630014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:04.636627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:04.649663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:04.652730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:04.653264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:04.654033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:04.654508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:04.655121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:04.656911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:04.678212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:04.683592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:04.686435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:04.689007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:04.691272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:04.693340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:05.759382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:05.792377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-87996ba4-28a2-4e81-a207-211ade56bf65 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 1.157598 Oct 28 19:21:05.793260 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1559/3116] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:04 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:05.816689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:05.826052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:05.848718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:05.849455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:05.850156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:05.851297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:05.875114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:05.876369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:06.580000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:06.594478 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a588e0c-27e4-483a-b8bf-c240273d80a4 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 1.969020 Oct 28 19:21:06.596536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:06.602256 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1558/3117] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:04 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:06.619700 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3cea1efd-aba1-4082-b2cd-f1334881afd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.822226 Oct 28 19:21:06.620314 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1560/3118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:05 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:06.637190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:06.638307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:06.650062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:06.654684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:06.658093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:06.659115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:06.660829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:06.664316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:06.818040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:06.818659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:06.826144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:06.831034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:06.832008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:06.834395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:06.835139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:06.837446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:07.527887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:07.540524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5113cb24-6ff1-44c1-b37c-f8926256952d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 0.726746 Oct 28 19:21:07.541434 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1561/3119] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:06 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:07.558883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659", "tag": "8865ad41-e1f7-4f21-84a3-a4cf533ab343"}, {"name": "network-changed", "server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:07.577714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:07.578271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:07.578739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:07.616821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] Creating event network-changed:8865ad41-e1f7-4f21-84a3-a4cf533ab343 for instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 on n-h1-862769-3 Oct 28 19:21:07.618254 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] Creating event network-changed:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:21:07.626421 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4089924b-5eee-4323-8918-b2a03fdc7a49 req-7746d7c1-f427-4e9d-9add-6cb96fe40cbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076956 Oct 28 19:21:07.627924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1562/3120] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:07.630623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:07.649667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d7921d52-d3ca-40f6-82bb-1cf67701899f req-4c897eca-97a0-41f2-a50f-8bf4d7bfbcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8630beb-6d10-42f0-8862-979dde98c74c", "name": "network-vif-plugged", "status": "completed", "tag": "abee9c23-0008-4980-b817-d2d1e84210b1"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:07.661170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:07.662377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7921d52-d3ca-40f6-82bb-1cf67701899f req-4c897eca-97a0-41f2-a50f-8bf4d7bfbcce service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:07.663733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7921d52-d3ca-40f6-82bb-1cf67701899f req-4c897eca-97a0-41f2-a50f-8bf4d7bfbcce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:07.664330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d7921d52-d3ca-40f6-82bb-1cf67701899f req-4c897eca-97a0-41f2-a50f-8bf4d7bfbcce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:07.665128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:07.667003 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-40e7d738-7251-45e3-b792-5e6742668828 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1708 microversion: 2.32 time: 1.062208 Oct 28 19:21:07.669496 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1559/3121] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:06 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1708 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:07.675881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70f39a41-5753-4dc0-a03e-79479bcf5d4b tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d779fb5e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:07.692260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d7921d52-d3ca-40f6-82bb-1cf67701899f req-4c897eca-97a0-41f2-a50f-8bf4d7bfbcce service nova] Creating event network-vif-plugged:abee9c23-0008-4980-b817-d2d1e84210b1 for instance d8630beb-6d10-42f0-8862-979dde98c74c on n-h1-862769-3 Oct 28 19:21:07.702267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d7921d52-d3ca-40f6-82bb-1cf67701899f req-4c897eca-97a0-41f2-a50f-8bf4d7bfbcce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069805 Oct 28 19:21:07.704967 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1563/3122] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:07.719911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:07.721185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:07.734072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:07.734563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:07.735027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:07.735764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:07.736214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:07.736638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:07.780072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70f39a41-5753-4dc0-a03e-79479bcf5d4b tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6cfaab71-69f6-4c3f-bd7b-6724afd86a4f" status: 200 len: 350 microversion: 2.1 time: 0.108956 Oct 28 19:21:07.791403 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1560/3123] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:21:07 2022] GET /compute/v2.1/os-volumes/6cfaab71-69f6-4c3f-bd7b-6724afd86a4f => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:07.801557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:07.802472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:07.817179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:07.819656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:07.820281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:07.824813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:07.825473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:07.826094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:08.156137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:08.162976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:08.167100 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-87aa66c5-d344-40a8-be7d-bb22a0467c30 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 0.460546 Oct 28 19:21:08.182729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1564/3124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:07 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:08.183175 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd9b8952-1888-4c5a-84d0-047587342a1e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.380156 Oct 28 19:21:08.183175 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1561/3125] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:07 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:08.183374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e32f1bc-bd18-409b-9457-53e5d56322ac tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d7ff5c310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:08.311140 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e32f1bc-bd18-409b-9457-53e5d56322ac tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.140982 Oct 28 19:21:08.313100 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1565/3126] 10.222.0.44 () {58 vars in 1134 bytes} [Fri Oct 28 19:21:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:08.328544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30a85fbe-1fa8-45db-a47b-67ee9a0a27db tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d77a1c5e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:08.564335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:08.565659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:08.583151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:08.583482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:08.583909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:08.585171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:08.585171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:08.589202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:08.636286 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30a85fbe-1fa8-45db-a47b-67ee9a0a27db tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.311575 Oct 28 19:21:08.647384 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1562/3127] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:21:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:08.652733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ed24ee6-9fb8-4d31-a1f1-7e1cd353061e tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d77420a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:08.824705 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ed24ee6-9fb8-4d31-a1f1-7e1cd353061e tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.175851 Oct 28 19:21:08.825286 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1563/3128] 10.222.0.44 () {58 vars in 1134 bytes} [Fri Oct 28 19:21:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:08.831461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:08.833032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:08.847973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:08.848472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:08.849108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:08.849851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:08.850306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:08.858801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:08.874267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:08.883114 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9bc52f03-a979-4ebd-8e41-0842f57e9234 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 0.322945 Oct 28 19:21:08.899784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1566/3129] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:08 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:08.905849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2de5fd39-9fd4-4431-a719-29a7fafdf7f0 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d7c177ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.004197 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2de5fd39-9fd4-4431-a719-29a7fafdf7f0 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102921 Oct 28 19:21:09.005396 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1567/3130] 10.222.0.44 () {58 vars in 1167 bytes} [Fri Oct 28 19:21:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:09.019400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f90187b-e038-4874-9e9f-3e6bcf5f0c49 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d77c45c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.135527 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f90187b-e038-4874-9e9f-3e6bcf5f0c49 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.120152 Oct 28 19:21:09.136336 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1568/3131] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:21:09.154298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8738a45b-91e0-4ddf-8676-94ac59c47076 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d7ffa0dc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.251153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:09.270304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:09.272564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:09.274380 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff7424db-293b-40b9-b18f-b6f84bd09661 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1755 microversion: 2.32 time: 0.447768 Oct 28 19:21:09.275525 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1564/3132] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:08 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1755 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:09.280469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.281385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:09.288127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:09.288932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:09.289601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:09.290527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:09.291740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:09.292549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:09.311772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8738a45b-91e0-4ddf-8676-94ac59c47076 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161674 Oct 28 19:21:09.313435 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1569/3133] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:09.318940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.319845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:09.336833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:09.338065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:09.339557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:09.340548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:09.344195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:09.344989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:09.655439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:09.671556 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-092576fd-9bb5-46a9-a01e-273218c1f42f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.355596 Oct 28 19:21:09.672859 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1570/3134] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:09.678304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d19cdc73-c4d3-452e-90cf-cf583a31d4bd tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d77dd8550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.716058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:09.728484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ddcf3c43-6b6c-496c-906e-aa1593bf0a1a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 0.451597 Oct 28 19:21:09.729236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1565/3135] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:09.778610 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d19cdc73-c4d3-452e-90cf-cf583a31d4bd tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104147 Oct 28 19:21:09.786743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1571/3136] 10.222.0.44 () {58 vars in 1188 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:09.799103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc4db8a9-f4a7-4c31-831c-7601bf9de6c7 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] Calling method '.version_select at 0x7f1d7787f940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.915542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:09.916656 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc4db8a9-f4a7-4c31-831c-7601bf9de6c7 tempest-VolumesTestJSON-1507856374 tempest-VolumesTestJSON-1507856374-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.122639 Oct 28 19:21:09.916997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:09.927410 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1566/3137] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:09.936382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:09.937194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:09.937789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:09.939067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:09.940308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:09.940856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:10.189745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:10.204054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2c0c2c2-b72c-48c7-9a88-a11346f829fa tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 0.295443 Oct 28 19:21:10.213436 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1572/3138] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:09 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:10.302886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:10.305017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:10.316218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:10.317308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:10.317948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:10.318913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:10.319604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:10.320256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:10.617606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:10.627866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:10.635455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:10.642489 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f91f4efa-519c-42ef-b0d9-0e7a7a4315ad tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1849 microversion: 2.32 time: 0.344365 Oct 28 19:21:10.643577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1567/3139] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:10 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1849 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:10.696790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:10.699255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:10.732849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:10.733880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:10.735300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:10.739371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:10.740176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:10.740829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:10.758724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:10.760021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:10.769012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:10.769565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:10.770002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:10.770805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:10.771270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:10.771700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:11.453038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:11.464563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36f69b1f-c403-4565-9470-7bb2c9a19697 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 0.712065 Oct 28 19:21:11.465630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:11.469244 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1568/3140] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:10 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:11.474752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c65c5e9a-fb84-42eb-9650-b98b9ff257cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.783230 Oct 28 19:21:11.475344 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1573/3141] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:10 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:11.483752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:11.486116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:11.521928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:11.539052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:11.539690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:11.540462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:11.541234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:11.541665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:11.672245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:11.673259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:11.684006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:11.687639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:11.688340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:11.689292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:11.690513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:11.692852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.371293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:12.374510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:12.384212 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c48834c2-6de6-46a8-a49f-d50039fd0bde tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1318 microversion: 2.1 time: 0.912203 Oct 28 19:21:12.384602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:12.385823 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1569/3142] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:11 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1318 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:12.387307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:12.388821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a4e9b700-aee2-4fbc-9a27-f2a4fafc11e1 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1849 microversion: 2.32 time: 0.721367 Oct 28 19:21:12.389585 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1574/3143] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:11 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1849 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:21:12.495638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:12.496632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:12.515722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:12.517201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:12.548034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:12.550093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:12.552428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:12.553416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:12.554118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.556621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:12.557062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.558085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:12.558810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:12.559939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.560788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:12.565409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.964062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:12.975700 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-20d5ab35-3624-46cf-acbe-0dc0ef1e72a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1520 microversion: 2.1 time: 0.472414 Oct 28 19:21:12.979151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1575/3144] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:12 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1520 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:13.325671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:13.337518 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af34e4e2-1e8f-4d95-8057-675e520c5b51 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 0.845965 Oct 28 19:21:13.341316 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1570/3145] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:12 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:13.409251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:13.410599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:13.430047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:13.431626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:13.432195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:13.435129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:13.437105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:13.438227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:13.442454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:13.443639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:13.447075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:13.451974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:13.452669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:13.453848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:13.454515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:13.455191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:13.483948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:14.503296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:14.514516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:14.524024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:14.525499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a8c28b83-ccb0-4971-9887-b86badcb938a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1849 microversion: 2.32 time: 1.101037 Oct 28 19:21:14.527674 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1571/3146] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:13 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1849 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:14.533925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0959495b-bce7-49e1-8e9a-c8c5b794c555 req-6676a6da-1461-4871-872a-ddca81c82ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b91a78-37e5-45b4-882c-28fa94cbf587", "name": "network-vif-plugged", "status": "completed", "tag": "645c15b9-9053-49f5-bc5a-9f83255db076"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:14.563852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0959495b-bce7-49e1-8e9a-c8c5b794c555 req-6676a6da-1461-4871-872a-ddca81c82ab6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:14.572375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0959495b-bce7-49e1-8e9a-c8c5b794c555 req-6676a6da-1461-4871-872a-ddca81c82ab6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:14.573131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0959495b-bce7-49e1-8e9a-c8c5b794c555 req-6676a6da-1461-4871-872a-ddca81c82ab6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:14.587269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0959495b-bce7-49e1-8e9a-c8c5b794c555 req-6676a6da-1461-4871-872a-ddca81c82ab6 service nova] Creating event network-vif-plugged:645c15b9-9053-49f5-bc5a-9f83255db076 for instance 90b91a78-37e5-45b4-882c-28fa94cbf587 on n-h1-862769-3 Oct 28 19:21:14.604981 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0959495b-bce7-49e1-8e9a-c8c5b794c555 req-6676a6da-1461-4871-872a-ddca81c82ab6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075681 Oct 28 19:21:14.607500 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1572/3147] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:14.624798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:14.625877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:14.634816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:14.639738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:14.640395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:14.642490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:14.643189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:14.644821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:15.095470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:15.118153 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f84ec07-143e-40ec-bd85-44784a4f6fbb tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1507 microversion: 2.1 time: 1.709301 Oct 28 19:21:15.121605 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1576/3148] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:13 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1507 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:15.145457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:15.149183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:15.174210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:15.176647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:15.177317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:15.179035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:15.184000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:15.184821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:15.356280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:15.364651 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-239bbcab-27ec-4bb3-87a0-96391781baea tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1500 microversion: 2.1 time: 0.755104 Oct 28 19:21:15.379090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1573/3149] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:14 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1500 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:15.386354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2e6abf70-c866-45dd-9abc-591660764814 req-c845db6b-319c-44e9-9d7f-1d7529299595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "8b43571d-9302-4a3e-afb5-3cd7c6545571"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:15.404900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e6abf70-c866-45dd-9abc-591660764814 req-c845db6b-319c-44e9-9d7f-1d7529299595 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:15.408758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e6abf70-c866-45dd-9abc-591660764814 req-c845db6b-319c-44e9-9d7f-1d7529299595 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:15.409627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e6abf70-c866-45dd-9abc-591660764814 req-c845db6b-319c-44e9-9d7f-1d7529299595 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:15.450580 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2e6abf70-c866-45dd-9abc-591660764814 req-c845db6b-319c-44e9-9d7f-1d7529299595 service nova] Creating event network-changed:8b43571d-9302-4a3e-afb5-3cd7c6545571 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:15.469903 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2e6abf70-c866-45dd-9abc-591660764814 req-c845db6b-319c-44e9-9d7f-1d7529299595 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089142 Oct 28 19:21:15.471109 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1574/3150] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:15.476466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:15.477477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:15.491079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:15.491881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:15.492559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:15.497174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:15.500634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:15.501076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:16.485856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:16.496746 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a04f982e-5573-4424-b26d-0644a9c6758b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1514 microversion: 2.1 time: 1.024054 Oct 28 19:21:16.499381 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1575/3151] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:15 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1514 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:16.510472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:16.515631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:16.530547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:16.531332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:16.539526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:16.545563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:16.546335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:16.546971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:16.782395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:16.834440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f937f113-1097-49ac-8443-29eb7a895fbf tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1322 microversion: 2.1 time: 1.701513 Oct 28 19:21:16.835154 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1577/3152] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:15 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1322 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:16.852558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bba8ff8b-51f7-4a5b-9158-1a64865ca996 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:16.859832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bba8ff8b-51f7-4a5b-9158-1a64865ca996 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 02b83c3e-5029-48e4-ac6d-9077ccaa956e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:16.883804 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-bba8ff8b-51f7-4a5b-9158-1a64865ca996 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Instance 02b83c3e-5029-48e4-ac6d-9077ccaa956e could not be found. Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bba8ff8b-51f7-4a5b-9158-1a64865ca996 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/02b83c3e-5029-48e4-ac6d-9077ccaa956e/action HTTP/1.1 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 14 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: {"rescue": {}} Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 02b83c3e-5029-48e4-ac6d-9077ccaa956e could not be found. Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '02b83c3e-5029-48e4-ac6d-9077ccaa956e', 'body': {'rescue': {}}} Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b83c3e-5029-48e4-ac6d-9077ccaa956e could not be found. Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b83c3e-5029-48e4-ac6d-9077ccaa956e could not be found. Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:16.908664 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b83c3e-5029-48e4-ac6d-9077ccaa956e could not be found. Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bba8ff8b-51f7-4a5b-9158-1a64865ca996 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 404 to user: Instance 02b83c3e-5029-48e4-ac6d-9077ccaa956e could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bba8ff8b-51f7-4a5b-9158-1a64865ca996 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/02b83c3e-5029-48e4-ac6d-9077ccaa956e/action" status: 404 len: 111 microversion: 2.1 time: 0.074162 Oct 28 19:21:16.919000 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1578/3153] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:16 2022] POST /compute/v2.1/servers/02b83c3e-5029-48e4-ac6d-9077ccaa956e/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:16.930509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1917ecc6-fa0c-4045-89d7-089700168982 req-d6ac6377-9135-43b3-ba56-83f2e7e32b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659", "name": "network-vif-plugged", "status": "completed", "tag": "8865ad41-e1f7-4f21-84a3-a4cf533ab343"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:17.010398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1917ecc6-fa0c-4045-89d7-089700168982 req-d6ac6377-9135-43b3-ba56-83f2e7e32b54 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.011071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1917ecc6-fa0c-4045-89d7-089700168982 req-d6ac6377-9135-43b3-ba56-83f2e7e32b54 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.011491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1917ecc6-fa0c-4045-89d7-089700168982 req-d6ac6377-9135-43b3-ba56-83f2e7e32b54 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:17.067993 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1917ecc6-fa0c-4045-89d7-089700168982 req-d6ac6377-9135-43b3-ba56-83f2e7e32b54 service nova] Creating event network-vif-plugged:8865ad41-e1f7-4f21-84a3-a4cf533ab343 for instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 on n-h1-862769-3 Oct 28 19:21:17.077938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1917ecc6-fa0c-4045-89d7-089700168982 req-d6ac6377-9135-43b3-ba56-83f2e7e32b54 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164663 Oct 28 19:21:17.078550 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1579/3154] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:17.097144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:17.098459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:17.111539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.113071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.116744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:17.117987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.119977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.121306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:17.173275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:17.334730 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-274f1b27-dcc8-48b4-933f-446d574544ac tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action" status: 202 len: 0 microversion: 2.1 time: 0.254347 Oct 28 19:21:17.336279 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1580/3155] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:17 2022] POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:21:17.366803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:17.369955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:17.417977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.424208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.424672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:17.425645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.426105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.426591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:17.806323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:17.823218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:17.824852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:17.826187 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72e4fd1d-423e-42e6-bffe-e045262b5a61 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1870 microversion: 2.32 time: 1.325660 Oct 28 19:21:17.831841 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1576/3156] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:16 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1870 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:17.864843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:17.865887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:17.890973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.891848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.892530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:17.893482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:17.894217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:17.894900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.012341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:18.029737 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e5d3be3-221d-4822-8897-cb0d77b21eb0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1519 microversion: 2.1 time: 0.688634 Oct 28 19:21:18.031261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1581/3157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:17 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1519 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:18.083240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "09a32a04-c44e-46d6-b99b-bdc9bf1080b7"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:18.085993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:18.104100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.104833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.105489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.106419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.107118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.107747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.213768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] HTTP exception thrown: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Request method failure captured: Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c/os-volume_attachments/a407b4ed-7e21-4ff9-8458-768c67249d1c HTTP/1.1 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 74 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCstsn8BMNeDZAuxoVbGqE7Dz7dvsa1wM73iW3yjFiv20LGaVM8McwEMi58T2Vj1Q1hcKKBw3qi01N1JJJzjFzvHjLnnPhqTwMe1NcGcBNFdAaN-ozTLIZPBVIBTGtuO5GecPwzUUijYmUohM1CH2u28H0ClJQAu-LCLUdbqo9dwjV4 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b1aff794e27541d990f3c83f05dab3bc Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesAdminNegativeTest-881100260 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1aff794e27541d990f3c83f05dab3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1aff794e27541d990f3c83f05dab3bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1aff794e27541d990f3c83f05dab3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1aff794e27541d990f3c83f05dab3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesAdminNegativeTest-881100260 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b1aff794e27541d990f3c83f05dab3bc Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-881100260 Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesAdminNegativeTest-881100260-project-admin Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 67682c986ce84d008acf3ac3a50bc00f Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesAdminNegativeTest-881100260-project-admin Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: {"volumeAttachment": {"volumeId": "09a32a04-c44e-46d6-b99b-bdc9bf1080b7"}} Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: exception: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': 'd8630beb-6d10-42f0-8862-979dde98c74c', 'id': 'a407b4ed-7e21-4ff9-8458-768c67249d1c', 'body': {'volumeAttachment': {'volumeId': '09a32a04-c44e-46d6-b99b-bdc9bf1080b7'}}} Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. (HTTP 404) (Request-ID: req-506563b9-b769-4315-8cb6-15c3a6d40c04) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:21:18.216914 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] Returning 404 to user: Volume a407b4ed-7e21-4ff9-8458-768c67249d1c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b1c31523-3649-4729-bfbd-e3c393d125eb tempest-VolumesAdminNegativeTest-881100260 tempest-VolumesAdminNegativeTest-881100260-project-admin] 10.222.0.44 "PUT /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c/os-volume_attachments/a407b4ed-7e21-4ff9-8458-768c67249d1c" status: 404 len: 109 microversion: 2.1 time: 0.138838 Oct 28 19:21:18.234570 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1582/3158] 10.222.0.44 () {60 vars in 1433 bytes} [Fri Oct 28 19:21:18 2022] PUT /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c/os-volume_attachments/a407b4ed-7e21-4ff9-8458-768c67249d1c => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:21:18.367833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:18.384389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e3b4a1e-8d10-45a9-9a4d-dbc02d5baf98 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 200 len: 1513 microversion: 2.1 time: 0.522583 Oct 28 19:21:18.386400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1577/3159] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:17 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 1513 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:18.418731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:18.419415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:18.448201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.450854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.452366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.453481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.460080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.460762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.511805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-016c1e85-5587-4453-adac-a0e17b8b9a44 req-a1ea27cc-09ba-4f7d-b630-bfd24ed772ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "8863b8c0-1e3b-4e0c-9702-077d59002e68"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:18.525231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-016c1e85-5587-4453-adac-a0e17b8b9a44 req-a1ea27cc-09ba-4f7d-b630-bfd24ed772ac service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.526091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-016c1e85-5587-4453-adac-a0e17b8b9a44 req-a1ea27cc-09ba-4f7d-b630-bfd24ed772ac service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.527069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-016c1e85-5587-4453-adac-a0e17b8b9a44 req-a1ea27cc-09ba-4f7d-b630-bfd24ed772ac service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.556339 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-016c1e85-5587-4453-adac-a0e17b8b9a44 req-a1ea27cc-09ba-4f7d-b630-bfd24ed772ac service nova] Creating event network-changed:8863b8c0-1e3b-4e0c-9702-077d59002e68 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:18.561913 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-016c1e85-5587-4453-adac-a0e17b8b9a44 req-a1ea27cc-09ba-4f7d-b630-bfd24ed772ac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064135 Oct 28 19:21:18.566287 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1578/3160] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:21:18.862062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:18.863572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:18.888327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.888836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.899076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:18.900311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:18.900807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:18.901247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:19.485312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:19.499311 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd63232c-3062-42eb-a0ad-413918f0645b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591" status: 200 len: 1514 microversion: 2.1 time: 1.085940 Oct 28 19:21:19.509037 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1583/3161] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:18 2022] GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 => generated 1514 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:19.520967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:19.527922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:19.564805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:19.567425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:19.568392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:19.571311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:19.580536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:19.583648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:20.394318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:20.452112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:20.453895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:20.455169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c8bc8ede-507c-4d3c-b2f3-980fe65c4bbd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1870 microversion: 2.32 time: 1.597378 Oct 28 19:21:20.475319 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1579/3162] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:18 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1870 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:21:20.491077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:20.491999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:20.501714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:20.505837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:20.506498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:20.508030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:20.510815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:20.511444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:20.780726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:20.813048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1dac5860-2594-4235-961f-6ba2b65ea49a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1499 microversion: 2.1 time: 1.302572 Oct 28 19:21:20.835195 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1584/3163] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:19 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1499 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:20.846354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41a23347-af74-456c-9afc-0e390eebd7bc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Action: 'create', calling method: .version_select at 0x7f1d7c731e50>, body: {"keypair": {"name": "tempest-keypair-1202489765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtk7HrMGClY15Go/1ohK3vQ+EGnUKPcBJZb1I077BQIYnp1NRHEs9DFQFv1Ge0rypHL4WqEiiXlb8djQm4djZBoN5szg6qN26DoUa/CNKGV3CnUotfhEryD+C0f773ABA=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:20.878530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=84 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:20.904483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:20.907592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-41a23347-af74-456c-9afc-0e390eebd7bc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Getting quotas for project a2546fc671294f799bacfc3340e4cb8e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:21:20.913976 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02d49c5a-4749-43d3-9a8e-142ae3bcece8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 200 len: 1514 microversion: 2.1 time: 0.437406 Oct 28 19:21:20.914579 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1580/3164] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:20 2022] GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:20.936684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-41a23347-af74-456c-9afc-0e390eebd7bc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Getting quotas for user de0e0089caf3413f89b608d5a6ac63a7 and project a2546fc671294f799bacfc3340e4cb8e. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:21:20.947912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:20.951300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:20.983219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:20.983969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:20.988762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:20.990784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:20.997111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.002901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.009083 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41a23347-af74-456c-9afc-0e390eebd7bc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.172152 Oct 28 19:21:21.010538 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1585/3165] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:21:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:21:21.017010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:21.017789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:21.025977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.026876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.027539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.028550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.029209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.029908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.087435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lazy-loading 'flavor' on Instance uuid 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:21:21.136826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Cannot 'rescue' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state paused Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action HTTP/1.1 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 14 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: {"rescue": {}} Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'rescue' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state paused Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9d1db064-f45c-4a74-8a9b-8f3c9cd85570', 'body': {'rescue': {}}} Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 in vm_state paused. Cannot rescue while the instance is in this state. Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state paused Oct 28 19:21:21.138790 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state paused Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 409 to user: Cannot 'rescue' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state paused {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:21.143551 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a18ef69-7ab5-49b1-8666-8ae606f8645d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action" status: 409 len: 144 microversion: 2.1 time: 0.213277 Oct 28 19:21:21.154015 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1581/3166] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:20 2022] POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action => generated 144 bytes in 239 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:21:21.165093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:21:21.172947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:21.174423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:21.193824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.194349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.200490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.201320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.201320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.207910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.439497 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-33b157f1-b48b-4201-8d77-cdec8ee3f98a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 204 len: 0 microversion: 2.1 time: 0.427415 Oct 28 19:21:21.440499 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1586/3167] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:21 2022] DELETE /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:21:21.448590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c8fc700a-1215-4534-ab66-9c119e0d18d8 req-69d1bb36-bbde-4aa6-8ecd-ef04556f3c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "fd46a76b-d76c-49eb-b708-b512909cfaf3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:21.479308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c8fc700a-1215-4534-ab66-9c119e0d18d8 req-69d1bb36-bbde-4aa6-8ecd-ef04556f3c3e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.480171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c8fc700a-1215-4534-ab66-9c119e0d18d8 req-69d1bb36-bbde-4aa6-8ecd-ef04556f3c3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.480817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c8fc700a-1215-4534-ab66-9c119e0d18d8 req-69d1bb36-bbde-4aa6-8ecd-ef04556f3c3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.484454 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf73f55d-b4d6-46b7-856b-58b8f689a1cd tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action" status: 202 len: 0 microversion: 2.1 time: 0.326325 Oct 28 19:21:21.489461 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1582/3168] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:21 2022] POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:21:21.511604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:21.512328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:21.525689 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c8fc700a-1215-4534-ab66-9c119e0d18d8 req-69d1bb36-bbde-4aa6-8ecd-ef04556f3c3e service nova] Creating event network-changed:fd46a76b-d76c-49eb-b708-b512909cfaf3 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:21.530813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.531319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.531826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.532530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.532951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.533310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.539325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c8fc700a-1215-4534-ab66-9c119e0d18d8 req-69d1bb36-bbde-4aa6-8ecd-ef04556f3c3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094772 Oct 28 19:21:21.552973 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1587/3169] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:21.562210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:21.571330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:21.586403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.591611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.592384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:21.596357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:21.597376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:21.599308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:22.334893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:22.345966 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-378704cd-ce86-44bc-85df-66d483d7d9a1 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 200 len: 1520 microversion: 2.1 time: 0.855105 Oct 28 19:21:22.350399 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1583/3170] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:21 2022] GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 1520 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:22.364233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:22.375955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:22.376838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:22.385819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:22.401834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:22.403276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:22.404252 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4de2cdf-35b2-41b3-8aa7-eb8ae58833fd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1891 microversion: 2.32 time: 0.846558 Oct 28 19:21:22.405299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:22.406409 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1588/3171] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:21 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1891 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:22.406684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:22.408472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:22.409127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:22.409791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:22.968528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:22.994578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ab3acd5b-6209-40e9-b4cc-97ae5a361c78 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1514 microversion: 2.1 time: 0.619822 Oct 28 19:21:23.027050 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1584/3172] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:22 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1514 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:23.169180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:23.169696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:23.196645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:23.197133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:23.197557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:23.198302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:23.200987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:23.201536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:23.292172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:21:23.379042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:23.379924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:23.392884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:23.393790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:23.394486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:23.395449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:23.396128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:23.399371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:23.453945 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf4d48af-e310-4bfb-b6f1-408ff24a4384 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 204 len: 0 microversion: 2.1 time: 0.288512 Oct 28 19:21:23.456537 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1589/3173] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:23 2022] DELETE /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:21:23.474002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:23.474987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:23.494441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:23.496060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:23.497457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:23.498295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:23.498939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:23.499369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:24.335027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:24.346205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-838862cf-2af5-4bb0-8c3e-b9be899c110c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 200 len: 1520 microversion: 2.1 time: 0.972203 Oct 28 19:21:24.349797 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1585/3174] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:23 2022] GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 1520 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:24.351250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:24.361588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:24.368697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:24.370165 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c83c73e4-4614-402a-836a-5336fad8ee2b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.911232 Oct 28 19:21:24.382976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:24.383801 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1590/3175] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:23 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:24.386040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:24.407143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:24.409991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:24.410662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:24.411624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:24.414395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:24.415060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:24.860703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:24.872557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77297d4f-985c-424b-93a9-af4fd7975bec tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1513 microversion: 2.1 time: 0.506736 Oct 28 19:21:24.873503 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1586/3176] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:24 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1513 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:25.390957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:25.397019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:25.413384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:25.414033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:25.415934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.417256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.418019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.422530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.423713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.424925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.426996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.427530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.427960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.435311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.436335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.441002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.708406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:25.727770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7064d944-0a0e-4fa1-a2ee-82ad7994754c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 200 len: 1307 microversion: 2.1 time: 0.352137 Oct 28 19:21:25.743684 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1591/3177] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:25 2022] GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:25.750097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ef9d6193-e92c-4811-bccc-dc9bac404df5 req-0e11557e-6000-49ea-9320-350c4adff17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659", "name": "network-vif-deleted", "tag": "8865ad41-e1f7-4f21-84a3-a4cf533ab343"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:25.762363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ef9d6193-e92c-4811-bccc-dc9bac404df5 req-0e11557e-6000-49ea-9320-350c4adff17f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.763663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ef9d6193-e92c-4811-bccc-dc9bac404df5 req-0e11557e-6000-49ea-9320-350c4adff17f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.764850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ef9d6193-e92c-4811-bccc-dc9bac404df5 req-0e11557e-6000-49ea-9320-350c4adff17f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.786371 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ef9d6193-e92c-4811-bccc-dc9bac404df5 req-0e11557e-6000-49ea-9320-350c4adff17f service nova] Creating event network-vif-deleted:8865ad41-e1f7-4f21-84a3-a4cf533ab343 for instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 on n-h1-862769-3 Oct 28 19:21:25.792766 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ef9d6193-e92c-4811-bccc-dc9bac404df5 req-0e11557e-6000-49ea-9320-350c4adff17f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047540 Oct 28 19:21:25.794508 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1592/3178] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:25.897149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:25.900024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:25.906914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.907775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.908425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.909366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:25.910093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:25.910766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:25.936965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lazy-loading 'flavor' on Instance uuid 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:21:26.031152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:26.042043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:26.060997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:26.063706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:26.066481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5e4fabea-f189-47b4-8550-5568bdf8b2c7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.656496 Oct 28 19:21:26.082196 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1587/3179] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:25 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:26.082329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f96d2825-229f-4954-a92a-467d60d26e21 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action" status: 200 len: 32 microversion: 2.1 time: 0.185712 Oct 28 19:21:26.082329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1593/3180] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:25 2022] POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:21:26.091306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:26.092697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:26.100973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:26.102594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:26.119540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.121087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.124244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.125626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.126388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.127720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.128290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.128807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.129291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.129949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.130346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.132398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.482917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:26.489265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:26.505726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0d62ea8-6f10-4ab8-b5b5-f10d1be0580d tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1513 microversion: 2.1 time: 0.427421 Oct 28 19:21:26.508283 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1588/3181] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:26 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:26.515093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-76a673d6-d002-4769-b6d1-2786e91275ad req-d0b3877a-9376-4989-ab6f-b272b3e95312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "a2159bfa-7eb3-44d5-8030-541b13200f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:26.532379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-76a673d6-d002-4769-b6d1-2786e91275ad req-d0b3877a-9376-4989-ab6f-b272b3e95312 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.533867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-76a673d6-d002-4769-b6d1-2786e91275ad req-d0b3877a-9376-4989-ab6f-b272b3e95312 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.535954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-76a673d6-d002-4769-b6d1-2786e91275ad req-d0b3877a-9376-4989-ab6f-b272b3e95312 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.562984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:26.568256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-76a673d6-d002-4769-b6d1-2786e91275ad req-d0b3877a-9376-4989-ab6f-b272b3e95312 service nova] Creating event network-changed:a2159bfa-7eb3-44d5-8030-541b13200f39 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:26.573973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa1b235c-ccce-44d6-afde-059304db29f6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.486600 Oct 28 19:21:26.576761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1594/3182] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:26 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:26.593973 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-76a673d6-d002-4769-b6d1-2786e91275ad req-d0b3877a-9376-4989-ab6f-b272b3e95312 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081166 Oct 28 19:21:26.601294 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1589/3183] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:26.759422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:26.766914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:26.780208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.782084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.782084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.782352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.785287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.788215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.811662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] HTTP exception thrown: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 HTTP/1.1 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659'} Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:26.813943 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 404 to user: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:26.821013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa66e135-523e-4805-be9f-897a8d4cce70 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 404 len: 111 microversion: 2.1 time: 0.059960 Oct 28 19:21:26.829346 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1595/3184] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:26 2022] GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:26.837662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:26.844947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:26.846236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:26.853400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.853970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.854808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:26.855818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:26.856566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:26.857507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.083769 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c413f6f1-4504-40dd-b2fe-907798773d7e tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.253991 Oct 28 19:21:27.102556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f94e5d7-1f91-43e1-9a25-ba85e27adf4a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f94e5d7-1f91-43e1-9a25-ba85e27adf4a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: action_args: {} Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 19:21:27.107032 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f94e5d7-1f91-43e1-9a25-ba85e27adf4a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:27.111316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f94e5d7-1f91-43e1-9a25-ba85e27adf4a tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010448 Oct 28 19:21:27.114856 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1590/3185] 10.222.0.44 () {58 vars in 1230 bytes} [Fri Oct 28 19:21:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:21:27.120366 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1596/3186] 10.222.0.44 () {58 vars in 1182 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:21:27.124162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.124968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:27.127511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.133455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:27.134263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:27.141462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.142230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.142922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.143905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.158270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.159275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.171044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.177979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.182235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.185184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.187919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.189283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.252105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:21:27.311893 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3080d93-8b65-4b1b-ac1b-fa360397645d tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.190325 Oct 28 19:21:27.320820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1597/3187] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers => generated 681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:27.326176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.346749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:27.349566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.servers [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Removing options 'limit' from query {{(pid=120629) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 19:21:27.350658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:27.365199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.371556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.372276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.373259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.375320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.376030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.433153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:21:27.489931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a394b65c-bbd7-4e90-a645-3a051c078046 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.167087 Oct 28 19:21:27.490947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1598/3188] 10.222.0.44 () {58 vars in 1144 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:27.496551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-893173113", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "006078f5-2187-446c-acd0-070b1c7066ef"}, {"port": "4b55a9dd-89c8-4bbf-9e0c-e262ed3ca26b", "tag": "port-1"}, {"port": "c3014475-d009-4c81-b666-f4d6d626674b", "tag": "port-2"}, {"uuid": "5409c723-12c7-45cc-b6a2-6800fb7c5c43", "tag": "net-1"}, {"uuid": "5409c723-12c7-45cc-b6a2-6800fb7c5c43"}, {"uuid": "959e45a8-f9db-42d3-bd92-3bd69cfe585a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "959e45a8-f9db-42d3-bd92-3bd69cfe585a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d96149cc-a778-4ed1-a384-9050673f8d67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "71b1b1a8-0290-4c87-b53e-032143b633b7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "56cb6483-525c-437b-bd7f-24a2fdab7cdc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1164446422"}], "key_name": "tempest-keypair-1202489765", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:27.593008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:27.617811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:27.620430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:27.622652 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c913c569-d02e-48fe-88ee-66562c2ed24d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.506646 Oct 28 19:21:27.626001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1591/3189] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:27.639599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bc1917f-858b-4236-8a75-e1654b72275c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bc1917f-858b-4236-8a75-e1654b72275c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '-1' Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 19:21:27.646902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 19:21:27.651770 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:27.652795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bc1917f-858b-4236-8a75-e1654b72275c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:27.654491 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bc1917f-858b-4236-8a75-e1654b72275c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.027234 Oct 28 19:21:27.660478 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1592/3190] 10.222.0.44 () {58 vars in 1142 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:21:27.665575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.670093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:27.687537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.688495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.689007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.689998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.690545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.691467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.707195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] validate_networks() for [('006078f5-2187-446c-acd0-070b1c7066ef', None, None, None, None, None), (None, None, '4b55a9dd-89c8-4bbf-9e0c-e262ed3ca26b', None, None, None), (None, None, 'c3014475-d009-4c81-b666-f4d6d626674b', None, None, None), ('5409c723-12c7-45cc-b6a2-6800fb7c5c43', None, None, None, None, None), ('5409c723-12c7-45cc-b6a2-6800fb7c5c43', None, None, None, None, None), ('959e45a8-f9db-42d3-bd92-3bd69cfe585a', '10.2.2.100', None, None, None, None), ('959e45a8-f9db-42d3-bd92-3bd69cfe585a', '10.2.2.200', None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:21:27.734584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.735160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.735590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.736046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lazy-loading 'fault' on Instance uuid d8630beb-6d10-42f0-8862-979dde98c74c {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:21:27.799229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:27.814452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aa8d1cdf-20c3-4f58-af76-c209472dfab8 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 200 len: 1308 microversion: 2.1 time: 0.152593 Oct 28 19:21:27.816571 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1593/3191] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:27.822684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:27.823800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:27.831556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.832666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.834343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:27.835510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:27.837511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:27.838212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.239662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:28.251715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75e17129-7680-4599-a9db-840ed0321444 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.431371 Oct 28 19:21:28.252336 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1594/3192] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:27 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:28.258064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00eb1e02-d7f0-42b6-9b7e-eeb65e63bafe tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00eb1e02-d7f0-42b6-9b7e-eeb65e63bafe tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: action_args: {} Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'testing' Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 19:21:28.262613 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 19:21:28.266956 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:28.272344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00eb1e02-d7f0-42b6-9b7e-eeb65e63bafe tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:28.273486 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00eb1e02-d7f0-42b6-9b7e-eeb65e63bafe tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019890 Oct 28 19:21:28.280090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1595/3193] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:21:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:21:28.296280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-50b46b3a-fe52-43c6-8880-d43d5f308f89 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:28.307571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-50b46b3a-fe52-43c6-8880-d43d5f308f89 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:28.315181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-50b46b3a-fe52-43c6-8880-d43d5f308f89 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:28.326437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.servers [None req-50b46b3a-fe52-43c6-8880-d43d5f308f89 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Flavor 'non_existing_flavor' could not be found {{(pid=120628) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 28 19:21:28.332096 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-50b46b3a-fe52-43c6-8880-d43d5f308f89 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.047697 Oct 28 19:21:28.344101 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1596/3194] 10.222.0.44 () {58 vars in 1178 bytes} [Fri Oct 28 19:21:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:21:28.346350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=82 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:28.357224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:28.369955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:28.372980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:28.390205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.390720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.392053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.395465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.395995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.398116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.515478 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43339c3c-7d58-463a-b27e-8560f677c21c tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.168101 Oct 28 19:21:28.516248 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1597/3195] 10.222.0.44 () {58 vars in 1174 bytes} [Fri Oct 28 19:21:28 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:21:28.529735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:28.535374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:28.536054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:28.542801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.543291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.543728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.544443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.544989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.545301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.759372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b22ff5e-259d-48aa-97da-177100af31f3 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.232173 Oct 28 19:21:28.770792 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1598/3196] 10.222.0.44 () {58 vars in 1184 bytes} [Fri Oct 28 19:21:28 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:21:28.775742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8630beb-6d10-42f0-8862-979dde98c74c", "name": "network-vif-deleted", "tag": "abee9c23-0008-4980-b817-d2d1e84210b1"}, {"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "03f7e99b-6731-4c76-a80d-1812703f9eb8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:28.817439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.817923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.818348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.841581 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] Creating event network-vif-deleted:abee9c23-0008-4980-b817-d2d1e84210b1 for instance d8630beb-6d10-42f0-8862-979dde98c74c on n-h1-862769-3 Oct 28 19:21:28.842361 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] Creating event network-changed:03f7e99b-6731-4c76-a80d-1812703f9eb8 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:28.869131 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4c9ef91b-d37e-42fd-ae66-2aed1a1e0ff8 req-a2d5fca5-d7b4-4789-9d9e-fd445a1a3736 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094522 Oct 28 19:21:28.871032 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1599/3197] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:28.886174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:28.886924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:28.915316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.917414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.920176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:28.921317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:28.922673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:28.923244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.578120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:29.587800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:29.589535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:29.591225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eba55997-e8ea-4246-b6f5-14e476438578 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.711253 Oct 28 19:21:29.592548 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1600/3198] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:28 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:29.597571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:29.602741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:29.604192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:29.610553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.611057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.611481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.612187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.612899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.613610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.654919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:21:29.702846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:29.713618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.714359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.715133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.911930 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2d9d7eef-5225-43c5-b80b-cfea528798b5 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 3020 microversion: 2.1 time: 0.318007 Oct 28 19:21:29.913187 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1601/3199] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:21:29 2022] GET /compute/v2.1/servers/detail => generated 3020 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:29.939505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:29.940462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d8630beb-6d10-42f0-8862-979dde98c74c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:29.946830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.947680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.948207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.949009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.949645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.950156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.965294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] HTTP exception thrown: Instance d8630beb-6d10-42f0-8862-979dde98c74c could not be found. Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Request method failure captured: Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c HTTP/1.1 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCsgng_otLXLa6-E5G4iAhNk3nPrngl66soCF9GLqJ8dqfQJXy0-EAoj6RpLD9m-KoLYgUMOdNEKhxjd57GmCC7H7fbRimSklsFqaQvb8r-RD5DBLlUlZFnNwqRKZZhDCDwnB2I4eHppauI3Wji3nBQthlBNjO9xd68k_oUTjmCYba8 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: c3084e2b5c2a49a9887a6f9ebf8a2993 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesAdminNegativeTest-1342796446 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c3084e2b5c2a49a9887a6f9ebf8a2993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c3084e2b5c2a49a9887a6f9ebf8a2993", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c3084e2b5c2a49a9887a6f9ebf8a2993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c3084e2b5c2a49a9887a6f9ebf8a2993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesAdminNegativeTest-1342796446 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: c3084e2b5c2a49a9887a6f9ebf8a2993 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1342796446 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesAdminNegativeTest-1342796446-project Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: e14650c88086424cb2f7e27ffe97d6c2 Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesAdminNegativeTest-1342796446-project Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d8630beb-6d10-42f0-8862-979dde98c74c could not be found. Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd8630beb-6d10-42f0-8862-979dde98c74c'} Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8630beb-6d10-42f0-8862-979dde98c74c could not be found. Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8630beb-6d10-42f0-8862-979dde98c74c could not be found. Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:29.967013 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8630beb-6d10-42f0-8862-979dde98c74c could not be found. Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Returning 404 to user: Instance d8630beb-6d10-42f0-8862-979dde98c74c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e5487e2-ea04-40ee-b17d-9f16201510bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c" status: 404 len: 111 microversion: 2.1 time: 0.040235 Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1602/3200] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:29 2022] GET /compute/v2.1/servers/d8630beb-6d10-42f0-8862-979dde98c74c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:29.974403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:29.976420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:29.982539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.983056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.983725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.984162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.984612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.985031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.211010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:30.221492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-335350c0-7ecd-4a59-871d-75dcd1ee7c98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.251508 Oct 28 19:21:30.226559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1603/3201] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:29 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:30.232761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:30.233369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:30.241177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.242121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.243270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.244242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.244904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.245520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.500530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:30.509253 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00179849-0b98-476b-8e41-65b832c320f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.280175 Oct 28 19:21:30.512891 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1604/3202] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:30 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:30.531596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e0ca3f8-11a9-4d13-99cf-d0c9603404c6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:30.539054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e0ca3f8-11a9-4d13-99cf-d0c9603404c6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:30.541772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e0ca3f8-11a9-4d13-99cf-d0c9603404c6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025162 Oct 28 19:21:30.542616 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1605/3203] 10.222.0.44 () {58 vars in 1178 bytes} [Fri Oct 28 19:21:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:21:30.547986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:30.548967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:30.556992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.557860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.558529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.559533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.561803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.563152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.911469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:30.923668 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2d53bee6-2033-4838-bba5-06033e459d91 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.379554 Oct 28 19:21:30.927052 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1606/3204] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:30 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:30.934058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:30.945422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:30.948337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Searching by: {'deleted': False, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:21:30.954760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.955604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.956815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.957959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.958633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.959411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.966885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:30.995698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:21:31.036683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-180d0351-ea06-4f6b-8485-9c806ff3b90b tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.108239 Oct 28 19:21:31.045980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1607/3205] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:21:30 2022] GET /compute/v2.1/servers => generated 681 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:31.045980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:31.045980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:31.058559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.059085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.059558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.060263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.060890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.063005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.429353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:31.439572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:31.441520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:31.443059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-08b815c6-d90c-4107-92f2-786a8bbce13c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.403083 Oct 28 19:21:31.444374 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1608/3206] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:31 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:31.449333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "32e61231-4254-4b17-87a2-4cfe24506e43"}, {"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "6b647e6b-b284-4f51-8eb1-e1c929fd1742"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:31.465640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.466123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.466551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.479381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] Creating event network-changed:32e61231-4254-4b17-87a2-4cfe24506e43 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:31.479945 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] Creating event network-changed:6b647e6b-b284-4f51-8eb1-e1c929fd1742 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:21:31.485709 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5c2d8069-a83f-48c1-b183-7697e005cc66 req-bf3a5511-d879-47be-8ff1-5e0f8d08de61 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039920 Oct 28 19:21:31.486936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1609/3207] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:31.492810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:31.493807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:31.501996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.502528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.502992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.504113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.504860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.505812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.756596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:31.766404 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fabdf116-71d7-4395-bec3-10733c436600 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.277910 Oct 28 19:21:31.775309 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1610/3208] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:31 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:31.775309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:31.775309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:31.780180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.781067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.781827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.782981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.783447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.783865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.815451 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] HTTP exception thrown: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 HTTP/1.1 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659'} Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:31.817741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:31.822636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:31.825061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 404 to user: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:31.826182 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2188d8b-d038-4263-850b-950eee8e1e67 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 404 len: 111 microversion: 2.1 time: 0.058038 Oct 28 19:21:31.827478 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1611/3209] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:31 2022] DELETE /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:31.834308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:31.835217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:31.841514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.842010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.842445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.843188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.843644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.844068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.943251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:21:31.943958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:21:31.944679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:21:31.945590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:21:31.945590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:21:31.956540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.957560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.958242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.959212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.960173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.960831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.992627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Getting quotas for project a2546fc671294f799bacfc3340e4cb8e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:21:32.000388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Getting quotas for user de0e0089caf3413f89b608d5a6ac63a7 and project a2546fc671294f799bacfc3340e4cb8e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:21:32.057070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:32.079591 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ab1c67c6-56e4-4998-9fb8-fc9a8b372b4e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.250706 Oct 28 19:21:32.080800 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1612/3210] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:31 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:32.087496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1864217099"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:32.091398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:32.102758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.103725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.104670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.106586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.107447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.108038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.138168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:32.276349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:21:32.280454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d96149cc-a778-4ed1-a384-9050673f8d67',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='71b1b1a8-0290-4c87-b53e-032143b633b7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56cb6483-525c-437b-bd7f-24a2fdab7cdc',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:21:32.496715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f3c6c858-d78b-4007-978a-0a6d65b155ee tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.413285 Oct 28 19:21:32.501348 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1613/3211] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:32 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 19:21:32.517255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:32.519675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:32.537968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.539134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.542872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.544895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.545447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.545910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.581293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:21:32.744380 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd57c6b0-0002-432e-8411-d9415e6935ac tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "DELETE /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591" status: 204 len: 0 microversion: 2.1 time: 0.243616 Oct 28 19:21:32.745859 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1614/3212] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:32 2022] DELETE /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:21:32.764314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:32.765540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:32.774421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.775338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.776113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.777147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.778594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.779579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.894941 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07812cd9-58ea-47df-a6fe-e0088185a9b4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.402009 Oct 28 19:21:32.896091 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1599/3213] 10.222.0.44 () {62 vars in 1189 bytes} [Fri Oct 28 19:21:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 5404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:21:32.901314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:32.902013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:32.910065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.910836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.911418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.912357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.913003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.913745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.961940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:21:33.059578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d66c747d-1155-4bb5-9a78-4a1525da9cc6 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "DELETE /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 204 len: 0 microversion: 2.1 time: 0.160840 Oct 28 19:21:33.060592 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1600/3214] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:32 2022] DELETE /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:21:33.071220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1000f44f-91b5-44dd-b4cd-5c3b2aef9024 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:33.072000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1000f44f-91b5-44dd-b4cd-5c3b2aef9024 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:33.077244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.090669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.093585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.095559 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99656a69-0a6a-4151-aacc-1aa7b4738bc3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.347849 Oct 28 19:21:33.097003 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1615/3215] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:32 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:33.116764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:33.120115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:33.127524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.127900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.128391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.129104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.129563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.130335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.147844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1000f44f-91b5-44dd-b4cd-5c3b2aef9024 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.153354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] HTTP exception thrown: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 HTTP/1.1 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659'} Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.156325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.160435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 404 to user: Instance f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:33.161006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1000f44f-91b5-44dd-b4cd-5c3b2aef9024 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.161112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8b4d1c9-bb74-4a5d-bed3-f6cce29f71fa tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659" status: 404 len: 111 microversion: 2.1 time: 0.060097 Oct 28 19:21:33.161193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1000f44f-91b5-44dd-b4cd-5c3b2aef9024 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.161279 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1616/3216] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:33 2022] GET /compute/v2.1/servers/f56ff4ad-ee1e-4ccc-b2ae-d8c8ace3c659 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:33.164157 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1000f44f-91b5-44dd-b4cd-5c3b2aef9024 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1285 microversion: 2.42 time: 0.098927 Oct 28 19:21:33.165172 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1601/3217] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:33 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:33.169926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:33.170097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:33.170804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:33.175100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:33.178628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.179174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.179611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.180937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.181405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.181828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.191145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.192034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.192520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.193331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.193820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.194300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.503498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.524705 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dce2fd25-c3c4-4890-9588-32cd58590302 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591" status: 200 len: 1520 microversion: 2.1 time: 0.358334 Oct 28 19:21:33.525397 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1602/3218] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:33 2022] GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:33.575313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:33.585263 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2fc11ddd-857e-4de6-b395-f7712a6e3d3f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.424364 Oct 28 19:21:33.585846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1617/3219] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:33 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:34.130453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:34.131108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:34.140413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.141499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.142528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.144020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.144497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.144953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.201176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:34.201803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:34.216417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.216923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.217362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.218085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.218549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.218995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.356397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.369422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.370936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.379019 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56afdfb0-832a-4f42-899a-a1a9135ca20e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1527 microversion: 2.42 time: 0.192071 Oct 28 19:21:34.383431 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1618/3220] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:34 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1527 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:34.464143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:34.464791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:34.471345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.474473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.477896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.479242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.481275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.481873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.482491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.488625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.490099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.495697 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a8585a2c-d47b-4fae-8cce-e98aca503ce9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.369114 Oct 28 19:21:34.496312 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1603/3221] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:34 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:34.544948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:21:34.549697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:34.550405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:34.568149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.568641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.569077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.570344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.570858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.571324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.668305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed96962b-970d-4044-b11a-05bb03f64e52 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 204 len: 0 microversion: 2.1 time: 0.206422 Oct 28 19:21:34.674312 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1619/3222] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:34 2022] DELETE /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:21:34.689828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:34.690637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:34.700566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.700708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.716446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.718016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.718528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.719001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.865305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:34.873530 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0240cb9f-49e4-48e8-8369-cb7198e6b03f tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591" status: 200 len: 1520 microversion: 2.1 time: 0.328394 Oct 28 19:21:34.874130 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1604/3223] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:34 2022] GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:34.897367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:34.902382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:34.912909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.914214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.914846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:34.915725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:34.916647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:34.917266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.044342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:35.058443 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd804aad-a104-46fb-b664-4e8ddc792e63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.378382 Oct 28 19:21:35.061397 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1620/3224] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:34 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:35.274123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:35.287301 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e70a581-b244-4b8d-9c2a-b104d2ca82bc tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1682 microversion: 2.1 time: 0.399094 Oct 28 19:21:35.288583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1605/3225] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:34 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1682 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:35.407342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:35.407701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:35.418969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:35.421894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:35.423240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.426574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:35.430079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:35.430845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.623734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:35.648673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:35.650362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:35.651627 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2908feb0-86c8-4171-8402-ff951c471332 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1575 microversion: 2.42 time: 0.250062 Oct 28 19:21:35.679752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1606/3226] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:35 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:21:35.720283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:35.722654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:35.735953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:35.736355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:35.736785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.737528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:35.737978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:35.741569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.902423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:35.903224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:35.912115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:35.923830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:35.924857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.930387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:35.931297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:35.932028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:35.992183 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ddc8e5b-7c70-4acf-a614-241cd0d86397 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/ips" status: 200 len: 145 microversion: 2.1 time: 0.618442 Oct 28 19:21:35.992726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1621/3227] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:21:35 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/ips => generated 145 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:36.009238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-1a066a45-9ad3-4b9d-8df7-430ed93e5c0d req-29ee6f04-a810-4db8-94d5-0da1b48e3e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6dd28b-dfb3-45e6-94c9-500cb8597591", "name": "network-vif-deleted", "tag": "376fab2b-1597-45d7-93d8-b95eb9f27f56"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:36.021052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1a066a45-9ad3-4b9d-8df7-430ed93e5c0d req-29ee6f04-a810-4db8-94d5-0da1b48e3e3e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.021525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1a066a45-9ad3-4b9d-8df7-430ed93e5c0d req-29ee6f04-a810-4db8-94d5-0da1b48e3e3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.021959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1a066a45-9ad3-4b9d-8df7-430ed93e5c0d req-29ee6f04-a810-4db8-94d5-0da1b48e3e3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.058003 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-1a066a45-9ad3-4b9d-8df7-430ed93e5c0d req-29ee6f04-a810-4db8-94d5-0da1b48e3e3e service nova] Creating event network-vif-deleted:376fab2b-1597-45d7-93d8-b95eb9f27f56 for instance df6dd28b-dfb3-45e6-94c9-500cb8597591 on n-h2-862769-3 Oct 28 19:21:36.076563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-1a066a45-9ad3-4b9d-8df7-430ed93e5c0d req-29ee6f04-a810-4db8-94d5-0da1b48e3e3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082556 Oct 28 19:21:36.077494 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1622/3228] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:36.099188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:36.100083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:36.117935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.118494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.119027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.120000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.120474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.121050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.311710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.320013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.321794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.324161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lazy-loading 'fault' on Instance uuid df6dd28b-dfb3-45e6-94c9-500cb8597591 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:21:36.562430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85316cfd644d49b7350b33a102f6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3fef86a6de14e1a9f37d3aa5b3dce77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:36.571555 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-60a6f2af-b75b-4455-be2d-f277dc08b937 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591" status: 200 len: 1312 microversion: 2.1 time: 0.492834 Oct 28 19:21:36.572408 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1623/3229] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:36 2022] GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:36.583655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:36.590216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:36.607566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.609874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.611204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.613818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.614363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.616286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.726935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:36.737079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:36.738573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:36.739768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af0e6845-6dae-4980-b4d0-f7730528d0b9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.056533 Oct 28 19:21:36.740326 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1607/3230] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:35 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:36.769457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:36.770470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:36.785454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.786581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.788511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:36.790193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:36.791001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:36.792756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.540222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:37.549874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d991c3e8-a471-4515-959d-bfd5c3a631db tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1682 microversion: 2.1 time: 0.792635 Oct 28 19:21:37.550540 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1608/3231] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:36 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1682 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:37.583041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:37.583888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:37.595085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:37.604673 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e26fdb6-ee11-429c-a19c-919210f5b88e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 1.030919 Oct 28 19:21:37.606840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.607579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.608511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.610024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.610796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.612384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.614920 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1624/3232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:36 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:37.624711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:37.627905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: df6dd28b-dfb3-45e6-94c9-500cb8597591] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:37.649225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.650077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.651888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.655560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.656388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.657066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.711052 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] HTTP exception thrown: Instance df6dd28b-dfb3-45e6-94c9-500cb8597591 could not be found. Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 HTTP/1.1 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance df6dd28b-dfb3-45e6-94c9-500cb8597591 could not be found. Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'df6dd28b-dfb3-45e6-94c9-500cb8597591'} Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6dd28b-dfb3-45e6-94c9-500cb8597591 could not be found. Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6dd28b-dfb3-45e6-94c9-500cb8597591 could not be found. Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.718230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6dd28b-dfb3-45e6-94c9-500cb8597591 could not be found. Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 404 to user: Instance df6dd28b-dfb3-45e6-94c9-500cb8597591 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:37.723721 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02d3f13b-d811-4831-98e8-299cb9560dc8 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591" status: 404 len: 111 microversion: 2.1 time: 0.103281 Oct 28 19:21:37.726364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1625/3233] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:37 2022] GET /compute/v2.1/servers/df6dd28b-dfb3-45e6-94c9-500cb8597591 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:37.759960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:37.760739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] [instance: 90b91a78-37e5-45b4-882c-28fa94cbf587] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:37.786581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.799447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.805351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.806405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.807016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.807457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.839414 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] HTTP exception thrown: Instance 90b91a78-37e5-45b4-882c-28fa94cbf587 could not be found. Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Request method failure captured: Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 HTTP/1.1 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCuORTaRZ2Kb_VdlQmv0hqHLlcX9wykKcQJx7w1Ffdwdrq_s7MgPEPHbF-vzuqBh2nCSnH_1Jb3bWUMTRLna-m69pKyNJDFF2jEVxeIDZYNsNH2XObhhvAH97liM1K9GJQaZ7-BEZLPRyTvoceUttJvZwBxifElKjEhsj1FnuFZCwE4 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3fef86a6de14e1a9f37d3aa5b3dce77", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3fef86a6de14e1a9f37d3aa5b3dce77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e3fef86a6de14e1a9f37d3aa5b3dce77 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-130259472 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2b85316cfd644d49b7350b33a102f6d3 Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListServersNegativeTestJSON-130259472-project Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 90b91a78-37e5-45b4-882c-28fa94cbf587 could not be found. Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '90b91a78-37e5-45b4-882c-28fa94cbf587'} Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b91a78-37e5-45b4-882c-28fa94cbf587 could not be found. Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b91a78-37e5-45b4-882c-28fa94cbf587 could not be found. Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.842896 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b91a78-37e5-45b4-882c-28fa94cbf587 could not be found. Oct 28 19:21:37.847674 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:21:37.853313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] Returning 404 to user: Instance 90b91a78-37e5-45b4-882c-28fa94cbf587 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:37.854621 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-257905f4-b219-4bcb-95ae-d5cb25670b63 tempest-ListServersNegativeTestJSON-130259472 tempest-ListServersNegativeTestJSON-130259472-project] 10.222.0.44 "GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587" status: 404 len: 111 microversion: 2.1 time: 0.127059 Oct 28 19:21:37.864752 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1626/3234] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:37 2022] GET /compute/v2.1/servers/90b91a78-37e5-45b4-882c-28fa94cbf587 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:37.878232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:37.879292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:37.892509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.898680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.899586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:37.900716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:37.901471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:37.902186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:38.112898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.134946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.142082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.150348 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2f68b2a-eb0f-4952-9959-1317db58343c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1593 microversion: 2.42 time: 0.579637 Oct 28 19:21:38.150990 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1609/3235] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:37 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1593 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:38.165140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f10eb2a1-7ff9-4bab-af1a-9f8c2a3d961f req-844f9ea2-04d4-476b-9dc5-d9668fb287a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b91a78-37e5-45b4-882c-28fa94cbf587", "name": "network-vif-deleted", "tag": "645c15b9-9053-49f5-bc5a-9f83255db076"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:38.198171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f10eb2a1-7ff9-4bab-af1a-9f8c2a3d961f req-844f9ea2-04d4-476b-9dc5-d9668fb287a5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:38.198954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f10eb2a1-7ff9-4bab-af1a-9f8c2a3d961f req-844f9ea2-04d4-476b-9dc5-d9668fb287a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:38.199626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f10eb2a1-7ff9-4bab-af1a-9f8c2a3d961f req-844f9ea2-04d4-476b-9dc5-d9668fb287a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:38.225356 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f10eb2a1-7ff9-4bab-af1a-9f8c2a3d961f req-844f9ea2-04d4-476b-9dc5-d9668fb287a5 service nova] Creating event network-vif-deleted:645c15b9-9053-49f5-bc5a-9f83255db076 for instance 90b91a78-37e5-45b4-882c-28fa94cbf587 on n-h1-862769-3 Oct 28 19:21:38.242896 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f10eb2a1-7ff9-4bab-af1a-9f8c2a3d961f req-844f9ea2-04d4-476b-9dc5-d9668fb287a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086506 Oct 28 19:21:38.245246 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1610/3236] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:38.577195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:38.578983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:38.615683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:38.620137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:38.623687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:38.627826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:38.634313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:38.635064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:38.687854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.700293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.713149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.715593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a87e194-c738-4d94-951c-8a0f671179a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.849322 Oct 28 19:21:38.716912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1627/3237] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:37 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:38.722028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:38.725090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:38.758303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:38.758942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:38.759396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:38.760169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:38.760633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:38.766771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:38.844655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:38.972688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:38.975332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:38.992379 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7f4051d-8ecb-4b83-9b40-97b23af3ebab tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1614 microversion: 2.1 time: 0.420243 Oct 28 19:21:38.993170 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1611/3238] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:38 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1614 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:39.012815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fcf7b0d-0450-4cef-beb0-bcbf871e337b"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:39.033861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:39.052771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:39.053339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:39.053703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:39.054421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:39.059532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:39.060794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:39.671691 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04f3f5ce-f99a-4f5b-a83d-64f2715356a2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676689 Oct 28 19:21:39.682096 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1612/3239] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:21:38 2022] POST /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:39.699758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:39.708456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:39.717190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:39.738622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:39.754938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:39.756590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:39.759768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:39.763362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:39.766456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:39.767054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:40.120782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:40.132931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:40.134382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:40.135596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97429fe0-6b88-474b-a113-abcfd5e2218c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1593 microversion: 2.42 time: 0.448433 Oct 28 19:21:40.154728 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1613/3240] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:39 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1593 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:40.162742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2c92c1f2-04d8-4e74-88bf-0676668957f6 req-80601497-a281-4083-b0bb-c1efb2e13040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-plugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:40.194074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2c92c1f2-04d8-4e74-88bf-0676668957f6 req-80601497-a281-4083-b0bb-c1efb2e13040 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:40.194464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2c92c1f2-04d8-4e74-88bf-0676668957f6 req-80601497-a281-4083-b0bb-c1efb2e13040 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:40.194918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2c92c1f2-04d8-4e74-88bf-0676668957f6 req-80601497-a281-4083-b0bb-c1efb2e13040 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:40.228151 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2c92c1f2-04d8-4e74-88bf-0676668957f6 req-80601497-a281-4083-b0bb-c1efb2e13040 service nova] Creating event network-vif-plugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:21:40.247912 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2c92c1f2-04d8-4e74-88bf-0676668957f6 req-80601497-a281-4083-b0bb-c1efb2e13040 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102221 Oct 28 19:21:40.248613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1614/3241] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:40.254968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:40.255678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:40.283200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:40.283705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:40.284141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:40.284951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:40.285451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:40.285971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:40.973820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:41.248323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:41.276506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61df2813-77e9-4989-96f6-031cafea8f98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 2.556410 Oct 28 19:21:41.291896 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1628/3242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:38 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:41.296588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:41.298754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:41.342198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:41.345881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:41.346412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:41.347245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:41.347721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:41.348159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:41.465246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:41.465737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:41.466197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:41.490892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lazy-loading 'fault' on Instance uuid d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:21:41.692347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14650c88086424cb2f7e27ffe97d6c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3084e2b5c2a49a9887a6f9ebf8a2993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:41.706538 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-694a44b3-5cc5-42d6-9c45-6ca0f9f37bf6 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 200 len: 1332 microversion: 2.1 time: 0.425054 Oct 28 19:21:41.717342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1629/3243] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:41 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 1332 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:41.754444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-70b4fa88-3307-41ab-bf0e-ffe2d178d87c req-de7028e6-12f6-4e98-a9a4-1b70646c1ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667", "name": "network-vif-deleted", "tag": "c9f2928e-7ee1-46a5-a904-0f018cf7d4b4"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:41.820824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-70b4fa88-3307-41ab-bf0e-ffe2d178d87c req-de7028e6-12f6-4e98-a9a4-1b70646c1ecd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:41.827250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-70b4fa88-3307-41ab-bf0e-ffe2d178d87c req-de7028e6-12f6-4e98-a9a4-1b70646c1ecd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:41.833256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-70b4fa88-3307-41ab-bf0e-ffe2d178d87c req-de7028e6-12f6-4e98-a9a4-1b70646c1ecd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:41.976315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:42.213973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:42.238591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:42.248871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:42.253666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a8936ec-f47b-4662-8e7d-9e1c41aaf224 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 2.002673 Oct 28 19:21:42.254327 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1615/3244] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:40 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:42.284023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:42.284693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:42.321952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:42.322378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:42.322838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:42.333902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:42.335035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:42.335805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:42.701396 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-70b4fa88-3307-41ab-bf0e-ffe2d178d87c req-de7028e6-12f6-4e98-a9a4-1b70646c1ecd service nova] Creating event network-vif-deleted:c9f2928e-7ee1-46a5-a904-0f018cf7d4b4 for instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 on n-h2-862769-3 Oct 28 19:21:42.724000 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-70b4fa88-3307-41ab-bf0e-ffe2d178d87c req-de7028e6-12f6-4e98-a9a4-1b70646c1ecd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.992076 Oct 28 19:21:42.726330 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1630/3245] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:42.735749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:42.737783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:42.754491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:42.757552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:42.768833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:42.771371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:42.773596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:42.774632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:43.157273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:43.429940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:43.452125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:43.454384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:43.456020 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-20d83f3a-56c8-4786-b7ab-21990d2f46bd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1661 microversion: 2.42 time: 1.195417 Oct 28 19:21:43.457222 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1616/3246] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:42 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1661 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:43.463006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:43.464079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] [instance: d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:43.477664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:43.479050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:43.479537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:43.483738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:43.484393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:43.485216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:43.543097 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] HTTP exception thrown: Instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 could not be found. Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Request method failure captured: Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 HTTP/1.1 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCsgng_otLXLa6-E5G4iAhNk3nPrngl66soCF9GLqJ8dqfQJXy0-EAoj6RpLD9m-KoLYgUMOdNEKhxjd57GmCC7H7fbRimSklsFqaQvb8r-RD5DBLlUlZFnNwqRKZZhDCDwnB2I4eHppauI3Wji3nBQthlBNjO9xd68k_oUTjmCYba8 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: c3084e2b5c2a49a9887a6f9ebf8a2993 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesAdminNegativeTest-1342796446 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c3084e2b5c2a49a9887a6f9ebf8a2993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c3084e2b5c2a49a9887a6f9ebf8a2993", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c3084e2b5c2a49a9887a6f9ebf8a2993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c3084e2b5c2a49a9887a6f9ebf8a2993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesAdminNegativeTest-1342796446 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: c3084e2b5c2a49a9887a6f9ebf8a2993 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1342796446 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesAdminNegativeTest-1342796446-project Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: e14650c88086424cb2f7e27ffe97d6c2 Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesAdminNegativeTest-1342796446-project Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 could not be found. Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd98ec0f4-85ad-4a57-8ef4-fabd9dc2f667'} Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 could not be found. Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 could not be found. Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:43.552265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 could not be found. Oct 28 19:21:43.556457 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:21:43.559781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Returning 404 to user: Instance d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:43.561389 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb670a75-6345-4a87-810e-c66f9d018913 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667" status: 404 len: 111 microversion: 2.1 time: 0.102625 Oct 28 19:21:43.571200 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1617/3247] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:43 2022] GET /compute/v2.1/servers/d98ec0f4-85ad-4a57-8ef4-fabd9dc2f667 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:43.582793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:43.584672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:43.606931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:43.611100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:43.614133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:43.615736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:43.617507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:43.618159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:44.409572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:44.433067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ac645464-26c3-447e-a8ec-6af3ca660ac3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 1.702790 Oct 28 19:21:44.435100 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1631/3248] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:42 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:44.447081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4c1cf76e-ee87-4d57-9ecc-1a4ceb15e4c9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] Calling method '.version_select at 0x7f1d76cb3a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:44.494161 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4c1cf76e-ee87-4d57-9ecc-1a4ceb15e4c9 tempest-VolumesAdminNegativeTest-1342796446 tempest-VolumesAdminNegativeTest-1342796446-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553816268" status: 202 len: 0 microversion: 2.1 time: 0.056622 Oct 28 19:21:44.496838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1632/3249] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:21:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553816268 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:21:44.524110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:44.525834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:44.540979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:44.545479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:44.546200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:44.549754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:44.550540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:44.552436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:44.558593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:44.574749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:44.576799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:44.579576 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-725f0716-0ea5-4b41-91f8-f0a4489c089d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.006886 Oct 28 19:21:44.583303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1618/3250] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:43 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:44.995639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:45.012319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:45.013733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:45.014996 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7328cb86-eee8-416a-9143-2cb4e7795f96 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1708 microversion: 2.42 time: 0.495101 Oct 28 19:21:45.015622 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1633/3251] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:44 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1708 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:45.457539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:45.458159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:45.474930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:45.475424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:45.475868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:45.476608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:45.477054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:45.477475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:45.613873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:45.614534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:45.630452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:45.635964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:45.638560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:45.639660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:45.640337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:45.640971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:46.208953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:46.255036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6c31c70-ceac-43b2-a6e8-4a56e3059e54 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.798362 Oct 28 19:21:46.259494 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1619/3252] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:45 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:46.277626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:46.278244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:46.310500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:46.311028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:46.311454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:46.312166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:46.312609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:46.313024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:47.081886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.100388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.107379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.109397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5fc92ea0-4e22-4882-ae5a-a13a7eca25c4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.499703 Oct 28 19:21:47.110657 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1634/3253] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:45 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:47.285530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:47.286539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:47.305641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:47.307784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:47.308819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:47.311945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:47.313141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:47.316841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:47.470802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.492726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.497036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.498406 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6cc8095-b2ee-4428-b1dc-6f76d9a258cc tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1755 microversion: 2.42 time: 1.237798 Oct 28 19:21:47.505826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1620/3254] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:46 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1755 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:48.141028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:48.141873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:48.159897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.161071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.161872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.165716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.166909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.167610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.227401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:48.239216 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85e21b6c-94a7-415d-8716-dbb7881b6341 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.960201 Oct 28 19:21:48.244318 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1635/3255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:47 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:48.525455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:48.526114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:48.539223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.545346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.548826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.552561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.556178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.558734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.826016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:48.840151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:48.857973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:48.864160 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c262b73c-7b16-4631-b9bd-3faac16d1623 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.729403 Oct 28 19:21:48.887715 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1621/3256] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:48 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:21:49.275283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:49.275973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:49.287709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:49.288206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:49.288642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:49.289352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:49.289825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:49.301186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:50.035811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:50.069437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:50.070967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:50.072299 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4325b9ee-2975-4a48-9141-e851865c7bd0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1755 microversion: 2.42 time: 1.551313 Oct 28 19:21:50.082140 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1636/3257] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:48 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1755 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:50.101592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:50.103840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:50.118100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:50.120189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:50.123423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:50.124200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:50.126098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:50.131964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:50.132812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:50.340966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:50.351854 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1400f70-6a28-442b-b275-718acd357910 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 1.081776 Oct 28 19:21:50.354759 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1622/3258] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:49 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:51.103971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:51.105034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:51.127034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:51.128142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:51.128856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:51.132150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:51.133003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:51.133773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:51.686890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:51.731520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:51.742836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:51.771450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cdad4cae-5d78-48bb-ae38-6e1c3f5bb3fe tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.664500 Oct 28 19:21:51.774390 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1637/3259] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:50 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:51.802707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:51.809148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:51.822522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:51.823374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:51.824073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:51.825036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:51.825776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:51.826913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:52.175085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:52.185534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:52.202958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:52.210046 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-39c9ff91-d664-41a9-9261-e10f3bfdf730 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1802 microversion: 2.42 time: 1.110628 Oct 28 19:21:52.212424 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1623/3260] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:51 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1802 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:21:52.805977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:52.806601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:52.823038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:52.823919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:52.824617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:52.825617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:52.826296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:52.827180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:53.308939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:53.319597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a5fd238b-a451-4bb3-af1c-89a24bf5145d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 1.541727 Oct 28 19:21:53.328728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1638/3261] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:51 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:53.358718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:53.366523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:53.384545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:53.394281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:53.395691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:53.397208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:53.399396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:53.399949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.125321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.149723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.155158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.163679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.165167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.166423 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb965b8f-451b-4c13-97ed-be4efa8631fb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1802 microversion: 2.42 time: 0.825781 Oct 28 19:21:54.167781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.170291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1639/3262] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:53 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1802 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:54.171099 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d10b6eb5-db87-4371-a14a-5918d9b75628 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.367979 Oct 28 19:21:54.173289 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1624/3263] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:52 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:54.356667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:54.357419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:54.401923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.402458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.402938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.403681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.404147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.404580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:55.050364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:55.085043 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5aa42bef-11b5-4038-8147-9532df0cc994 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.733555 Oct 28 19:21:55.106811 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1640/3264] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:54 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:55.207032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:55.207674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:55.211325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:55.212302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:55.235412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:55.237794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:55.238870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:55.240593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:55.240823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:55.242630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:55.243398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:55.246407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:55.246899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:55.247712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:55.248367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:55.249840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:56.208025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.227513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.229379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.230745 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc379493-a847-454a-8074-1e09ddd58d56 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1849 microversion: 2.42 time: 1.031185 Oct 28 19:21:56.237481 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1641/3265] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:55 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1849 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:56.255408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:56.263391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:56.279481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:56.292827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:56.300164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:56.304076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:56.314310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:56.315387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:56.329024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.352373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.367774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.373592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4146aa2f-f90e-4f56-b76e-05a06bb3412c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.174884 Oct 28 19:21:56.380235 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1625/3266] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:55 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:56.796622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:56.816503 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1cc058b-58b0-4be8-b868-79a2a89a13a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.572402 Oct 28 19:21:56.817763 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1642/3267] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:56 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:57.092109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1eb128c9-2651-4271-afb7-a634732d3c7f req-e69985e9-c953-487e-805c-d291f2a6233a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "34895f9e-4c59-4b18-9ec2-caff3e73d280"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:57.140729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1eb128c9-2651-4271-afb7-a634732d3c7f req-e69985e9-c953-487e-805c-d291f2a6233a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:57.141369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1eb128c9-2651-4271-afb7-a634732d3c7f req-e69985e9-c953-487e-805c-d291f2a6233a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:57.141813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1eb128c9-2651-4271-afb7-a634732d3c7f req-e69985e9-c953-487e-805c-d291f2a6233a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:57.238927 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1eb128c9-2651-4271-afb7-a634732d3c7f req-e69985e9-c953-487e-805c-d291f2a6233a service nova] Creating event network-changed:34895f9e-4c59-4b18-9ec2-caff3e73d280 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:21:57.257850 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1eb128c9-2651-4271-afb7-a634732d3c7f req-e69985e9-c953-487e-805c-d291f2a6233a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169550 Oct 28 19:21:57.259800 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1626/3268] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:57.291271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:57.294133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:57.304944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:57.305665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:57.306267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:57.307224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:57.307847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:57.308429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:57.410830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:57.411537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:57.422429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:57.426390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:57.426991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:57.428027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:57.428499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:57.430591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:57.989137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:58.004528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:58.009523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:58.010413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:58.018022 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6b52bec-f441-456b-a3ee-d9ee61afd777 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1849 microversion: 2.42 time: 0.754962 Oct 28 19:21:58.019433 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1643/3269] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:57 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1849 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:21:58.032405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:58.037419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:58.038487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:58.039604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:58.043292 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc9d367e-907a-46cb-b09f-95c84e8714e3 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.636921 Oct 28 19:21:58.049019 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1627/3270] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:57 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:21:58.078894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:58.079705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:58.080336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:58.081402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:58.082068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:58.082716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:59.005008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:59.017075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f546f42-2052-4c9f-b4dc-7abcd0c55dba tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.996321 Oct 28 19:21:59.021745 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1644/3271] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:58 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:59.053314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:59.053943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:59.066562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:59.068962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:59.069633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:59.070576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:59.073214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:59.073945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:59.085161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:59.085929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:59.099385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:59.102748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:59.103495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:59.104260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:59.106849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:59.107412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:59.998631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.011310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.017725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.025131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ce710b9-2a7c-41f1-8fab-9dbd62795574 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1870 microversion: 2.42 time: 0.978039 Oct 28 19:22:00.031053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1628/3272] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:59 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1870 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:00.045861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:00.051475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:00.058991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.064143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:00.073509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:00.074449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.075047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:00.075956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:00.076084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.077184 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95a80d76-dfe7-492f-a0e0-7eb3520d9586 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.998187 Oct 28 19:22:00.077349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:00.077757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1645/3273] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:21:59 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:00.097422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:00.165340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:00.881427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:00.890109 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5ca474f0-46ff-45b8-b335-4dc217a2a9e6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.848449 Oct 28 19:22:00.911852 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1629/3274] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:00 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:00.999026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e06d2d28-266d-49e9-bead-60a6eb21d602 req-b8e2f352-68ec-4991-b98f-248532932202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "4b55a9dd-89c8-4bbf-9e0c-e262ed3ca26b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:01.028292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e06d2d28-266d-49e9-bead-60a6eb21d602 req-b8e2f352-68ec-4991-b98f-248532932202 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:01.029089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e06d2d28-266d-49e9-bead-60a6eb21d602 req-b8e2f352-68ec-4991-b98f-248532932202 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:01.029694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e06d2d28-266d-49e9-bead-60a6eb21d602 req-b8e2f352-68ec-4991-b98f-248532932202 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:01.051842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:01.065222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:01.065905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:01.073146 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e06d2d28-266d-49e9-bead-60a6eb21d602 req-b8e2f352-68ec-4991-b98f-248532932202 service nova] Creating event network-changed:4b55a9dd-89c8-4bbf-9e0c-e262ed3ca26b for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:22:01.078963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:01.079442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:01.079872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:01.093940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:01.094511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:01.097313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:01.099356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e06d2d28-266d-49e9-bead-60a6eb21d602 req-b8e2f352-68ec-4991-b98f-248532932202 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104427 Oct 28 19:22:01.106173 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1646/3275] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:01.120147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:01.126741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:01.155160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:01.163136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:01.167122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:01.168281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:01.168998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:01.169703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:02.327057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.353634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.356236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.358028 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a909e9fa-0f30-4920-ab63-9d69e811e4ca tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1870 microversion: 2.42 time: 1.297922 Oct 28 19:22:02.360007 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1630/3276] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:01 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1870 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:02.374226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:02.379806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:02.405892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:02.406357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:02.416271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:02.418078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:02.419330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:02.421509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:02.452400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.475066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.476948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.486448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df017592-fd0d-4f69-a617-123decfaeb89 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.370702 Oct 28 19:22:02.487993 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1647/3277] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:01 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:02.901536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:02.909629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ec40cee-553f-4f66-b46b-5b48cc0c7193 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1500 microversion: 2.1 time: 0.546298 Oct 28 19:22:02.910223 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1631/3278] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:02 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1500 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:02.954281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b513c9d-b295-4d86-8fa3-39c3d1c9acd6"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:02.985516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:03.055955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.063179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.070590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.076625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.082423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.084212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.221948 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Cannot 'attach_volume' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state rescued Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/os-volume_attachments HTTP/1.1 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 74 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: {"volumeAttachment": {"volumeId": "2b513c9d-b295-4d86-8fa3-39c3d1c9acd6"}} Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'attach_volume' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state rescued Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '9d1db064-f45c-4a74-8a9b-8f3c9cd85570', 'body': {'volumeAttachment': {'volumeId': '2b513c9d-b295-4d86-8fa3-39c3d1c9acd6'}}} Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 19:22:03.224305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state rescued Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state rescued Oct 28 19:22:03.229602 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:22:03.238938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 409 to user: Cannot 'attach_volume' instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 while it is in vm_state rescued {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:22:03.240197 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea776f13-f0d4-4e54-a16a-f15a04bbf741 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.306441 Oct 28 19:22:03.246105 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1648/3279] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:22:02 2022] POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/os-volume_attachments => generated 152 bytes in 313 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:22:03.249733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:03.250268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:03.289121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.292111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.292811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.293800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.294438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.295090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.315883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:03.320846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:03.340708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.341985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.356063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.357612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.357612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.361092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.479966 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e14f24b6-1981-4374-9358-f9f1fba2ca50 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171076 Oct 28 19:22:03.487951 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1649/3280] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:22:03 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:03.498851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:03.499951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:03.511903 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a04f0e67-97ba-48a9-9da0-f5b3efb7b69c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action" status: 202 len: 0 microversion: 2.1 time: 0.265857 Oct 28 19:22:03.513923 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1632/3281] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:22:03 2022] POST /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:22:03.520913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.524294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.524950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.525845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.526416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:03.527107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.528210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.528565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:03.541429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.542589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.545666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.546900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.549883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.550565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.637000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc02fb7f-0ab1-41df-ad8a-c08cfa096a6e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/0fcf7b0d-0450-4cef-beb0-bcbf871e337b" status: 200 len: 194 microversion: 2.1 time: 0.121355 Oct 28 19:22:03.656488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1633/3282] 10.222.0.44 () {58 vars in 1413 bytes} [Fri Oct 28 19:22:03 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/0fcf7b0d-0450-4cef-beb0-bcbf871e337b => generated 194 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:03.676394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:03.686216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:03.704391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.705145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.705794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:03.706788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:03.707489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:03.708105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:04.804186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:04.815073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:04.816581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:04.817813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-678bb390-2f23-43f9-bc67-e4a8c226d1e5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1870 microversion: 2.42 time: 1.328230 Oct 28 19:22:04.863325 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1650/3283] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:03 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1870 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:04.887558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:04.888192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:04.927011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:04.930456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:04.935344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:04.936200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:04.936693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:04.937129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:05.504157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:05.514740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:05.549301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:05.564108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73693305-7301-45a4-b737-d4d899de78a5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.906151 Oct 28 19:22:05.564728 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1634/3284] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:03 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:05.894956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:05.895641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:05.909730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:05.911378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:05.911828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:05.912567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:05.918411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:05.919376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:06.892822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:06.905469 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce3d9f23-9f9d-4afc-9f53-50df7540dff7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1508 microversion: 2.1 time: 2.038429 Oct 28 19:22:06.908890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1651/3285] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:04 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1508 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:06.927996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:06.935249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:06.952749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:06.953289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:06.953407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:06.953783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:06.954499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:06.954982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:06.955617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:06.984750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:06.996966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:06.998867 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5d8b58a6-19dc-4685-9b57-704b67f0a5c7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 1.107960 Oct 28 19:22:06.999483 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1635/3286] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:05 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:07.740658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a32747fe-a559-4fcf-b38d-6ceeb6f5ed5f req-36077593-6f17-4d8c-b33b-537259a893d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "c3014475-d009-4c81-b666-f4d6d626674b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:07.788615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a32747fe-a559-4fcf-b38d-6ceeb6f5ed5f req-36077593-6f17-4d8c-b33b-537259a893d0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.789127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a32747fe-a559-4fcf-b38d-6ceeb6f5ed5f req-36077593-6f17-4d8c-b33b-537259a893d0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.789613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a32747fe-a559-4fcf-b38d-6ceeb6f5ed5f req-36077593-6f17-4d8c-b33b-537259a893d0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.840700 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a32747fe-a559-4fcf-b38d-6ceeb6f5ed5f req-36077593-6f17-4d8c-b33b-537259a893d0 service nova] Creating event network-changed:c3014475-d009-4c81-b666-f4d6d626674b for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:22:07.848714 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a32747fe-a559-4fcf-b38d-6ceeb6f5ed5f req-36077593-6f17-4d8c-b33b-537259a893d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123446 Oct 28 19:22:07.853233 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1636/3287] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:07.878452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49e8a315-33a9-461b-a2cd-7811ce380549"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:07.883433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:07.902874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.903369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.903940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.904490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.905103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.905675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:08.474543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f031dd4-a00d-408d-9881-b8bb591b1c3a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "POST /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619395 Oct 28 19:22:08.476838 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1637/3288] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:22:07 2022] POST /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:08.483592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:08.484616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:08.495915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:08.496713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:08.497314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:08.498499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:08.499299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:08.500101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:08.947496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:08.963684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:08.967493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:08.968740 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c79d6276-3e98-429e-a846-db268f620048 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 2.055781 Oct 28 19:22:08.977085 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1652/3289] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:06 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:08.987579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:08.988268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:09.001397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:09.010818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:09.011412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:09.012191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:09.012669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:09.013097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:10.730304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:10.743404 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-87721b17-7832-4451-8204-49733e89c591 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1514 microversion: 2.1 time: 2.265044 Oct 28 19:22:10.744252 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1638/3290] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:08 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1514 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:10.758925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:10.759867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:10.781044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=52 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:10.781551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:10.783536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:10.784555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:10.785224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:10.786193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:10.795018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:10.796141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:10.796850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:10.809625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:10.816735 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a4a74bc-c888-44e0-a540-9df45c3c72f6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 1.832749 Oct 28 19:22:10.818326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1653/3291] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:08 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:11.505174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:11.505876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:11.507486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:11.526555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:11.528795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:11.531847 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2397080-2a18-45a8-8f91-b9b88f408805 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.786358 Oct 28 19:22:11.535471 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1639/3292] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:10 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:11.540809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.542919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.543825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:11.547582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.551494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.553070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:11.758589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1b3d95a8-3acf-4752-ba1a-ed76a603369a req-efd6ada2-9bd8-47e5-adb5-0411b240f8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "d7a208a2-6068-4367-b33a-210bdb57b27d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:11.789689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1b3d95a8-3acf-4752-ba1a-ed76a603369a req-efd6ada2-9bd8-47e5-adb5-0411b240f8c8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.796008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1b3d95a8-3acf-4752-ba1a-ed76a603369a req-efd6ada2-9bd8-47e5-adb5-0411b240f8c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.796807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1b3d95a8-3acf-4752-ba1a-ed76a603369a req-efd6ada2-9bd8-47e5-adb5-0411b240f8c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:11.818410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1b3d95a8-3acf-4752-ba1a-ed76a603369a req-efd6ada2-9bd8-47e5-adb5-0411b240f8c8 service nova] Creating event network-changed:d7a208a2-6068-4367-b33a-210bdb57b27d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:22:11.834637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1b3d95a8-3acf-4752-ba1a-ed76a603369a req-efd6ada2-9bd8-47e5-adb5-0411b240f8c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082433 Oct 28 19:22:11.836015 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1640/3293] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:11.905289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:11.905289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:11.918558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.919345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.920354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:11.923767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.924792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.925511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.395004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:12.409701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5719d901-b68f-4832-a00a-30970c1dea8b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.909750 Oct 28 19:22:12.414006 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1654/3294] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:11 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:12.459737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-929951514"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:12.462603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:12.483655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.487617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.488413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.489354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.490356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.498857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.952235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:12.966950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:12.971592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:12.975233 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eee97e91-bc8d-4b24-b5d8-7e9c994325f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 1.102258 Oct 28 19:22:12.992865 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1641/3295] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:11 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:13.008378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:13.011153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:13.015491 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e0794d8-be08-417a-93e0-07f5de61ff77 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.561248 Oct 28 19:22:13.017130 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1655/3296] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:22:12 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 28 19:22:13.031807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:13.032315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:13.035292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:13.036215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:13.037349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:13.039521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:13.644545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:13.660970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:13.662635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:13.666463 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a30480d-57e9-4a79-8d75-6c5691e60d5a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 0.671868 Oct 28 19:22:13.670044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1642/3297] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:12 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:14.012880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:14.013768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:14.029660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.030276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.030671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:14.032593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.033780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.035551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:14.705407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:14.706661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:14.721691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.731143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.734509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:14.740708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.741363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.742033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:14.742160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:14.760511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:14.762242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:14.763719 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f58d4b16-9414-4ca9-a1ab-96bfce88801f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 0.758483 Oct 28 19:22:14.775438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1656/3298] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:14 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:14.796936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-701d5438-4f17-48e7-8ff7-443d6dc0971b req-cedd9c07-5ec3-4ac9-ad08-dbb6c901f96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:14.812927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-701d5438-4f17-48e7-8ff7-443d6dc0971b req-cedd9c07-5ec3-4ac9-ad08-dbb6c901f96c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.819459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-701d5438-4f17-48e7-8ff7-443d6dc0971b req-cedd9c07-5ec3-4ac9-ad08-dbb6c901f96c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.820611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-701d5438-4f17-48e7-8ff7-443d6dc0971b req-cedd9c07-5ec3-4ac9-ad08-dbb6c901f96c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:14.851880 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-701d5438-4f17-48e7-8ff7-443d6dc0971b req-cedd9c07-5ec3-4ac9-ad08-dbb6c901f96c service nova] Creating event network-changed:f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:22:14.860548 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-701d5438-4f17-48e7-8ff7-443d6dc0971b req-cedd9c07-5ec3-4ac9-ad08-dbb6c901f96c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083457 Oct 28 19:22:14.861519 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1657/3299] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:14.958659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7e8a1f5d-98cf-4058-bf7a-e8ecffd484d8 req-05ced42c-ab48-4a45-8f07-0e0ad1f12ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "32e61231-4254-4b17-87a2-4cfe24506e43"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:14.987482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7e8a1f5d-98cf-4058-bf7a-e8ecffd484d8 req-05ced42c-ab48-4a45-8f07-0e0ad1f12ec9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.989906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7e8a1f5d-98cf-4058-bf7a-e8ecffd484d8 req-05ced42c-ab48-4a45-8f07-0e0ad1f12ec9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.990591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7e8a1f5d-98cf-4058-bf7a-e8ecffd484d8 req-05ced42c-ab48-4a45-8f07-0e0ad1f12ec9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:15.022312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7e8a1f5d-98cf-4058-bf7a-e8ecffd484d8 req-05ced42c-ab48-4a45-8f07-0e0ad1f12ec9 service nova] Creating event network-vif-plugged:32e61231-4254-4b17-87a2-4cfe24506e43 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:15.038265 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7e8a1f5d-98cf-4058-bf7a-e8ecffd484d8 req-05ced42c-ab48-4a45-8f07-0e0ad1f12ec9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089746 Oct 28 19:22:15.040864 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1658/3300] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:15.798321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:15.800959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:15.817233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:15.818431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:15.821182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:15.823252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:15.824368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:15.825338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:16.287494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:16.334278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:16.353499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:16.368370 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8eeed319-653d-49b8-b338-a429a4d8d01b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.654555 Oct 28 19:22:16.369224 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1643/3301] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:14 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:16.723471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:16.738141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:16.741048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:16.746526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f8e083c-275e-4858-b561-b07d642c252f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 0.955204 Oct 28 19:22:16.759488 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1659/3302] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:15 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:17.112168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-71557289-4336-4524-844a-50caf63483b3 req-af43ef57-ffdd-4a07-a65e-749bdac2a59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-unplugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:17.149936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-71557289-4336-4524-844a-50caf63483b3 req-af43ef57-ffdd-4a07-a65e-749bdac2a59d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:17.150579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-71557289-4336-4524-844a-50caf63483b3 req-af43ef57-ffdd-4a07-a65e-749bdac2a59d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:17.153992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-71557289-4336-4524-844a-50caf63483b3 req-af43ef57-ffdd-4a07-a65e-749bdac2a59d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:17.176162 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-71557289-4336-4524-844a-50caf63483b3 req-af43ef57-ffdd-4a07-a65e-749bdac2a59d service nova] Creating event network-vif-unplugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:22:17.186057 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-71557289-4336-4524-844a-50caf63483b3 req-af43ef57-ffdd-4a07-a65e-749bdac2a59d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076899 Oct 28 19:22:17.189064 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1644/3303] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:17.359100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8b02b51f-84cd-412e-86ed-3271afa62290 req-158b8675-1479-4d1c-96d1-ae08df876209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "9cc771af-ac85-45d1-abee-094430b22ea8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:17.387305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b02b51f-84cd-412e-86ed-3271afa62290 req-158b8675-1479-4d1c-96d1-ae08df876209 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:17.389999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b02b51f-84cd-412e-86ed-3271afa62290 req-158b8675-1479-4d1c-96d1-ae08df876209 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:17.394556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b02b51f-84cd-412e-86ed-3271afa62290 req-158b8675-1479-4d1c-96d1-ae08df876209 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:17.397871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:17.398597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:17.413898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:17.417778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:17.421892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:17.425561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:17.426055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:17.430319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8b02b51f-84cd-412e-86ed-3271afa62290 req-158b8675-1479-4d1c-96d1-ae08df876209 service nova] Creating event network-changed:9cc771af-ac85-45d1-abee-094430b22ea8 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:22:17.430567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:17.444750 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8b02b51f-84cd-412e-86ed-3271afa62290 req-158b8675-1479-4d1c-96d1-ae08df876209 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090519 Oct 28 19:22:17.448074 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1660/3304] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:17.510769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:17.776120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:17.776837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:17.784091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:17.784848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:17.785497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:17.786471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:17.787132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:17.791427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:19.753605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:19.773577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:19.777475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:19.778983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:19.780196 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-51adc963-43f3-40f7-a0b5-4c1740fd4f65 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 2.387180 Oct 28 19:22:19.780765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1645/3305] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:17 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:19.789892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:19.808637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:19.809782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a5215f74-1fa4-432d-a79c-ffc0475f4619 req-20b26e67-f5ff-433b-98f3-c1b4469498ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "03f7e99b-6731-4c76-a80d-1812703f9eb8"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:19.812863 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6efebd6-5822-4594-a4c4-c841640d18d3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 2.041005 Oct 28 19:22:19.838958 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1661/3306] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:17 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:19.922590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5215f74-1fa4-432d-a79c-ffc0475f4619 req-20b26e67-f5ff-433b-98f3-c1b4469498ea service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:19.926886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5215f74-1fa4-432d-a79c-ffc0475f4619 req-20b26e67-f5ff-433b-98f3-c1b4469498ea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:19.930039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5215f74-1fa4-432d-a79c-ffc0475f4619 req-20b26e67-f5ff-433b-98f3-c1b4469498ea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:20.000018 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a5215f74-1fa4-432d-a79c-ffc0475f4619 req-20b26e67-f5ff-433b-98f3-c1b4469498ea service nova] Creating event network-vif-plugged:03f7e99b-6731-4c76-a80d-1812703f9eb8 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:20.027378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a5215f74-1fa4-432d-a79c-ffc0475f4619 req-20b26e67-f5ff-433b-98f3-c1b4469498ea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245239 Oct 28 19:22:20.035556 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1646/3307] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:20.810171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:20.812185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:20.825138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=50 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:20.832617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:20.833577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:20.836010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:20.839626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:20.841064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:20.841744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:20.853870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:20.854600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:20.871371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:20.886371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:20.888459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:20.890408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:20.893069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:20.898291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:22.278127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:22.290054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:22.305340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:22.309208 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d475fa5-5906-4a2a-a15a-6c37f8328da8 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.502924 Oct 28 19:22:22.314731 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1662/3308] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:20 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:22.328203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "8863b8c0-1e3b-4e0c-9702-077d59002e68"}, {"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "a2159bfa-7eb3-44d5-8030-541b13200f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:22.367045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:22.368798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:22.369564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:22.393001 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] Creating event network-vif-plugged:8863b8c0-1e3b-4e0c-9702-077d59002e68 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:22.401419 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] Creating event network-vif-plugged:a2159bfa-7eb3-44d5-8030-541b13200f39 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:22.426124 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b519f909-0397-4abd-941b-489709f656cb req-d4de1dec-f92a-45da-bdf8-194ddc08329b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109542 Oct 28 19:22:22.427492 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1663/3309] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:22.492118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:22.505336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:22.526662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:22.528449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3b03bc0-0a1f-4e25-9b7f-f5a61a9a062c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 1.680089 Oct 28 19:22:22.537074 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1647/3310] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:20 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:22.806631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-63f4eb65-a244-4c55-abeb-70058710094d req-17365ad2-7289-443c-b12f-9cbd9aba11bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "28d81463-0059-42be-868c-058c68f736c0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:22.833101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-63f4eb65-a244-4c55-abeb-70058710094d req-17365ad2-7289-443c-b12f-9cbd9aba11bf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:22.837719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-63f4eb65-a244-4c55-abeb-70058710094d req-17365ad2-7289-443c-b12f-9cbd9aba11bf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:22.838333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-63f4eb65-a244-4c55-abeb-70058710094d req-17365ad2-7289-443c-b12f-9cbd9aba11bf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:22.867844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-63f4eb65-a244-4c55-abeb-70058710094d req-17365ad2-7289-443c-b12f-9cbd9aba11bf service nova] Creating event network-changed:28d81463-0059-42be-868c-058c68f736c0 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:22:22.886818 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-63f4eb65-a244-4c55-abeb-70058710094d req-17365ad2-7289-443c-b12f-9cbd9aba11bf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083343 Oct 28 19:22:22.888068 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1664/3311] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:23.340771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:23.341673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:23.372297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:23.372789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:23.376294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:23.379700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:23.380347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:23.381950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:23.567844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:23.569127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:23.585496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:23.591880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:23.592719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:23.593721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:23.594539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:23.595255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:25.053604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:25.075785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:25.086904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:25.091435 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eb271da4-7922-4ad9-aa02-d67b2e76180b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.752873 Oct 28 19:22:25.095046 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1648/3312] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:23 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:25.110015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-plugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}, {"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "8b43571d-9302-4a3e-afb5-3cd7c6545571"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:25.153553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:25.154350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:25.155854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:25.197290 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] Creating event network-vif-plugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:22:25.199558 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] Creating event network-vif-plugged:8b43571d-9302-4a3e-afb5-3cd7c6545571 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:25.240500 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a24bf106-ace7-4b1c-a274-f9c575b12116 req-9386dbbd-0fcd-4693-98f1-748906d3ef07 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.143821 Oct 28 19:22:25.250405 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1649/3313] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:25.368554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:25.388331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:25.408600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:25.422791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:25.425112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c739c658-400e-4632-bc8a-5402a5758f6a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 1.861766 Oct 28 19:22:25.428364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1665/3314] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:23 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:26.121501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:26.122276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:26.153778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:26.154881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:26.154881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:26.159426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:26.166327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:26.171579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:26.460101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:26.461460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:26.481013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:26.481515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:26.495754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:26.498965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:26.504511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:26.506066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:27.305430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:27.325538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:27.329602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:27.331628 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-346075f1-ce5f-4fc0-a8b3-902329c1e219 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.215158 Oct 28 19:22:27.332521 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1650/3315] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:26 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:27.343906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bc037962-a217-41ca-a2c4-a64c44e6556e req-6b7d293f-3d35-40cf-b59a-3ed600bee820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "fd46a76b-d76c-49eb-b708-b512909cfaf3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:27.367440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bc037962-a217-41ca-a2c4-a64c44e6556e req-6b7d293f-3d35-40cf-b59a-3ed600bee820 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:27.371180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bc037962-a217-41ca-a2c4-a64c44e6556e req-6b7d293f-3d35-40cf-b59a-3ed600bee820 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:27.372561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bc037962-a217-41ca-a2c4-a64c44e6556e req-6b7d293f-3d35-40cf-b59a-3ed600bee820 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:27.398303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bc037962-a217-41ca-a2c4-a64c44e6556e req-6b7d293f-3d35-40cf-b59a-3ed600bee820 service nova] Creating event network-vif-plugged:fd46a76b-d76c-49eb-b708-b512909cfaf3 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:27.411762 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bc037962-a217-41ca-a2c4-a64c44e6556e req-6b7d293f-3d35-40cf-b59a-3ed600bee820 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069612 Oct 28 19:22:27.412475 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1651/3316] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:27.701023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:27.733332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:27.735054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:27.772233 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2091c041-7aab-4e01-ad21-4cc4c0c37bfd tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1891 microversion: 2.42 time: 1.282786 Oct 28 19:22:27.775135 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1666/3317] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:26 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1891 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:28.363609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:28.365170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:28.377491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:28.391744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:28.392746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:28.393774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:28.396973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:28.397641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:28.809037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:28.809898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:28.821034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:28.831580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:28.831894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:28.834505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:28.835020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:28.836961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:31.059454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:31.075623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:31.081333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:31.090643 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff9ae064-14f3-4534-87d1-99311ce41a7a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 2.285774 Oct 28 19:22:31.116388 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1667/3318] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:28 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:31.122039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a9bf215b-a0d0-4b7f-bfa7-e7d1c5d55448 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'create', calling method: .version_select at 0x7f1d774a9550>, body: {"keypair": {"name": "tempest-keypair-1487335839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtXNTIQ2MPh3X1Ko5q4vajnfXHKCPuVKtZ/SkjKsrZcvzfqlhGUpTWVwty3KSMvcyNPBGeHccvrkSfXXGbfQpZceqTXuyD44kw4ZhQd2uSnVz6iankTauv/7Ybkk6DN+w=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:31.139653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-a9bf215b-a0d0-4b7f-bfa7-e7d1c5d55448 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:22:31.152064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-a9bf215b-a0d0-4b7f-bfa7-e7d1c5d55448 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for user de03197eac374bf09c19018aa1417e88 and project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:22:31.207904 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a9bf215b-a0d0-4b7f-bfa7-e7d1c5d55448 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087451 Oct 28 19:22:31.215253 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1668/3319] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:22:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:31.223073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f8224507-9e02-4827-8251-a295c3e667dd req-24877de0-ee79-433d-acee-2c32cba2debf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-plugged", "status": "completed", "tag": "6b647e6b-b284-4f51-8eb1-e1c929fd1742"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:31.232716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:31.273381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:31.281608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:31.284560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f8224507-9e02-4827-8251-a295c3e667dd req-24877de0-ee79-433d-acee-2c32cba2debf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:31.285329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f8224507-9e02-4827-8251-a295c3e667dd req-24877de0-ee79-433d-acee-2c32cba2debf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:31.285796 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-259878a8-52a5-4ea7-87d6-c24008b9d3c6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 2.926296 Oct 28 19:22:31.286979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f8224507-9e02-4827-8251-a295c3e667dd req-24877de0-ee79-433d-acee-2c32cba2debf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:31.311971 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1652/3320] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:28 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 2955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:31.331349 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f8224507-9e02-4827-8251-a295c3e667dd req-24877de0-ee79-433d-acee-2c32cba2debf service nova] Creating event network-vif-plugged:6b647e6b-b284-4f51-8eb1-e1c929fd1742 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:31.338474 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f8224507-9e02-4827-8251-a295c3e667dd req-24877de0-ee79-433d-acee-2c32cba2debf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120608 Oct 28 19:22:31.339537 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1669/3321] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:31.639556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d48ac4e-bb28-4b6b-8328-eeb0c930194f tempest-FloatingIPDetailsNegativeTestJSON-392720736 tempest-FloatingIPDetailsNegativeTestJSON-392720736-project] Calling method '.version_select at 0x7f1d76ac0dc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:31.859498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG neutronclient.v2_0.client [None req-3d48ac4e-bb28-4b6b-8328-eeb0c930194f tempest-FloatingIPDetailsNegativeTestJSON-392720736 tempest-FloatingIPDetailsNegativeTestJSON-392720736-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 could not be found", "detail": ""}} {{(pid=120629) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 19:22:31.860249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3d48ac4e-bb28-4b6b-8328-eeb0c930194f tempest-FloatingIPDetailsNegativeTestJSON-392720736 tempest-FloatingIPDetailsNegativeTestJSON-392720736-project] HTTP exception thrown: Floating IP not found for ID 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d48ac4e-bb28-4b6b-8328-eeb0c930194f tempest-FloatingIPDetailsNegativeTestJSON-392720736 tempest-FloatingIPDetailsNegativeTestJSON-392720736-project] Request method failure captured: Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-floating-ips/5e5059f0-97d4-4dcc-a92e-e32d5728bee5 HTTP/1.1 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCv1C_anuK-zq6SxleNYx_846xCLTUQgLLqcXDguOVgRlSgIJFEZIU3mEzKA_Efv1hgSgvYLSEli0Op01F2jhDQTdMq_QTTxQUufx_HGoHJqZhhM1dW8SFkmkXI0m2frkj3dX_5fZoVIuzGPApMledt5CUr1PDk9r5zoXChWqAwohXw Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 578e407af94b4b5fae16e8da6809bb01 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-392720736 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/578e407af94b4b5fae16e8da6809bb01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_578e407af94b4b5fae16e8da6809bb01", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/578e407af94b4b5fae16e8da6809bb01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/578e407af94b4b5fae16e8da6809bb01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-392720736 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 578e407af94b4b5fae16e8da6809bb01 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-392720736 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-392720736-project Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 9553cbede9134fce95e4ea06c2658041 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-392720736-project Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: exception: Floating IP not found for ID 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5e5059f0-97d4-4dcc-a92e-e32d5728bee5'} Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 could not be found Oct 28 19:22:31.862357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec526233-9600-49da-ab9b-c3b3ff97e219'] Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5e5059f0-97d4-4dcc-a92e-e32d5728bee5. Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d48ac4e-bb28-4b6b-8328-eeb0c930194f tempest-FloatingIPDetailsNegativeTestJSON-392720736 tempest-FloatingIPDetailsNegativeTestJSON-392720736-project] Returning 404 to user: Floating IP not found for ID 5e5059f0-97d4-4dcc-a92e-e32d5728bee5 {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:22:31.866877 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d48ac4e-bb28-4b6b-8328-eeb0c930194f tempest-FloatingIPDetailsNegativeTestJSON-392720736 tempest-FloatingIPDetailsNegativeTestJSON-392720736-project] 10.222.0.44 "GET /compute/v2.1/os-floating-ips/5e5059f0-97d4-4dcc-a92e-e32d5728bee5" status: 404 len: 111 microversion: 2.1 time: 0.550776 Oct 28 19:22:31.874616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1653/3322] 10.222.0.44 () {58 vars in 1260 bytes} [Fri Oct 28 19:22:31 2022] GET /compute/v2.1/os-floating-ips/5e5059f0-97d4-4dcc-a92e-e32d5728bee5 => generated 111 bytes in 558 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:22:32.125014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:32.126488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:32.137904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:32.142672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:32.147790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:32.153133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:32.153944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:32.154666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:32.321026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:32.321747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:32.336049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:32.336936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:32.337606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:32.338566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:32.339295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:32.339949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:33.176404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:33.211981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:33.222612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:33.226756 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6bd0e178-7b4e-479c-a048-5914b7d99486 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.107543 Oct 28 19:22:33.227374 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1670/3323] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:32 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:33.367685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:33.385666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:33.387550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:33.390731 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11355d52-224b-4a90-8a3a-8fa18dd8fb10 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1879 microversion: 2.32 time: 1.075458 Oct 28 19:22:33.399605 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1654/3324] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:32 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1879 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:33.547316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1240378341", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "bf7ad3ba-74ac-478a-8126-c954bb343e95"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:33.685031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] validate_networks() for [('bf7ad3ba-74ac-478a-8126-c954bb343e95', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:22:34.256755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:34.257579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:34.266985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:34.275870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:34.277991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:34.280129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:34.287985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:34.288441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.009963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:36.025129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:36.036145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:36.051726 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92da287f-a4cc-484b-870b-79577c7eaf66 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.799308 Oct 28 19:22:36.053010 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1655/3325] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:34 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:36.073658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:36.081122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:36.119000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:36.130039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:36.133484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.138259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:36.138945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:22:36.139413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:22:36.139960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:22:36.140538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:22:36.143276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:22:36.144385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:36.158282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.170509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:36.172458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:36.174212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.175143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:36.178600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:36.179101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.259473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Getting quotas for project b35c6fa4d63c4faba04f986a0ef6ebff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:22:36.298341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Getting quotas for user e827a656445444478cc6239c8457d8c6 and project b35c6fa4d63c4faba04f986a0ef6ebff. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:22:36.337864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Going to run 2 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:22:36.340290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:22:36.437024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:22:36.613970 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7dae6b49-7f6b-4329-b4f8-7b1a9eba995d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.373258 Oct 28 19:22:36.614748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1671/3326] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:22:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:22:36.627021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:36.636235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:36.644513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Searching by: {'deleted': False, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:22:36.706463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:36.708385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:36.710676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.712320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:36.713958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:36.715087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:36.804409 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f3bcb290-8cfe-4456-938f-ca9d743b982d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.181908 Oct 28 19:22:36.813699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1672/3327] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:22:36 2022] GET /compute/v2.1/servers => generated 677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:36.823249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2fd99d0-28b4-4376-a8a3-318fd4003cb0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:36.824947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e2fd99d0-28b4-4376-a8a3-318fd4003cb0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:37.171198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e2fd99d0-28b4-4376-a8a3-318fd4003cb0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:37.184453 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2fd99d0-28b4-4376-a8a3-318fd4003cb0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1220 microversion: 2.1 time: 0.367587 Oct 28 19:22:37.187386 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1673/3328] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:36 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1220 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:37.206969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-36404910", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bc07b19-8281-4c7d-be78-251a99f71ed5"}], "security_groups": [{"name": "tempest-securitygroup--153015208"}], "key_name": "tempest-keypair-1487335839", "user_data": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:37.334929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:37.363200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:37.370527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:37.380874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1af31046-547f-499a-96b2-13223b9548de tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2833 microversion: 2.32 time: 1.326512 Oct 28 19:22:37.394942 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1656/3329] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:36 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2833 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:37.411609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:37.412299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:37.442966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:37.443691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:37.443951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:37.444721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:37.445175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:37.445603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:37.500566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] validate_networks() for [('8bc07b19-8281-4c7d-be78-251a99f71ed5', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:22:38.744926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:38.758917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:38.762793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:38.764052 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27eea8ba-c803-40c5-b723-6b8a5153e149 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.378886 Oct 28 19:22:38.780408 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1657/3330] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:37 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:38.792903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:38.793626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:38.809681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:38.831014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:38.833081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:38.836044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:38.837337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:38.841397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.081370 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c81b7683-2ed0-4f3f-8db0-09156f87985c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.305772 Oct 28 19:22:39.097147 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1658/3331] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:22:38 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1/os-interface => generated 1831 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:39.102935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:39.107682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:39.123736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.127279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.128732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.131190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.132083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.133304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.226791 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e83eb50-5251-4a89-8cd3-6e433278eebf tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.128310 Oct 28 19:22:39.235546 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1659/3332] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:22:39 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:39.249711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:39.255024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:39.277297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.278148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.279267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.288872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.289913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.290667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.654246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:39.676052 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6b72d1a-7896-4847-9a12-6d87f0e47a90 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1224 microversion: 2.1 time: 0.437069 Oct 28 19:22:39.725332 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1660/3333] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:39 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1224 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:39.757210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:39.761015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:39.800243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.800837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.801293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.802047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.802503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.809080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.919824 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1986fdc-9124-4ab0-8596-4e468e81e8b2 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/0fcf7b0d-0450-4cef-beb0-bcbf871e337b" status: 200 len: 194 microversion: 2.1 time: 0.188645 Oct 28 19:22:39.938613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1661/3334] 10.222.0.44 () {58 vars in 1413 bytes} [Fri Oct 28 19:22:39 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/0fcf7b0d-0450-4cef-beb0-bcbf871e337b => generated 194 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:39.954962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:39.957376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:39.976050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.976551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.981358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:39.985409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:39.987472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:39.990796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.287153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:22:41.287671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:22:41.288187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:22:41.288595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:22:41.289006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:22:41.307685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:41.308636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:41.309447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.310826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:41.311497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:41.312299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.336684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:22:41.346220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Getting quotas for user de03197eac374bf09c19018aa1417e88 and project 0a6b1cf2b07145eab7e090ed440efd5e. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:22:41.384815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:22:41.401648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:22:41.487328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:41.512566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:41.521183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:41.522412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-01e4ec2e-14dc-4b40-88c2-dbbf04d2126e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.582525 Oct 28 19:22:41.530764 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1662/3335] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:39 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:41.552297 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9fb8814e-db55-4057-828f-0dc6cf93d3e5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.363320 Oct 28 19:22:41.552963 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1674/3336] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:22:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 4365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:22:41.558425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:41.558954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:41.573887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:41.575262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=46 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:41.576124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:41.578552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:41.582794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:41.583581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.586642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:41.588094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:41.591155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.599091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:41.600000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:41.600667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.601653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:41.603381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:41.604225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:41.767124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:41.785730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lazy-loading 'services' on Instance uuid 1382020a-761f-4edd-902f-ceb8944d0585 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:22:41.807573 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad5992d6-5a58-425a-af8b-a71b3e05b003 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1278 microversion: 2.1 time: 0.253422 Oct 28 19:22:41.827001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1675/3337] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:41 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:41.839400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d83463ee-e9c8-4267-bcb7-c9adf8a35316 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:41.840433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d83463ee-e9c8-4267-bcb7-c9adf8a35316 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:42.006791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d83463ee-e9c8-4267-bcb7-c9adf8a35316 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:42.022860 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d83463ee-e9c8-4267-bcb7-c9adf8a35316 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1244 microversion: 2.1 time: 0.194111 Oct 28 19:22:42.023657 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1676/3338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:41 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:42.023758 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c0d0099-61e1-4038-a84f-c458c372d57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/0fcf7b0d-0450-4cef-beb0-bcbf871e337b" status: 202 len: 0 microversion: 2.1 time: 0.485289 Oct 28 19:22:42.024490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1663/3339] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:22:41 2022] DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/0fcf7b0d-0450-4cef-beb0-bcbf871e337b => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:22:42.560724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:42.561412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:42.577774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:42.578309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:42.583654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:42.584513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:42.589495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:42.590166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:42.838743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:42.840294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:42.852020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:42.852782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:42.853376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:42.854615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:42.855250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:42.855833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:43.130443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:43.133325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:43.158938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd476e95-544c-4f6c-aca0-366cc2af17bc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1278 microversion: 2.1 time: 0.325018 Oct 28 19:22:43.160601 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1664/3340] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:42 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:43.171640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:43.173805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:43.189612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:43.193436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:43.195368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:43.196809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:43.200136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:43.200962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:43.599480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:43.615838 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-52b663a6-fa97-479f-b414-51c698f4c47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1296 microversion: 2.1 time: 0.453864 Oct 28 19:22:43.616840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1665/3341] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:43 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1296 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:43.668397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f69af253-9c0b-4c87-982b-af7a5b3af456 req-cc29627f-88ca-4ac5-85eb-6c6c3cd43ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "tag": "8b43571d-9302-4a3e-afb5-3cd7c6545571"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:43.703339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f69af253-9c0b-4c87-982b-af7a5b3af456 req-cc29627f-88ca-4ac5-85eb-6c6c3cd43ba4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:43.706242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f69af253-9c0b-4c87-982b-af7a5b3af456 req-cc29627f-88ca-4ac5-85eb-6c6c3cd43ba4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:43.706963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f69af253-9c0b-4c87-982b-af7a5b3af456 req-cc29627f-88ca-4ac5-85eb-6c6c3cd43ba4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:43.745502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f69af253-9c0b-4c87-982b-af7a5b3af456 req-cc29627f-88ca-4ac5-85eb-6c6c3cd43ba4 service nova] Creating event network-changed:8b43571d-9302-4a3e-afb5-3cd7c6545571 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:22:43.768860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f69af253-9c0b-4c87-982b-af7a5b3af456 req-cc29627f-88ca-4ac5-85eb-6c6c3cd43ba4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104364 Oct 28 19:22:43.775955 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1666/3342] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:22:43.829810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:43.844169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:43.845760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:43.847023 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4330d94-e6ae-48ad-a513-700de57d152c tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.290377 Oct 28 19:22:43.847898 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1677/3343] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:42 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:44.187708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:44.188611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:44.202075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:44.205535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:44.208078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:44.210580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:44.212641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:44.214554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:44.445669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:44.465547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-174633e1-6ebc-4739-955f-2c4620f1df1a tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1278 microversion: 2.1 time: 0.281752 Oct 28 19:22:44.467835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1667/3344] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:44 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:44.645682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:44.646303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:44.672910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:44.673676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:44.674140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:44.684362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:44.686235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:44.686733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:44.878315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:44.878980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:44.892053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:44.892624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:44.893108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:44.893884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:44.894349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:44.900443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:44.942668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:44.960144 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-acdfec61-95d3-48a1-ac11-c84a94a1ae66 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1302 microversion: 2.1 time: 0.315248 Oct 28 19:22:44.963109 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1678/3345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:44 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1302 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:45.492130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:45.492666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:45.515290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:45.515808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:45.516319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:45.517133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:45.517534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:45.518004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:46.249149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:46.294729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:46.296638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:46.298239 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a914dd32-020a-4e6c-bb5c-3406e97a31c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.424291 Oct 28 19:22:46.299582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1668/3346] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:44 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:46.307398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:46.308292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:46.317024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:46.317986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:46.318708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:46.319670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:46.320475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:46.321733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:46.958122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:46.960279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:46.981718 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a862999-0b98-4809-af3a-9a22ebc6ea9d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 1.494177 Oct 28 19:22:46.982158 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a233140a-aef3-41d2-b0f2-afe1c23a460b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1302 microversion: 2.1 time: 0.681062 Oct 28 19:22:46.983535 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1669/3347] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:46 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1302 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:47.010378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1679/3348] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:45 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:47.330347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:47.332292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:47.355722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:47.367552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:47.368530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:47.372674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:47.378529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:47.379491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:47.951679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:47.966758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:47.968225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:47.969479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-941d5216-0192-4c22-84a9-a7a1bacc586a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.643611 Oct 28 19:22:47.988029 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1670/3349] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:47 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:48.006503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:48.007197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:48.021383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:48.021918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:48.022372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:48.023158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:48.023632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:48.024063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:48.035820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:48.036443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:48.058864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:48.059392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:48.059851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:48.060607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:48.061069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:48.071993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:49.106511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:49.121242 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d83915e-4067-40dd-8203-b8a79e5ebe5e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 1.119455 Oct 28 19:22:49.126258 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1680/3350] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:48 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:49.139984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:49.170068 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb8ef42d-1e0b-4f0c-aa62-80f82dba2739 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 1.138742 Oct 28 19:22:49.177363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:49.178135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:49.178358 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1671/3351] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:48 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:49.193084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c1b16dcb-adad-446f-8d2f-e6a5591a89cd req-72acb991-ed32-434a-b845-7f852c260591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe", "tag": "1ebdd540-c80e-4843-b78b-b87cb9539ce5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:49.195214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:49.195946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:49.197180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:49.198341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:49.201398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:49.202106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:49.247900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c1b16dcb-adad-446f-8d2f-e6a5591a89cd req-72acb991-ed32-434a-b845-7f852c260591 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:49.254246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c1b16dcb-adad-446f-8d2f-e6a5591a89cd req-72acb991-ed32-434a-b845-7f852c260591 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:49.254749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c1b16dcb-adad-446f-8d2f-e6a5591a89cd req-72acb991-ed32-434a-b845-7f852c260591 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:49.299946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c1b16dcb-adad-446f-8d2f-e6a5591a89cd req-72acb991-ed32-434a-b845-7f852c260591 service nova] Creating event network-changed:1ebdd540-c80e-4843-b78b-b87cb9539ce5 for instance 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe on n-h2-862769-3 Oct 28 19:22:49.309347 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c1b16dcb-adad-446f-8d2f-e6a5591a89cd req-72acb991-ed32-434a-b845-7f852c260591 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126042 Oct 28 19:22:49.312269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1672/3352] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:49.706741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:49.717980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:49.720239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:49.721961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74d7e8eb-357d-4123-8e30-64cfac09c183 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.565301 Oct 28 19:22:49.741790 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1681/3353] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:49 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:50.151101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:50.152174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:50.167684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.172356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.173880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.175355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.177296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.177842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.205021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:50.205674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:50.244887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.248018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.248478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.251423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.253322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.254525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.695080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:50.711715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-454a1484-25c8-4d98-b344-1a208443e901 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.514853 Oct 28 19:22:50.716620 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1682/3354] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:50 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:50.722616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-079b0751-8f5c-4a8c-9c98-17af587a7634 req-f11af2c0-b5e0-43fc-873f-fc0be0e9fc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf8bd2c-1aed-43f6-9773-98b79ee35739", "tag": "410ee5dc-145e-4989-b3c0-0f8f513f4f26"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:50.741728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:50.744389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-079b0751-8f5c-4a8c-9c98-17af587a7634 req-f11af2c0-b5e0-43fc-873f-fc0be0e9fc7d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.746429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-079b0751-8f5c-4a8c-9c98-17af587a7634 req-f11af2c0-b5e0-43fc-873f-fc0be0e9fc7d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.747071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-079b0751-8f5c-4a8c-9c98-17af587a7634 req-f11af2c0-b5e0-43fc-873f-fc0be0e9fc7d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.759176 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f8be8a25-a8f0-4b06-a7cb-34dc0d7691a1 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.614379 Oct 28 19:22:50.762407 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1673/3355] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:50 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:50.766756 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-079b0751-8f5c-4a8c-9c98-17af587a7634 req-f11af2c0-b5e0-43fc-873f-fc0be0e9fc7d service nova] Creating event network-changed:410ee5dc-145e-4989-b3c0-0f8f513f4f26 for instance daf8bd2c-1aed-43f6-9773-98b79ee35739 on n-h2-862769-3 Oct 28 19:22:50.786790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:50.788040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:50.788356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-079b0751-8f5c-4a8c-9c98-17af587a7634 req-f11af2c0-b5e0-43fc-873f-fc0be0e9fc7d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070188 Oct 28 19:22:50.788995 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1683/3356] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:50.805383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.807968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.808509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.810131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:50.812111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:50.814132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:50.996987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:50.997941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:51.002503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:51.015797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.016592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.017136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.020270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.020992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.021538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.322090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:51.325912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:51.336944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:51.338672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:51.340281 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-479d4bb1-8811-4ea9-87ea-5d617a722748 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.576119 Oct 28 19:22:51.340886 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1674/3357] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:50 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:51.347349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7751318b-613a-4e11-b524-4e3b142f83e5 req-a0092c08-7c73-4a4f-be03-f280757214ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333a6415-d488-4d8e-bf1d-d37ad5d7a119", "tag": "1409d499-1122-4843-88af-14d1a9134087"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:51.358665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7751318b-613a-4e11-b524-4e3b142f83e5 req-a0092c08-7c73-4a4f-be03-f280757214ee service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.359486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7751318b-613a-4e11-b524-4e3b142f83e5 req-a0092c08-7c73-4a4f-be03-f280757214ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.360129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7751318b-613a-4e11-b524-4e3b142f83e5 req-a0092c08-7c73-4a4f-be03-f280757214ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.375164 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7751318b-613a-4e11-b524-4e3b142f83e5 req-a0092c08-7c73-4a4f-be03-f280757214ee service nova] Creating event network-changed:1409d499-1122-4843-88af-14d1a9134087 for instance 333a6415-d488-4d8e-bf1d-d37ad5d7a119 on n-h1-862769-3 Oct 28 19:22:51.383912 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7751318b-613a-4e11-b524-4e3b142f83e5 req-a0092c08-7c73-4a4f-be03-f280757214ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041556 Oct 28 19:22:51.386077 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1675/3358] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:51.465381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:51.495824 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05088532-1e8b-4966-81dc-7f9830a189be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.500891 Oct 28 19:22:51.502565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:51.504657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:51.515553 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1684/3359] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:50 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:51.522030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1733989334"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:51.525243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:51.525556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.526718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.528876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.531438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.534851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.535900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.536579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.537512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.538049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.539106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.539238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.539939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.638509 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5484e2a-e6ea-49c6-ae46-9761a70d6af9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/49e8a315-33a9-461b-a2cd-7811ce380549" status: 200 len: 194 microversion: 2.1 time: 0.141616 Oct 28 19:22:51.642785 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1676/3360] 10.222.0.44 () {58 vars in 1413 bytes} [Fri Oct 28 19:22:51 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/49e8a315-33a9-461b-a2cd-7811ce380549 => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:22:51.659490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:51.661457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:51.679697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.680547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.681268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.683305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.685589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.686480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.872143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lazy-loading 'services' on Instance uuid 1382020a-761f-4edd-902f-ceb8944d0585 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:22:51.923062 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-734baa26-ffde-47a0-8f63-7271387bb83f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.405453 Oct 28 19:22:51.927541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1685/3361] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:22:51 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 28 19:22:51.935286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:51.950557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:51.964104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.964655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.965379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:51.966951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:51.967758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:51.968408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.024458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=20 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:52.029673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2474343d-3327-4709-aa44-ad8f68b29123 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/49e8a315-33a9-461b-a2cd-7811ce380549" status: 202 len: 0 microversion: 2.1 time: 0.380733 Oct 28 19:22:52.030635 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1677/3362] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:22:51 2022] DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments/49e8a315-33a9-461b-a2cd-7811ce380549 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:22:52.056669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:52.057411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:52.072197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:52.072700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:52.073139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.089444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:52.093802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:52.095558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.407615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:52.426410 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1004f497-cf97-4d34-a682-c7ea358a2277 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.496950 Oct 28 19:22:52.440894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:52.446991 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1686/3363] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:51 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:52.451543 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-761f221c-37c7-43f8-bc99-5c4705a9c650 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.418621 Oct 28 19:22:52.454063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:52.455167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:52.455786 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1678/3364] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:52 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:52.462423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:52.463013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:52.464184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:52.464961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.465900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:52.466393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:52.467343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:52.467996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.479219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:52.479636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:52.480080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.480791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:52.481248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:52.481665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:52.493980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:52.910168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:52.917596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:52.930971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:52.933195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:52.934947 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5f7cecb8-994e-40b7-afd2-5bb62d14e9f5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.477941 Oct 28 19:22:52.935900 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1679/3365] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:52 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:52.937107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d348a9db-84ec-4bf4-a771-cb4b699a214a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.486125 Oct 28 19:22:52.938019 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1687/3366] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:52 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:53.454987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:53.456896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:53.478181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:53.478181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:53.478181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:53.478181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:53.478181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:53.481666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:53.482858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:53.483330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:53.497603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:53.500634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:53.501786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:53.502887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:53.503609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:53.504299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:53.930320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:53.943103 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fac3904-f08c-4d56-95e2-142cc75f34a0 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.493418 Oct 28 19:22:53.962485 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1680/3367] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:53 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:53.980230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:53.981117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:53.984257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:53.992546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-501c9afa-6f70-4362-a205-14ffb71d32e4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.520809 Oct 28 19:22:53.993130 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1688/3368] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:53 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:54.003189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.003189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.003189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:54.003189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.003189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.003189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:54.021535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:54.023918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:54.042069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.043254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.043881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:54.044782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.045410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.045995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:54.434300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:54.472418 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a19e29b6-8b2d-493a-add0-8204ab580056 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1685 microversion: 2.1 time: 0.507904 Oct 28 19:22:54.478578 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1681/3369] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:53 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1685 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:54.543319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:54.557573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:54.560732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:54.562862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e313d2d9-9351-48f8-92f4-e88e3ed14b3b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.544885 Oct 28 19:22:54.563888 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1689/3370] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:54 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:54.621107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d8f70d06-ba1f-41a6-8723-0bbd1fa93129 req-77695206-aba8-4a5a-af94-d2014259e3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-unplugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:54.646329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d8f70d06-ba1f-41a6-8723-0bbd1fa93129 req-77695206-aba8-4a5a-af94-d2014259e3b5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.647272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d8f70d06-ba1f-41a6-8723-0bbd1fa93129 req-77695206-aba8-4a5a-af94-d2014259e3b5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.648602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d8f70d06-ba1f-41a6-8723-0bbd1fa93129 req-77695206-aba8-4a5a-af94-d2014259e3b5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:54.682466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d8f70d06-ba1f-41a6-8723-0bbd1fa93129 req-77695206-aba8-4a5a-af94-d2014259e3b5 service nova] Creating event network-vif-unplugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:22:54.715742 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d8f70d06-ba1f-41a6-8723-0bbd1fa93129 req-77695206-aba8-4a5a-af94-d2014259e3b5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100924 Oct 28 19:22:54.717039 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1682/3371] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:54.970815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:54.971448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:54.979001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.979496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.979937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:54.981299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:54.981299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:54.981544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:55.024517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:55.025503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:55.037611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:55.039683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:55.041523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:55.042827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:55.045219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:55.047524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:55.073693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:55.369299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:55.382555 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49fac8ef-08aa-4ca3-a0be-b62af5644014 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.416414 Oct 28 19:22:55.394474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:55.397926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1690/3372] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:54 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:55.405501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-51b79997-9dd8-4c26-9489-3e6821795fd8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.384866 Oct 28 19:22:55.408006 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1683/3373] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:55 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:55.499335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:55.499976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:55.525538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:55.527155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:55.527794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:55.528848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:55.529478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:55.530523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:55.593615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:55.594880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:55.604768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:55.610410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:55.610912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:55.611847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:55.612500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:55.612928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:56.299460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:56.314161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:56.316980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:56.318732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:56.320666 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-718541fe-cb78-4635-aea6-2f44c27a96f0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.732193 Oct 28 19:22:56.321558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1684/3374] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:55 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:56.327937 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6686761-828b-4119-81d4-1a93befd6816 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1685 microversion: 2.1 time: 0.833563 Oct 28 19:22:56.331523 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1691/3375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:55 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1685 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:56.404853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:56.405462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:56.415299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:56.415777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:56.416202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:56.416904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:56.417755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:56.418170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:56.436590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:56.437660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:56.453170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:56.458002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:56.459289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:56.465161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:56.466139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:56.470729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:56.747290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:56.758843 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e0e9c660-3d7b-437f-a766-1c6b3d571c26 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.357726 Oct 28 19:22:56.771052 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1685/3376] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:56 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:56.868469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:56.878428 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9efc0366-a869-46ee-8612-7b1fede7f864 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.446853 Oct 28 19:22:56.884908 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1692/3377] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:56 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:57.367400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:57.372603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:57.377643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:57.378220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:57.431872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:57.437698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:57.442029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:57.443043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:57.444052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:57.446551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:57.448008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:57.449469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:57.450445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:57.451656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:57.454184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:57.456179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.132929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:58.169150 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a77c8257-82c5-4985-a1f7-2f780aa7ae46 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.813201 Oct 28 19:22:58.172691 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1693/3378] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:57 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:58.191151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:58.193178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:58.222289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.230585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.240205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.241608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.244883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.250565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.264490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:58.285802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:58.288444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:58.293780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-708fab60-1e1b-4d7d-ab1c-ed7249c32b70 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.947588 Oct 28 19:22:58.296504 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1686/3379] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:57 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:22:58.307556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:58.309053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:58.324059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.324916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.326611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.327662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.330047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.330760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.898023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:58.923715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5871a607-498f-4072-af0c-83411c2c2fda tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.749446 Oct 28 19:22:58.925299 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1694/3380] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:58 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:58.936457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-920f9561-2df7-4942-9e5a-0312990622ac req-4917a132-95b1-4876-8409-36779ab798bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe", "name": "network-vif-plugged", "status": "completed", "tag": "1ebdd540-c80e-4843-b78b-b87cb9539ce5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:58.959142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-920f9561-2df7-4942-9e5a-0312990622ac req-4917a132-95b1-4876-8409-36779ab798bf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.961203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-920f9561-2df7-4942-9e5a-0312990622ac req-4917a132-95b1-4876-8409-36779ab798bf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.962771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-920f9561-2df7-4942-9e5a-0312990622ac req-4917a132-95b1-4876-8409-36779ab798bf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.980904 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-920f9561-2df7-4942-9e5a-0312990622ac req-4917a132-95b1-4876-8409-36779ab798bf service nova] Creating event network-vif-plugged:1ebdd540-c80e-4843-b78b-b87cb9539ce5 for instance 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe on n-h2-862769-3 Oct 28 19:22:58.990376 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-920f9561-2df7-4942-9e5a-0312990622ac req-4917a132-95b1-4876-8409-36779ab798bf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062681 Oct 28 19:22:58.991307 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1695/3381] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:59.027488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:59.064376 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ddeddff0-b218-4437-a2a9-b1c673cce74d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.756475 Oct 28 19:22:59.074338 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1687/3382] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:58 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:59.203606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:59.204785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:59.245386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.245386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.245386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.270114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.273193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.273722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.325883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:59.326334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:59.337963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.343407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.343858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.344642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.345105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.345545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.677332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:59.692409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:59.698502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:59.702111 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6ada19ce-e754-4080-b6ba-2683481c95df tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.379984 Oct 28 19:22:59.704420 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1688/3383] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:22:59 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:22:59.904445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:59.925666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a980c72-7f4b-493b-bd14-daf93d03e276 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.729069 Oct 28 19:22:59.944784 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1696/3384] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:59 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:59.953098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:59.954048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:59.969591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.972836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.973296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.977229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.983738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.984207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.258769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:00.268383 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2402edaf-381a-410a-8e3b-60aeca86c500 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.319130 Oct 28 19:23:00.270116 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1689/3385] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:59 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:00.275723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:00.276670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:00.293959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:00.294862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:00.296430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.297424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:00.298141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:00.299188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.686428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:00.695998 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-33ecbd75-d333-4d3d-9948-a6d69636f777 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.424375 Oct 28 19:23:00.705406 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1690/3386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:00 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:00.732459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:00.733071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:00.743548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:00.744037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:00.744468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.745170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:00.745614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:00.746029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.770872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1985010937", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a2a9fb07-7594-4148-91c4-67cde00ca3a4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:01.055342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:01.073983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:01.075653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:01.077443 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68588f57-4dd2-40fa-b2bd-61058ba366d5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.348434 Oct 28 19:23:01.078662 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1691/3387] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:00 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:23:01.104278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:01.104910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:01.123292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.123804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.124451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.125349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.125968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.126582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.404624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:01.415865 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dbad8d00-6757-43b4-af86-927fe61e6132 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.334145 Oct 28 19:23:01.416792 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1692/3388] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:01 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:01.431099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0d8252e3-1544-4beb-b7a3-9ffe183a1416 req-7f58c268-f8ad-4907-89a2-4adaad0d54b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333a6415-d488-4d8e-bf1d-d37ad5d7a119", "name": "network-vif-plugged", "status": "completed", "tag": "1409d499-1122-4843-88af-14d1a9134087"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:01.442092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d8252e3-1544-4beb-b7a3-9ffe183a1416 req-7f58c268-f8ad-4907-89a2-4adaad0d54b7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.443080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d8252e3-1544-4beb-b7a3-9ffe183a1416 req-7f58c268-f8ad-4907-89a2-4adaad0d54b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.443736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d8252e3-1544-4beb-b7a3-9ffe183a1416 req-7f58c268-f8ad-4907-89a2-4adaad0d54b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.459178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0d8252e3-1544-4beb-b7a3-9ffe183a1416 req-7f58c268-f8ad-4907-89a2-4adaad0d54b7 service nova] Creating event network-vif-plugged:1409d499-1122-4843-88af-14d1a9134087 for instance 333a6415-d488-4d8e-bf1d-d37ad5d7a119 on n-h1-862769-3 Oct 28 19:23:01.466408 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0d8252e3-1544-4beb-b7a3-9ffe183a1416 req-7f58c268-f8ad-4907-89a2-4adaad0d54b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047833 Oct 28 19:23:01.468516 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1693/3389] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:01.475924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:01.477258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:01.487679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.488526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.489219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.491114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.492181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.492840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.644240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] validate_networks() for [('a2a9fb07-7594-4148-91c4-67cde00ca3a4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:23:01.771707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:01.786971 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-74058201-771c-4fac-849a-cc9057f72d14 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1320 microversion: 2.1 time: 0.316023 Oct 28 19:23:01.790520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1694/3390] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:01 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:01.797271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:01.805287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:01.830165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.832737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.834409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.836590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.837160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.838515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.943072 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f7357a4b-2aaa-4ef5-82f7-a8ee0cacdff8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133224 Oct 28 19:23:01.946251 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1695/3391] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:23:01 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:23:01.968857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:01.970893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:01.983184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.983683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.984163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.984862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.985343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.985757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.259168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:02.272883 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d8f791d-b81e-4ebd-b3be-01520db4231b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.316622 Oct 28 19:23:02.290490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1696/3392] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:01 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:02.304510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:02.305421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:02.323163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.325141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.327069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.329454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.330214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.331676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.652243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:02.665574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:02.671774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:02.673423 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d9a1517f-259b-44c8-ad19-3ba594df083f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.379755 Oct 28 19:23:02.682561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1697/3393] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:02 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:02.687509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:02.690208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:02.696967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.697721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.698370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.699302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.702660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.703370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.757086 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64b7200e-a210-4e88-9285-a006159ed57c tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073326 Oct 28 19:23:02.757953 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1698/3394] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:23:02 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:23:02.763313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:02.764550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:02.774047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.774629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.778270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.779224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.780178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.782679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.909532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:23:02.909969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:23:02.912183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:23:02.914672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:23:02.916203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:23:02.947486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.948067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.948521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.949381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.949923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.950704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.997664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:23:03.007051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for user 6ea87a8ceb604f0aa3baa5453a3bd434 and project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:23:03.032522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:23:03.035222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:23:03.127892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fb391efa-755e-4ac2-b624-ae1cbc4cdeb5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.111814 Oct 28 19:23:03.135850 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1697/3395] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:23:03.144601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:03.145391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:03.152152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.152653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.153085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.153826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.154250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.155070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.156312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:03.174179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eb0ccb54-8446-408a-aa90-ff2c291e274e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.414613 Oct 28 19:23:03.174810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1699/3396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:02 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:03.220507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:03.221527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:03.239455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.243075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.252037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.254164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.255158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.255822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.302613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:23:03.311172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:03.528485 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f80819c3-7e2a-4028-835e-13a93e5f0aa9 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 204 len: 0 microversion: 2.1 time: 0.328963 Oct 28 19:23:03.529708 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1700/3397] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:03 2022] DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:03.552838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2caacd01-0fb0-40e7-b3a7-2d0b3184f386 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:03.553536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2caacd01-0fb0-40e7-b3a7-2d0b3184f386 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:03.695788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2caacd01-0fb0-40e7-b3a7-2d0b3184f386 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:03.702752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:03.709890 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2caacd01-0fb0-40e7-b3a7-2d0b3184f386 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1208 microversion: 2.1 time: 0.177588 Oct 28 19:23:03.728187 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df8c232e-0cc0-42d5-886e-7e7b61f4564b tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 200 len: 1507 microversion: 2.1 time: 0.594695 Oct 28 19:23:03.728840 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1698/3398] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:03 2022] GET /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:03.731153 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1701/3399] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:03 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1208 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:03.736875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e01f9e0e-f66f-46f1-954e-27dd59faf655 req-50d2025f-bd18-414b-965a-e456c44383cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf8bd2c-1aed-43f6-9773-98b79ee35739", "name": "network-vif-plugged", "status": "completed", "tag": "410ee5dc-145e-4989-b3c0-0f8f513f4f26"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:03.748964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e01f9e0e-f66f-46f1-954e-27dd59faf655 req-50d2025f-bd18-414b-965a-e456c44383cb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.749840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e01f9e0e-f66f-46f1-954e-27dd59faf655 req-50d2025f-bd18-414b-965a-e456c44383cb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.750518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e01f9e0e-f66f-46f1-954e-27dd59faf655 req-50d2025f-bd18-414b-965a-e456c44383cb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.762413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:03.772535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:03.773138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e01f9e0e-f66f-46f1-954e-27dd59faf655 req-50d2025f-bd18-414b-965a-e456c44383cb service nova] Creating event network-vif-plugged:410ee5dc-145e-4989-b3c0-0f8f513f4f26 for instance daf8bd2c-1aed-43f6-9773-98b79ee35739 on n-h2-862769-3 Oct 28 19:23:03.781333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e01f9e0e-f66f-46f1-954e-27dd59faf655 req-50d2025f-bd18-414b-965a-e456c44383cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048531 Oct 28 19:23:03.781967 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1702/3400] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:03.787060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:03.787762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:03.795477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.795722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.796391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.797002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.798449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.798584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.799164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.800089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.800681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.801176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.801831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.805132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.319555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.342656 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ce21315-402e-4e68-ab16-6e4416069036 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1673 microversion: 2.1 time: 0.559482 Oct 28 19:23:04.347227 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1703/3401] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:03 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1673 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:04.351412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.374925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:04.376186 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd531c1a-2d28-45ff-96b2-bf013e64b64d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.622207 Oct 28 19:23:04.377949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1699/3402] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:03 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:04.383104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:04.384154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:04.386788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:04.396791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:04.399549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:04.401196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.402978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:04.404273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:04.406749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:04.408535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.414458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:04.415583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.416670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:04.418028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:04.418939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.935611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.939464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.949093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.951099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.953456 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-555de9fe-2563-4d82-a9c8-42ee0e761aaa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.591190 Oct 28 19:23:04.966769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1704/3403] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:04 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:04.972904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:04.973530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:04.979217 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c367a909-1243-4e4f-8f55-4ea158ce1c64 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe" status: 200 len: 1507 microversion: 2.1 time: 0.599319 Oct 28 19:23:04.985920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:04.987006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:04.987630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.990237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:04.990761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:04.991174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.992179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1700/3404] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:04 2022] GET /compute/v2.1/servers/84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe => generated 1507 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:04.998537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:04.999335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:05.037845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.038708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.039345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.040227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.040853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.041451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.218239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:05.254305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c2e01b7-5dca-438e-8632-d0e553a8f45b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1260 microversion: 2.1 time: 0.260365 Oct 28 19:23:05.254963 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1701/3405] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:04 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:05.279082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:05.279599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:05.309989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.310743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.312011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.313115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.317359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.318147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.439777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:23:05.593000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:05.616105 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8a63200-eeeb-433c-b04d-0281e6cbc432 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.653239 Oct 28 19:23:05.619520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1705/3406] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:04 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:05.638655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:05.641127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:05.656365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.660099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.661796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.663918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.665491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.666854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.729481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61ef44b4-baa9-4872-904e-565465407f0f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "DELETE /compute/v2.1/servers/84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe" status: 204 len: 0 microversion: 2.1 time: 0.464566 Oct 28 19:23:05.733177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1702/3407] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:05 2022] DELETE /compute/v2.1/servers/84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:05.764770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:05.765488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:05.789176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.789682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.790125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.798502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.799139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.799612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.250052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:06.266931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1e1ffee-6e36-45e0-9bbb-5983b812c2b6 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1673 microversion: 2.1 time: 0.643653 Oct 28 19:23:06.267536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1706/3408] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:05 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1673 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:06.322341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:06.327360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:06.351813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.356224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.359896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.362006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.367670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.368444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.512230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: 333a6415-d488-4d8e-bf1d-d37ad5d7a119] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:23:06.588576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:06.596118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:06.602015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d1c3c53-29b6-4c9b-9391-3549dde5e054 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1369 microversion: 2.1 time: 0.864128 Oct 28 19:23:06.602844 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1703/3409] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:05 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1369 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:06.612037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:06.616062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:06.634110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.635143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.637208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.639467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.642345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.643431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.715747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:06.758954 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1931c698-696c-4b8b-bbe0-b15011e4d5c3 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "DELETE /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119" status: 204 len: 0 microversion: 2.1 time: 0.460103 Oct 28 19:23:06.761184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1707/3410] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:06 2022] DELETE /compute/v2.1/servers/333a6415-d488-4d8e-bf1d-d37ad5d7a119 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:06.772378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:06.773533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:06.804363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.804917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.805365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.806644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.807132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.807562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.018912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:08.039738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:08.046372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:08.048260 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-681a6ec2-0460-4383-8315-df49db9add48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.440286 Oct 28 19:23:08.050654 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1704/3411] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:06 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:08.063938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:08.064920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:08.087900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:08.088451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:08.088909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.091347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:08.091820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:08.092256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.304202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:08.317595 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e671f26-116f-484c-8a4e-828a8c441c9d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 1.552481 Oct 28 19:23:08.319630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1708/3412] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:06 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:08.331044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-504053749", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "bf7ad3ba-74ac-478a-8126-c954bb343e95"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:08.895975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:08.911221 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3dc0ad8c-226f-4c73-8758-305af945920f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.859214 Oct 28 19:23:08.930420 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1705/3413] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:08 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:08.956200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:08.957144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:08.968615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:08.973765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:08.974407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.975794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:08.977341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:08.978922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.998833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] validate_networks() for [('bf7ad3ba-74ac-478a-8126-c954bb343e95', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:23:09.644702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:09.662343 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d05b50e-3a06-4e34-9c61-fdf6d664be6b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1673 microversion: 2.1 time: 0.717501 Oct 28 19:23:09.667739 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1706/3414] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:08 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1673 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:09.678778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:09.679411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:09.701226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:09.701541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:09.701982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:09.702726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:09.703179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:09.703603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:10.204835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:10.214425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d47b4b4c-b3c9-45ba-b8e5-cc296930fa3a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1562 microversion: 2.1 time: 0.544528 Oct 28 19:23:10.219819 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1707/3415] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:09 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1562 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:10.229755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3cf8ead8-c359-4a96-b6be-1143e396a04e req-2b7db82e-38d6-4a6d-8065-7bc42dfd175c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-plugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:10.253293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3cf8ead8-c359-4a96-b6be-1143e396a04e req-2b7db82e-38d6-4a6d-8065-7bc42dfd175c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:10.254108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3cf8ead8-c359-4a96-b6be-1143e396a04e req-2b7db82e-38d6-4a6d-8065-7bc42dfd175c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:10.254745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3cf8ead8-c359-4a96-b6be-1143e396a04e req-2b7db82e-38d6-4a6d-8065-7bc42dfd175c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:10.285542 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3cf8ead8-c359-4a96-b6be-1143e396a04e req-2b7db82e-38d6-4a6d-8065-7bc42dfd175c service nova] Creating event network-vif-plugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:23:10.320026 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3cf8ead8-c359-4a96-b6be-1143e396a04e req-2b7db82e-38d6-4a6d-8065-7bc42dfd175c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098618 Oct 28 19:23:10.336566 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1708/3416] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:10.505364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a570333b-6332-4e43-878c-084ebd089f17 req-10bfd81d-14c0-4211-b37a-95c9115e0fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe", "name": "network-vif-deleted", "tag": "1ebdd540-c80e-4843-b78b-b87cb9539ce5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:10.534895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a570333b-6332-4e43-878c-084ebd089f17 req-10bfd81d-14c0-4211-b37a-95c9115e0fb4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:10.535453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a570333b-6332-4e43-878c-084ebd089f17 req-10bfd81d-14c0-4211-b37a-95c9115e0fb4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:10.535906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a570333b-6332-4e43-878c-084ebd089f17 req-10bfd81d-14c0-4211-b37a-95c9115e0fb4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:10.580545 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a570333b-6332-4e43-878c-084ebd089f17 req-10bfd81d-14c0-4211-b37a-95c9115e0fb4 service nova] Creating event network-vif-deleted:1ebdd540-c80e-4843-b78b-b87cb9539ce5 for instance 84ba2ec3-1ad6-404e-a0ea-d1e323dd92fe on n-h2-862769-3 Oct 28 19:23:10.602201 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a570333b-6332-4e43-878c-084ebd089f17 req-10bfd81d-14c0-4211-b37a-95c9115e0fb4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251448 Oct 28 19:23:10.611911 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1709/3417] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:10.631720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:10.632525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:10.662714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:10.670049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:10.670512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:10.671306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:10.671821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:10.672272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.027297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:23:11.027297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:23:11.027297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:23:11.027995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:23:11.028318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:23:11.048954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.049504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.049939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.050669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.051539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.051977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.099612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Getting quotas for project b35c6fa4d63c4faba04f986a0ef6ebff. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:23:11.111794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Getting quotas for user e827a656445444478cc6239c8457d8c6 and project b35c6fa4d63c4faba04f986a0ef6ebff. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:23:11.138719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Going to run 2 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:23:11.141736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:23:11.200454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=e298007b-e300-4fec-ae1c-21fd686947e8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:23:11.346476 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17abbd00-bffb-41b1-bad0-e017b1e118f9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.023215 Oct 28 19:23:11.351269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1709/3418] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 3031 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 19:23:11.362668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:11.363590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:11.391023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.392218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.393248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.394206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.394887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.395473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.529199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:11.551156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:11.552657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:11.553959 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29c049d8-826d-43e9-8b6a-a82da0cdd72b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.940959 Oct 28 19:23:11.554611 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1710/3419] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:10 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:11.586266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:11.587945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:11.609392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.610521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.611197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.615820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.617627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.618659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.119774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:12.136224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8247580d-199c-4d6b-951c-0dbcb0acbd11 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 0.783202 Oct 28 19:23:12.136825 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1710/3420] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:11 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:12.156068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:12.158882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:12.162488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:12.169461 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-34918ce3-8a81-49dc-9b5f-1590527b9392 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.590089 Oct 28 19:23:12.172845 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1711/3421] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:11 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:12.178924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.179425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.179861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.180820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.181367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.181800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.187032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:12.187734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:12.225148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.225777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.226234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.227074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.227531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.227963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.353977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.354472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.355125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.356289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lazy-loading 'fault' on Instance uuid 1382020a-761f-4edd-902f-ceb8944d0585 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:23:12.513806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3f354a00cf468ca48261a56f68c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd7944caa7b47adb4bc10f2804ad2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:12.545878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-043fef3e-5f6f-44f5-a816-8f7167f6c42a tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 200 len: 1327 microversion: 2.1 time: 0.369092 Oct 28 19:23:12.549347 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1712/3422] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:12 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 1327 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:12.553061 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c082c6ce-5483-4b4e-a262-a45aacbf02cf tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.410451 Oct 28 19:23:12.554333 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1711/3423] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:23:12 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-interface => generated 285 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:12.559162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:12.569257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:12.570046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Searching by: {'deleted': False, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:23:12.629827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.630362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.652502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.653540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.654484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.662426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.768167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:23:12.857881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-283eb5cd-f83b-4811-9dc3-a5b3cd95ad95 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.302180 Oct 28 19:23:12.859608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1712/3424] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 19:23:12 2022] GET /compute/v2.1/servers => generated 1003 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:12.870745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:12.871721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:12.886376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.889550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.890310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.893216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.894185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.896288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.984279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:13.022291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:13.129614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c7579598-7180-4c54-8c88-af01ac68eb29 req-6f231a00-632e-4467-945c-e09bc96b3f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333a6415-d488-4d8e-bf1d-d37ad5d7a119", "name": "network-vif-deleted", "tag": "1409d499-1122-4843-88af-14d1a9134087"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:13.188314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c7579598-7180-4c54-8c88-af01ac68eb29 req-6f231a00-632e-4467-945c-e09bc96b3f3b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.190734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c7579598-7180-4c54-8c88-af01ac68eb29 req-6f231a00-632e-4467-945c-e09bc96b3f3b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.193569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c7579598-7180-4c54-8c88-af01ac68eb29 req-6f231a00-632e-4467-945c-e09bc96b3f3b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.264688 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c7579598-7180-4c54-8c88-af01ac68eb29 req-6f231a00-632e-4467-945c-e09bc96b3f3b service nova] Creating event network-vif-deleted:1409d499-1122-4843-88af-14d1a9134087 for instance 333a6415-d488-4d8e-bf1d-d37ad5d7a119 on n-h1-862769-3 Oct 28 19:23:13.296802 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c7579598-7180-4c54-8c88-af01ac68eb29 req-6f231a00-632e-4467-945c-e09bc96b3f3b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.745477 Oct 28 19:23:13.297796 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1713/3425] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:13.317704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c16f2ea5-03eb-4ac5-ac61-35c130348c8f req-3d6ec266-cb01-4b63-8925-ef3eceeb4797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50e570b-bb24-4bfa-9833-94f0f24d31df", "tag": "4b0b1cf6-0173-4bd0-ad2d-8e63e808d551"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:13.339027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c16f2ea5-03eb-4ac5-ac61-35c130348c8f req-3d6ec266-cb01-4b63-8925-ef3eceeb4797 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.339912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c16f2ea5-03eb-4ac5-ac61-35c130348c8f req-3d6ec266-cb01-4b63-8925-ef3eceeb4797 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.340939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c16f2ea5-03eb-4ac5-ac61-35c130348c8f req-3d6ec266-cb01-4b63-8925-ef3eceeb4797 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.355171 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c16f2ea5-03eb-4ac5-ac61-35c130348c8f req-3d6ec266-cb01-4b63-8925-ef3eceeb4797 service nova] Creating event network-changed:4b0b1cf6-0173-4bd0-ad2d-8e63e808d551 for instance a50e570b-bb24-4bfa-9833-94f0f24d31df on n-h1-862769-3 Oct 28 19:23:13.362063 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c16f2ea5-03eb-4ac5-ac61-35c130348c8f req-3d6ec266-cb01-4b63-8925-ef3eceeb4797 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062340 Oct 28 19:23:13.363443 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1714/3426] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:13.370242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:13.371303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:13.389891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.390899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.391637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.392668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.393983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.394881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.581968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:13.612834 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eed9aefc-f239-4aae-a195-896bdeb173a1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1213 microversion: 2.1 time: 0.241993 Oct 28 19:23:13.614082 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1715/3427] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:13 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1213 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:13.633812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:13.635158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:13.660920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.663842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.668936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.670147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.670891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.672053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.959617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:13.972830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:13.978846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:13.981699 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07bb785d-ea3a-4adc-be08-f22fd0d0f9b0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.119526 Oct 28 19:23:13.982524 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1713/3428] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:12 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:13.988341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:13.989289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:14.000028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:14.001407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:14.002208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:14.003250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:14.003949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:14.004745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.227807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:15.236673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-de94f674-06f9-48a3-823a-9af2244e1137 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 1.252801 Oct 28 19:23:15.253109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:15.259498 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1714/3429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:13 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:15.269452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-695c070c-01b2-428b-98ab-2388f383c7c5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 1.649966 Oct 28 19:23:15.280611 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1716/3430] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:13 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:15.304378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:15.305091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:15.322649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.323220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.323844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.324550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.325184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.325808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.357432 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] HTTP exception thrown: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Request method failure captured: Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 HTTP/1.1 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCp82Adc7qqPkC-sdL2YUgHdFrDIql7Ra6_NxzQltMaHipruNFir9x_lbl6sxAwKxZbbuJpov1u7nDrKFbuyysYAmSy4yYaL4BT42JH1PVM14_qv6u8pjNEgGc4taU7xoTNmoa_fgRThgt6S1_8hxgU6ZHykYT0ZPGTc4FjubFDBsZg Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdd7944caa7b47adb4bc10f2804ad2cd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7a3f354a00cf468ca48261a56f68c410 Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1382020a-761f-4edd-902f-ceb8944d0585'} Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:15.360026 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:15.366357 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:15.372208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Returning 404 to user: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:15.373422 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df496f31-ba56-4fbf-b611-1a842173f2c8 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 404 len: 111 microversion: 2.1 time: 0.091507 Oct 28 19:23:15.375222 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1717/3431] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:15 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:15.381766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:15.382651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:15.395453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.396227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.396863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.398500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.399785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.401313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.665110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ecdbe16b-fbc0-4187-b7c3-2d8b4b854d5e req-694fcc9b-9ef3-431f-8b34-ffa556456540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "c3014475-d009-4c81-b666-f4d6d626674b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:15.713618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ecdbe16b-fbc0-4187-b7c3-2d8b4b854d5e req-694fcc9b-9ef3-431f-8b34-ffa556456540 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.715805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ecdbe16b-fbc0-4187-b7c3-2d8b4b854d5e req-694fcc9b-9ef3-431f-8b34-ffa556456540 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.717860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ecdbe16b-fbc0-4187-b7c3-2d8b4b854d5e req-694fcc9b-9ef3-431f-8b34-ffa556456540 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.773292 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ecdbe16b-fbc0-4187-b7c3-2d8b4b854d5e req-694fcc9b-9ef3-431f-8b34-ffa556456540 service nova] Creating event network-vif-plugged:c3014475-d009-4c81-b666-f4d6d626674b for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:15.791371 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ecdbe16b-fbc0-4187-b7c3-2d8b4b854d5e req-694fcc9b-9ef3-431f-8b34-ffa556456540 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.519927 Oct 28 19:23:15.792779 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1715/3432] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:15.809973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:15.838240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:15.838997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:15.851157 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-505a0e71-18a6-47b0-84a6-643d8ae4a80f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1287 microversion: 2.1 time: 0.474566 Oct 28 19:23:15.857618 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1718/3433] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:15 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1287 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:15.896666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.897610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.898167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.899565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.900355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.900493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad23f550-d345-4a05-97bf-00fc3214e7ec tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '.version_select at 0x7f1d7c5283a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:15.900780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.987427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad23f550-d345-4a05-97bf-00fc3214e7ec tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386699405" status: 202 len: 0 microversion: 2.1 time: 0.105010 Oct 28 19:23:15.991193 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1719/3434] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:23:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386699405 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:23:15.999789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4adce8b0-83f3-4c03-a9c4-b1513709e6ef req-a33cc23f-b6dc-4b54-9a15-5648e0c4f0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1382020a-761f-4edd-902f-ceb8944d0585", "name": "network-vif-deleted", "tag": "62150461-e199-4de2-af0f-34998e176ea8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:16.016956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4adce8b0-83f3-4c03-a9c4-b1513709e6ef req-a33cc23f-b6dc-4b54-9a15-5648e0c4f0d2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:16.017457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4adce8b0-83f3-4c03-a9c4-b1513709e6ef req-a33cc23f-b6dc-4b54-9a15-5648e0c4f0d2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:16.018174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4adce8b0-83f3-4c03-a9c4-b1513709e6ef req-a33cc23f-b6dc-4b54-9a15-5648e0c4f0d2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.036380 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4adce8b0-83f3-4c03-a9c4-b1513709e6ef req-a33cc23f-b6dc-4b54-9a15-5648e0c4f0d2 service nova] Creating event network-vif-deleted:62150461-e199-4de2-af0f-34998e176ea8 for instance 1382020a-761f-4edd-902f-ceb8944d0585 on n-h2-862769-3 Oct 28 19:23:16.044477 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4adce8b0-83f3-4c03-a9c4-b1513709e6ef req-a33cc23f-b6dc-4b54-9a15-5648e0c4f0d2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051939 Oct 28 19:23:16.045744 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1720/3435] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:16.278193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:16.278960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:16.318909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:16.325853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:16.339106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.342265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:16.353308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:16.353923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.824715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:16.853327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:16.859185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:16.860806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c3b7078-13c9-4ac4-9d5b-f38e9585ab5b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 1.065687 Oct 28 19:23:16.864662 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1716/3436] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:15 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:16.886346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:16.887625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:16.907973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:16.908857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:16.909491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.911796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:16.913756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:16.915203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.969418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:17.537622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:17.548868 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b08eec4-e0a5-44c5-b383-4b3bd8d4db12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 1.288811 Oct 28 19:23:17.552383 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1721/3437] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:16 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:17.564904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:17.568760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:17.579763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:17.586726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:17.588432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:17.591627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:17.592903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:17.594889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:17.596059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.465584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:18.474093 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7479e2e2-119f-490a-8413-941a144994bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 1.607986 Oct 28 19:23:18.474651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1717/3438] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:16 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:18.485153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "4b55a9dd-89c8-4bbf-9e0c-e262ed3ca26b"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "28d81463-0059-42be-868c-058c68f736c0"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "34895f9e-4c59-4b18-9ec2-caff3e73d280"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:18.510047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.511213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.511825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.544590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Creating event network-vif-plugged:4b55a9dd-89c8-4bbf-9e0c-e262ed3ca26b for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:18.545282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Creating event network-vif-plugged:f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:18.545961 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Creating event network-vif-plugged:28d81463-0059-42be-868c-058c68f736c0 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:18.546621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] Creating event network-vif-plugged:34895f9e-4c59-4b18-9ec2-caff3e73d280 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:18.551499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:18.555076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-04330ce3-cb55-40d0-9fec-b217670179aa req-4bf04780-c737-4cf3-bcca-b941d92dac0f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.073327 Oct 28 19:23:18.559004 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1718/3439] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:18.563817 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb716b15-d508-48af-95ba-cd77bb220a54 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1317 microversion: 2.1 time: 1.008446 Oct 28 19:23:18.564524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1722/3440] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:17 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1317 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:18.575408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:18.577719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:18.582635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:18.583301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:18.600383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.603847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.605040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.605766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.606280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.607202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.607895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.608542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.609740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.614967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.615545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.616065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:19.510094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:19.526924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:19.528905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:19.530383 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f636fdc-a5f9-4fab-bd0c-541ae6f6cfc3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.970038 Oct 28 19:23:19.532300 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1719/3441] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:18 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:19.562346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:19.569836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:19.587381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:19.588287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:19.588962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:19.589934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:19.590631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:19.591310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:19.992264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:20.032114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d9602cbe-6537-4859-ab38-7e4adf276848 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 1.459573 Oct 28 19:23:20.034172 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1723/3442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:18 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:20.059485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:20.064467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:20.107792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.111994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.112885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.122157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.123255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.124022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.737513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:20.751021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-70a75b12-4742-4382-bdd1-384a48e4f25c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 1.204543 Oct 28 19:23:20.753652 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1720/3443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:19 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:20.766469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-58275719-a166-41a5-8ce8-add4b821e5b2 req-126545c2-2323-49aa-8496-4e53eb53f9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c181f5-9793-4903-b38d-aa38220ed7f2", "tag": "5a3fe13b-2b31-433b-92a2-3979d011fdfd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:20.790806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-58275719-a166-41a5-8ce8-add4b821e5b2 req-126545c2-2323-49aa-8496-4e53eb53f9a0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.792786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-58275719-a166-41a5-8ce8-add4b821e5b2 req-126545c2-2323-49aa-8496-4e53eb53f9a0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.794444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-58275719-a166-41a5-8ce8-add4b821e5b2 req-126545c2-2323-49aa-8496-4e53eb53f9a0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.817873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-58275719-a166-41a5-8ce8-add4b821e5b2 req-126545c2-2323-49aa-8496-4e53eb53f9a0 service nova] Creating event network-changed:5a3fe13b-2b31-433b-92a2-3979d011fdfd for instance a1c181f5-9793-4903-b38d-aa38220ed7f2 on n-h2-862769-3 Oct 28 19:23:20.829732 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-58275719-a166-41a5-8ce8-add4b821e5b2 req-126545c2-2323-49aa-8496-4e53eb53f9a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073725 Oct 28 19:23:20.833582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1721/3444] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:20.847998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:20.850049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:20.879501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.887867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.889464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.894156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.898601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.900022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.121957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:21.225243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:21.261800 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2d7582f9-dd45-43d3-a102-339b09169930 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1317 microversion: 2.1 time: 1.225143 Oct 28 19:23:21.288353 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1724/3445] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:20 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1317 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:21.322318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "9cc771af-ac85-45d1-abee-094430b22ea8"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-plugged", "status": "completed", "tag": "d7a208a2-6068-4367-b33a-210bdb57b27d"}, {"server_uuid": "a50e570b-bb24-4bfa-9833-94f0f24d31df", "name": "network-vif-plugged", "status": "completed", "tag": "4b0b1cf6-0173-4bd0-ad2d-8e63e808d551"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:21.400099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.400923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.401667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.428221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:21.514914 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Creating event network-vif-plugged:9cc771af-ac85-45d1-abee-094430b22ea8 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:21.516370 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Creating event network-vif-plugged:d7a208a2-6068-4367-b33a-210bdb57b27d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:21.526413 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] Creating event network-vif-plugged:4b0b1cf6-0173-4bd0-ad2d-8e63e808d551 for instance a50e570b-bb24-4bfa-9833-94f0f24d31df on n-h1-862769-3 Oct 28 19:23:21.559456 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e51340a0-0fce-442e-a4a8-f146e73e514a req-0c6460f6-967d-405e-a2a8-d53e90a7fe52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.266760 Oct 28 19:23:21.560069 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1725/3446] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:21.565837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:21.583581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:21.607572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:21.618197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:21.619014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.623571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.625901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.630618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.637728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:21.638108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.638978 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d35f25be-1dc7-421a-9bb3-05390b20ca3f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.803436 Oct 28 19:23:21.642547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.657231 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1722/3447] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:20 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:21.686953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b610890c-8aeb-445f-8423-017eb0afa558 req-e892e9ed-20f0-441e-98fa-bccbc04f400e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf8bd2c-1aed-43f6-9773-98b79ee35739", "tag": "410ee5dc-145e-4989-b3c0-0f8f513f4f26"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:21.746435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b610890c-8aeb-445f-8423-017eb0afa558 req-e892e9ed-20f0-441e-98fa-bccbc04f400e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.758461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b610890c-8aeb-445f-8423-017eb0afa558 req-e892e9ed-20f0-441e-98fa-bccbc04f400e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.759058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b610890c-8aeb-445f-8423-017eb0afa558 req-e892e9ed-20f0-441e-98fa-bccbc04f400e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.804743 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b610890c-8aeb-445f-8423-017eb0afa558 req-e892e9ed-20f0-441e-98fa-bccbc04f400e service nova] Creating event network-changed:410ee5dc-145e-4989-b3c0-0f8f513f4f26 for instance daf8bd2c-1aed-43f6-9773-98b79ee35739 on n-h2-862769-3 Oct 28 19:23:21.818787 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b610890c-8aeb-445f-8423-017eb0afa558 req-e892e9ed-20f0-441e-98fa-bccbc04f400e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156103 Oct 28 19:23:21.832784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1723/3448] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:21.853031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:21.857078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:21.883445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.887442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.892951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.895171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.903584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.904420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:22.414028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:22.428234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15c57939-ff6b-41a8-9352-70ac7e4bcdf1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.864156 Oct 28 19:23:22.431420 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1726/3449] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:21 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:22.442112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:22.443016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:22.461900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:22.462820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:22.463661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:22.464689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:22.465375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:22.467278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:22.643203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:22.653314 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6583596e-2b24-4620-81dd-fd486b49460f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 0.818896 Oct 28 19:23:22.664094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1724/3450] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:21 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:22.682583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:22.683240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:22.699506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:22.704339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:22.705153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:22.705804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:22.707481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:22.708104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:22.708708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:23.141228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:23.154034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20596c48-46bf-43f4-8f57-f30b82145c3d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1317 microversion: 2.1 time: 0.721197 Oct 28 19:23:23.155249 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1727/3451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:22 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:23.320393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:23.331656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:23.345030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:23.346839 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c439b8bd-69cb-4b2c-8dc0-c674ef8997e3 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1879 microversion: 2.42 time: 0.668612 Oct 28 19:23:23.378239 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1725/3452] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:22 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1879 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:23:23.454274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:23.455787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:23.462428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:23.463241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:23.463882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:23.473759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:23.479430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:23.480322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:23.695172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:23.696241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:23.707238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:23.711213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:23.712773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:23.714312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:23.717389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:23.718117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:24.066217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:24.080434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b968f90e-73c7-4c9d-9329-4947f710b03b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.629893 Oct 28 19:23:24.081346 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1728/3453] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:23 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:24.182304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:24.183597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:24.201292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:24.202477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:24.204465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:24.207120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:24.208001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:24.209767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:24.856654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:24.866460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fb4bf5a-2f89-46a8-9a9e-a51f8d38c4d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1308 microversion: 2.1 time: 1.182562 Oct 28 19:23:24.873625 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1726/3454] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:23 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1308 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:24.878670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-af43245e-4915-4543-b2a8-da4839836590 req-cfb29fde-72d6-4dbd-82b2-3d5c35d0e67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e298007b-e300-4fec-ae1c-21fd686947e8", "tag": "64bad41d-54bb-4d84-b0fd-c9acb607ea81"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:24.913122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-af43245e-4915-4543-b2a8-da4839836590 req-cfb29fde-72d6-4dbd-82b2-3d5c35d0e67f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:24.914108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-af43245e-4915-4543-b2a8-da4839836590 req-cfb29fde-72d6-4dbd-82b2-3d5c35d0e67f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:24.914786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-af43245e-4915-4543-b2a8-da4839836590 req-cfb29fde-72d6-4dbd-82b2-3d5c35d0e67f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:24.936079 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-af43245e-4915-4543-b2a8-da4839836590 req-cfb29fde-72d6-4dbd-82b2-3d5c35d0e67f service nova] Creating event network-changed:64bad41d-54bb-4d84-b0fd-c9acb607ea81 for instance e298007b-e300-4fec-ae1c-21fd686947e8 on n-h2-862769-3 Oct 28 19:23:24.951682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-af43245e-4915-4543-b2a8-da4839836590 req-cfb29fde-72d6-4dbd-82b2-3d5c35d0e67f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076427 Oct 28 19:23:24.952951 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1727/3455] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:24.962086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:24.966247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:24.984784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:24.985587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:24.986443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:24.987576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:24.993705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:24.994473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:25.260449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:25.269377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-89e2a33a-0676-45fc-a533-254d45db4502 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1317 microversion: 2.1 time: 1.092344 Oct 28 19:23:25.273425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1729/3456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:24 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1317 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:25.286545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:25.292481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:25.306338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:25.308821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:25.309433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:25.310430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:25.311092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:25.311707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.018273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.032051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.034862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.037259 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22bfe3fe-ad60-41ad-a257-c8877ccc6da6 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2837 microversion: 2.42 time: 1.082547 Oct 28 19:23:26.040329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1728/3457] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:24 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2837 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:26.049818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:26.050839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:26.065644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.066421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.067278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.068198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.068892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.069568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.081956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.102415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.104780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.106320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d58ce23e-9eac-48b0-ad69-6ab5d53ae32c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2951 microversion: 2.32 time: 0.831713 Oct 28 19:23:26.107515 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1730/3458] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:23:25 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2951 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:26.113834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:26.114884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:26.121376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.122192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.122926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.123859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.124538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.125190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.567016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.577345 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-653c4505-b73d-4bbe-9716-d955edbe66b7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1680 microversion: 2.1 time: 0.535573 Oct 28 19:23:26.578468 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1729/3459] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:26 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1680 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:26.599213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:26.599930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:26.606660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.611265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.611979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.612916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.613569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.613695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:26.614676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.635593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-463763f8-34dd-4f9d-90a3-5455732f61de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1487 microversion: 2.1 time: 0.526607 Oct 28 19:23:26.657181 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1731/3460] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:26 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1487 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:26.667993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:26.668496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:26.688791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.689371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.689856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.703182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.703791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.704242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.895199 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74f41ced-c8e6-43e1-bc19-d41420f6cd74 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.231407 Oct 28 19:23:26.896903 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1732/3461] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:23:26 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1/os-interface => generated 1831 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:26.902089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:26.902726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:26.914349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.914864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.915307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:26.916009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:26.923757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:26.924243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.216155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a05011ff-0bff-4aa7-b2eb-a70e421c9110 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.636149 Oct 28 19:23:27.242904 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1730/3462] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:23:26 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003/os-interface => generated 1830 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:23:27.249438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:27.250276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:27.265256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:27.266077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:27.268277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.271739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:27.272515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:27.273147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.389033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:27.399506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cac6a13d-e085-4574-96e1-3a9daf8a5ab9 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1317 microversion: 2.1 time: 0.501214 Oct 28 19:23:27.401625 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1733/3463] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:26 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:27.451942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe301a6b-0b5b-41a2-866d-aeeef29c5bb1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df/action" status: 202 len: 0 microversion: 2.1 time: 0.206167 Oct 28 19:23:27.455887 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1731/3464] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:27 2022] POST /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:23:27.465440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:27.467081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:27.476083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:27.477004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:27.477706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.479348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:27.480760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:27.481437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.603326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:27.604472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:27.614519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:27.616604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:27.622370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.623464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:27.624162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:27.624836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:27.958581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:27.969546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bf4a043-bfd4-4841-b7b0-baa023395429 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1492 microversion: 2.1 time: 0.511269 Oct 28 19:23:27.973229 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1734/3465] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:27 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1492 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:28.168474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8d981372-e85c-476a-ae55-d6be73babf14 req-cc932c25-f280-4877-b4dc-1cd2a1600d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c181f5-9793-4903-b38d-aa38220ed7f2", "name": "network-vif-plugged", "status": "completed", "tag": "5a3fe13b-2b31-433b-92a2-3979d011fdfd"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:28.188407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d981372-e85c-476a-ae55-d6be73babf14 req-cc932c25-f280-4877-b4dc-1cd2a1600d3d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.188602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d981372-e85c-476a-ae55-d6be73babf14 req-cc932c25-f280-4877-b4dc-1cd2a1600d3d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.190833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d981372-e85c-476a-ae55-d6be73babf14 req-cc932c25-f280-4877-b4dc-1cd2a1600d3d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:28.215738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8d981372-e85c-476a-ae55-d6be73babf14 req-cc932c25-f280-4877-b4dc-1cd2a1600d3d service nova] Creating event network-vif-plugged:5a3fe13b-2b31-433b-92a2-3979d011fdfd for instance a1c181f5-9793-4903-b38d-aa38220ed7f2 on n-h2-862769-3 Oct 28 19:23:28.233043 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8d981372-e85c-476a-ae55-d6be73babf14 req-cc932c25-f280-4877-b4dc-1cd2a1600d3d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067512 Oct 28 19:23:28.235957 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1735/3466] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:28.424918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:28.426954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:28.435986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:28.440122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.440808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.441441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:28.442318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.445001 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3d782fe-22dd-4615-8e11-35d0a4e47c99 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.846578 Oct 28 19:23:28.446043 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1732/3467] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:27 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:28.462836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.462836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:28.644405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:28.644899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:28.664684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.665194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.665638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:28.666364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.666852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.667279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:28.718326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] HTTP exception thrown: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Request method failure captured: Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 HTTP/1.1 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCp82Adc7qqPkC-sdL2YUgHdFrDIql7Ra6_NxzQltMaHipruNFir9x_lbl6sxAwKxZbbuJpov1u7nDrKFbuyysYAmSy4yYaL4BT42JH1PVM14_qv6u8pjNEgGc4taU7xoTNmoa_fgRThgt6S1_8hxgU6ZHykYT0ZPGTc4FjubFDBsZg Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdd7944caa7b47adb4bc10f2804ad2cd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 7a3f354a00cf468ca48261a56f68c410 Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1382020a-761f-4edd-902f-ceb8944d0585'} Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:28.722775 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:28.728252 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:28.741168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Returning 404 to user: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:28.751671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53107738-279b-42ba-a78d-b45407878968 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 404 len: 111 microversion: 2.1 time: 0.111728 Oct 28 19:23:28.752922 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1733/3468] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:28 2022] DELETE /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:28.759927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:28.772272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:28.792251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.793451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.794772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:28.800351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:28.802033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:28.802896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:29.338078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:29.349531 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-be3b508c-8344-4e0a-98e4-8d7130d9b1df tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1317 microversion: 2.1 time: 0.928858 Oct 28 19:23:29.350859 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1736/3469] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:28 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:29.356793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:29.362614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 1382020a-761f-4edd-902f-ceb8944d0585] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:29.370107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:29.374346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:29.376135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:29.377157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:29.381638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:29.382321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:29.409110 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] HTTP exception thrown: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Request method failure captured: Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 HTTP/1.1 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCp82Adc7qqPkC-sdL2YUgHdFrDIql7Ra6_NxzQltMaHipruNFir9x_lbl6sxAwKxZbbuJpov1u7nDrKFbuyysYAmSy4yYaL4BT42JH1PVM14_qv6u8pjNEgGc4taU7xoTNmoa_fgRThgt6S1_8hxgU6ZHykYT0ZPGTc4FjubFDBsZg Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdd7944caa7b47adb4bc10f2804ad2cd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7a3f354a00cf468ca48261a56f68c410 Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1382020a-761f-4edd-902f-ceb8944d0585'} Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:29.411149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. Oct 28 19:23:29.416263 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:29.418624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Returning 404 to user: Instance 1382020a-761f-4edd-902f-ceb8944d0585 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:29.419686 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df1e70f0-5844-4f41-9c55-67f1df5420c4 tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585" status: 404 len: 111 microversion: 2.1 time: 0.067630 Oct 28 19:23:29.420445 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1737/3470] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:29 2022] GET /compute/v2.1/servers/1382020a-761f-4edd-902f-ceb8944d0585 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:29.451481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:29.452711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:29.466233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:29.472556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:29.473204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:29.478118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:29.479538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:29.480155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:29.706720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:29.718718 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e111ce1f-d25e-4f24-8300-e899ea208e10 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.963621 Oct 28 19:23:29.720945 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1734/3471] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:28 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:29.835923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:29.851654 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a27859fb-d8bb-4dad-9d95-48eaf13d3dad tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 200 len: 1472 microversion: 2.1 time: 0.414660 Oct 28 19:23:29.852640 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1738/3472] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:29 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:29.883181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1233400106"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:29.892871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:29.916177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:29.916687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:29.917126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:29.926482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:29.927289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:29.942964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:30.380984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:30.381911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:30.401302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:30.406501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:30.414102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:30.416317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:30.418609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:30.422638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:30.529926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:30.583815 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-215f15c7-ba44-42a3-988c-a0576f295d26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df/action" status: 202 len: 0 microversion: 2.1 time: 0.709722 Oct 28 19:23:30.585531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1735/3473] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:29 2022] POST /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:23:30.592338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0ffd59d0-2e3f-41df-b72f-f0ab3a5a1bd3 req-2cc1ab59-707b-4897-8877-b907da7a76c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-unplugged", "status": "completed", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:30.607546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ffd59d0-2e3f-41df-b72f-f0ab3a5a1bd3 req-2cc1ab59-707b-4897-8877-b907da7a76c9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:30.608565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ffd59d0-2e3f-41df-b72f-f0ab3a5a1bd3 req-2cc1ab59-707b-4897-8877-b907da7a76c9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:30.609144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ffd59d0-2e3f-41df-b72f-f0ab3a5a1bd3 req-2cc1ab59-707b-4897-8877-b907da7a76c9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:30.630961 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0ffd59d0-2e3f-41df-b72f-f0ab3a5a1bd3 req-2cc1ab59-707b-4897-8877-b907da7a76c9 service nova] Creating event network-vif-unplugged:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:23:30.651364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0ffd59d0-2e3f-41df-b72f-f0ab3a5a1bd3 req-2cc1ab59-707b-4897-8877-b907da7a76c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061580 Oct 28 19:23:30.652681 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1736/3474] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:30.668066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-28a9200d-d377-45d1-b37a-32758ab65493 req-e49b280d-5077-4b57-86d6-a5cfc117fe2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "tag": "34895f9e-4c59-4b18-9ec2-caff3e73d280"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:30.694385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-28a9200d-d377-45d1-b37a-32758ab65493 req-e49b280d-5077-4b57-86d6-a5cfc117fe2f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:30.694912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-28a9200d-d377-45d1-b37a-32758ab65493 req-e49b280d-5077-4b57-86d6-a5cfc117fe2f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:30.706775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-28a9200d-d377-45d1-b37a-32758ab65493 req-e49b280d-5077-4b57-86d6-a5cfc117fe2f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:30.733588 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-28a9200d-d377-45d1-b37a-32758ab65493 req-e49b280d-5077-4b57-86d6-a5cfc117fe2f service nova] Creating event network-changed:34895f9e-4c59-4b18-9ec2-caff3e73d280 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:23:30.756199 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-28a9200d-d377-45d1-b37a-32758ab65493 req-e49b280d-5077-4b57-86d6-a5cfc117fe2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100459 Oct 28 19:23:30.756834 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1737/3475] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:30.780982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97bce5cc-2bb5-4f45-95c1-65e66902a189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ff2d3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:30.861412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:30.869960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14107311-8c5d-4aca-b9d4-1f25fa3db60e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1504 microversion: 2.1 time: 0.497878 Oct 28 19:23:30.875426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1739/3476] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:30 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:30.899805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:30.902183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:30.904788 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97bce5cc-2bb5-4f45-95c1-65e66902a189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.141767 Oct 28 19:23:30.905428 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1738/3477] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:30 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:30.912605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:30.915277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:30.915990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:30.916953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:30.927499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:30.928383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.090884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:31.115070 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d21b4764-9e7b-412d-bd24-1da6cbae7d47 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1317 microversion: 2.1 time: 0.219126 Oct 28 19:23:31.116324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1740/3478] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:30 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:31.475607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:31.476610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:31.485749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:31.486520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:31.487147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.488023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:31.488637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:31.489233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.646935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:31.656091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9eee0a1d-8ebb-46fe-b13d-83b025795011 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.184910 Oct 28 19:23:31.671451 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1739/3479] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:31 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:31.680271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:31.682882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:31.690242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:31.691020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:31.691749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.693012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:31.693636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:31.694215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.889448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:31.900594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-401f2eba-607c-499f-a46b-c3dc5d4fd5c3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.224081 Oct 28 19:23:31.915896 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1741/3480] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:31 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:31.924018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf19a105-13cd-4545-916e-aa5b92b89072 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ff2de50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:31.928078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:31.929476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:31.937862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:31.938446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:31.939237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.940306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:31.941056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:31.942388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:31.997159 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf19a105-13cd-4545-916e-aa5b92b89072 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.079988 Oct 28 19:23:31.999675 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1740/3481] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:31 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:32.113842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:32.126429 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68beffd5-3ea3-475a-a75f-f5b00e324069 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.203173 Oct 28 19:23:32.127705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1742/3482] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:31 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:32.139710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:32.140115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:32.149634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:32.150376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:32.152210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:32.152800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:32.153497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:32.154597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:32.155556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:32.156247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:32.166225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:32.167051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:32.167989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:32.168880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:32.169502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:32.170087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:32.264668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:32.324348 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-830740de-018d-4dea-aae2-7263f9f26a56 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.179015 Oct 28 19:23:32.327900 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1743/3483] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:32 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:23:32.335482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:32.336100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:32.372567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:32.376464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:32.386841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:32.387733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:32.388797 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bfc5dd0e-4d24-474f-9c70-ec42e5833dbc tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1317 microversion: 2.1 time: 0.253266 Oct 28 19:23:32.389214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:32.389747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:32.390179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:32.390547 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1741/3484] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:32 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:32.671386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:32.681307 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43deb9d0-d73e-4c47-86e3-7e6975632dde tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1669 microversion: 2.1 time: 0.350031 Oct 28 19:23:32.685810 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1744/3485] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:32 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1669 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:33.015032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-821696b9-838c-4d29-8884-baea133aab73 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7c333af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:33.082521 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-821696b9-838c-4d29-8884-baea133aab73 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.071459 Oct 28 19:23:33.083441 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1742/3486] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:33 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:33.416283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:33.416912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:33.423656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:33.424155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:33.424592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:33.426236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:33.426740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:33.429667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:33.643441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:33.653881 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a05aaf95-4652-4125-aafc-6ec238184d4e tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1317 microversion: 2.1 time: 0.242568 Oct 28 19:23:33.654518 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1745/3487] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:33 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:33.710765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:33.711651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:33.724293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:33.724914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:33.725420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:33.726310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:33.726917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:33.728762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:33.979762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:33.980406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:33.991703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:33.992312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.003338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:34.004231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:34.005198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.005829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:34.035867 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] HTTP exception thrown: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Request method failure captured: Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 HTTP/1.1 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCp82Adc7qqPkC-sdL2YUgHdFrDIql7Ra6_NxzQltMaHipruNFir9x_lbl6sxAwKxZbbuJpov1u7nDrKFbuyysYAmSy4yYaL4BT42JH1PVM14_qv6u8pjNEgGc4taU7xoTNmoa_fgRThgt6S1_8hxgU6ZHykYT0ZPGTc4FjubFDBsZg Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdd7944caa7b47adb4bc10f2804ad2cd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7a3f354a00cf468ca48261a56f68c410 Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '47a9adc5-334c-4b5e-b804-3fed340769f4'} Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:34.037585 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.042169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Returning 404 to user: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:34.048252 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3af98020-a74c-4f9c-aa8c-6fa3ef99837b tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 404 len: 111 microversion: 2.1 time: 0.063259 Oct 28 19:23:34.048252 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1746/3488] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:33 2022] DELETE /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:23:34.057054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:34.057520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] [instance: 47a9adc5-334c-4b5e-b804-3fed340769f4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:34.078312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:34.078855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.079293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:34.080062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:34.080517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.080939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:34.097042 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] HTTP exception thrown: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Request method failure captured: Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 HTTP/1.1 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCp82Adc7qqPkC-sdL2YUgHdFrDIql7Ra6_NxzQltMaHipruNFir9x_lbl6sxAwKxZbbuJpov1u7nDrKFbuyysYAmSy4yYaL4BT42JH1PVM14_qv6u8pjNEgGc4taU7xoTNmoa_fgRThgt6S1_8hxgU6ZHykYT0ZPGTc4FjubFDBsZg Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdd7944caa7b47adb4bc10f2804ad2cd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdd7944caa7b47adb4bc10f2804ad2cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: fdd7944caa7b47adb4bc10f2804ad2cd Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-492630720 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 7a3f354a00cf468ca48261a56f68c410 Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeTestJSON-492630720-project Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '47a9adc5-334c-4b5e-b804-3fed340769f4'} Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:34.099042 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. Oct 28 19:23:34.103517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:34.105548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] Returning 404 to user: Instance 47a9adc5-334c-4b5e-b804-3fed340769f4 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:34.106663 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c8fd8fbe-1320-46f6-8b56-dd0391f8e99e tempest-AttachVolumeTestJSON-492630720 tempest-AttachVolumeTestJSON-492630720-project] 10.222.0.44 "GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4" status: 404 len: 111 microversion: 2.1 time: 0.054338 Oct 28 19:23:34.107854 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1747/3489] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:34 2022] GET /compute/v2.1/servers/47a9adc5-334c-4b5e-b804-3fed340769f4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:23:34.131345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5fbc5bd4-9245-4627-96ba-25f197927b4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77df54c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:34.203747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:34.212113 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5fbc5bd4-9245-4627-96ba-25f197927b4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.102905 Oct 28 19:23:34.212794 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1748/3490] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:34 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:34.219289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fb4a389-883b-4974-bba8-817359529e36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1674 microversion: 2.1 time: 0.513680 Oct 28 19:23:34.222541 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1743/3491] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:33 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1674 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:34.416757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8abed67e-2c51-4a28-af69-903997027354 req-8c9a44e7-dd62-4f42-a557-6b5f031a24fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e298007b-e300-4fec-ae1c-21fd686947e8", "name": "network-vif-plugged", "status": "completed", "tag": "64bad41d-54bb-4d84-b0fd-c9acb607ea81"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:34.449256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8abed67e-2c51-4a28-af69-903997027354 req-8c9a44e7-dd62-4f42-a557-6b5f031a24fe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:34.453294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8abed67e-2c51-4a28-af69-903997027354 req-8c9a44e7-dd62-4f42-a557-6b5f031a24fe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.457876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8abed67e-2c51-4a28-af69-903997027354 req-8c9a44e7-dd62-4f42-a557-6b5f031a24fe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:34.494951 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8abed67e-2c51-4a28-af69-903997027354 req-8c9a44e7-dd62-4f42-a557-6b5f031a24fe service nova] Creating event network-vif-plugged:64bad41d-54bb-4d84-b0fd-c9acb607ea81 for instance e298007b-e300-4fec-ae1c-21fd686947e8 on n-h2-862769-3 Oct 28 19:23:34.508755 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8abed67e-2c51-4a28-af69-903997027354 req-8c9a44e7-dd62-4f42-a557-6b5f031a24fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096490 Oct 28 19:23:34.509703 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1749/3492] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:34.682156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:34.683657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:34.694192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:34.695682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.697363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:34.700056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:34.701855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:34.702548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:35.145127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:35.160436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1268ae3f-dc01-491e-80a8-c0400eab7280 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1317 microversion: 2.1 time: 0.484055 Oct 28 19:23:35.161765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1744/3493] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:34 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:35.230681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c65e8df-d7bf-403a-b50c-2629a1c7f6de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77df54c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:35.251719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:35.252907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:35.269723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:35.272004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:35.273521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:35.277540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:35.279570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:35.281690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:35.325792 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c65e8df-d7bf-403a-b50c-2629a1c7f6de tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.100119 Oct 28 19:23:35.327096 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1750/3494] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:35 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:35.810428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:35.829004 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ce68040-8a8f-4476-902f-742499de07e0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.582545 Oct 28 19:23:35.830271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1745/3495] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:35 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:35.865637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:35.868552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:35.893570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:35.894234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:35.895962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:35.898209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:35.898932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:35.900152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:35.988316 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51bd9c27-7983-42fb-baba-ae22eed01c02 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 200 len: 322 microversion: 2.1 time: 0.127445 Oct 28 19:23:35.989146 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1751/3496] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:35 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 322 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:36.000787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:36.002088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:36.013117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.016426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.017120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.018515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.022271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.022862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.203268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:36.205499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:36.226279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.228911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.229665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.232739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.233928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.236679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.351765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:36.376596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f65768c5-d344-4079-8a8e-9b9c6a66faef tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.381500 Oct 28 19:23:36.382102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1746/3497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:35 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:36.405570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56ea58cc-9153-4992-a22d-7faaf4fe8ae3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a86e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:36.500637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:36.507757 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56ea58cc-9153-4992-a22d-7faaf4fe8ae3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.123836 Oct 28 19:23:36.526536 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f3f83812-1a8a-4aea-b996-97644c45bbbd tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1317 microversion: 2.1 time: 0.332726 Oct 28 19:23:36.528569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1752/3498] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:36 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:36.533698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:36.534895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:36.543071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.544446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.545201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.546140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.546662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.547178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.547558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1747/3499] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:36 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:36.561266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4ff52cf2-0c3b-450e-9bba-295e10afce5e req-e1794de8-7b5b-4747-bdc8-1351b2d21ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50e570b-bb24-4bfa-9833-94f0f24d31df", "name": "network-vif-plugged", "status": "completed", "tag": "4b0b1cf6-0173-4bd0-ad2d-8e63e808d551"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:36.602903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4ff52cf2-0c3b-450e-9bba-295e10afce5e req-e1794de8-7b5b-4747-bdc8-1351b2d21ebe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.604406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4ff52cf2-0c3b-450e-9bba-295e10afce5e req-e1794de8-7b5b-4747-bdc8-1351b2d21ebe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.605605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4ff52cf2-0c3b-450e-9bba-295e10afce5e req-e1794de8-7b5b-4747-bdc8-1351b2d21ebe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.624548 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4ff52cf2-0c3b-450e-9bba-295e10afce5e req-e1794de8-7b5b-4747-bdc8-1351b2d21ebe service nova] Creating event network-vif-plugged:4b0b1cf6-0173-4bd0-ad2d-8e63e808d551 for instance a50e570b-bb24-4bfa-9833-94f0f24d31df on n-h1-862769-3 Oct 28 19:23:36.633412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4ff52cf2-0c3b-450e-9bba-295e10afce5e req-e1794de8-7b5b-4747-bdc8-1351b2d21ebe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084020 Oct 28 19:23:36.634421 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1748/3500] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:36.728258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:36.737287 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-19bd9010-79ee-45ba-9238-fc5ac205f326 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.207359 Oct 28 19:23:36.737897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1753/3501] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:36 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:36.762385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:36.764001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:36.781334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.781965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.784115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:36.785202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:36.786088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:36.792507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:37.043020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:37.066147 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e98de966-d8a4-417a-8aaf-c779f557980e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.304416 Oct 28 19:23:37.067454 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1749/3502] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:36 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:37.089428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:37.090041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:37.101735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:37.102151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:37.102840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:37.103746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:37.104396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:37.105011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:37.347096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:37.367454 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a48943b7-0f94-44fe-81de-99ea22ba8faf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.281536 Oct 28 19:23:37.384900 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1754/3503] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:37 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:37.552872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1340313563", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "4e4640cd-261b-42b5-9b7b-42f460667021"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:37.556352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54c73995-0ecf-4e1f-939c-2b2b88b414b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7740a160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:37.575977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:37.700508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54c73995-0ecf-4e1f-939c-2b2b88b414b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.152426 Oct 28 19:23:37.710757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1755/3504] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:37 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:37.717494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] validate_networks() for [('4e4640cd-261b-42b5-9b7b-42f460667021', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:23:37.735114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:37.738798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:37.755628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:37.756121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:37.756552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:37.757277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:37.757713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:37.758128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:38.123003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:38.134966 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-52ef4ebf-86d3-4fc7-8311-1372c0a76f5f tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1505 microversion: 2.1 time: 0.419780 Oct 28 19:23:38.137162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1756/3505] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:37 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:38.165295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:38.166170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:38.173150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:38.173956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:38.174555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:38.175604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:38.176219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:38.176802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:38.243827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:23:38.435792 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b380f5c9-0eb7-447d-9062-18ddbbbb749d tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 204 len: 0 microversion: 2.1 time: 0.268272 Oct 28 19:23:38.443020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1757/3506] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:38 2022] DELETE /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:23:38.454590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:38.458261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:38.487970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:38.488893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:38.489340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:38.490122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:38.491000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:38.491428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:38.574336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:23:38.750935 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36afe6be-b6e7-4b86-a0d4-78fff8f01903 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 204 len: 0 microversion: 2.1 time: 0.303578 Oct 28 19:23:38.754943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1758/3507] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:38 2022] DELETE /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:23:38.763642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d9ceaefa-34f2-432c-aa92-a0406f1c4e92 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76d2b820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:38.829225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d9ceaefa-34f2-432c-aa92-a0406f1c4e92 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.072584 Oct 28 19:23:38.830232 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1759/3508] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:38 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:38.838428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:38.839933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:38.847881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:38.848750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:38.849554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:38.850497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:38.851194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:38.851853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:39.572483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:39.582228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-41da0801-2624-4b7c-b6f5-133163f6a404 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1511 microversion: 2.1 time: 0.750214 Oct 28 19:23:39.586591 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1760/3509] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:38 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1511 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:39.634948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:23:39.635898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:23:39.636549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:23:39.637154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:23:39.637734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:23:39.657120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:39.657966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:39.658572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:39.660110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:39.660978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:39.662159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:39.693680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:23:39.709856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for user 42f0003698694056b69b98933c84cd8a and project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:23:39.749882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:23:39.757596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:23:39.857938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-555f84aa-30e2-4a1e-8caa-f8fd5422cc1f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77928670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:39.871341 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d865c522-5162-4cf4-9ba8-602434f7f596 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.327034 Oct 28 19:23:39.872012 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1750/3510] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:23:39.890236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb6173c8-637f-4f8e-af52-8147f0542b9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:39.891475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cb6173c8-637f-4f8e-af52-8147f0542b9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:39.947829 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-555f84aa-30e2-4a1e-8caa-f8fd5422cc1f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.105994 Oct 28 19:23:39.951414 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1761/3511] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:39 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:40.121090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cb6173c8-637f-4f8e-af52-8147f0542b9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:40.146866 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb6173c8-637f-4f8e-af52-8147f0542b9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1215 microversion: 2.1 time: 0.256436 Oct 28 19:23:40.147912 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1751/3512] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:39 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:40.610770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:40.612047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:40.627957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:40.633726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:40.634451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:40.638576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:40.639754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:40.641545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:40.965200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42962d28-e711-4698-bdc1-3bbb07c69d81 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ffd60d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:41.062268 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42962d28-e711-4698-bdc1-3bbb07c69d81 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.100609 Oct 28 19:23:41.065718 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1752/3513] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:40 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:41.098614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:41.113891 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48552712-aa00-4b7f-8d29-e8701e261104 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1511 microversion: 2.1 time: 0.506352 Oct 28 19:23:41.116061 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1762/3514] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:40 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1511 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:41.174732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:41.176382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:41.188695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:41.190485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:41.191217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:41.192338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:41.193050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:41.193696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:41.370478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:41.383354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f28634dc-0057-4a7a-9a2c-a8b59fe7e89a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1267 microversion: 2.1 time: 0.213123 Oct 28 19:23:41.391536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1753/3515] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:41 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:42.080931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15908adb-e0bb-419c-8876-2ee8b0584a67 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76cb30d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:42.139183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:42.139920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:42.194249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:42.198186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:42.198714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:42.199475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:42.199947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:42.200375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:42.220136 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15908adb-e0bb-419c-8876-2ee8b0584a67 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.143339 Oct 28 19:23:42.221884 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1763/3516] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:42 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:42.251070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b48f9acd-f395-405e-8f5c-25afb3e5b4bd req-44e2e4c5-37ef-4ef6-b077-739b09472a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e298007b-e300-4fec-ae1c-21fd686947e8", "name": "network-vif-deleted", "tag": "64bad41d-54bb-4d84-b0fd-c9acb607ea81"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:42.296659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b48f9acd-f395-405e-8f5c-25afb3e5b4bd req-44e2e4c5-37ef-4ef6-b077-739b09472a7f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:42.297279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b48f9acd-f395-405e-8f5c-25afb3e5b4bd req-44e2e4c5-37ef-4ef6-b077-739b09472a7f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:42.298929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b48f9acd-f395-405e-8f5c-25afb3e5b4bd req-44e2e4c5-37ef-4ef6-b077-739b09472a7f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:42.329011 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b48f9acd-f395-405e-8f5c-25afb3e5b4bd req-44e2e4c5-37ef-4ef6-b077-739b09472a7f service nova] Creating event network-vif-deleted:64bad41d-54bb-4d84-b0fd-c9acb607ea81 for instance e298007b-e300-4fec-ae1c-21fd686947e8 on n-h2-862769-3 Oct 28 19:23:42.344114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b48f9acd-f395-405e-8f5c-25afb3e5b4bd req-44e2e4c5-37ef-4ef6-b077-739b09472a7f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120236 Oct 28 19:23:42.344895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1764/3517] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:42.415055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:42.415786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:42.437307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:42.454836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:42.456954 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a3ac136-cbf9-4ce1-86ad-edbfb7412a51 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 200 len: 1469 microversion: 2.1 time: 0.322203 Oct 28 19:23:42.457699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:42.458667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:42.459586 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1754/3518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:42 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:42.465052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:42.466053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:42.466776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:42.522604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:42.668194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:42.679397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ef462e49-921f-4fe2-833c-fff0e97b7b14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1273 microversion: 2.1 time: 0.271499 Oct 28 19:23:42.682163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1765/3519] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:42 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:43.087133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-19f1ac29-4c18-4ceb-981b-e86fa4108e8b req-2f9bc1f8-8901-4b38-a9c3-7a342db0ab16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c181f5-9793-4903-b38d-aa38220ed7f2", "name": "network-vif-deleted", "tag": "5a3fe13b-2b31-433b-92a2-3979d011fdfd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:43.111559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-19f1ac29-4c18-4ceb-981b-e86fa4108e8b req-2f9bc1f8-8901-4b38-a9c3-7a342db0ab16 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.113898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-19f1ac29-4c18-4ceb-981b-e86fa4108e8b req-2f9bc1f8-8901-4b38-a9c3-7a342db0ab16 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.114529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-19f1ac29-4c18-4ceb-981b-e86fa4108e8b req-2f9bc1f8-8901-4b38-a9c3-7a342db0ab16 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.169150 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-19f1ac29-4c18-4ceb-981b-e86fa4108e8b req-2f9bc1f8-8901-4b38-a9c3-7a342db0ab16 service nova] Creating event network-vif-deleted:5a3fe13b-2b31-433b-92a2-3979d011fdfd for instance a1c181f5-9793-4903-b38d-aa38220ed7f2 on n-h2-862769-3 Oct 28 19:23:43.189821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-19f1ac29-4c18-4ceb-981b-e86fa4108e8b req-2f9bc1f8-8901-4b38-a9c3-7a342db0ab16 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107010 Oct 28 19:23:43.193359 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1755/3520] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:43.239947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e20f9b7c-7c1a-4c53-931c-586ff56adf4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77928670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:43.328811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e20f9b7c-7c1a-4c53-931c-586ff56adf4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.094982 Oct 28 19:23:43.329653 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1766/3521] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:43 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:43.486639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:43.487941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: e298007b-e300-4fec-ae1c-21fd686947e8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:43.504173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.505859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.506520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.508917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.510272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.511679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.546894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95f7538b-24ad-43bf-81d7-0efb57a0f5e9"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:43.550041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:43.554682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] HTTP exception thrown: Instance e298007b-e300-4fec-ae1c-21fd686947e8 could not be found. Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Request method failure captured: Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 HTTP/1.1 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCv4wCZD9SoYpVucuLgvfSNs00cCEhBrcYm7MF4kyjdvXMqSPh4CjfSYFc3biy0FMjD-kqL_uD5x2VlLPJxKXSKjRfidGIIcTztLDGzmeRmvTqPd8S73S6vGZjzKdHoOjleL4anATKoELTa8dUOXb0kJkeUnJk_Bxa5q_cVIB8TwRLw Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b35c6fa4d63c4faba04f986a0ef6ebff Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MultipleCreateTestJSON-2079536836 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b35c6fa4d63c4faba04f986a0ef6ebff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b35c6fa4d63c4faba04f986a0ef6ebff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b35c6fa4d63c4faba04f986a0ef6ebff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b35c6fa4d63c4faba04f986a0ef6ebff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MultipleCreateTestJSON-2079536836 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b35c6fa4d63c4faba04f986a0ef6ebff Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2079536836 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MultipleCreateTestJSON-2079536836-project Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: e827a656445444478cc6239c8457d8c6 Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MultipleCreateTestJSON-2079536836-project Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e298007b-e300-4fec-ae1c-21fd686947e8 could not be found. Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e298007b-e300-4fec-ae1c-21fd686947e8'} Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e298007b-e300-4fec-ae1c-21fd686947e8 could not be found. Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e298007b-e300-4fec-ae1c-21fd686947e8 could not be found. Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:43.558340 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e298007b-e300-4fec-ae1c-21fd686947e8 could not be found. Oct 28 19:23:43.566122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:43.569853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Returning 404 to user: Instance e298007b-e300-4fec-ae1c-21fd686947e8 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:43.571037 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a6aba75c-cd7c-41d7-9cbb-5d217eeae0f1 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8" status: 404 len: 111 microversion: 2.1 time: 0.090447 Oct 28 19:23:43.574355 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1756/3522] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:43 2022] GET /compute/v2.1/servers/e298007b-e300-4fec-ae1c-21fd686947e8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:43.583990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.585124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:43.585922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:43.591520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.592702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.593402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.593532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.594266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.594986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.596044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.596689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.596811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.597221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.597636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.644235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.645196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.645853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.646506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lazy-loading 'fault' on Instance uuid a1c181f5-9793-4903-b38d-aa38220ed7f2 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:23:43.759707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e827a656445444478cc6239c8457d8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35c6fa4d63c4faba04f986a0ef6ebff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:43.772905 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-12a412ab-ee51-4b78-8c9a-198903305f11 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 200 len: 1307 microversion: 2.1 time: 0.192400 Oct 28 19:23:43.773514 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1757/3523] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:43 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 1307 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:43.793451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:43.794456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:43.805368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.806198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.806934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.807858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.808647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.809434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:44.173048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-586049e5-299d-4bee-b65c-cadd48f82483 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630786 Oct 28 19:23:44.175939 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1767/3524] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:23:43 2022] POST /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:44.346922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b99816b3-3cb3-4a60-bb14-91b103b20854 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d777c3e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:44.395832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:44.414615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4ed2900-a92c-4e70-b7ff-6a28d26c19d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.626121 Oct 28 19:23:44.415601 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1758/3525] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:43 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:44.486520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b99816b3-3cb3-4a60-bb14-91b103b20854 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.144154 Oct 28 19:23:44.495653 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1768/3526] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:44 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:44.682192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-100d5daa-e7f2-44de-8fad-b644c7985eb8 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Action: 'create', calling method: .version_select at 0x7f1d7c18b310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1071831965", "metadata": {"Type": "work"}}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-100d5daa-e7f2-44de-8fad-b644c7985eb8 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Request method failure captured: Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 122 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxAkOC-aFl3b6Hc4oW0bOcTqCUmYo2MlvzxgPrj1rdJ5cK4gl2qH7NB9jzMl9VGRFHrRIjsMwD3IBJLu9JFin546Z_1OMXrGvdEhngJzF1_cwq2jIlR14UUN4llk_nv4jXqRkntc4MsT5oKi-zVe_AMs4RGapuMf8ksiYtuHUVkjSE Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c6834a9bd10445abf1312b11a10a801", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8c031d46c686455d90fe1a49150edef8 Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1071831965", "metadata": {"Type": "work"}}} Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1071831965', 'metadata': {'Type': 'work'}}}} Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:44.686604 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-100d5daa-e7f2-44de-8fad-b644c7985eb8 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:44.691679 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-100d5daa-e7f2-44de-8fad-b644c7985eb8 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.273499 Oct 28 19:23:44.704306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3abfaad1-436e-4f27-b697-11b7afed960c tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Action: 'create', calling method: .version_select at 0x7f1d77a1c550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1229477939", "metadata": {"Type": "work"}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3abfaad1-436e-4f27-b697-11b7afed960c tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Request method failure captured: Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 120 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxAkOC-aFl3b6Hc4oW0bOcTqCUmYo2MlvzxgPrj1rdJ5cK4gl2qH7NB9jzMl9VGRFHrRIjsMwD3IBJLu9JFin546Z_1OMXrGvdEhngJzF1_cwq2jIlR14UUN4llk_nv4jXqRkntc4MsT5oKi-zVe_AMs4RGapuMf8ksiYtuHUVkjSE Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c6834a9bd10445abf1312b11a10a801", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8c031d46c686455d90fe1a49150edef8 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1229477939", "metadata": {"Type": "work"}}} Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1229477939', 'metadata': {'Type': 'work'}}}} Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '0' Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:44.708512 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:44.715420 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.717003 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1759/3527] 10.222.0.44 () {60 vars in 1156 bytes} [Fri Oct 28 19:23:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:23:44.717176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3abfaad1-436e-4f27-b697-11b7afed960c tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:44.717176 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3abfaad1-436e-4f27-b697-11b7afed960c tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009902 Oct 28 19:23:44.722568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-266f2da5-aa54-45e0-9f06-515fff1138f1 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Action: 'create', calling method: .version_select at 0x7f1d7ffda670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-883109411", "metadata": {"Type": "work"}}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:44.722846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1769/3528] 10.222.0.44 () {60 vars in 1156 bytes} [Fri Oct 28 19:23:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-266f2da5-aa54-45e0-9f06-515fff1138f1 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Request method failure captured: Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 118 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxAkOC-aFl3b6Hc4oW0bOcTqCUmYo2MlvzxgPrj1rdJ5cK4gl2qH7NB9jzMl9VGRFHrRIjsMwD3IBJLu9JFin546Z_1OMXrGvdEhngJzF1_cwq2jIlR14UUN4llk_nv4jXqRkntc4MsT5oKi-zVe_AMs4RGapuMf8ksiYtuHUVkjSE Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c6834a9bd10445abf1312b11a10a801", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8c031d46c686455d90fe1a49150edef8 Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-883109411", "metadata": {"Type": "work"}}} Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-883109411', 'metadata': {'Type': 'work'}}}} Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi '' Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:44.735052 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-266f2da5-aa54-45e0-9f06-515fff1138f1 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:44.742048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-266f2da5-aa54-45e0-9f06-515fff1138f1 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018466 Oct 28 19:23:44.744386 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1760/3529] 10.222.0.44 () {60 vars in 1156 bytes} [Fri Oct 28 19:23:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:23:44.759671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5b1f1d7-559a-4927-a219-679d465f3763 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Calling method '.version_select at 0x7f1d7c38de50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:44.797603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:44.798283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] [instance: a1c181f5-9793-4903-b38d-aa38220ed7f2] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:44.808983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c5b1f1d7-559a-4927-a219-679d465f3763 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] HTTP exception thrown: Volume tempest-invalid-581691720 could not be found. Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5b1f1d7-559a-4927-a219-679d465f3763 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Request method failure captured: Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-581691720 HTTP/1.1 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxAkOC-aFl3b6Hc4oW0bOcTqCUmYo2MlvzxgPrj1rdJ5cK4gl2qH7NB9jzMl9VGRFHrRIjsMwD3IBJLu9JFin546Z_1OMXrGvdEhngJzF1_cwq2jIlR14UUN4llk_nv4jXqRkntc4MsT5oKi-zVe_AMs4RGapuMf8ksiYtuHUVkjSE Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c6834a9bd10445abf1312b11a10a801", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8c031d46c686455d90fe1a49150edef8 Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: exception: Volume tempest-invalid-581691720 could not be found. Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'tempest-invalid-581691720'} Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-581691720 could not be found. (HTTP 404) (Request-ID: req-64f43cbd-dda6-49e9-b12d-b7bcf983cf59) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:23:44.817676 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-581691720 could not be found. Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-581691720 could not be found. Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-581691720 could not be found. Oct 28 19:23:44.822285 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.828231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:44.828423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5b1f1d7-559a-4927-a219-679d465f3763 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Returning 404 to user: Volume tempest-invalid-581691720 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:44.828586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:44.828586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:44.828586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:44.828586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:44.828586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:44.829347 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c5b1f1d7-559a-4927-a219-679d465f3763 tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-581691720" status: 404 len: 98 microversion: 2.1 time: 0.073345 Oct 28 19:23:44.832155 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1770/3530] 10.222.0.44 () {58 vars in 1215 bytes} [Fri Oct 28 19:23:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-581691720 => generated 98 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:23:44.837399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b2df1c4-5ae6-4cc1-b651-c674b40f343e tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004093 Oct 28 19:23:44.848183 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1771/3531] 10.222.0.44 () {58 vars in 1140 bytes} [Fri Oct 28 19:23:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 19:23:44.858088 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12eb1f75-dfbb-490c-9888-94d1a179d27d tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008746 Oct 28 19:23:44.871566 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1772/3532] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:23:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 19:23:44.877422 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] HTTP exception thrown: Instance a1c181f5-9793-4903-b38d-aa38220ed7f2 could not be found. Oct 28 19:23:44.881859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8b812f12-29a5-4ac7-954c-be9e570d464f tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Calling method '.version_select at 0x7f1d778310d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Request method failure captured: Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 HTTP/1.1 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCv4wCZD9SoYpVucuLgvfSNs00cCEhBrcYm7MF4kyjdvXMqSPh4CjfSYFc3biy0FMjD-kqL_uD5x2VlLPJxKXSKjRfidGIIcTztLDGzmeRmvTqPd8S73S6vGZjzKdHoOjleL4anATKoELTa8dUOXb0kJkeUnJk_Bxa5q_cVIB8TwRLw Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b35c6fa4d63c4faba04f986a0ef6ebff Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MultipleCreateTestJSON-2079536836 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b35c6fa4d63c4faba04f986a0ef6ebff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b35c6fa4d63c4faba04f986a0ef6ebff", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b35c6fa4d63c4faba04f986a0ef6ebff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b35c6fa4d63c4faba04f986a0ef6ebff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MultipleCreateTestJSON-2079536836 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b35c6fa4d63c4faba04f986a0ef6ebff Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2079536836 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MultipleCreateTestJSON-2079536836-project Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: e827a656445444478cc6239c8457d8c6 Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MultipleCreateTestJSON-2079536836-project Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a1c181f5-9793-4903-b38d-aa38220ed7f2 could not be found. Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a1c181f5-9793-4903-b38d-aa38220ed7f2'} Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c181f5-9793-4903-b38d-aa38220ed7f2 could not be found. Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c181f5-9793-4903-b38d-aa38220ed7f2 could not be found. Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.883463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c181f5-9793-4903-b38d-aa38220ed7f2 could not be found. Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] Returning 404 to user: Instance a1c181f5-9793-4903-b38d-aa38220ed7f2 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:44.887916 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ab988bd2-6c5f-4ed5-bfc3-67da55abdf34 tempest-MultipleCreateTestJSON-2079536836 tempest-MultipleCreateTestJSON-2079536836-project] 10.222.0.44 "GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2" status: 404 len: 111 microversion: 2.1 time: 0.093150 Oct 28 19:23:44.895068 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1761/3533] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:44 2022] GET /compute/v2.1/servers/a1c181f5-9793-4903-b38d-aa38220ed7f2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:44.936832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8b812f12-29a5-4ac7-954c-be9e570d464f tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] HTTP exception thrown: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8b812f12-29a5-4ac7-954c-be9e570d464f tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Request method failure captured: Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-volumes/7ef4eba8-134e-472b-9772-edb3c3bfecf4 HTTP/1.1 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxAkOC-aFl3b6Hc4oW0bOcTqCUmYo2MlvzxgPrj1rdJ5cK4gl2qH7NB9jzMl9VGRFHrRIjsMwD3IBJLu9JFin546Z_1OMXrGvdEhngJzF1_cwq2jIlR14UUN4llk_nv4jXqRkntc4MsT5oKi-zVe_AMs4RGapuMf8ksiYtuHUVkjSE Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c6834a9bd10445abf1312b11a10a801", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8c031d46c686455d90fe1a49150edef8 Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: exception: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7ef4eba8-134e-472b-9772-edb3c3bfecf4'} Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. (HTTP 404) (Request-ID: req-424fdf0a-7a90-423e-80fa-c58e2bdac040) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:23:44.939937 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. Oct 28 19:23:44.945181 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:44.948361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8b812f12-29a5-4ac7-954c-be9e570d464f tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Returning 404 to user: Volume 7ef4eba8-134e-472b-9772-edb3c3bfecf4 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:44.951740 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8b812f12-29a5-4ac7-954c-be9e570d464f tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/7ef4eba8-134e-472b-9772-edb3c3bfecf4" status: 404 len: 109 microversion: 2.1 time: 0.075786 Oct 28 19:23:44.951908 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1773/3534] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:23:44 2022] DELETE /compute/v2.1/os-volumes/7ef4eba8-134e-472b-9772-edb3c3bfecf4 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:44.963797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7c22aed-2135-49f1-864f-8f33461abfcd tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Calling method '.version_select at 0x7f1d771f7040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:45.013144 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c7c22aed-2135-49f1-864f-8f33461abfcd tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] HTTP exception thrown: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7c22aed-2135-49f1-864f-8f33461abfcd tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Request method failure captured: Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-volumes/2caff401-89b7-43c7-ac63-2f6fb1f9bad1 HTTP/1.1 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxAkOC-aFl3b6Hc4oW0bOcTqCUmYo2MlvzxgPrj1rdJ5cK4gl2qH7NB9jzMl9VGRFHrRIjsMwD3IBJLu9JFin546Z_1OMXrGvdEhngJzF1_cwq2jIlR14UUN4llk_nv4jXqRkntc4MsT5oKi-zVe_AMs4RGapuMf8ksiYtuHUVkjSE Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c6834a9bd10445abf1312b11a10a801", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c6834a9bd10445abf1312b11a10a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 8c6834a9bd10445abf1312b11a10a801 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesNegativeTest-1502585110 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8c031d46c686455d90fe1a49150edef8 Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesNegativeTest-1502585110-project Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: exception: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2caff401-89b7-43c7-ac63-2f6fb1f9bad1'} Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. (HTTP 404) (Request-ID: req-5bb7ddfa-e431-40eb-a5d3-01e4eeb47443) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:23:45.016027 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:45.021329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7c22aed-2135-49f1-864f-8f33461abfcd tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] Returning 404 to user: Volume 2caff401-89b7-43c7-ac63-2f6fb1f9bad1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:45.024809 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7c22aed-2135-49f1-864f-8f33461abfcd tempest-VolumesNegativeTest-1502585110 tempest-VolumesNegativeTest-1502585110-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2caff401-89b7-43c7-ac63-2f6fb1f9bad1" status: 404 len: 109 microversion: 2.1 time: 0.063449 Oct 28 19:23:45.024809 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1762/3535] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:23:44 2022] GET /compute/v2.1/os-volumes/2caff401-89b7-43c7-ac63-2f6fb1f9bad1 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:45.444883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:45.446957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:45.460123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:45.462920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:45.465352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:45.466562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:45.467501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:45.468958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:45.504133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4d21e21-8926-4a63-838b-7ce255781a1b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771f7a60>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:45.594436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a4d21e21-8926-4a63-838b-7ce255781a1b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.096198 Oct 28 19:23:45.615790 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1763/3536] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:45 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:45.766229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e7f8f944-d9c0-4c5b-9867-3fc45a1e7564 req-7a8e0074-1222-41e0-b953-7b2e927cc4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1aa922-be6c-4f4b-bd29-40d3b87ad14b", "tag": "5f8d1a12-1d86-48c9-b972-32472c57e16c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:45.784991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e7f8f944-d9c0-4c5b-9867-3fc45a1e7564 req-7a8e0074-1222-41e0-b953-7b2e927cc4ce service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:45.786275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e7f8f944-d9c0-4c5b-9867-3fc45a1e7564 req-7a8e0074-1222-41e0-b953-7b2e927cc4ce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:45.786978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e7f8f944-d9c0-4c5b-9867-3fc45a1e7564 req-7a8e0074-1222-41e0-b953-7b2e927cc4ce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:45.811425 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e7f8f944-d9c0-4c5b-9867-3fc45a1e7564 req-7a8e0074-1222-41e0-b953-7b2e927cc4ce service nova] Creating event network-changed:5f8d1a12-1d86-48c9-b972-32472c57e16c for instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b on n-h1-862769-3 Oct 28 19:23:45.817539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e7f8f944-d9c0-4c5b-9867-3fc45a1e7564 req-7a8e0074-1222-41e0-b953-7b2e927cc4ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055679 Oct 28 19:23:45.818736 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1764/3537] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:23:46.292644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:46.306055 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10dc7593-bc25-4f5d-b430-036f383da3e1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.864709 Oct 28 19:23:46.307706 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1774/3538] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:45 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:46.612461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78c331de-089e-4382-97bd-1b7f0d8ffa01 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ffd61f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:46.751788 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78c331de-089e-4382-97bd-1b7f0d8ffa01 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.145110 Oct 28 19:23:46.767819 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1765/3539] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:46 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:47.332940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:47.334833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:47.351351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:47.353887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:47.355262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:47.368264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:47.369350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:47.372336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:47.709414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:47.721033 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99d4f3a4-9e0c-493c-b3bb-6962fefef2d6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.392927 Oct 28 19:23:47.724806 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1775/3540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:47 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:47.769170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94986812-44e5-4091-bc11-c573111092b2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a9f9d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:47.871108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94986812-44e5-4091-bc11-c573111092b2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.106618 Oct 28 19:23:47.871896 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1766/3541] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:47 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:48.750073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:48.753082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:48.757956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:48.775416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:48.777278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:48.778268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:48.781681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:48.783171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:48.795467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:48.889260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d38aae61-d2ea-4af0-89ed-f9dce9de5679 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771f7e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:48.991779 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d38aae61-d2ea-4af0-89ed-f9dce9de5679 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.106859 Oct 28 19:23:48.992612 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1767/3542] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:48 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:49.133095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:49.146101 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e87f1d18-82aa-458d-8834-e2170da20fb5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.401294 Oct 28 19:23:49.149299 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1776/3543] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:48 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:50.005418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:50.013619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8981296c-43fa-4fef-9ca5-118149749199 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a86040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:50.127255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:50.141185 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8981296c-43fa-4fef-9ca5-118149749199 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.136451 Oct 28 19:23:50.144223 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1768/3544] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:50 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:50.180018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:50.181263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:50.196736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:50.203497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:50.207233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:50.212303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:50.213624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:50.215250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:50.751672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:50.759738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24d4402b-ffdb-4835-b96a-72d8df1b2c5a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.584220 Oct 28 19:23:50.764128 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1777/3545] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:50 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:51.161118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83d86036-eb3f-4c18-9a80-572fa9833d73 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771f7160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:51.264697 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83d86036-eb3f-4c18-9a80-572fa9833d73 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.109920 Oct 28 19:23:51.265295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1769/3546] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:51 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:51.784522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:51.785103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:51.804553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.813241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.813908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:51.822119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.828631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.831282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:52.281636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbf18ef0-f9e2-4b75-aa11-568647e636b2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77bf53a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:52.428004 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fbf18ef0-f9e2-4b75-aa11-568647e636b2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.151331 Oct 28 19:23:52.430449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1770/3547] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:52 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:52.686388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:52.712007 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c3e644a-d4d0-4cc6-b9f2-54e58fa1fc4f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.931582 Oct 28 19:23:52.715231 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1778/3548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:51 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:53.445276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a137e036-de6e-4d9e-afff-e926702312e1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ffd6670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:53.529530 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a137e036-de6e-4d9e-afff-e926702312e1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.088911 Oct 28 19:23:53.537591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1771/3549] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:53 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:53.748773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:53.749852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:53.787434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:53.796297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:53.796909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:53.797798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:53.798267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:53.811557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:54.297968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:54.316905 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a794cd8-78f0-421b-9c51-d3847df7027d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.573887 Oct 28 19:23:54.321128 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1779/3550] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:53 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:54.429993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0d3cc377-a074-4858-bba7-d51860cc24dc req-c2be4093-07ee-4a46-8829-9f28618a1314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1aa922-be6c-4f4b-bd29-40d3b87ad14b", "name": "network-vif-plugged", "status": "completed", "tag": "5f8d1a12-1d86-48c9-b972-32472c57e16c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:54.471136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d3cc377-a074-4858-bba7-d51860cc24dc req-c2be4093-07ee-4a46-8829-9f28618a1314 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:54.471694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d3cc377-a074-4858-bba7-d51860cc24dc req-c2be4093-07ee-4a46-8829-9f28618a1314 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:54.472049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d3cc377-a074-4858-bba7-d51860cc24dc req-c2be4093-07ee-4a46-8829-9f28618a1314 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:54.519879 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0d3cc377-a074-4858-bba7-d51860cc24dc req-c2be4093-07ee-4a46-8829-9f28618a1314 service nova] Creating event network-vif-plugged:5f8d1a12-1d86-48c9-b972-32472c57e16c for instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b on n-h1-862769-3 Oct 28 19:23:54.538528 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0d3cc377-a074-4858-bba7-d51860cc24dc req-c2be4093-07ee-4a46-8829-9f28618a1314 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113612 Oct 28 19:23:54.541209 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1772/3551] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:54.553459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b79a1813-b26b-46ac-ae0d-2e4895d46a7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77d63940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:54.670549 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b79a1813-b26b-46ac-ae0d-2e4895d46a7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.128828 Oct 28 19:23:54.674830 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1780/3552] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:54 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:55.359314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:55.360578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:55.385302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:55.387659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:55.388836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:55.393847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:55.398797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:55.400241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:55.689053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bda61b9d-751f-4cce-9ee6-45bf647968a1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77d679d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:55.827960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bda61b9d-751f-4cce-9ee6-45bf647968a1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.144420 Oct 28 19:23:55.839308 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1781/3553] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:55 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:55.974717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:55.993475 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5d3b4fa6-89c8-4bc1-bf22-8b164fddfd8a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1315 microversion: 2.1 time: 0.650174 Oct 28 19:23:56.000604 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1773/3554] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:55 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:56.846622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b98d475-2218-46c8-9c1d-4946ba0cb947 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7c425430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:56.948499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b98d475-2218-46c8-9c1d-4946ba0cb947 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1414 microversion: 2.1 time: 0.096886 Oct 28 19:23:56.960831 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1782/3555] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:56 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:57.050218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:57.051984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:57.069385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:57.070244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:57.071395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:57.074040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:57.075202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:57.077169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:57.135867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:57.392549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:57.401122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0936fe10-1fc7-4a09-9faf-528fbe558f40 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1502 microversion: 2.1 time: 0.356985 Oct 28 19:23:57.407065 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1774/3556] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:57 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:57.441501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91e2d11e-2c13-4458-92b4-4e88a0d4d61c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:57.452355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91e2d11e-2c13-4458-92b4-4e88a0d4d61c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:57.453112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91e2d11e-2c13-4458-92b4-4e88a0d4d61c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:57.453711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91e2d11e-2c13-4458-92b4-4e88a0d4d61c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:57.495767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91e2d11e-2c13-4458-92b4-4e88a0d4d61c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Going to try to stop instance {{(pid=120628) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:23:57.553965 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91e2d11e-2c13-4458-92b4-4e88a0d4d61c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b/action" status: 202 len: 0 microversion: 2.1 time: 0.131735 Oct 28 19:23:57.555113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1783/3557] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:57 2022] POST /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:23:57.572834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:57.575456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:57.592331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:57.593604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:57.594296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:57.596492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:57.597487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:57.598185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:57.799539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:57.810821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f46e87eb-d2e4-4cf3-a06a-fa4745ba2788 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.251190 Oct 28 19:23:57.812280 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1775/3558] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:57 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:57.966267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d3f8819-3e8f-4137-ac33-75580702464b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7c541940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:58.037701 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d3f8819-3e8f-4137-ac33-75580702464b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1423 microversion: 2.1 time: 0.076021 Oct 28 19:23:58.043536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1776/3559] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:57 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:58.058311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7403016a-fc08-42e5-929c-cbfd8aef4bc0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771f7ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:58.106868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3ef5fb4-b924-4434-a28c-ebf6be1be221 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2128667188", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:58.112549 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a3ef5fb4-b924-4434-a28c-ebf6be1be221 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] HTTP exception thrown: min_count must be <= max_count Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3ef5fb4-b924-4434-a28c-ebf6be1be221 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Request method failure captured: Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 184 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxNfqLBFi-Y17eb20gmTBMcrMHHduHuLuPdEh9jo9j5hPCscdKge7SC_hmuTfFdoH6sljmVyjCWXISjItVP5N0cKXEBHu7lTx68gjycaFGT9kLzMeKLEqO9UYCBnJsdb9v4y0PFoHBD15Z2-v9uefn-cJhTbntpCxCgt-mQGBpPlts Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_16c44fdac7f0409fb70374c737d75037", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: c83c28e1edab42e5a55cbf8dc5c553d0 Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2128667188", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: exception: min_count must be <= max_count Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2128667188', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 28 19:23:58.114738 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.119337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3ef5fb4-b924-4434-a28c-ebf6be1be221 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Returning 400 to user: min_count must be <= max_count {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:58.119337 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3ef5fb4-b924-4434-a28c-ebf6be1be221 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.191509 Oct 28 19:23:58.122390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7403016a-fc08-42e5-929c-cbfd8aef4bc0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 200 len: 1423 microversion: 2.1 time: 0.068202 Oct 28 19:23:58.129211 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1784/3560] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:57 2022] POST /compute/v2.1/servers => generated 74 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:23:58.140201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2d582a65-1bfa-427f-b6ff-766428a02bba tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d777c3700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:58.142170 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1777/3561] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:23:58 2022] GET /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 1423 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:58.253988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b37c4318-aed5-4a76-8d2f-9b776d2060a7 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1886654637", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "max_count": 0}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b37c4318-aed5-4a76-8d2f-9b776d2060a7 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Request method failure captured: Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 168 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxNfqLBFi-Y17eb20gmTBMcrMHHduHuLuPdEh9jo9j5hPCscdKge7SC_hmuTfFdoH6sljmVyjCWXISjItVP5N0cKXEBHu7lTx68gjycaFGT9kLzMeKLEqO9UYCBnJsdb9v4y0PFoHBD15Z2-v9uefn-cJhTbntpCxCgt-mQGBpPlts Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_16c44fdac7f0409fb70374c737d75037", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c83c28e1edab42e5a55cbf8dc5c553d0 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1886654637", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "max_count": 0}} Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1886654637', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'max_count': 0}}} Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 0 Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:58.260034 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:58.265867 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.270895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b37c4318-aed5-4a76-8d2f-9b776d2060a7 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:58.272080 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b37c4318-aed5-4a76-8d2f-9b776d2060a7 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025280 Oct 28 19:23:58.273167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1778/3562] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:23:58.348177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-314b573c-a4e5-44aa-a022-c044d9244127 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-477846221", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "max_count": 2.5}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-314b573c-a4e5-44aa-a022-c044d9244127 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Request method failure captured: Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 169 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxNfqLBFi-Y17eb20gmTBMcrMHHduHuLuPdEh9jo9j5hPCscdKge7SC_hmuTfFdoH6sljmVyjCWXISjItVP5N0cKXEBHu7lTx68gjycaFGT9kLzMeKLEqO9UYCBnJsdb9v4y0PFoHBD15Z2-v9uefn-cJhTbntpCxCgt-mQGBpPlts Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_16c44fdac7f0409fb70374c737d75037", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c83c28e1edab42e5a55cbf8dc5c553d0 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-477846221", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "max_count": 2.5}} Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-477846221', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'max_count': 2.5}}} Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:58.353018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-314b573c-a4e5-44aa-a022-c044d9244127 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-314b573c-a4e5-44aa-a022-c044d9244127 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011073 Oct 28 19:23:58.368260 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1779/3563] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:23:58.411359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d75d3e3c-6de7-4bc7-9a66-1c3c6bf4e341 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-531613379", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 0}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d75d3e3c-6de7-4bc7-9a66-1c3c6bf4e341 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Request method failure captured: Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 167 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxNfqLBFi-Y17eb20gmTBMcrMHHduHuLuPdEh9jo9j5hPCscdKge7SC_hmuTfFdoH6sljmVyjCWXISjItVP5N0cKXEBHu7lTx68gjycaFGT9kLzMeKLEqO9UYCBnJsdb9v4y0PFoHBD15Z2-v9uefn-cJhTbntpCxCgt-mQGBpPlts Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_16c44fdac7f0409fb70374c737d75037", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c83c28e1edab42e5a55cbf8dc5c553d0 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-531613379", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 0}} Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-531613379', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'min_count': 0}}} Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 0 Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:58.415985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d75d3e3c-6de7-4bc7-9a66-1c3c6bf4e341 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:58.420846 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d75d3e3c-6de7-4bc7-9a66-1c3c6bf4e341 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012139 Oct 28 19:23:58.429441 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1780/3564] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:23:58.536817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-519fdddc-a867-4d08-966d-f4f11583c672 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1760874069", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 2.5}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-519fdddc-a867-4d08-966d-f4f11583c672 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Request method failure captured: Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 170 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxNfqLBFi-Y17eb20gmTBMcrMHHduHuLuPdEh9jo9j5hPCscdKge7SC_hmuTfFdoH6sljmVyjCWXISjItVP5N0cKXEBHu7lTx68gjycaFGT9kLzMeKLEqO9UYCBnJsdb9v4y0PFoHBD15Z2-v9uefn-cJhTbntpCxCgt-mQGBpPlts Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_16c44fdac7f0409fb70374c737d75037", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/16c44fdac7f0409fb70374c737d75037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 16c44fdac7f0409fb70374c737d75037 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-231951414 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: c83c28e1edab42e5a55cbf8dc5c553d0 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-231951414-project Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1760874069", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "min_count": 2.5}} Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1760874069', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'min_count': 2.5}}} Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:23:58.541533 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 19:23:58.546654 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:23:58.551188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-519fdddc-a867-4d08-966d-f4f11583c672 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:58.552294 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-519fdddc-a867-4d08-966d-f4f11583c672 tempest-MultipleCreateNegativeTestJSON-231951414 tempest-MultipleCreateNegativeTestJSON-231951414-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020409 Oct 28 19:23:58.553305 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1781/3565] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:23:58.838026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:58.838790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:58.852524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:58.853172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:58.853709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:58.856187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:58.856999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:58.859522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:59.060057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:59.083524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-928698bc-4143-4f56-9df5-c20166cfa265 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.249717 Oct 28 19:23:59.096686 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1782/3566] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:58 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:59.162563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2d582a65-1bfa-427f-b6ff-766428a02bba tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 204 len: 0 microversion: 2.1 time: 1.025942 Oct 28 19:23:59.163220 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1785/3567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:58 2022] DELETE /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:59.177499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:59.178628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:23:59.193237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:59.194940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:59.196429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:59.198236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:59.199089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:59.199959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:59.259529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:23:59.391915 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-efd7e40e-2ba3-4a8e-808d-012ea0119255 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 204 len: 0 microversion: 2.1 time: 0.222744 Oct 28 19:23:59.392958 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1783/3568] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:59 2022] DELETE /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:59.577338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-637969428", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a2a9fb07-7594-4148-91c4-67cde00ca3a4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:59.677847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] validate_networks() for [('a2a9fb07-7594-4148-91c4-67cde00ca3a4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:24:00.122185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:00.123433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:00.140650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:00.142221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:00.143635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:00.145002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:00.146066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:00.147204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:00.451434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:00.462330 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-326ea153-15a2-4546-b3d2-410c491ce66c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.347932 Oct 28 19:24:00.464520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1784/3569] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:00 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:00.540920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:24:00.543178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:24:00.543935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:24:00.544346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:24:00.544753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:24:00.562058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:00.562556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:00.563026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:00.563760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:00.564283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:00.564711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:00.650828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:00.674292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for user 6ea87a8ceb604f0aa3baa5453a3bd434 and project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:00.683725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:24:00.686485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:24:00.742405 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b462394-3bc3-4a8c-9378-837d992bf558 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171795 Oct 28 19:24:00.743720 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1786/3570] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:24:00.763194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba7dbb83-3da2-49c5-9c30-af7133987a69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:00.763946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba7dbb83-3da2-49c5-9c30-af7133987a69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:00.861189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba7dbb83-3da2-49c5-9c30-af7133987a69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:00.873172 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba7dbb83-3da2-49c5-9c30-af7133987a69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1207 microversion: 2.1 time: 0.113053 Oct 28 19:24:00.873951 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1785/3571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:00 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1207 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:01.507968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:01.509246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:01.529955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:01.531637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:01.533045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:01.537355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:01.538907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:01.542784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:01.579664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-816194105", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:01.806845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:24:01.807679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:24:01.811927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:24:01.812718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:24:01.813505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:24:01.839911 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:24:01.840300 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 19:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b (ip 10.222.0.44) !!! Oct 28 19:24:01.867207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:01.867903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:01.873685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:01.876283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:01.876988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:01.877403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:01.904595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Getting quotas for project 8af1f7774b6d4b82a735901eb4fbbb43. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:01.911668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Getting quotas for user 71842834a47a46b4ac2ef4c9df1c1317 and project 8af1f7774b6d4b82a735901eb4fbbb43. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:01.928519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:24:01.937543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:24:02.044017 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22281697-5fb6-4feb-864e-5a1cdaffba5c tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.918807 Oct 28 19:24:02.048390 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1787/3572] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:24:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:24:02.062547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:02.071955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:02.085780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.090204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.090917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:02.092269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.094517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.095015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:02.175291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lazy-loading 'flavor' on Instance uuid daf8bd2c-1aed-43f6-9773-98b79ee35739 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:24:02.436846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:02.466469 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5126585-4caa-4944-8d8b-8fe0f56ad50b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.961113 Oct 28 19:24:02.468523 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1786/3573] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:01 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:02.482639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:02.483570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:02.499036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.500238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.503023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:02.504261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.505526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.506641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:02.710990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-40208a3b-e152-4f14-befa-c2a611306a98 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/action" status: 200 len: 32 microversion: 2.1 time: 0.660257 Oct 28 19:24:02.715888 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1788/3574] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:02 2022] POST /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/action => generated 32 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:02.756304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a05b41e6-42a0-46cd-9c11-63702ce33c85 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:02.759338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a05b41e6-42a0-46cd-9c11-63702ce33c85 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:02.787698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:02.805970 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bbfada45-55fc-406b-9162-ce13aa78c1af tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1259 microversion: 2.1 time: 0.336068 Oct 28 19:24:02.809232 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1787/3575] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:02 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1259 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:02.821983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-37e75cbc-d128-4586-ae74-fd3225fd30ef req-a22197b3-eb6e-4892-a5bd-f92cb9661a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50e570b-bb24-4bfa-9833-94f0f24d31df", "name": "network-vif-unplugged", "status": "completed", "tag": "4b0b1cf6-0173-4bd0-ad2d-8e63e808d551"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:02.863920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37e75cbc-d128-4586-ae74-fd3225fd30ef req-a22197b3-eb6e-4892-a5bd-f92cb9661a54 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.865928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37e75cbc-d128-4586-ae74-fd3225fd30ef req-a22197b3-eb6e-4892-a5bd-f92cb9661a54 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.868292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37e75cbc-d128-4586-ae74-fd3225fd30ef req-a22197b3-eb6e-4892-a5bd-f92cb9661a54 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:02.900208 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-37e75cbc-d128-4586-ae74-fd3225fd30ef req-a22197b3-eb6e-4892-a5bd-f92cb9661a54 service nova] Creating event network-vif-unplugged:4b0b1cf6-0173-4bd0-ad2d-8e63e808d551 for instance a50e570b-bb24-4bfa-9833-94f0f24d31df on n-h1-862769-3 Oct 28 19:24:02.910342 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-37e75cbc-d128-4586-ae74-fd3225fd30ef req-a22197b3-eb6e-4892-a5bd-f92cb9661a54 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096315 Oct 28 19:24:02.911846 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1788/3576] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:02.924021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:02.924924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:02.945971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.950498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.951134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:02.952293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:02.955120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:02.955774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:03.094106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a05b41e6-42a0-46cd-9c11-63702ce33c85 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:03.117955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a05b41e6-42a0-46cd-9c11-63702ce33c85 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:03.122389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a05b41e6-42a0-46cd-9c11-63702ce33c85 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:03.124907 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a05b41e6-42a0-46cd-9c11-63702ce33c85 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1280 microversion: 2.47 time: 0.406668 Oct 28 19:24:03.134242 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1789/3577] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:02 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1280 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:03.471240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:03.486672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1bfa055-c60e-4749-a1f5-615e66078d27 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.573077 Oct 28 19:24:03.492630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1789/3578] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:02 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:03.516677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:03.517350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:03.529886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:03.530632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:03.531346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:03.532470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:03.533407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:03.534235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:03.857962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:03.859679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:03.868871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:03.869857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:03.870708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:03.872156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:03.872969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:03.873776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:04.032435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:04.043432 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-57b53475-4dfb-4327-870e-11dc4a9c4081 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1265 microversion: 2.1 time: 0.189575 Oct 28 19:24:04.044724 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1790/3579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:03 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:04.050424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6b000c90-26c7-4d44-9fb6-6a780c10a92b req-fbdc2e23-46a3-4663-92b2-03580ee903e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50e570b-bb24-4bfa-9833-94f0f24d31df", "name": "network-vif-deleted", "tag": "4b0b1cf6-0173-4bd0-ad2d-8e63e808d551"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:04.068894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6b000c90-26c7-4d44-9fb6-6a780c10a92b req-fbdc2e23-46a3-4663-92b2-03580ee903e7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:04.069960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6b000c90-26c7-4d44-9fb6-6a780c10a92b req-fbdc2e23-46a3-4663-92b2-03580ee903e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:04.070660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6b000c90-26c7-4d44-9fb6-6a780c10a92b req-fbdc2e23-46a3-4663-92b2-03580ee903e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:04.087064 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6b000c90-26c7-4d44-9fb6-6a780c10a92b req-fbdc2e23-46a3-4663-92b2-03580ee903e7 service nova] Creating event network-vif-deleted:4b0b1cf6-0173-4bd0-ad2d-8e63e808d551 for instance a50e570b-bb24-4bfa-9833-94f0f24d31df on n-h1-862769-3 Oct 28 19:24:04.093260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6b000c90-26c7-4d44-9fb6-6a780c10a92b req-fbdc2e23-46a3-4663-92b2-03580ee903e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046783 Oct 28 19:24:04.094025 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1791/3580] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:04.138514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:04.154092 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf8c701d-5236-4664-86ae-fa54ac5b368d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.642211 Oct 28 19:24:04.155727 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1790/3581] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:03 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:04.187245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:04.189529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:04.201847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:04.202428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:04.202892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:04.203818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:04.204312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:04.204937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:04.311394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:04.328321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:04.330134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:04.332685 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0363660c-7a09-4a9a-85be-98deb9b57077 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1338 microversion: 2.47 time: 0.161731 Oct 28 19:24:04.333801 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1792/3582] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:04 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1338 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:24:04.540675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:04.542676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:04.576817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:04.577922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:04.578909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:04.580449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:04.581241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:04.582146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:04.873501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:04.896571 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c63540dc-21c4-4067-9373-e0d8067059b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.379856 Oct 28 19:24:04.900071 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1791/3583] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:04 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:05.083646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:05.084684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:05.116269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.117116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.118018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.119454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.120401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.121180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.186997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:05.188618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:05.203219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.204671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.205699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.207187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.208285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.209374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.218097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:05.404973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:05.421043 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80b6ddb0-c421-46fe-8346-8c4e81b7ab69 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.344594 Oct 28 19:24:05.421697 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1793/3584] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:05 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:05.434903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:05.435863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:05.443412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.444152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.444778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.445855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.446499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.447164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.518153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:05.527355 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e8662d4-9a05-4d48-ac56-337ec6a0fb82 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.346736 Oct 28 19:24:05.527963 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1792/3585] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:05 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:05.562062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:05.577229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:05.579531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:05.580786 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25710c1d-a139-45d9-b7e5-943fb4c17dec tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1338 microversion: 2.47 time: 0.157907 Oct 28 19:24:05.581796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1794/3586] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:05 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1338 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:05.944782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:05.945393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:05.959786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.959786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.959786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:05.959786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:05.959786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:05.959786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.140897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.153063 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e206055c-ea01-4d2e-9bdc-07c66a4abc2d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.212343 Oct 28 19:24:06.155099 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1793/3587] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:05 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:06.444487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:06.445761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:06.453861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.454450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.454914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.455617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.456247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.456672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.566337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:06.568075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:06.575337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.576285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.577045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.578469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.579231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.579951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.623074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.639434 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7dd32b8d-6f64-4df3-831c-75d43d92429f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.198482 Oct 28 19:24:06.659385 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1795/3588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:06 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:06.670892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:06.671534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:06.680609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.681115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.681547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.682305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.682785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.683207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.753391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.764264 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b43ba4cc-13ce-4983-aba3-1b0c8ae091cc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.205717 Oct 28 19:24:06.765646 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1794/3589] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:06 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:06.771945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.781235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.783139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.784672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3246d2e-da22-4a30-8597-ee940fb8bd13 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1359 microversion: 2.47 time: 0.122956 Oct 28 19:24:06.797488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1796/3590] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:06 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1359 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:06.814713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1852408085"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:06.817598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:06.825667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.826476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.826961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.827874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.828501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.829096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.122778 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3ff80fa-6374-47bf-8552-1dbd0a0f139e tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "POST /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855/action" status: 202 len: 52 microversion: 2.47 time: 0.312279 Oct 28 19:24:07.124487 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1795/3591] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:24:06 2022] POST /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855/action => generated 52 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:24:07.152076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:07.152950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:07.167185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.168219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.169940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.171685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.172622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.173396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.189210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:07.190716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:07.204510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.206388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.207521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.209543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.211806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.212836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.225511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:24:07.231218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:07.366298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f754d7f-f70d-4384-b00c-483e45c2e9f0 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 204 len: 0 microversion: 2.47 time: 0.231496 Oct 28 19:24:07.367626 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1797/3592] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:24:07 2022] DELETE /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:24:07.377308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7400e497-fad3-4cff-b7cd-a82922b4dbe6 req-28e6a8b1-ca4c-47f7-aa10-030926f9869f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2b6e84-8310-4924-b1f6-fd2e29466257", "tag": "4e66d50a-b635-43d4-acc2-f5f9543cb611"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:07.388983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7400e497-fad3-4cff-b7cd-a82922b4dbe6 req-28e6a8b1-ca4c-47f7-aa10-030926f9869f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.389594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7400e497-fad3-4cff-b7cd-a82922b4dbe6 req-28e6a8b1-ca4c-47f7-aa10-030926f9869f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.390089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7400e497-fad3-4cff-b7cd-a82922b4dbe6 req-28e6a8b1-ca4c-47f7-aa10-030926f9869f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.410429 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7400e497-fad3-4cff-b7cd-a82922b4dbe6 req-28e6a8b1-ca4c-47f7-aa10-030926f9869f service nova] Creating event network-changed:4e66d50a-b635-43d4-acc2-f5f9543cb611 for instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 on n-h2-862769-3 Oct 28 19:24:07.417071 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7400e497-fad3-4cff-b7cd-a82922b4dbe6 req-28e6a8b1-ca4c-47f7-aa10-030926f9869f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047802 Oct 28 19:24:07.418343 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1798/3593] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:07.424869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:07.425951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:07.433763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.434674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.435151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.436162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.436615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.437348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.604735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:07.619647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:07.622398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:07.625652 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-115169c1-6156-4611-9401-b28dd1c3e79b tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1365 microversion: 2.47 time: 0.206522 Oct 28 19:24:07.626417 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1799/3594] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:07 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:07.665193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:07.666097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:07.672404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:07.674219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.674997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.675821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.676727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.677603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.678418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.695954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:07.721697 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88b99cfb-425c-4518-b1aa-eacda0170a44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.540638 Oct 28 19:24:07.722805 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1796/3595] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:07 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:07.798915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:07.799971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:07.808026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.808745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.809325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.810336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.811636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.812326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.144245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:08.165411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:08.190532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2937d2cd-0692-4f87-a005-88453a6b2bdb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.393514 Oct 28 19:24:08.192619 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f06f2ab3-8153-4b79-8df7-a8462a10250c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.529105 Oct 28 19:24:08.197265 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1797/3596] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:07 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:08.200033 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1800/3597] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:07 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:08.659370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:08.660103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:08.667124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:08.667627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:08.668367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.669080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:08.669547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:08.669957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.750183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:08.751514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:08.763480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:08.764256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:08.765281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.766482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:08.767601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:08.768857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.771851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:08.792473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:08.795579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:08.798416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aed99da2-557d-4c50-b22f-781238d57ce3 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1365 microversion: 2.47 time: 0.142183 Oct 28 19:24:08.803087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1798/3598] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:08 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:09.066405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.087708 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2506a6ec-2d61-43a3-8684-5ce8f9b63fa0 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.344241 Oct 28 19:24:09.088953 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1801/3599] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:08 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:09.218833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:09.225827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:09.227665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:09.228052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:09.245555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.246186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.246881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.247528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.248073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.248837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.251178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.251553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.252275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.252877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.253414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.254092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.570248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.571540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.584855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8af2436e-cf2d-4fbc-b1ff-7b8a9734c674 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.363508 Oct 28 19:24:09.585457 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1802/3600] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:09 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:09.599019 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f60f709-91a6-4a1d-ab15-bbdadaf1ba0b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.376722 Oct 28 19:24:09.601854 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1799/3601] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:09 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:09.832018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:09.833166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:09.841511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.845937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.846635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.847772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.848413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.849091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.925077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.933915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.939443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.940917 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b7fba8a-2867-4473-bca9-f8cfbbea3165 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1365 microversion: 2.47 time: 0.113513 Oct 28 19:24:09.941739 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1803/3602] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:09 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:10.112540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:10.113132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:10.119776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.120509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.121195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.121920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.122383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.122845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.284602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:10.295628 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36f5fee7-ad6d-47d7-926e-412533fb540e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.187422 Oct 28 19:24:10.308195 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1800/3603] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:10 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:10.608774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:10.609390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:10.615536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:10.616389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:10.629044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.629534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.630896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.631878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.632338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.634513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.635280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.635743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.636157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.638109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.638659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.639195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.873237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:10.875516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:10.878199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:10.904515 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4956f878-2c4d-40ce-a8c0-2c8885c88aae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.292975 Oct 28 19:24:10.905152 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1801/3604] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:10 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:10.914363 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28e1c509-f2e8-405e-a36a-ae1e09db054e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.310024 Oct 28 19:24:10.924740 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1804/3605] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:10 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:10.968415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:10.969036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:10.995762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.996274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.996720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:10.997776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:10.998303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:10.999248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.064094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.064998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.065734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.066846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lazy-loading 'fault' on Instance uuid 9a20c3f3-50f5-4070-a169-3b3b9dae3855 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:24:11.153395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:11.165231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:11.167137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71842834a47a46b4ac2ef4c9df1c1317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1f7774b6d4b82a735901eb4fbbb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:11.169715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5f7d92a5-8960-40c3-90ec-ccf3eaf74b77 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 200 len: 1370 microversion: 2.47 time: 0.206254 Oct 28 19:24:11.170474 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1802/3606] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:10 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:11.319473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:11.320077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:11.326766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.327325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.327861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.329191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.329852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.330337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.497096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:11.509596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb6b428f-a99e-45b9-9303-67462f4b3ceb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.193859 Oct 28 19:24:11.511982 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1805/3607] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:11 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:11.928496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:11.929104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:11.936836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:11.941626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:11.942818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:11.947590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.948087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.948516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.949220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.952619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.953354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.953795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.958080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.958816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.959733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.960409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.961009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.345272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:12.355233 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba94c496-3c55-4ca0-aa45-6de794200246 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.416962 Oct 28 19:24:12.356033 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1806/3608] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:11 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:12.367051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:12.367051 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f9496356-4f4f-4716-a6e5-2bad638a1df0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.440955 Oct 28 19:24:12.367051 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1803/3609] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:11 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:12.372168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:12.372168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] [instance: 9a20c3f3-50f5-4070-a169-3b3b9dae3855] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:12.386369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.387109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.387720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.389001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.389688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.390357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.408880 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] HTTP exception thrown: Instance 9a20c3f3-50f5-4070-a169-3b3b9dae3855 could not be found. Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Request method failure captured: Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 HTTP/1.1 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxQmMYjDsjSlTBXAVDEA5jhr0NA3ISNNPpS3xKbVQnvsuEvU5n_nl5UkoHFue75dTAnzl502EJsQHg-qWFEukQ_HACT9JvGRcAQuEIHxZX9nHTgfxP0cR0ilOtkpOyTVEvLimYVBADrldhRS_jcQGres2AYiChYl4HLTz7GXJQyGGU Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 8af1f7774b6d4b82a735901eb4fbbb43 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAaction247Test-642502408 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8af1f7774b6d4b82a735901eb4fbbb43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8af1f7774b6d4b82a735901eb4fbbb43", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8af1f7774b6d4b82a735901eb4fbbb43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8af1f7774b6d4b82a735901eb4fbbb43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAaction247Test-642502408 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 8af1f7774b6d4b82a735901eb4fbbb43 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAaction247Test-642502408 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAaction247Test-642502408-project Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 71842834a47a46b4ac2ef4c9df1c1317 Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAaction247Test-642502408-project Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9a20c3f3-50f5-4070-a169-3b3b9dae3855 could not be found. Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9a20c3f3-50f5-4070-a169-3b3b9dae3855'} Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a20c3f3-50f5-4070-a169-3b3b9dae3855 could not be found. Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a20c3f3-50f5-4070-a169-3b3b9dae3855 could not be found. Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:12.410341 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a20c3f3-50f5-4070-a169-3b3b9dae3855 could not be found. Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] Returning 404 to user: Instance 9a20c3f3-50f5-4070-a169-3b3b9dae3855 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cec49d72-2efa-4f96-b456-550ba33000e5 tempest-ServersAaction247Test-642502408 tempest-ServersAaction247Test-642502408-project] 10.222.0.44 "GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855" status: 404 len: 111 microversion: 2.47 time: 0.046292 Oct 28 19:24:12.416221 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1804/3610] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:12 2022] GET /compute/v2.1/servers/9a20c3f3-50f5-4070-a169-3b3b9dae3855 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:24:12.535126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:12.535751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:12.545286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.546027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.546667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.547578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.548296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.548878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.795943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:12.806368 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a12ee777-db90-4b14-8dc2-55cb990e9837 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.276158 Oct 28 19:24:12.835621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:12.838894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:12.847897 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1807/3611] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:12 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:12.851830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.852534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.853130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.854039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.854490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.855201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.106593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=14 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:13.130244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:13.142873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:13.144305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:13.146261 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2660343a-6006-41b7-8f66-aa6dbfabd21e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2956 microversion: 2.42 time: 0.326362 Oct 28 19:24:13.147455 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1805/3612] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:24:12 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2956 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:13.185857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:13.187162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:13.196938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.197515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.198016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.198904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.199993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.200483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.381740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:13.382352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:13.391413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.392132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.393362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.394342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.394974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.395490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.399412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b19f7e14-9f9c-4dc0-98cc-cb294a6922cf tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.221347 Oct 28 19:24:13.399412 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1808/3613] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:24:13 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003/os-interface => generated 1830 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:24:13.404386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:13.405005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:13.425438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.425945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.427028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.427600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.428065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.428597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.774524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:13.783926 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c37b9a20-cc01-4e54-8a2c-65efecfcc381 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.406086 Oct 28 19:24:13.798749 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1806/3614] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:13 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:13.798972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:13.798972 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d9803e2-0ab0-4890-a767-598e226879a3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.397296 Oct 28 19:24:13.798972 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1809/3615] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:13 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:13.835477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:13.837299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:13.846110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.846998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.848693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.850252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.851655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.852390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.115065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:14.119751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:14.136108 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f65365c0-58f0-4597-ac6f-ef87a18bb1b3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.305488 Oct 28 19:24:14.137057 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1807/3616] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:13 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:14.281815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-86fba320-710b-4cc1-928d-01a90b35e1e4 req-dc0553fc-c9fa-4a31-82c5-aeba6e43834a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b6e84-8310-4924-b1f6-fd2e29466257", "name": "network-vif-plugged", "status": "completed", "tag": "4e66d50a-b635-43d4-acc2-f5f9543cb611"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:14.300135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-86fba320-710b-4cc1-928d-01a90b35e1e4 req-dc0553fc-c9fa-4a31-82c5-aeba6e43834a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.300619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-86fba320-710b-4cc1-928d-01a90b35e1e4 req-dc0553fc-c9fa-4a31-82c5-aeba6e43834a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.301048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-86fba320-710b-4cc1-928d-01a90b35e1e4 req-dc0553fc-c9fa-4a31-82c5-aeba6e43834a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.316415 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-86fba320-710b-4cc1-928d-01a90b35e1e4 req-dc0553fc-c9fa-4a31-82c5-aeba6e43834a service nova] Creating event network-vif-plugged:4e66d50a-b635-43d4-acc2-f5f9543cb611 for instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 on n-h2-862769-3 Oct 28 19:24:14.323939 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-86fba320-710b-4cc1-928d-01a90b35e1e4 req-dc0553fc-c9fa-4a31-82c5-aeba6e43834a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045221 Oct 28 19:24:14.325284 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1810/3617] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:14.817801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:14.820295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:14.821572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:14.822444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:14.830267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.831173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.831786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.832656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.833419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.834635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.837279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.838738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.839710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.841515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.842111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.842617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:15.049683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:15.058784 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f3b019e-7b60-4313-b1e9-37345720f75e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.242579 Oct 28 19:24:15.075620 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1811/3618] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:14 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:15.131999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:15.147398 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28204b5b-1707-486d-9e58-75e4b2be4c4a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1307 microversion: 2.1 time: 0.337550 Oct 28 19:24:15.148430 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1808/3619] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:14 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:15.166276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:15.167705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:15.176998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:15.177934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:15.178622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:15.179704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:15.180360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:15.181143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:15.448502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:15.464770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aaf68849-16c9-47dd-b968-a6d47afde27c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.304796 Oct 28 19:24:15.481036 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1812/3620] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:15 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:16.082102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:16.082953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:16.091872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.095284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.095754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.107729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.108502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.109123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.175100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:16.175768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:16.185453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.185870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.186379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.191593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.192679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.193162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.830616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:16.845531 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-276347e9-9900-4178-a8d2-e95919dfb720 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.767451 Oct 28 19:24:16.846424 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1809/3621] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:16 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:16.853129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:16.865237 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-565cc591-7cf9-48bf-941d-34f3851e027c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1486 microversion: 2.1 time: 0.694666 Oct 28 19:24:16.870390 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1813/3622] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:16 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1486 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:16.893014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:16.898639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:16.898976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a2fb03a9-f467-4d65-8937-68e1da2fd4d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:16.905578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2fb03a9-f467-4d65-8937-68e1da2fd4d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.906359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2fb03a9-f467-4d65-8937-68e1da2fd4d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.907062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2fb03a9-f467-4d65-8937-68e1da2fd4d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.923473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:16.926078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.928836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.932455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.935050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:16.935736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a2fb03a9-f467-4d65-8937-68e1da2fd4d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Going to try to stop instance {{(pid=120629) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:24:16.938459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:16.939008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:16.990991 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a2fb03a9-f467-4d65-8937-68e1da2fd4d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257/action" status: 202 len: 0 microversion: 2.1 time: 0.096328 Oct 28 19:24:16.995331 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1814/3623] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:16 2022] POST /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:24:17.003305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:17.004763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:17.015106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.018475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.019863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.020890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.021573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.022342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.369517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:17.384050 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78bf9614-837f-4c98-b0fd-79de5abe169a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.524993 Oct 28 19:24:17.391010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:17.415122 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1810/3624] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:16 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:17.416346 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ddcc99b-b7ae-4813-847c-ced0df305c41 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.419076 Oct 28 19:24:17.419336 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1815/3625] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:16 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:17.876171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:17.876961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:17.884206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.885043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.885719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.886763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.887812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.888936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:18.162358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:18.182990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9dfce8cc-4531-4e5d-8533-ed257cf37eb3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.314951 Oct 28 19:24:18.184244 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1811/3626] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:17 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:18.422585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:18.423292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:18.441093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:18.443174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:18.444411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:18.445225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:18.445833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:18.447566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:18.449195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:18.449638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:18.465317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:18.469024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:18.469517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:18.471730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:18.476541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:18.477110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:19.018832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:19.031152 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-deebd3e1-441d-423c-9e9d-c5ee66234859 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.591340 Oct 28 19:24:19.031749 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1812/3627] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:18 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:19.037535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:19.050554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83fe3f21-178e-4fe4-84e9-13fdceab08c6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.632764 Oct 28 19:24:19.065255 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1816/3628] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:18 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:19.208900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:19.209891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:19.213425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:19.238996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:19.239742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:19.244025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:19.244955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:19.245534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:19.246183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:19.475681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:19.486660 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce48d190-2722-4b32-bdc2-ed7eab7ef0f2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.281543 Oct 28 19:24:19.489242 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1813/3629] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:19 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:20.059240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:20.060779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:20.077306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:20.078308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:20.082981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:20.085320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:20.086210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:20.087512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:20.090034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:20.090577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:20.091285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:20.095240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:20.096172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:20.097192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:20.097884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:20.101749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:20.951410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:20.960720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:20.968735 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7357e23e-51fc-47ff-aedc-d8e9f5a928a5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.894151 Oct 28 19:24:20.971353 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef4e17df-b836-4235-810d-4ba5239ef898 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.915624 Oct 28 19:24:20.986170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1814/3630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:20 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:20.986887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:20.991046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:20.991941 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1817/3631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:20 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:21.012149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:21.013276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:21.014042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:21.015906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:21.016415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:21.017179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:21.339256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:21.350079 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-029be6b6-28d9-46fd-a698-20a00f6790bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.375333 Oct 28 19:24:21.351108 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1815/3632] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:20 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:21.793581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94c44a69-541d-4592-ab9f-93c0468d9142 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Action: 'create', calling method: .version_select at 0x7f1d77bf2280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-47130646", "policies": ["affinity"]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:21.821857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-94c44a69-541d-4592-ab9f-93c0468d9142 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:21.828357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-94c44a69-541d-4592-ab9f-93c0468d9142 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:21.881983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-94c44a69-541d-4592-ab9f-93c0468d9142 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:21.892303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-94c44a69-541d-4592-ab9f-93c0468d9142 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:21.909386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94c44a69-541d-4592-ab9f-93c0468d9142 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.286483 Oct 28 19:24:21.915742 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1818/3633] 10.222.0.44 () {60 vars in 1174 bytes} [Fri Oct 28 19:24:21 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:21.922568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e27d56d8-0663-467f-a4eb-a6046a3b6f3f tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Action: 'create', calling method: .version_select at 0x7f1d774a8ca0>, body: {"server_group": {"name": "tempest-server-group-1653085452", "policies": ["affinity"]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:21.948135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e27d56d8-0663-467f-a4eb-a6046a3b6f3f tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:21.956156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e27d56d8-0663-467f-a4eb-a6046a3b6f3f tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:22.002247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.002925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:22.019118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:22.021138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:22.021588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:22.025619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:22.026118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:22.026553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:22.048081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e27d56d8-0663-467f-a4eb-a6046a3b6f3f tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:22.062036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e27d56d8-0663-467f-a4eb-a6046a3b6f3f tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:22.148744 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e27d56d8-0663-467f-a4eb-a6046a3b6f3f tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.231525 Oct 28 19:24:22.150352 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1816/3634] 10.222.0.44 () {60 vars in 1173 bytes} [Fri Oct 28 19:24:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:24:22.155926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.156648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:22.164019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:22.165927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:22.165927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:22.166157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:22.166587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:22.167136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:22.313755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:22.323740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9033f37-073c-42bd-9e3c-3b21fe42f47a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.327604 Oct 28 19:24:22.344225 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1819/3635] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:21 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:22.349880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ffbd6ae-17da-446b-8c34-c7b76ae450f4 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Action: 'create', calling method: .version_select at 0x7f1d77d77940>, body: {"server_group": {"name": "tempest-server-group-1653085452", "policies": ["affinity"]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:22.370125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7ffbd6ae-17da-446b-8c34-c7b76ae450f4 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:22.376387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7ffbd6ae-17da-446b-8c34-c7b76ae450f4 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:22.439432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:22.466783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7ffbd6ae-17da-446b-8c34-c7b76ae450f4 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:22.475102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7ffbd6ae-17da-446b-8c34-c7b76ae450f4 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:22.478303 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02cd8bde-456a-4935-be29-676a3f1f3d8e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.311667 Oct 28 19:24:22.479310 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1817/3636] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:22 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:22.495082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.496028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:22.503992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ffbd6ae-17da-446b-8c34-c7b76ae450f4 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.157953 Oct 28 19:24:22.505125 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1820/3637] 10.222.0.44 () {60 vars in 1173 bytes} [Fri Oct 28 19:24:22 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:22.507182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:22.510004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:22.512947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:22.516581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d7d12ec-1bc7-47f2-9897-ea5e2f26f440 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.529353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:22.531389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:22.532068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:22.547841 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d7d12ec-1bc7-47f2-9897-ea5e2f26f440 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c" status: 204 len: 0 microversion: 2.1 time: 0.035620 Oct 28 19:24:22.549884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1821/3638] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:22 2022] DELETE /compute/v2.1/os-server-groups/0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:24:22.563608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d29ea731-a44c-4be0-97a6-013be777d657 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.585363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:22.591904 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d29ea731-a44c-4be0-97a6-013be777d657 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.037440 Oct 28 19:24:22.600053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1822/3639] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:24:22 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:22.605515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8f08666-b035-49de-8575-e53cfe42efaa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.644847 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8f08666-b035-49de-8575-e53cfe42efaa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/e4f639f3-e713-427a-a443-2a00af6ff383" status: 204 len: 0 microversion: 2.1 time: 0.043416 Oct 28 19:24:22.645815 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1823/3640] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:22 2022] DELETE /compute/v2.1/os-server-groups/e4f639f3-e713-427a-a443-2a00af6ff383 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:24:22.655997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e31be48-7731-4311-85fd-02de73715920 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.676326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e31be48-7731-4311-85fd-02de73715920 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.026121 Oct 28 19:24:22.676921 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1824/3641] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:24:22 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:22.696868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10f2a250-ca27-4e52-948a-bce4c4c2b179 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Action: 'create', calling method: .version_select at 0x7f1d7c1ea1f0>, body: {"server_group": {"name": "tempest-server-group-51367073", "policies": ["affinity"]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:22.721031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10f2a250-ca27-4e52-948a-bce4c4c2b179 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:22.726410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10f2a250-ca27-4e52-948a-bce4c4c2b179 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:22.768599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:22.780738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3cd2c8d5-876e-4809-8a21-d11ca72ba2ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.296605 Oct 28 19:24:22.794722 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1818/3642] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:22 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:22.814317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10f2a250-ca27-4e52-948a-bce4c4c2b179 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:22.824538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-10f2a250-ca27-4e52-948a-bce4c4c2b179 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:22.848590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10f2a250-ca27-4e52-948a-bce4c4c2b179 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.158107 Oct 28 19:24:22.849253 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1825/3643] 10.222.0.44 () {60 vars in 1173 bytes} [Fri Oct 28 19:24:22 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:22.860081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f6a110f-94c3-4695-ae75-16feeebd97a3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.900899 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f6a110f-94c3-4695-ae75-16feeebd97a3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/a39ac71d-4a2e-4d43-a247-b9e7bdcff543" status: 204 len: 0 microversion: 2.1 time: 0.044495 Oct 28 19:24:22.901820 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1819/3644] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:22 2022] DELETE /compute/v2.1/os-server-groups/a39ac71d-4a2e-4d43-a247-b9e7bdcff543 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:24:22.911006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0e3502b-86d2-425f-8e6e-3a57a1a1d47b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:22.922564 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e0e3502b-86d2-425f-8e6e-3a57a1a1d47b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.015652 Oct 28 19:24:22.930826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1826/3645] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:24:22 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:22.936407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9bd5ea3c-c018-4ba8-a42a-d7295c7221b8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Action: 'create', calling method: .version_select at 0x7f1d779fbdc0>, body: {"server_group": {"name": "tempest-server-group-598156640", "policies": ["anti-affinity"]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:22.957376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9bd5ea3c-c018-4ba8-a42a-d7295c7221b8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:22.963588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9bd5ea3c-c018-4ba8-a42a-d7295c7221b8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:23.011428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9bd5ea3c-c018-4ba8-a42a-d7295c7221b8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:23.016594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9bd5ea3c-c018-4ba8-a42a-d7295c7221b8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_groups'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:23.041968 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9bd5ea3c-c018-4ba8-a42a-d7295c7221b8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.109512 Oct 28 19:24:23.043530 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1820/3646] 10.222.0.44 () {60 vars in 1173 bytes} [Fri Oct 28 19:24:22 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:24:23.053936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eec079db-bb71-4c8d-b49d-e33216d0a757 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:23.087461 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eec079db-bb71-4c8d-b49d-e33216d0a757 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/8086585a-8137-4ac6-b289-08909b8f5399" status: 204 len: 0 microversion: 2.1 time: 0.037203 Oct 28 19:24:23.088813 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1827/3647] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:23 2022] DELETE /compute/v2.1/os-server-groups/8086585a-8137-4ac6-b289-08909b8f5399 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:24:23.098595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb389b2b-b9c1-4b28-bf80-836aa9c51ea0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:23.113385 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb389b2b-b9c1-4b28-bf80-836aa9c51ea0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.019670 Oct 28 19:24:23.114637 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1821/3648] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:24:23 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:23.240269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-283031810", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "9768ff52-8247-437a-8327-17ba2d992a4a"}]}, "os:scheduler_hints": {"group": "d76aabf9-955c-409c-93cb-b436b688e2df"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:23.297232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] validate_networks() for [('9768ff52-8247-437a-8327-17ba2d992a4a', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:24:23.352210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:23.352853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:23.365250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.365984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.366606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.368570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.369288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.370056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.616621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:23.626398 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2554ef9-34c0-479c-a0f9-90a44c801d58 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.278403 Oct 28 19:24:23.627035 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1822/3649] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:23 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:23.632461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:23.633337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:23.647873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.648906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.648906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.655543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.656170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.659407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.906539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:23.917638 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa433240-866e-4e01-8bc4-92ea66741add tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.289363 Oct 28 19:24:23.918823 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1823/3650] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:23 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:23.945639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:23.946651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:23.947805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:24:23.948268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:24:23.948674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:24:23.949073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:24:23.949478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:24:23.957530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.958814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.959857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.961157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.961851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.962285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.966723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.967231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.967738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:23.969298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:23.971707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:23.972155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:24.014647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:24.021138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:24.037976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:24:24.041636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:24:24.108583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:24.131346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:24.154246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:24.163320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b73efef8-cce7-43ad-8968-19b7f2a12bbe tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.230104 Oct 28 19:24:24.182775 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1824/3651] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:23 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:24.183045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for project 90d351568a2146db9e27828256ae993d. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:24.189648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Getting quotas for user 046df06e8f514e2097b53e7cc3bccacf and project 90d351568a2146db9e27828256ae993d. Resources: {'server_group_members'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:24.225337 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0be0496-e213-4c46-8921-0874ad700e3b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989301 Oct 28 19:24:24.231849 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1828/3652] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:24:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:24:24.239152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4169d66-f904-41e0-a1f2-443a084b37b3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:24.239798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4169d66-f904-41e0-a1f2-443a084b37b3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:24.306111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f4169d66-f904-41e0-a1f2-443a084b37b3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:24.314846 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4169d66-f904-41e0-a1f2-443a084b37b3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1212 microversion: 2.1 time: 0.080312 Oct 28 19:24:24.315450 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1825/3653] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:24 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:24.650428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:24.651533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:24.671136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:24.672576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:24.673854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:24.676379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:24.677548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:24.678313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:24.890004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:24.900866 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7c3746f4-60d7-4b22-801b-0698df437cd3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.254740 Oct 28 19:24:24.901843 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1829/3654] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:24 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:24.947043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:24.947940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:24.959743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:24.960710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:24.961048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:24.961779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:24.962245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:24.962681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:25.171271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:25.180246 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5564eb70-98ae-43f7-b592-43c02b685487 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.238409 Oct 28 19:24:25.186917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1826/3655] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:24 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:25.197157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:25.197761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:25.210253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:25.210785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:25.211220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:25.211939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:25.212385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:25.212801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:25.340315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:25.341592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:25.352343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:25.353794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:25.354424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:25.355379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:25.356034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:25.356677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:25.485889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:25.498425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7496e75f-4f97-49bc-8c33-18ecd1ba9ada tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1208 microversion: 2.1 time: 0.162999 Oct 28 19:24:25.502737 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1827/3656] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:25 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1208 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:25.549425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:25.559928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f9880419-f88a-4d0b-b7b3-09ec05303c87 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.367208 Oct 28 19:24:25.562235 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1830/3657] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:25 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:25.925743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:25.927115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:25.937438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:25.938973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:25.939971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:25.942829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:25.944235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:25.945166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.209885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:26.211263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:26.229407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:26.229970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:26.231123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:26.231743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.232479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:26.232935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:26.233355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.243486 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc10fac0-59b1-4c6d-931d-0e2a22e3d2bc tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.321666 Oct 28 19:24:26.249541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1828/3658] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:25 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:26.525845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:26.526956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:26.536227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:26.536723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:26.537162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.544389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:26.545211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:26.547233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.583129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:26.728306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:26.742976 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1dd7abf1-9846-4d4c-a1d6-94795db7472a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1270 microversion: 2.1 time: 0.223239 Oct 28 19:24:26.745759 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1829/3659] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:26 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:26.764230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:26.769074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:26.779391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:26.784731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:26.788032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.789061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:26.791429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:26.792224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:26.810992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:26.826232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bce8943e-d9cd-417c-b86e-33b1c170305f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.619845 Oct 28 19:24:26.828966 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1831/3660] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:26 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:27.210911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:27.222838 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23afc497-13c4-4626-ab8c-005eed955c2a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1512 microversion: 2.1 time: 0.475578 Oct 28 19:24:27.226594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1830/3661] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:26 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:27.279952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:27.280584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:27.295348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:27.295951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:27.296785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:27.297749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:27.298506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:27.299358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:27.636029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:27.656136 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8173a1b-eb18-423e-ad81-3feab0fb475f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.377901 Oct 28 19:24:27.667341 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1832/3662] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:27 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:27.772288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:27.773580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:27.786420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:27.787444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:27.788173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:27.789266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:27.789956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:27.790782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:27.851749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:27.852687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:27.855872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:27.866272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:27.870674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:27.871311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:27.874366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:27.875493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:27.876038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.175466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:28.189505 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd7f305b-3efd-4182-b59c-a5d25c34c3c2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.418875 Oct 28 19:24:28.190151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1831/3663] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:27 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:28.246169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:28.247137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:28.257837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.258749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.260051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.262145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.264027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.264749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.311342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:28.320281 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02e56691-6357-4955-904e-d75ed1b4e75a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.472548 Oct 28 19:24:28.320825 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1833/3664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:27 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:28.605162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:28.628320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-083a0d99-5c97-4821-a00e-f67cf3b5ffad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1489 microversion: 2.1 time: 0.373936 Oct 28 19:24:28.641773 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1832/3665] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:28 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1489 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:28.667549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:28.674003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:28.684284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:28.684928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:28.688159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.692589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.693234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.694832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.696329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.697020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.697512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.698182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.698314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.698993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.700312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.702729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.775045 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2a1c60a-a250-46ba-b719-fe0e8195ed12 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 200 len: 141 microversion: 2.1 time: 0.119348 Oct 28 19:24:28.776420 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1834/3666] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:28 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 141 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:28.788138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:28.789069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:28.804723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.808505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.809582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:28.821708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:28.824228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:28.826589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.131066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:29.142206 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30be9c1b-78f2-4a44-8d8f-8c7daacd1021 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.463396 Oct 28 19:24:29.158165 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1833/3667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:28 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:29.238726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:29.240621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:29.247731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:29.250434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.251371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.252426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.253409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.254055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.255136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.305200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:29.316353 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3827c643-a64f-4b58-8f97-0f333a3ee079 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.534172 Oct 28 19:24:29.318371 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1835/3668] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:28 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:29.354220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:29.355425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:29.362724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.363565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.364225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.365153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.365887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.370872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.625085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:29.640035 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0cf33646-6d57-4127-a952-87e3f43502fc tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.427314 Oct 28 19:24:29.659107 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1834/3669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:29 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:29.665077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:29.666893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:29.676017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.676909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.677532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.679334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.680120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.680826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.716183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:29.732531 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6aa4ab79-04b5-40b6-bf2f-4ec48d200681 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.386703 Oct 28 19:24:29.735179 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1836/3670] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:29 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:29.748046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3be59d20-1aad-4324-a616-204b0218166b req-ee50126f-84e9-4ae1-adf1-2442c9af7179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e641349a-6593-4285-81db-8f00909c88d1", "tag": "cb5f71b2-5706-4501-9730-05ecff292943"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:29.768752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3be59d20-1aad-4324-a616-204b0218166b req-ee50126f-84e9-4ae1-adf1-2442c9af7179 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.769518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3be59d20-1aad-4324-a616-204b0218166b req-ee50126f-84e9-4ae1-adf1-2442c9af7179 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.770281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3be59d20-1aad-4324-a616-204b0218166b req-ee50126f-84e9-4ae1-adf1-2442c9af7179 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.804503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3be59d20-1aad-4324-a616-204b0218166b req-ee50126f-84e9-4ae1-adf1-2442c9af7179 service nova] Creating event network-changed:cb5f71b2-5706-4501-9730-05ecff292943 for instance e641349a-6593-4285-81db-8f00909c88d1 on n-h1-862769-3 Oct 28 19:24:29.811624 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3be59d20-1aad-4324-a616-204b0218166b req-ee50126f-84e9-4ae1-adf1-2442c9af7179 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073018 Oct 28 19:24:29.812500 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1837/3671] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:29.821630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:29.822837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:29.832480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.833375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.833973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:29.835354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:29.835981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:29.836849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.076399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:30.091107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70bab078-f519-4460-8f83-a1450a14bca8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.429905 Oct 28 19:24:30.092282 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1835/3672] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:29 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:30.165689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:30.166390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:30.173205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:30.173704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:30.173874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:30.174205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.174949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:30.175404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:30.175832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.190094 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1edd96ef-76d9-44ef-93aa-73a41f1f28b1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.373932 Oct 28 19:24:30.202485 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1838/3673] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:29 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:30.215330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:30.216101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:30.242861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:30.243525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:30.243965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.244675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:30.245127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:30.245574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.771583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:30.783040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aca05fc4-2ef7-4cd4-b3b6-13fc861d3c6a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.618345 Oct 28 19:24:30.790504 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1836/3674] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:30 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:30.805180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:30.805884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:30.812336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:30.813134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:30.813865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.814820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:30.815483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:30.816111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:30.835723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:30.845227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a8f6631-b108-4319-b3c3-056be5ec44df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.634097 Oct 28 19:24:30.849842 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1839/3675] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:30 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:31.007450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:31.016649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ad4a5c8-13a0-4d7d-8f1e-b6bf05115291 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.216104 Oct 28 19:24:31.017342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1837/3676] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:30 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:31.028561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-466145318", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "4e4640cd-261b-42b5-9b7b-42f460667021"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:31.094302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] validate_networks() for [('4e4640cd-261b-42b5-9b7b-42f460667021', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:24:31.116360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:31.117307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:31.127714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:31.128211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:31.128649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:31.129350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:31.140696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:31.141461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:31.425851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:31.435653 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-858abb42-5f94-466b-a168-2d43d9adc9f7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.325837 Oct 28 19:24:31.436977 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1838/3677] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:31 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:31.614515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:24:31.614942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:24:31.615410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:24:31.615819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:24:31.616613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:24:31.629018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:31.629501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:31.629933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:31.630965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:31.631612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:31.632035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:31.650325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:31.655821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for user 42f0003698694056b69b98933c84cd8a and project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:31.672184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:24:31.675903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:24:31.726231 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72cdd853-c3a3-45c0-9658-cc4cad8a848a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701644 Oct 28 19:24:31.727310 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1840/3678] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:24:31.739579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a64ea066-c67f-4754-8ca5-47494b90d981 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:31.740624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a64ea066-c67f-4754-8ca5-47494b90d981 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:31.809690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:31.810322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:31.825359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:31.825861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:31.831575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:31.832569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:31.832964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:31.835573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:31.840395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a64ea066-c67f-4754-8ca5-47494b90d981 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:31.854160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a64ea066-c67f-4754-8ca5-47494b90d981 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1214 microversion: 2.1 time: 0.119680 Oct 28 19:24:31.855755 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1839/3679] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:31 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:31.859102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:32.044425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:32.045433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:32.067115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:32.067772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:32.068240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:32.069035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:32.069501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:32.072437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:32.182469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:32.191241 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9549ab56-a847-4f78-b9a3-f78367a3502d tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.388280 Oct 28 19:24:32.207234 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1841/3680] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:31 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:32.387377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:32.401095 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cc9d754-0da7-4c34-9715-5d533b649899 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.360348 Oct 28 19:24:32.418984 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1840/3681] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:32 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:32.460923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:32.461453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:32.468417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:32.469167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:32.469597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:32.470578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:32.471215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:32.471799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:32.881786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:32.883297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:32.895324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:32.896126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:32.896765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:32.898530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:32.899480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:32.899949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:32.967761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:32.979406 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b2b10d7-53f4-4b1b-bb47-1675f3584cca tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.522516 Oct 28 19:24:32.980064 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1842/3682] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:32 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:33.020204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:33.030103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a4d7201-a3df-4b56-8d5b-d5760ebe57f3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1210 microversion: 2.1 time: 0.152402 Oct 28 19:24:33.041549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1841/3683] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:32 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:33.214725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:33.215391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:33.231604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:33.233230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:33.233681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:33.234428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:33.234919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:33.235378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:33.399942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:33.412103 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6163adf9-1705-4a21-af80-bb9be3e48543 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1732 microversion: 2.1 time: 0.201449 Oct 28 19:24:33.413468 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1843/3684] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:33 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:33.429272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:33.430141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:33.438454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:33.439098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:33.440396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:33.441945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:33.442507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:33.443037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:33.580038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:33.588053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1090903-ad0d-436c-a770-4c4cdf4e19f6 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.163769 Oct 28 19:24:33.588758 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1842/3685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:33 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:34.003701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:34.004473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:34.011887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.012380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.012816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.013559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.013978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.014432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.057518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:34.058333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:34.065420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.065965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.066418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.067219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.067715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.068411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.143623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:34.152658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f915a1d-762c-4e21-ac2a-eabcdbe39a6f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1272 microversion: 2.1 time: 0.099452 Oct 28 19:24:34.153241 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1843/3686] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:34 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:34.187103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:34.195907 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-84107673-d88c-4033-97ae-eddef73fe5d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.196299 Oct 28 19:24:34.196604 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1844/3687] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:33 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:34.436774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:34.437243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:34.446235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.447199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.447910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.448691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.449858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.450397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.609438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:34.613404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:34.615220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:34.623961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.624357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0217acd5-e707-4a22-bec3-c229095d7f83 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1712 microversion: 2.1 time: 0.191428 Oct 28 19:24:34.624670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.625106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.625989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.626670 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1844/3688] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:34 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1712 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:34.626863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.627273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.775394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:34.777564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:34.784901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.785804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.786658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.787447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.787967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.788528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.811189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:34.825590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-afab7b43-717c-4265-b34b-c5eb6e0eb841 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.214000 Oct 28 19:24:34.826266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1845/3689] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:34 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:34.917178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Cannot 'detach_volume' instance daf8bd2c-1aed-43f6-9773-98b79ee35739 while it is in vm_state rescued Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments/95f7538b-24ad-43bf-81d7-0efb57a0f5e9 HTTP/1.1 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'detach_volume' instance daf8bd2c-1aed-43f6-9773-98b79ee35739 while it is in vm_state rescued Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': 'daf8bd2c-1aed-43f6-9773-98b79ee35739', 'id': '95f7538b-24ad-43bf-81d7-0efb57a0f5e9'} Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance daf8bd2c-1aed-43f6-9773-98b79ee35739 while it is in vm_state rescued Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:34.920304 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:34.925902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:34.925902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:34.925902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:34.925902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:34.925902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance daf8bd2c-1aed-43f6-9773-98b79ee35739 while it is in vm_state rescued Oct 28 19:24:34.925902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:34.927525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 409 to user: Cannot 'detach_volume' instance daf8bd2c-1aed-43f6-9773-98b79ee35739 while it is in vm_state rescued {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:34.928633 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe4e12d4-ff73-44f8-b070-5c137fe94517 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments/95f7538b-24ad-43bf-81d7-0efb57a0f5e9" status: 409 len: 152 microversion: 2.1 time: 0.159378 Oct 28 19:24:34.929445 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1845/3690] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:24:34 2022] DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments/95f7538b-24ad-43bf-81d7-0efb57a0f5e9 => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:24:34.938736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:34.939886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:34.952512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.953043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.953529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:34.954365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:34.958878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:34.959321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.048626 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4eb06d1-02d4-4d4b-8437-950078bcbeb3 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/action" status: 202 len: 0 microversion: 2.1 time: 0.113933 Oct 28 19:24:35.049685 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1846/3691] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:34 2022] POST /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:24:35.057829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:35.058440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:35.065560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.066327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.066964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.067834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.068292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.068744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.177876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:35.178896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:35.186181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.186649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.187152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.187882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.188598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.189026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.493322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:35.502862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f193cc2-6945-4113-b614-ec38e102b79f tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1720 microversion: 2.1 time: 0.448962 Oct 28 19:24:35.503464 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1846/3692] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:35 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1720 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:35.508754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:35.509605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:35.515762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.516633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.517271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.518212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.518949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.519619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.524036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:35.544187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:35.552523 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed18c91b-3d79-4b5e-91b6-bdfe2db3fa6d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.378970 Oct 28 19:24:35.567140 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1847/3693] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:35 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:35.749274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:35.758842 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1258661-5fad-48ab-91c6-4bce483bffb7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.254086 Oct 28 19:24:35.759579 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1847/3694] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:35 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:35.853575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:35.854625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:35.863885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.864619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.865112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:35.865956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:35.867078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:35.867660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.061705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:36.075927 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-993e4d07-a6ca-407a-9771-c916c0b2ddd1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.229391 Oct 28 19:24:36.077082 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1848/3695] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:35 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:36.529113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:36.529885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:36.538590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.539604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.540394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.541389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.542079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.542761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.577494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:36.578447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:36.588680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.589375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.591277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.593025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.594456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.595145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.832467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:36.835708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:36.841415 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dde51f73-9f9d-4ae3-afff-1ef3a50f217c tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1720 microversion: 2.1 time: 0.316723 Oct 28 19:24:36.842027 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1848/3696] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:36 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1720 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:36.844991 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a495c2b2-7106-42a6-b342-ccde1d56906e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.271846 Oct 28 19:24:36.848769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-49e73534-24f3-4e12-aff2-74930802db48 req-4544661f-2d98-42f1-a830-2755f90b0751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e641349a-6593-4285-81db-8f00909c88d1", "name": "network-vif-plugged", "status": "completed", "tag": "cb5f71b2-5706-4501-9730-05ecff292943"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:36.859027 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1849/3697] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:36 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:36.859347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-49e73534-24f3-4e12-aff2-74930802db48 req-4544661f-2d98-42f1-a830-2755f90b0751 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.859839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-49e73534-24f3-4e12-aff2-74930802db48 req-4544661f-2d98-42f1-a830-2755f90b0751 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.860296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-49e73534-24f3-4e12-aff2-74930802db48 req-4544661f-2d98-42f1-a830-2755f90b0751 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.865166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-abda1206-6819-45d2-8aed-28912683661f req-c155fc73-6ba8-473f-9f91-164d07f8e1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7fe9c2-a313-40dc-97e2-f41286b1216b", "tag": "543ab562-9b7c-4aef-bdbc-8f11573789c8"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:36.876561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-abda1206-6819-45d2-8aed-28912683661f req-c155fc73-6ba8-473f-9f91-164d07f8e1ad service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.877176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-abda1206-6819-45d2-8aed-28912683661f req-c155fc73-6ba8-473f-9f91-164d07f8e1ad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.877695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-abda1206-6819-45d2-8aed-28912683661f req-c155fc73-6ba8-473f-9f91-164d07f8e1ad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.878713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-49e73534-24f3-4e12-aff2-74930802db48 req-4544661f-2d98-42f1-a830-2755f90b0751 service nova] Creating event network-vif-plugged:cb5f71b2-5706-4501-9730-05ecff292943 for instance e641349a-6593-4285-81db-8f00909c88d1 on n-h1-862769-3 Oct 28 19:24:36.885237 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-49e73534-24f3-4e12-aff2-74930802db48 req-4544661f-2d98-42f1-a830-2755f90b0751 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042050 Oct 28 19:24:36.886216 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1849/3698] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:36.889834 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-abda1206-6819-45d2-8aed-28912683661f req-c155fc73-6ba8-473f-9f91-164d07f8e1ad service nova] Creating event network-changed:543ab562-9b7c-4aef-bdbc-8f11573789c8 for instance ef7fe9c2-a313-40dc-97e2-f41286b1216b on n-h2-862769-3 Oct 28 19:24:36.892876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:36.893776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:36.894909 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-abda1206-6819-45d2-8aed-28912683661f req-c155fc73-6ba8-473f-9f91-164d07f8e1ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033492 Oct 28 19:24:36.895651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1850/3699] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:36.900362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.900848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.901281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:36.901976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:36.902601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:36.903227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:37.102206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:37.103726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:37.110658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:37.111452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:37.112169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:37.112321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:37.113329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:37.114033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:37.114655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:37.121232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4fa5f94-a7bd-4f8d-8092-76a93d80dfc2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.233182 Oct 28 19:24:37.121851 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1850/3700] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:36 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:37.269558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:37.282475 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dba13df2-60af-4e0e-8e47-323690266924 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1312 microversion: 2.1 time: 0.185455 Oct 28 19:24:37.283722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1851/3701] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:37 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:37.864905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:37.866593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:37.872983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:37.873768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:37.873987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:37.874259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:37.874722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:37.875680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:37.876194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:37.876700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:37.882612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:37.884252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:37.885298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:37.886258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:37.886948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:37.887696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.415551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:38.419354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:38.428183 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e54bff9e-5261-48dc-9416-c706f69b6719 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.560406 Oct 28 19:24:38.429482 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1852/3702] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:37 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:38.434181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:38.434846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:38.440941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.441418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.441841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.442530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.443014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.443432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.444901 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ccae468a-d6d3-4125-b45b-6a8acaa1bdc7 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1726 microversion: 2.1 time: 0.583825 Oct 28 19:24:38.445583 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1851/3703] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:37 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1726 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:38.450546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:38.451459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:38.467757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.468588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.469037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.469882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.470511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.471136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.673849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:38.684326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:38.685410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0714687-28d0-4830-97ef-adb22fe18387 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.254805 Oct 28 19:24:38.686076 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1853/3704] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:38 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:38.698879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:38.698879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:38.700488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.701105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.702194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.702936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.703862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.704504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.710864 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ab72e99-52ee-4ecc-9a08-0ede61d5a2b0 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1497 microversion: 2.1 time: 0.264029 Oct 28 19:24:38.711634 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1852/3705] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:38 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:38.733099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05db5dd4-250f-485b-a306-66ccc1b91eb1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:38.746404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.server_groups [None req-05db5dd4-250f-485b-a306-66ccc1b91eb1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Querying cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) for 1 instances {{(pid=120628) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 19:24:38.747152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05db5dd4-250f-485b-a306-66ccc1b91eb1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.747810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05db5dd4-250f-485b-a306-66ccc1b91eb1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.748239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05db5dd4-250f-485b-a306-66ccc1b91eb1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.766961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05db5dd4-250f-485b-a306-66ccc1b91eb1 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups/d76aabf9-955c-409c-93cb-b436b688e2df" status: 200 len: 220 microversion: 2.1 time: 0.037369 Oct 28 19:24:38.767766 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1853/3706] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:24:38 2022] GET /compute/v2.1/os-server-groups/d76aabf9-955c-409c-93cb-b436b688e2df => generated 220 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:24:38.778199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:38.778723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:38.785025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.785237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.785625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.786322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.786809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.787231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.800931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6ccef8f-7ce3-44c0-b74b-f24320405e6e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113728 Oct 28 19:24:38.801654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1854/3707] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:24:38 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:38.820823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:24:38.911423 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2895537f-1cb7-4f9c-a8ff-6d2c09d5b33e tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 204 len: 0 microversion: 2.1 time: 0.136466 Oct 28 19:24:38.913694 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1854/3708] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:24:38 2022] DELETE /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:24:38.924368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:38.925281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:38.934301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.934828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.935446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:38.936329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:38.936953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:38.937544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:39.085921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:39.095576 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-33957e0f-b288-4a29-8ae1-b84e71143218 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1503 microversion: 2.1 time: 0.176496 Oct 28 19:24:39.096131 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1855/3709] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:38 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:39.453914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:39.454726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:39.462146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:39.463628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:39.464229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:39.464960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:39.465474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:39.466008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:39.617850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:39.629657 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cec8177-eaa9-4851-b19a-883dcb43c15b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.181212 Oct 28 19:24:39.631272 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1855/3710] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:39 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:39.714844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:39.715795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:39.724240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:39.724998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:39.725827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:39.726855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:39.727537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:39.728732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:39.927514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:39.936599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b612093d-e197-42e2-8c57-7d32971c81d3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.226701 Oct 28 19:24:39.937295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1856/3711] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:39 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:40.118014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:40.118629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:40.126836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.127680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.128349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.129351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.130226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.131721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.202614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5277805a-1acd-4985-b5d2-d7f72d480b07 req-796f535c-a7ad-4256-b307-a3fa66943371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf8bd2c-1aed-43f6-9773-98b79ee35739", "tag": "410ee5dc-145e-4989-b3c0-0f8f513f4f26"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:40.202614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5277805a-1acd-4985-b5d2-d7f72d480b07 req-796f535c-a7ad-4256-b307-a3fa66943371 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.202614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5277805a-1acd-4985-b5d2-d7f72d480b07 req-796f535c-a7ad-4256-b307-a3fa66943371 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.202614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5277805a-1acd-4985-b5d2-d7f72d480b07 req-796f535c-a7ad-4256-b307-a3fa66943371 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.238114 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5277805a-1acd-4985-b5d2-d7f72d480b07 req-796f535c-a7ad-4256-b307-a3fa66943371 service nova] Creating event network-changed:410ee5dc-145e-4989-b3c0-0f8f513f4f26 for instance daf8bd2c-1aed-43f6-9773-98b79ee35739 on n-h2-862769-3 Oct 28 19:24:40.245899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5277805a-1acd-4985-b5d2-d7f72d480b07 req-796f535c-a7ad-4256-b307-a3fa66943371 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089562 Oct 28 19:24:40.253464 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1857/3712] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:24:40.379583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:40.388103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f74ad459-c929-4c30-90cd-255b85f900a8 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1503 microversion: 2.1 time: 0.273934 Oct 28 19:24:40.408316 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1856/3713] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:40 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:40.653764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:40.655550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:40.673565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.674073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.674945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.676174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.676660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.677145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.964509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:40.965141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:40.971784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:40.972361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.972606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.973260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.973976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:40.974580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:40.975170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:40.978352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:40.994549 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cdd16ba8-66bb-4ce2-a1c4-6198677c462f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.345144 Oct 28 19:24:41.011291 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1858/3714] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:40 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:41.220166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d4d5f8ac-77e0-440b-9d1f-5b02c4f90564 req-78921a72-da1e-41f1-9397-ad809ec23af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e641349a-6593-4285-81db-8f00909c88d1", "name": "network-vif-deleted", "tag": "cb5f71b2-5706-4501-9730-05ecff292943"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:41.239476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d4d5f8ac-77e0-440b-9d1f-5b02c4f90564 req-78921a72-da1e-41f1-9397-ad809ec23af9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:41.243903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d4d5f8ac-77e0-440b-9d1f-5b02c4f90564 req-78921a72-da1e-41f1-9397-ad809ec23af9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:41.249896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d4d5f8ac-77e0-440b-9d1f-5b02c4f90564 req-78921a72-da1e-41f1-9397-ad809ec23af9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:41.271307 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d4d5f8ac-77e0-440b-9d1f-5b02c4f90564 req-78921a72-da1e-41f1-9397-ad809ec23af9 service nova] Creating event network-vif-deleted:cb5f71b2-5706-4501-9730-05ecff292943 for instance e641349a-6593-4285-81db-8f00909c88d1 on n-h1-862769-3 Oct 28 19:24:41.285496 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d4d5f8ac-77e0-440b-9d1f-5b02c4f90564 req-78921a72-da1e-41f1-9397-ad809ec23af9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070757 Oct 28 19:24:41.290714 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1859/3715] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:24:41.294911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:41.308060 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cfba29cb-2a30-49df-8462-1b2e4d340032 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.351050 Oct 28 19:24:41.308665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1857/3716] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:40 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:41.417529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:41.419061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:41.429094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:41.431739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:41.432497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:41.434457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:41.435346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:41.438854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:41.488669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:41.489265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:41.489818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:41.490360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lazy-loading 'fault' on Instance uuid e641349a-6593-4285-81db-8f00909c88d1 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:24:41.549333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046df06e8f514e2097b53e7cc3bccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d351568a2146db9e27828256ae993d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:41.572159 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-429dbce7-becd-4566-accd-73d19efae804 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 200 len: 1302 microversion: 2.1 time: 0.159292 Oct 28 19:24:41.572829 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1860/3717] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:41 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 1302 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:42.019728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.021391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:42.024255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=20 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:42.031204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.032036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.032652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.033557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.034269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.034863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.200955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:42.220107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7705fab4-a3bb-4159-a9f4-60b0ce031335 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.193415 Oct 28 19:24:42.221134 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1858/3718] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:42 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:42.266112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:42.267729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=44 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:42.274173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-49715dc3-8214-46e8-bef9-e67835a8ff5c req-85526833-24fa-43a7-a377-26aefadc21bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf8bd2c-1aed-43f6-9773-98b79ee35739", "tag": "410ee5dc-145e-4989-b3c0-0f8f513f4f26"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:42.285553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-49715dc3-8214-46e8-bef9-e67835a8ff5c req-85526833-24fa-43a7-a377-26aefadc21bd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.286114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-49715dc3-8214-46e8-bef9-e67835a8ff5c req-85526833-24fa-43a7-a377-26aefadc21bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.286551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-49715dc3-8214-46e8-bef9-e67835a8ff5c req-85526833-24fa-43a7-a377-26aefadc21bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.299984 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-49715dc3-8214-46e8-bef9-e67835a8ff5c req-85526833-24fa-43a7-a377-26aefadc21bd service nova] Creating event network-changed:410ee5dc-145e-4989-b3c0-0f8f513f4f26 for instance daf8bd2c-1aed-43f6-9773-98b79ee35739 on n-h2-862769-3 Oct 28 19:24:42.305811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-49715dc3-8214-46e8-bef9-e67835a8ff5c req-85526833-24fa-43a7-a377-26aefadc21bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040018 Oct 28 19:24:42.306968 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1861/3719] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:42.340878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.342143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:42.350518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.351309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.353699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.354761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.356262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.356877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.538504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:42.548557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-714f6813-87f6-4259-87c5-3ce9afeb12cd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1496 microversion: 2.1 time: 0.215849 Oct 28 19:24:42.553938 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1859/3720] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:42 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1496 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:42.597071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.597870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:42.604424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.604913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.605336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.606024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.606471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.606982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.621422 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 HTTP/1.1 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e641349a-6593-4285-81db-8f00909c88d1'} Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.623117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5c227068-feb8-4a99-ba77-4e5dfdf6894a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 404 len: 111 microversion: 2.1 time: 0.032010 Oct 28 19:24:42.626365 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1862/3721] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:42 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.635359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fde6d658-c9de-48ab-8a63-0efaa763e8b2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.650557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.server_groups [None req-fde6d658-c9de-48ab-8a63-0efaa763e8b2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Querying cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) for 1 instances {{(pid=120628) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 19:24:42.651375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde6d658-c9de-48ab-8a63-0efaa763e8b2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.651935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde6d658-c9de-48ab-8a63-0efaa763e8b2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.652365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde6d658-c9de-48ab-8a63-0efaa763e8b2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.663657 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fde6d658-c9de-48ab-8a63-0efaa763e8b2 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.032245 Oct 28 19:24:42.664240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1860/3722] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:24:42 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:42.676923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82c37510-0091-4ee0-8795-c7c87bb7cd6a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.690401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.server_groups [None req-82c37510-0091-4ee0-8795-c7c87bb7cd6a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Querying cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) for 1 instances {{(pid=120629) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 19:24:42.691193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82c37510-0091-4ee0-8795-c7c87bb7cd6a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.691664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82c37510-0091-4ee0-8795-c7c87bb7cd6a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.692088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82c37510-0091-4ee0-8795-c7c87bb7cd6a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.702646 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82c37510-0091-4ee0-8795-c7c87bb7cd6a tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/os-server-groups/d76aabf9-955c-409c-93cb-b436b688e2df" status: 200 len: 182 microversion: 2.1 time: 0.029801 Oct 28 19:24:42.703284 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1863/3723] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:24:42 2022] GET /compute/v2.1/os-server-groups/d76aabf9-955c-409c-93cb-b436b688e2df => generated 182 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:42.715110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.715861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:42.721803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.722286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.722734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.723576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.724028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.724560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.738988 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 HTTP/1.1 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e641349a-6593-4285-81db-8f00909c88d1'} Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:24:42.740703 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3a855eb-cc60-44f5-87b4-dda4eacf7f76 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 404 len: 111 microversion: 2.1 time: 0.031389 Oct 28 19:24:42.743989 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1861/3724] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:24:42 2022] DELETE /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.753459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.754259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] [instance: e641349a-6593-4285-81db-8f00909c88d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:42.761363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.761858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.762300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.763060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:42.764087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:42.764528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:42.780604 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 HTTP/1.1 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e641349a-6593-4285-81db-8f00909c88d1'} Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.782779 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance e641349a-6593-4285-81db-8f00909c88d1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-397303a3-94e1-432b-8e78-a817709c2183 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1" status: 404 len: 111 microversion: 2.1 time: 0.035703 Oct 28 19:24:42.785655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1864/3725] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:42 2022] GET /compute/v2.1/servers/e641349a-6593-4285-81db-8f00909c88d1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.792943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fd09117-9c63-44a1-8d9e-8eedd2f1f0d5 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.799524 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2fd09117-9c63-44a1-8d9e-8eedd2f1f0d5 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance group 8086585a-8137-4ac6-b289-08909b8f5399 could not be found. Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fd09117-9c63-44a1-8d9e-8eedd2f1f0d5 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-server-groups/8086585a-8137-4ac6-b289-08909b8f5399 HTTP/1.1 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance group 8086585a-8137-4ac6-b289-08909b8f5399 could not be found. Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '8086585a-8137-4ac6-b289-08909b8f5399'} Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8086585a-8137-4ac6-b289-08909b8f5399 could not be found. Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8086585a-8137-4ac6-b289-08909b8f5399 could not be found. Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.801044 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8086585a-8137-4ac6-b289-08909b8f5399 could not be found. Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fd09117-9c63-44a1-8d9e-8eedd2f1f0d5 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance group 8086585a-8137-4ac6-b289-08909b8f5399 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2fd09117-9c63-44a1-8d9e-8eedd2f1f0d5 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/8086585a-8137-4ac6-b289-08909b8f5399" status: 404 len: 117 microversion: 2.1 time: 0.013461 Oct 28 19:24:42.804807 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1862/3726] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:42 2022] DELETE /compute/v2.1/os-server-groups/8086585a-8137-4ac6-b289-08909b8f5399 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.811567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94c9ec84-b450-4a00-9b9f-a8d91cc00230 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.818291 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-94c9ec84-b450-4a00-9b9f-a8d91cc00230 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance group a39ac71d-4a2e-4d43-a247-b9e7bdcff543 could not be found. Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94c9ec84-b450-4a00-9b9f-a8d91cc00230 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-server-groups/a39ac71d-4a2e-4d43-a247-b9e7bdcff543 HTTP/1.1 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance group a39ac71d-4a2e-4d43-a247-b9e7bdcff543 could not be found. Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a39ac71d-4a2e-4d43-a247-b9e7bdcff543'} Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a39ac71d-4a2e-4d43-a247-b9e7bdcff543 could not be found. Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a39ac71d-4a2e-4d43-a247-b9e7bdcff543 could not be found. Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.820651 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a39ac71d-4a2e-4d43-a247-b9e7bdcff543 could not be found. Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94c9ec84-b450-4a00-9b9f-a8d91cc00230 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance group a39ac71d-4a2e-4d43-a247-b9e7bdcff543 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.823695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94c9ec84-b450-4a00-9b9f-a8d91cc00230 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/a39ac71d-4a2e-4d43-a247-b9e7bdcff543" status: 404 len: 117 microversion: 2.1 time: 0.014484 Oct 28 19:24:42.825936 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1865/3727] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:42 2022] DELETE /compute/v2.1/os-server-groups/a39ac71d-4a2e-4d43-a247-b9e7bdcff543 => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.833254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91359d30-66fa-4222-ae24-f3b4c3ac81aa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.844146 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-91359d30-66fa-4222-ae24-f3b4c3ac81aa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance group e4f639f3-e713-427a-a443-2a00af6ff383 could not be found. Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91359d30-66fa-4222-ae24-f3b4c3ac81aa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-server-groups/e4f639f3-e713-427a-a443-2a00af6ff383 HTTP/1.1 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance group e4f639f3-e713-427a-a443-2a00af6ff383 could not be found. Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e4f639f3-e713-427a-a443-2a00af6ff383'} Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e4f639f3-e713-427a-a443-2a00af6ff383 could not be found. Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e4f639f3-e713-427a-a443-2a00af6ff383 could not be found. Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.846170 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e4f639f3-e713-427a-a443-2a00af6ff383 could not be found. Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91359d30-66fa-4222-ae24-f3b4c3ac81aa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance group e4f639f3-e713-427a-a443-2a00af6ff383 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91359d30-66fa-4222-ae24-f3b4c3ac81aa tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/e4f639f3-e713-427a-a443-2a00af6ff383" status: 404 len: 117 microversion: 2.1 time: 0.020519 Oct 28 19:24:42.849149 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1863/3728] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:42 2022] DELETE /compute/v2.1/os-server-groups/e4f639f3-e713-427a-a443-2a00af6ff383 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.857209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ea5f835-9e82-48ea-a2de-53a77bf21b6b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.865538 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0ea5f835-9e82-48ea-a2de-53a77bf21b6b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] HTTP exception thrown: Instance group 0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c could not be found. Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ea5f835-9e82-48ea-a2de-53a77bf21b6b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Request method failure captured: Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/os-server-groups/0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c HTTP/1.1 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCxlY62tVT0NJ91bvy4EO0KO1UpABrQiT7RHiHKYuqDaw8B2XtsBZ8cOOFByuMUpQ4F7ge2KvpEsB7S5ZVrRbGnJ5zg9sdMK58HQqidepqlLGFmO-mcpfCzcNWU6KOOdxV-7pJDY7kcXaq88unHPJVsQWPuoFJ5EXWK9xvfUFUGFTaQ Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90d351568a2146db9e27828256ae993d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90d351568a2146db9e27828256ae993d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90d351568a2146db9e27828256ae993d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 90d351568a2146db9e27828256ae993d Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerGroupTestJSON-626147100 Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 046df06e8f514e2097b53e7cc3bccacf Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerGroupTestJSON-626147100-project Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance group 0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c could not be found. Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c'} Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c could not be found. Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c could not be found. Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.866375 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c could not be found. Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:24:42.870357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ea5f835-9e82-48ea-a2de-53a77bf21b6b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Returning 404 to user: Instance group 0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:24:42.870981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ea5f835-9e82-48ea-a2de-53a77bf21b6b tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c" status: 404 len: 117 microversion: 2.1 time: 0.017605 Oct 28 19:24:42.875441 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1866/3729] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:42 2022] DELETE /compute/v2.1/os-server-groups/0dbc7ab7-b2cd-4b5b-8393-ef87b5024b0c => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:24:42.880469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9796bf31-a6ec-4990-9c25-a5052d39c5b3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:42.913841 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9796bf31-a6ec-4990-9c25-a5052d39c5b3 tempest-ServerGroupTestJSON-626147100 tempest-ServerGroupTestJSON-626147100-project] 10.222.0.44 "DELETE /compute/v2.1/os-server-groups/d76aabf9-955c-409c-93cb-b436b688e2df" status: 204 len: 0 microversion: 2.1 time: 0.037094 Oct 28 19:24:42.914607 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1864/3730] 10.222.0.44 () {58 vars in 1266 bytes} [Fri Oct 28 19:24:42 2022] DELETE /compute/v2.1/os-server-groups/d76aabf9-955c-409c-93cb-b436b688e2df => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:24:43.246117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:43.247455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:43.253812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:43.254296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:43.254753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:43.255454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:43.255928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:43.256347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:43.542561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:43.551721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eb9fe6b3-987d-4dc9-838e-be137e50f1bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.309698 Oct 28 19:24:43.552554 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1867/3731] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:43 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:43.573515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:43.574192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:43.582452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:43.583049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:43.583460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:43.584432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:43.584913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:43.585555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:43.823305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:43.832263 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a09b6ab-8843-4baf-a6bd-29f3759e8d7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 200 len: 1473 microversion: 2.1 time: 0.262811 Oct 28 19:24:43.833002 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1865/3732] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:43 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:43.855069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-526692123"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:43.857662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:43.863805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:43.864462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:43.865156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:43.865855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:43.866452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:43.866908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:44.095747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e564ca29-be8a-491a-8d0d-f3669b31fb7c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257/action" status: 202 len: 0 microversion: 2.1 time: 0.244350 Oct 28 19:24:44.096729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1868/3733] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:43 2022] POST /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:24:44.107586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d13d048a-259d-49e1-b829-bf86219ca99a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d774a9550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:44.175258 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d13d048a-259d-49e1-b829-bf86219ca99a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.071398 Oct 28 19:24:44.184009 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1866/3734] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:44 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:44.577022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:44.577554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:44.592278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:44.592775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:44.593458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:44.594169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:44.594753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:44.597932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:44.853725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e8aa6413-a74e-4584-898e-d4bcddf69bf8 req-a289113a-dae1-40bc-bfad-ceb07c4c5e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7fe9c2-a313-40dc-97e2-f41286b1216b", "name": "network-vif-plugged", "status": "completed", "tag": "543ab562-9b7c-4aef-bdbc-8f11573789c8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:44.861976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:44.873912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e8aa6413-a74e-4584-898e-d4bcddf69bf8 req-a289113a-dae1-40bc-bfad-ceb07c4c5e05 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:44.877855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e8aa6413-a74e-4584-898e-d4bcddf69bf8 req-a289113a-dae1-40bc-bfad-ceb07c4c5e05 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:44.878519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e8aa6413-a74e-4584-898e-d4bcddf69bf8 req-a289113a-dae1-40bc-bfad-ceb07c4c5e05 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:44.882826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6674e506-dfdf-4995-9f7d-793331df2662 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.310698 Oct 28 19:24:44.884031 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1869/3735] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:44 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:44.909234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e8aa6413-a74e-4584-898e-d4bcddf69bf8 req-a289113a-dae1-40bc-bfad-ceb07c4c5e05 service nova] Creating event network-vif-plugged:543ab562-9b7c-4aef-bdbc-8f11573789c8 for instance ef7fe9c2-a313-40dc-97e2-f41286b1216b on n-h2-862769-3 Oct 28 19:24:44.918838 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e8aa6413-a74e-4584-898e-d4bcddf69bf8 req-a289113a-dae1-40bc-bfad-ceb07c4c5e05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069430 Oct 28 19:24:44.922496 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1867/3736] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:45.192013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0d15936-f4a7-4695-914a-085eddafc6eb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ffd33a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:45.272062 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0d15936-f4a7-4695-914a-085eddafc6eb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.084286 Oct 28 19:24:45.273246 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1870/3737] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:45 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:45.913274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:45.915282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:45.933168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:45.934052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:45.934652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:45.935530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:45.936134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:45.936705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:46.212789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:46.224493 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4764d574-ed43-443d-b8d7-161f54eca8bd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1314 microversion: 2.1 time: 0.319022 Oct 28 19:24:46.227904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1868/3738] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:45 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:46.290557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97f5136f-4daa-4d36-9870-9ee6b0e9cba0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c74790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:46.347898 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97f5136f-4daa-4d36-9870-9ee6b0e9cba0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.062027 Oct 28 19:24:46.349491 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1871/3739] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:46 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:47.251808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:47.253117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:47.263779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:47.264478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:47.265053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:47.272276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:47.273161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:47.273743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:47.278005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:47.365547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2204a03-64ea-4c7e-8582-1a2b68a465a4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7c342d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:47.467231 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2204a03-64ea-4c7e-8582-1a2b68a465a4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.107094 Oct 28 19:24:47.477442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1872/3740] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:47 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:47.594093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:47.603532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-39c2e498-11a1-44b5-87e4-a7cc0edf830e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1500 microversion: 2.1 time: 0.357473 Oct 28 19:24:47.604127 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1869/3741] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:47 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1500 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:47.627386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:47.629911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:47.664331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:47.665438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:47.666212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:47.670845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:47.671527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:47.672175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:47.729884 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44213d79-c6d7-411d-afcc-5c6e94e365ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.105192 Oct 28 19:24:47.734711 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1873/3742] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:47 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:48.483732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-438905e8-124b-49e8-9d0f-582fd2230a78 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c64790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:48.572935 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-438905e8-124b-49e8-9d0f-582fd2230a78 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.093196 Oct 28 19:24:48.579379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1870/3743] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:48 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:48.751284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:48.755026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:48.764053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:48.764883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:48.765996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:48.767116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:48.780163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:48.782807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:48.867934 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-afd33206-9366-4189-bb20-da756d9f4bf2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.123453 Oct 28 19:24:48.873597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1874/3744] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:48 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:48.885335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2b5d3874-0c69-440b-9057-1d37cce6302c req-eb806d97-a267-4081-8b79-da2702d463ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b6e84-8310-4924-b1f6-fd2e29466257", "name": "network-vif-plugged", "status": "completed", "tag": "4e66d50a-b635-43d4-acc2-f5f9543cb611"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:48.899059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2b5d3874-0c69-440b-9057-1d37cce6302c req-eb806d97-a267-4081-8b79-da2702d463ea service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:48.899984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2b5d3874-0c69-440b-9057-1d37cce6302c req-eb806d97-a267-4081-8b79-da2702d463ea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:48.900618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2b5d3874-0c69-440b-9057-1d37cce6302c req-eb806d97-a267-4081-8b79-da2702d463ea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:48.922754 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2b5d3874-0c69-440b-9057-1d37cce6302c req-eb806d97-a267-4081-8b79-da2702d463ea service nova] Creating event network-vif-plugged:4e66d50a-b635-43d4-acc2-f5f9543cb611 for instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 on n-h2-862769-3 Oct 28 19:24:48.937532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2b5d3874-0c69-440b-9057-1d37cce6302c req-eb806d97-a267-4081-8b79-da2702d463ea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056429 Oct 28 19:24:48.939670 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1871/3745] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:49.595434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76e2515f-4265-4042-8062-3776430c45aa tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77df8310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:49.686333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76e2515f-4265-4042-8062-3776430c45aa tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.097894 Oct 28 19:24:49.688465 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1875/3746] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:49 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:49.883906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:49.888149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:49.912888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:49.915178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:49.915743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:49.917767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:49.919101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:49.921536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:49.997172 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-26aa0dd3-ac2a-4631-bc4e-37549b2b12a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.120292 Oct 28 19:24:49.998054 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1872/3747] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:49 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:50.707644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76a00dc3-33b9-4408-a127-0092ca35b862 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77df8700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:50.795240 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76a00dc3-33b9-4408-a127-0092ca35b862 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.095109 Oct 28 19:24:50.802848 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1876/3748] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:50 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:51.009194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:51.011560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:51.032998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:51.034383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:51.035599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:51.038806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:51.039570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:51.040337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:51.120332 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-33e90831-bb8f-43ea-b203-85dca3b786d9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.115480 Oct 28 19:24:51.121188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1873/3749] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:51 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:51.818802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a81aac4d-6369-4fcf-98a3-a296fcd44386 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ff9a790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:51.922176 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a81aac4d-6369-4fcf-98a3-a296fcd44386 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.114166 Oct 28 19:24:51.926934 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1877/3750] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:51 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:52.134334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:52.136767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:52.143841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:52.144333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:52.144773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:52.145486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:52.145953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:52.146457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:52.202030 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8b0a4e7-1870-405e-aa16-cc67f96662c5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.073225 Oct 28 19:24:52.202808 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1874/3751] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:52 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:52.939866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e25b7367-e602-4ca3-9dc2-b23aadf75c92 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77df84c0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:53.019693 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e25b7367-e602-4ca3-9dc2-b23aadf75c92 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.085195 Oct 28 19:24:53.020840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1878/3752] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:52 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:53.214997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:53.217444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:53.234417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:53.236583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:53.237213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:53.239623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:53.240109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:53.240562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:53.320452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-951a0c6e-9e4e-40a8-b724-2d23aee5aee0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.110216 Oct 28 19:24:53.323992 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1875/3753] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:53 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:54.040744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92642c29-b220-4688-9fa4-805476043177 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d8001b700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:54.136212 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92642c29-b220-4688-9fa4-805476043177 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.102064 Oct 28 19:24:54.144226 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1879/3754] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:54 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:54.334106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:54.340189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:54.358903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:54.359651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:54.360918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:54.361841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:54.362522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:54.363139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:54.455390 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10a2eaae-71dd-482e-8cf6-c77553645279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.125403 Oct 28 19:24:54.460617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1876/3755] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:54 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:55.160804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42dffa26-3727-484a-947b-b5adab21fb32 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77ca4e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:55.257938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42dffa26-3727-484a-947b-b5adab21fb32 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.109283 Oct 28 19:24:55.258938 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1880/3756] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:55 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:55.469550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:55.473200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:55.488152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:55.495651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:55.498468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:55.499673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:55.501694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:55.502819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:55.504564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:55.605802 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87d1cc78-2f40-4122-9e4f-02f1690f6f6b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.140994 Oct 28 19:24:55.610975 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1877/3757] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:55 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:56.279130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6189ae7e-85e7-48a9-8287-6973771c8999 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ff9a5e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:56.363112 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6189ae7e-85e7-48a9-8287-6973771c8999 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.089046 Oct 28 19:24:56.373589 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1881/3758] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:56 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:56.618365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:56.634044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:56.649346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:56.649844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:56.654030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:56.654845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:56.655333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:56.658370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:56.744984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b00a67d8-02e7-489b-852a-3890004622ce tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.130668 Oct 28 19:24:56.748559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1878/3759] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:56 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:57.380942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e5ee517-6f21-40ad-b4d5-364e94224dd6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7c528430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:57.475479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e5ee517-6f21-40ad-b4d5-364e94224dd6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.096725 Oct 28 19:24:57.475801 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1879/3760] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:57 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:57.500203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-614675967", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:57.581281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] validate_networks() for [('ddc971ba-e70f-412b-9da6-b7178e048b01', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:24:57.757151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:57.759693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:57.768831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:57.769630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:57.770271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:57.777661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:57.778163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:57.778895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:57.830193 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d6e04c8-ec56-4843-a408-63b129bb4298 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.077170 Oct 28 19:24:57.831496 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1880/3761] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:57 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:24:58.230835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:24:58.231705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:24:58.232659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:24:58.233262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:24:58.233835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:24:58.238682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:58.264986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:58.265789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:58.266904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:58.267902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:58.268606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:58.269346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:58.295538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Getting quotas for project 724ba6314aa149df897b118534b70b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:58.303502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Getting quotas for user 51a5ade5f7734262881d9350659eba60 and project 724ba6314aa149df897b118534b70b93. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:58.339413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:24:58.342150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:24:58.435073 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ed9d844-d198-40c9-89b5-ae061607d1ba tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.464669 Oct 28 19:24:58.436206 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1882/3762] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:24:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:24:58.450821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e5b5536-1837-4f4f-b0bb-96e11f94a24c tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:58.451576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e5b5536-1837-4f4f-b0bb-96e11f94a24c tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:58.490095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-987c951c-8e3c-472e-aed1-9ab20ef55ff1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771960d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:58.561859 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-987c951c-8e3c-472e-aed1-9ab20ef55ff1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.075646 Oct 28 19:24:58.563318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1883/3763] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:58 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:24:58.684723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e5b5536-1837-4f4f-b0bb-96e11f94a24c tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:58.694329 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e5b5536-1837-4f4f-b0bb-96e11f94a24c tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1222 microversion: 2.1 time: 0.249985 Oct 28 19:24:58.697305 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1881/3764] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:58 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:58.841791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:58.852149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:58.863750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:58.875494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:58.876015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:58.876770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:58.877227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:58.877648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:58.942546 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f092b8c0-f99c-4c29-9ae0-a78819b96c9a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 14 microversion: 2.1 time: 0.104662 Oct 28 19:24:58.943404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1884/3765] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:58 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:24:59.581490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9114aab4-7927-4eb3-a580-10eabbc1d3d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c460d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:59.655714 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9114aab4-7927-4eb3-a580-10eabbc1d3d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.078260 Oct 28 19:24:59.656861 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1882/3766] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:24:59 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:59.727090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:59.728579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:59.739731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:59.740489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:59.741139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:59.742105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:59.742796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:59.743612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:59.886663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:59.900878 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-13eca1bd-2181-46f8-8859-dd64355521ad tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1274 microversion: 2.1 time: 0.180872 Oct 28 19:24:59.902179 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1885/3767] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:59 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:59.953676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:59.956291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:24:59.976567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:59.977082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:59.977541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:59.978333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:59.981852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:59.985838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:00.122145 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c5199494-da15-453a-bb40-09ff326caffd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action" status: 200 len: 8205 microversion: 2.1 time: 0.172095 Oct 28 19:25:00.129967 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1883/3768] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:59 2022] POST /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b/action => generated 8205 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:00.134210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:00.134883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:00.150030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:00.150535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:00.151031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:00.151759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:00.152221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:00.152777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:00.518742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:00.535917 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d174f68a-6380-4e62-be19-d3bdb36b6339 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.399496 Oct 28 19:25:00.537142 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1886/3769] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:00 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:00.582272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:00.583242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:00.622483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:00.639248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:00.640078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:00.644082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:00.645274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:00.646527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:00.674940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-731946ee-560a-4e81-ab8a-7a30f1a0cf59 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d772b8310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:00.791054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-731946ee-560a-4e81-ab8a-7a30f1a0cf59 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.120433 Oct 28 19:25:00.795051 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1887/3770] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:00 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:00.929990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:00.930618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:00.946529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:00.953003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:00.953738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:00.958940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:00.959742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:00.961139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:01.229372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:01.243729 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03c164a3-a15d-47df-9ff5-9286d5d1aa18 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1280 microversion: 2.1 time: 0.314876 Oct 28 19:25:01.259586 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1888/3771] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:00 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:01.481097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:01.495061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1aa83a54-107e-476e-98b1-1338fe2fa3ae tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.921264 Oct 28 19:25:01.506323 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1884/3772] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:00 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:01.531234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:01.532171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:01.547521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:01.549119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:01.552392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:01.554816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:01.555562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:01.561376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:01.814211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ddbe39bd-5b7b-4cea-a315-dec6c7bb85ea tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c640d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:01.929424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:01.956739 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cea3298d-3bc7-47f8-8451-a46ce96a69bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.431107 Oct 28 19:25:01.980781 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1889/3773] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:01 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:02.027705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:02.053931 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ddbe39bd-5b7b-4cea-a315-dec6c7bb85ea tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.247009 Oct 28 19:25:02.054508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:02.057171 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1885/3774] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:01 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:02.114448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:02.115599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:02.116294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:02.117795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:02.118327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:02.119658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:02.271825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:02.272502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:02.284094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:02.290429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:02.291044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:02.291973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:02.293121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:02.297481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:02.593117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:02.602857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d9c0626a-27c3-4fd4-b6e5-3106b598a587 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1280 microversion: 2.1 time: 0.337742 Oct 28 19:25:02.606545 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1886/3775] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:02 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1280 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:02.706617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:02.718922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6c827d07-3d71-4995-b9ed-c89b71b54680 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.736817 Oct 28 19:25:02.724960 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1890/3776] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:01 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:02.751758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:02.752481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:02.769800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:02.772000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:02.772461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:02.779189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:02.784950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:02.785503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:02.927534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Locking {{(pid=120628) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 28 19:25:03.083640 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5cc244be-e41d-4a00-b05d-b0e31e6ac925 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.333361 Oct 28 19:25:03.087975 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1887/3777] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:02 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:03.097938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:03.099369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:03.120394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:03.124463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65257ad2-ea2c-4725-8189-7a464195c0da tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d773b89d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:03.126995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:03.128519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:03.132567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:03.133077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:03.133497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:03.256948 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65257ad2-ea2c-4725-8189-7a464195c0da tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1413 microversion: 2.1 time: 0.144166 Oct 28 19:25:03.272838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1888/3778] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:03 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:03.641070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:03.641967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:03.652405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:03.652939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:03.655276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:03.660802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:03.661365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:03.661785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:04.115594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:04.138374 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-864433c3-e05b-4d6e-9693-22510266be24 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 1.045049 Oct 28 19:25:04.138995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1891/3779] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:03 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:04.162195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:04.179154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:04.179645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:04.179782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:04.181807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:04.196551 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a741cca0-8822-4432-80d5-864708d0e260 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1322 microversion: 2.1 time: 0.560006 Oct 28 19:25:04.197182 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1889/3780] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:03 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:04.243974 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] HTTP exception thrown: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 is locked Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Request method failure captured: Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action HTTP/1.1 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 15 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtsmXkcOQXSFh5nt1nO8UxrF7f7mjLMsVatMRciI8JqEXW-Uzz5Gl5-RQIq4jqirdqf98HC3-6v6VlOSzISvYXWbEyILCE39CwcF9AIGIAWKMjJmVLeaiVnQII2bfu3nLNcGAsq9XJeHjqNZMziDbCEcrhjeIvhuVbMLgVXC2j43YQ Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/488f01035c694382b597fcadb399bccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_488f01035c694382b597fcadb399bccc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-232803518 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42f0003698694056b69b98933c84cd8a Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: {"os-stop": {}} Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 is locked Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f1b86398-b5dd-4e34-a35d-ee6081efa9c5', 'body': {'os-stop': {}}} Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 is locked Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 is locked Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 is locked Oct 28 19:25:04.245824 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:04.249282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Returning 409 to user: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 is locked {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:25:04.249282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c20fabc-4b16-4363-8372-62a0b49b3569 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 409 len: 107 microversion: 2.1 time: 0.089665 Oct 28 19:25:04.249282 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1892/3781] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:04 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 107 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:25:04.262648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:04.263271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:04.273050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:04.275245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:04.275894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:04.277153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:04.277914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:04.278607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:04.280485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af1b05a8-42f1-4158-b27b-abf9166e0bfd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77ca4700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:04.344256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Unlocking {{(pid=120628) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 19:25:04.364198 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af1b05a8-42f1-4158-b27b-abf9166e0bfd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1422 microversion: 2.1 time: 0.087657 Oct 28 19:25:04.365202 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1893/3782] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:04 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:04.380982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-247d2b06-4dda-4a3f-9820-dcfbc2e8cd9b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ff9a0d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:04.429877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:04.467424 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-247d2b06-4dda-4a3f-9820-dcfbc2e8cd9b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 200 len: 1422 microversion: 2.1 time: 0.091829 Oct 28 19:25:04.479558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1894/3783] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:04 2022] GET /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:04.480847 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cfdfd6a7-d90e-4c7c-a1e5-2d5ded3597da tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.220735 Oct 28 19:25:04.481296 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1890/3784] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:04 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:04.487297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-744ea94b-7a41-4413-9ef5-b520ab9af5f9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c74ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:04.494269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6628037-d693-4b5e-92ef-e79a89b7aebb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:04.539174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6628037-d693-4b5e-92ef-e79a89b7aebb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:04.539709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6628037-d693-4b5e-92ef-e79a89b7aebb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:04.540159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6628037-d693-4b5e-92ef-e79a89b7aebb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:04.574438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6628037-d693-4b5e-92ef-e79a89b7aebb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Going to try to stop instance {{(pid=120628) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:25:04.645319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6628037-d693-4b5e-92ef-e79a89b7aebb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.160639 Oct 28 19:25:04.646398 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1891/3785] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:04 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:04.677262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:04.679723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:04.695826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:04.696461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:04.697081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:04.697860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:04.698327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:04.698773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:05.067531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:05.082602 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8bdc8de3-75fc-448c-8d4f-a474366a4363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.419420 Oct 28 19:25:05.083577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1892/3786] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:04 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:05.234622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:05.238384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:05.251926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:05.253342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:05.255365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:05.258637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:05.259391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:05.260871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:05.349139 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-744ea94b-7a41-4413-9ef5-b520ab9af5f9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 204 len: 0 microversion: 2.1 time: 0.866668 Oct 28 19:25:05.350445 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1895/3787] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:04 2022] DELETE /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:25:05.359159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:05.359781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:05.366489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:05.367389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:05.368390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:05.369328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:05.370149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:05.370641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:05.375305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:05.404092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:25:05.509897 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b5faac71-0129-4d1d-b797-866fc9562102 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 204 len: 0 microversion: 2.1 time: 0.154152 Oct 28 19:25:05.510973 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1896/3788] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:25:05 2022] DELETE /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:25:05.536173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5764146c-d4d5-4131-995a-d7190e8fb6d7 req-63fb72a8-bdbf-4dd1-8837-b5d8838289ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:05.548352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5764146c-d4d5-4131-995a-d7190e8fb6d7 req-63fb72a8-bdbf-4dd1-8837-b5d8838289ec service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:05.549079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5764146c-d4d5-4131-995a-d7190e8fb6d7 req-63fb72a8-bdbf-4dd1-8837-b5d8838289ec service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:05.550003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5764146c-d4d5-4131-995a-d7190e8fb6d7 req-63fb72a8-bdbf-4dd1-8837-b5d8838289ec service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:05.571013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5764146c-d4d5-4131-995a-d7190e8fb6d7 req-63fb72a8-bdbf-4dd1-8837-b5d8838289ec service nova] Creating event network-changed:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:25:05.578143 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5764146c-d4d5-4131-995a-d7190e8fb6d7 req-63fb72a8-bdbf-4dd1-8837-b5d8838289ec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065492 Oct 28 19:25:05.579609 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1897/3789] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:05.628599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:05.637186 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-499008b4-b1dd-448d-a350-0c21b438e65a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1322 microversion: 2.1 time: 0.408838 Oct 28 19:25:05.637782 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1893/3790] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:05 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:05.678776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-569484098", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a2a9fb07-7594-4148-91c4-67cde00ca3a4"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:05.746859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] validate_networks() for [('a2a9fb07-7594-4148-91c4-67cde00ca3a4', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:25:06.106926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:06.107640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:06.116076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:06.116472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:06.116914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:06.117611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:06.118120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:06.118808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:06.468808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:06.479078 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-922de93b-c241-4af1-a632-07985379a30e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.376002 Oct 28 19:25:06.479669 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1894/3791] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:06 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:06.584463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:25:06.584951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:25:06.585342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:25:06.585743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:25:06.586377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:25:06.596238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:06.597046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:06.597678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:06.598601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:06.599447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:06.600473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:06.618183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:25:06.623980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for user 6ea87a8ceb604f0aa3baa5453a3bd434 and project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:25:06.637442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:25:06.640103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:25:06.671743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:06.673579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:06.683277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:06.683984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:06.684613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:06.685293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:06.685890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:06.686730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:06.692257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-06252161-252e-4f49-8b5b-9e959342a8e8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019565 Oct 28 19:25:06.692913 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1898/3792] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:25:06.706761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c674a82-787c-4753-a39b-f8c83de11b30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:06.707670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c674a82-787c-4753-a39b-f8c83de11b30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:06.829815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c674a82-787c-4753-a39b-f8c83de11b30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:06.839695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c674a82-787c-4753-a39b-f8c83de11b30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1207 microversion: 2.1 time: 0.139299 Oct 28 19:25:06.847504 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1899/3793] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:06 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1207 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:06.923701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:06.933206 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ac0c0e0-2595-479b-b6fd-5f098c3ee769 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1322 microversion: 2.1 time: 0.268736 Oct 28 19:25:06.934328 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1895/3794] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:06 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:07.509344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:07.510324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:07.522095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:07.522938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:07.524056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:07.525306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:07.526297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:07.528652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:07.871949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:07.872683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:07.890018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:07.890535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:07.891066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:07.893994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:07.894480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:07.894946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:08.189850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:08.206494 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ad4fca4-7820-4f15-86b7-cc59582e3172 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1259 microversion: 2.1 time: 0.340152 Oct 28 19:25:08.207118 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1896/3795] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:07 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1259 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:08.238781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:08.239955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:08.264183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:08.266517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:08.267270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:08.271064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:08.271718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:08.272269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:08.273611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:08.285716 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd6d0cd4-bfb9-4802-8617-df8328efc907 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.782614 Oct 28 19:25:08.302442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1900/3796] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:07 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:08.302442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-429ca583-1046-443e-93d3-0ec8ca0e7532 req-b387f51c-be93-4f31-a2e8-d238bce3de6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b6e84-8310-4924-b1f6-fd2e29466257", "name": "network-vif-deleted", "tag": "4e66d50a-b635-43d4-acc2-f5f9543cb611"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:08.321236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-429ca583-1046-443e-93d3-0ec8ca0e7532 req-b387f51c-be93-4f31-a2e8-d238bce3de6b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:08.321714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-429ca583-1046-443e-93d3-0ec8ca0e7532 req-b387f51c-be93-4f31-a2e8-d238bce3de6b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:08.336602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-429ca583-1046-443e-93d3-0ec8ca0e7532 req-b387f51c-be93-4f31-a2e8-d238bce3de6b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:08.364821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-429ca583-1046-443e-93d3-0ec8ca0e7532 req-b387f51c-be93-4f31-a2e8-d238bce3de6b service nova] Creating event network-vif-deleted:4e66d50a-b635-43d4-acc2-f5f9543cb611 for instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 on n-h2-862769-3 Oct 28 19:25:08.380747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-429ca583-1046-443e-93d3-0ec8ca0e7532 req-b387f51c-be93-4f31-a2e8-d238bce3de6b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088580 Oct 28 19:25:08.381362 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1901/3797] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:08.690096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:08.794967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:08.809246 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f36cf5d2-4d07-46a8-95f9-19f54782bb89 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1322 microversion: 2.1 time: 0.599358 Oct 28 19:25:08.813491 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1897/3798] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:08 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:09.236740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:09.237580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:09.250879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:09.260024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:09.260675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:09.261794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:09.262454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:09.263332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:09.309221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:09.310607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:09.320591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:09.323086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:09.323804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:09.324920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:09.325587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:09.326490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:09.386384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:09.396854 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b9d80450-7574-4738-9b11-895689870cc5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1265 microversion: 2.1 time: 0.166609 Oct 28 19:25:09.397443 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1902/3799] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:09 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:09.635934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:09.645693 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a16e2ec-e13d-40c3-ab1b-7b53d1a89c64 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.340482 Oct 28 19:25:09.655223 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1898/3800] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:09 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:09.834370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:09.835176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:09.850449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:09.851293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:09.853108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:09.855180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:09.855641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:09.858584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:10.424987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:10.440662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:10.446043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:10.457279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5ff7dda-629f-475b-b070-6ed9adcb8934 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1322 microversion: 2.1 time: 0.627182 Oct 28 19:25:10.461419 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1903/3801] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:09 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:10.481099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:10.481828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:10.482021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:10.483869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:10.484376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:10.502710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:10.682130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:10.683083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:10.693614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:10.694132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:10.697218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:10.698784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:10.699475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:10.699957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:10.787934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:10.802391 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d030b82-ecb5-4123-a28e-04e94198632c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.379099 Oct 28 19:25:10.812269 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1899/3802] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:10 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:10.947375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f8846f7f-d846-4143-b996-26fcbda8080a req-6025fe72-7d7a-46f4-8ae5-0db9a7fe066e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "name": "network-vif-plugged", "status": "completed", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:10.957380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f8846f7f-d846-4143-b996-26fcbda8080a req-6025fe72-7d7a-46f4-8ae5-0db9a7fe066e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:10.958073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f8846f7f-d846-4143-b996-26fcbda8080a req-6025fe72-7d7a-46f4-8ae5-0db9a7fe066e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:10.958651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f8846f7f-d846-4143-b996-26fcbda8080a req-6025fe72-7d7a-46f4-8ae5-0db9a7fe066e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:10.971151 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f8846f7f-d846-4143-b996-26fcbda8080a req-6025fe72-7d7a-46f4-8ae5-0db9a7fe066e service nova] Creating event network-vif-plugged:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:25:10.978291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f8846f7f-d846-4143-b996-26fcbda8080a req-6025fe72-7d7a-46f4-8ae5-0db9a7fe066e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Oct 28 19:25:10.979645 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1900/3803] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:11.192271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:11.208286 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7bd06163-25c1-42d7-a556-28ef48c63e1a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.530141 Oct 28 19:25:11.213818 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1904/3804] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:10 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:11.440760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-eb7ef7c3-765c-4c39-8922-879dddcad13b req-f55b0031-076f-4c17-8ab9-297065839e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ee9cd8-4486-48e8-b0db-5070b46158a7", "tag": "11172299-004a-48cf-bd9e-1472e3f6a716"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:11.454325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eb7ef7c3-765c-4c39-8922-879dddcad13b req-f55b0031-076f-4c17-8ab9-297065839e38 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:11.455021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eb7ef7c3-765c-4c39-8922-879dddcad13b req-f55b0031-076f-4c17-8ab9-297065839e38 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:11.455819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eb7ef7c3-765c-4c39-8922-879dddcad13b req-f55b0031-076f-4c17-8ab9-297065839e38 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:11.484572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:11.485347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:11.504674 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-eb7ef7c3-765c-4c39-8922-879dddcad13b req-f55b0031-076f-4c17-8ab9-297065839e38 service nova] Creating event network-changed:11172299-004a-48cf-bd9e-1472e3f6a716 for instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 on n-h1-862769-3 Oct 28 19:25:11.512617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:11.513139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:11.515820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:11.517097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:11.517579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:11.518008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:11.519320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-eb7ef7c3-765c-4c39-8922-879dddcad13b req-f55b0031-076f-4c17-8ab9-297065839e38 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082829 Oct 28 19:25:11.520400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1901/3805] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:11.835392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:11.836192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:11.844753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:11.845307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:11.845899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:11.846936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:11.847496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:11.848015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:11.974470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:11.984296 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d53aa558-dc33-44f0-a83f-9c0b00fb52ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1322 microversion: 2.1 time: 0.503109 Oct 28 19:25:11.998882 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1905/3806] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:11 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:12.148550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:12.159237 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-92fcf547-1f2f-42f8-9aaf-a80fb4ff5a7d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.328328 Oct 28 19:25:12.160353 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1902/3807] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:11 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:12.239386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:12.240246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:12.251136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:12.251961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:12.252595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:12.253463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:12.254044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:12.254477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:12.423036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:12.434209 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca3e9687-0f40-478d-ae76-9cbb420a0b80 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.200204 Oct 28 19:25:12.443675 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1906/3808] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:12 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:12.741793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:12.743387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:12.752313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:12.753048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:12.754573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:12.756046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:12.756668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:12.757164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:12.887228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lazy-loading 'services' on Instance uuid daf8bd2c-1aed-43f6-9773-98b79ee35739 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:25:12.994513 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e4927711-1c17-41ec-998f-51d8b441ed38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments/95f7538b-24ad-43bf-81d7-0efb57a0f5e9" status: 202 len: 0 microversion: 2.1 time: 0.258918 Oct 28 19:25:12.996231 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1903/3809] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:25:12 2022] DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments/95f7538b-24ad-43bf-81d7-0efb57a0f5e9 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:25:13.005529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:13.008739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:13.021989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:13.024568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.026098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:13.026770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.030818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.032010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.032692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.033325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.046538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.047222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.047660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.048380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.049051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.049534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.112617 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-172bcfc6-6557-45dc-bf5a-8197b34d67fe tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111542 Oct 28 19:25:13.114875 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1907/3810] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:12 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:13.185726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:13.187550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:13.195569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.196280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.196942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.198044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.198642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.199793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.356008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:13.369337 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b84d472-c744-4bb0-9d68-9300f6499923 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1518 microversion: 2.1 time: 0.356760 Oct 28 19:25:13.373255 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1904/3811] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:13 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1518 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:13.400917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:13.404470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:13.413739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.414982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.415518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.416375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.417098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.417863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.454359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lazy-loading 'flavor' on Instance uuid f03481fd-5ed4-42af-add7-025ce96c4f01 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:25:13.494442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:13.499673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:13.519354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca2b6a00-22ac-4455-9bd5-81fe039404d6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.338473 Oct 28 19:25:13.520313 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1908/3812] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:13 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:13.527900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:13.528776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:13.554236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.555891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.558656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.560945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.563674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.565375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.575271 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fdbf9ba0-ab78-4d43-ac8d-a38d08b9e79e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action" status: 200 len: 32 microversion: 2.1 time: 0.181067 Oct 28 19:25:13.578013 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1905/3813] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:13 2022] POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:25:13.587624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:13.588408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:13.595191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.595681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.596161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:13.596865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:13.597307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:13.597882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:14.003301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:14.014347 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5f1c1391-3179-4077-bef1-55df2b21fbd4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.430879 Oct 28 19:25:14.014973 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1906/3814] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:13 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:14.133390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:14.142889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:14.145623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:14.156978 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b9d34b2f-2145-449b-a9bb-70ef6fe0c8e2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.635243 Oct 28 19:25:14.157120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:14.157583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1909/3815] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:13 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:14.158247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:14.162219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:14.163099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:14.165492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:14.166052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:14.266944 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b2541b9-bcc3-4da7-919b-cb800b6c59ef tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145039 Oct 28 19:25:14.268594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1907/3816] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:14 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:14.543953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:14.544570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:14.556273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:14.557254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:14.557841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:14.560084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:14.560599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:14.560965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.038030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:15.038662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:15.057414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:15.057979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:15.072674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.078864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:15.082323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:15.084332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.292453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:15.307822 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63e0792b-5b95-4147-9e19-f76aad1ca870 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.769513 Oct 28 19:25:15.309186 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1910/3817] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:14 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:15.314038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:15.314648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:15.339280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:15.339780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:15.340213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.341915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:15.342377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:15.345248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.434409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:15.444312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1f0274f-133a-453f-8ff2-89f28f58ce0e tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.411071 Oct 28 19:25:15.448328 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1908/3818] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:15 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:15.462869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:15.467990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:15.483995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:15.484669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:15.486071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.489244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:15.489785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:15.490217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:15.560062 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ef5d9cf8-54db-4bc8-8fc3-ea59e08209ce tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110290 Oct 28 19:25:15.564988 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1909/3819] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:15 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:16.018664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:16.028075 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f7980c3-6ede-49fb-891b-79d95500ba65 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1654 microversion: 2.1 time: 0.717831 Oct 28 19:25:16.031315 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1911/3820] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:15 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1654 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:16.057116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2564814f-b430-45b9-8e37-aa356988d79b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:16.069506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2564814f-b430-45b9-8e37-aa356988d79b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.070620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2564814f-b430-45b9-8e37-aa356988d79b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.071415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2564814f-b430-45b9-8e37-aa356988d79b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.102450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2564814f-b430-45b9-8e37-aa356988d79b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Going to try to start instance {{(pid=120628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:25:16.158326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2564814f-b430-45b9-8e37-aa356988d79b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.105847 Oct 28 19:25:16.159824 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1910/3821] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:16 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:16.169300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:16.170907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:16.184528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.185154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.188670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.189630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.190251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.191657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.334194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:16.335049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:16.350578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.351112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.351550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.352245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.352690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.353107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.610232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:16.669720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:16.687194 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5249efe4-786a-46b3-ba7d-dd238d999613 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1663 microversion: 2.1 time: 0.521904 Oct 28 19:25:16.690028 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1912/3822] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:16 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1663 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:16.701596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:16.704686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:16.731147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:16.734148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.738057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.742763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.745295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6eafb855-0cef-44d3-8992-bf4ad7859811 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.413156 Oct 28 19:25:16.746298 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1911/3823] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:16 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:16.747138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.747815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.750588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.753886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:16.756180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:16.777640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.778022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.778645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.779529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:16.780152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:16.782354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:16.832400 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58436f8a-af8f-40ac-8572-91b1a3f008c2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084800 Oct 28 19:25:16.833748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1912/3824] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:16 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:16.838728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=14 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:17.143261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:17.152913 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b5a41b0-4dd9-4604-8416-47de3d52ab9a tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.461172 Oct 28 19:25:17.158173 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1913/3825] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:16 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:17.717674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:17.718921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:17.732791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:17.735170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:17.735612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:17.738295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:17.738796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:17.741921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:17.771643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:17.772267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:17.783270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:17.783905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:17.784279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:17.784977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:17.785604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:17.788191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:17.803724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:18.204190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:18.217305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8fd680c3-2939-4875-9213-9672f1e7221d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1663 microversion: 2.1 time: 0.501726 Oct 28 19:25:18.225487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:18.230280 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1913/3826] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:17 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1663 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:18.240334 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-60d65a55-e603-4584-b95e-cd83105cf410 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.472605 Oct 28 19:25:18.241617 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1914/3827] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:17 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:18.248563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:18.251715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:18.260005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:18.260932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:18.285345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:18.286072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:18.288053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:18.288544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:18.290520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:18.290996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:18.293205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:18.293830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:18.294775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:18.295890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:18.299073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:18.300952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:18.357068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-862ae236-80c3-4c5e-a91e-5d921ab35d38 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123911 Oct 28 19:25:18.361951 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1914/3828] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:18 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:18.621436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:18.641449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14b19c8c-d877-4966-ae4b-3727518894e7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.398183 Oct 28 19:25:18.642675 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1915/3829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:18 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:19.034269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-65eb4a12-b672-4a8e-a053-da92f18c3f66 req-2b379689-7645-4d12-94e7-e66472fb1530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee9cd8-4486-48e8-b0db-5070b46158a7", "name": "network-vif-plugged", "status": "completed", "tag": "11172299-004a-48cf-bd9e-1472e3f6a716"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:19.053356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-65eb4a12-b672-4a8e-a053-da92f18c3f66 req-2b379689-7645-4d12-94e7-e66472fb1530 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.055434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-65eb4a12-b672-4a8e-a053-da92f18c3f66 req-2b379689-7645-4d12-94e7-e66472fb1530 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.056126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-65eb4a12-b672-4a8e-a053-da92f18c3f66 req-2b379689-7645-4d12-94e7-e66472fb1530 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.082972 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-65eb4a12-b672-4a8e-a053-da92f18c3f66 req-2b379689-7645-4d12-94e7-e66472fb1530 service nova] Creating event network-vif-plugged:11172299-004a-48cf-bd9e-1472e3f6a716 for instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 on n-h1-862769-3 Oct 28 19:25:19.089934 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-65eb4a12-b672-4a8e-a053-da92f18c3f66 req-2b379689-7645-4d12-94e7-e66472fb1530 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059571 Oct 28 19:25:19.093380 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1915/3830] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:19.242969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:19.243664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:19.254145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.256957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.258100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.263001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.263862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.264549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.267353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:19.268279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:19.278961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.290828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.291834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.292946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.293979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.294613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.667819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:19.680372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0cc1079-a266-4062-bad5-05d0ea91e678 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.418322 Oct 28 19:25:19.680993 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1916/3831] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:19 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:19.703446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:19.711492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:19.714199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:19.721118 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d46e494-1c00-4e3e-a7ea-ec523ecbfcca tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.483518 Oct 28 19:25:19.721971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.722893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.723796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.724904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.725634 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1916/3832] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:19 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:19.736061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:19.736061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:19.738926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.739930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.755479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.755479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.755479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.755479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.755479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.757082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.822263 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8b66406-4afc-456a-866b-7ea8f349bb94 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125699 Oct 28 19:25:19.825714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1917/3833] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:19 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:19.834985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:19.835801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:19.843941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.844702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.845387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:19.846435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:19.846937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:19.847422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.167213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:20.193564 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d08bdbe-97c7-4ed4-8815-f8a8581824ce tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.456778 Oct 28 19:25:20.200347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:20.210875 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24bba7e0-e9bc-4070-95b5-3411e5f7e95a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.383693 Oct 28 19:25:20.215317 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1917/3834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:19 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:20.232936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1918/3835] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:19 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:20.257051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:20.257566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:20.274385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.274997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.275448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.276159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.276613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.277285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.354121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Unlocking {{(pid=120629) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 19:25:20.433261 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b2fc4db-60c3-4571-9735-d6f5246540e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.180048 Oct 28 19:25:20.434004 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1918/3836] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:20 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:20.451668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:20.452376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:20.459835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.460596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.461080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.461996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.462478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.463031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.687013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:20.695578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a299e6f9-f3bd-4786-af95-8d9488d38b9e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.248451 Oct 28 19:25:20.696605 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1919/3837] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:20 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:20.714967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:20.715587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:20.722679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.724121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.724903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.725867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.727150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.727822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.745899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:20.749010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:20.779789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.781985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.783410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:20.786712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:20.787929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:20.789324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.117413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:21.130677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:21.139726 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-183fca50-b05b-45ed-83fc-16d1178747d5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1307 microversion: 2.1 time: 0.430859 Oct 28 19:25:21.142912 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1919/3838] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:20 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1307 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:21.152499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e3faa5ba-db64-4c91-96ec-65689ea4375f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.433147 Oct 28 19:25:21.153110 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1920/3839] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:20 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:21.157400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:21.166193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:21.180519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:21.181122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:21.183468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:21.186489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:21.187264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:21.188034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.188825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:21.189434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:21.190199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.205887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:21.206422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:21.206851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.207570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:21.208023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:21.208446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.221845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:21.260377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb7b7f8b-b78b-4712-84b0-5677642e675a tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113148 Oct 28 19:25:21.261677 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1920/3840] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:25:21 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:25:21.268188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:21.269495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:21.280361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:21.281084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:21.281801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.282998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:21.283603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:21.284175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:21.976721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:21.985257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-559f0c1f-4708-484c-a2e7-b37220022f37 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.811308 Oct 28 19:25:21.988377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:21.997693 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1921/3841] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:21 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:21.997936 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2401f57-05ec-49a6-bced-9339a9153d55 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.734627 Oct 28 19:25:21.998726 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1921/3842] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:21 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:22.011193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:22.011918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.021212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.021919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.022514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.023498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.024170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.024910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.028023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:22.030344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.036742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.037242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.037682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.038409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.038884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.039321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.082255 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Cannot 'reboot' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action HTTP/1.1 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 28 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: {"reboot": {"type": "HARD"}} Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'reboot' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'f68acfcf-a0cf-4f77-af94-6426cdb03c6d', 'body': {'reboot': {'type': 'HARD'}}} Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:25:22.084197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.088261 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.090364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 409 to user: Cannot 'reboot' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:25:22.091794 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f2d65d0c-4dbf-459b-82b8-041556ec64f2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action" status: 409 len: 145 microversion: 2.1 time: 0.092702 Oct 28 19:25:22.092871 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1922/3843] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:21 2022] POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action => generated 145 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:25:22.104464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:22.107990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.121351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.121884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.122326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.123146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.123776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.124203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.129561 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8fce7785-9816-47f5-b183-4cca074c099a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.122129 Oct 28 19:25:22.131993 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1922/3844] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:22 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:25:22.141059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:22.142120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.152845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.153377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.153874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.154628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.155222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.155732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.157521 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Cannot 'rebuild' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action HTTP/1.1 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 65 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'rebuild' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'f68acfcf-a0cf-4f77-af94-6426cdb03c6d', 'body': {'rebuild': {'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48'}}} Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:25:22.159875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued Oct 28 19:25:22.163152 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:25:22.180350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 409 to user: Cannot 'rebuild' instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d while it is in vm_state rescued {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:25:22.181524 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-335e732b-3093-4d3d-8bc6-764056116e51 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action" status: 409 len: 146 microversion: 2.1 time: 0.080981 Oct 28 19:25:22.187416 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1923/3845] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:22 2022] POST /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d/action => generated 146 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:25:22.187416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:22.187728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.198111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.201569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.202016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.202803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.203350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.203775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.592092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:22.602236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09c5c76a-e31b-493a-94bb-cd99f0e82141 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1672 microversion: 2.1 time: 0.466305 Oct 28 19:25:22.604094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1923/3846] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:22 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1672 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:22.609137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:22.609629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.616374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.617089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.617743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.618434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:22.619317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.619780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.620203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.629399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2c797e0a-b6f4-48e8-9eef-8091c50eb0dc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1486 microversion: 2.1 time: 0.446137 Oct 28 19:25:22.629993 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1924/3847] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:22 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1486 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:22.649318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:25:22.655878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:22.656789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.664366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.665998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.668728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.669782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.670440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.671126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.701790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lazy-loading 'flavor' on Instance uuid 86ee9cd8-4486-48e8-b0db-5070b46158a7 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:25:22.760833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47227730-26b2-4ba4-85f1-b49886ad5e12 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 204 len: 0 microversion: 2.1 time: 0.154617 Oct 28 19:25:22.761441 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1924/3848] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:25:22 2022] DELETE /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:25:22.777301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:22.778523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.786146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.786933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.787752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.788631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.789194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.789881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.814755 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea274ccf-dc8f-4dd9-81ac-8ff64ea8a64e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7/action" status: 202 len: 0 microversion: 2.1 time: 0.165044 Oct 28 19:25:22.834280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:22.841932 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1925/3849] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:22 2022] POST /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:22.866336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:22.870277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:22.886543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.887152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.892378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:22.893248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:22.893727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:22.895073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.000646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:23.014762 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe1034eb-f254-43ff-90e1-92635ffbee63 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1686 microversion: 2.1 time: 0.242629 Oct 28 19:25:23.015453 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1925/3850] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:22 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1686 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:23.042293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:23.042980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:23.052557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.054512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.055029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.056014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.056491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.056928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.361763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:23.375705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:23.377696 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-430255e1-3c0d-4532-ad45-31313b2aceff tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.356409 Oct 28 19:25:23.378857 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1926/3851] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:23 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:23.383960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-31eb9ab9-7683-4831-bc7d-00b8b333e74b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1494 microversion: 2.1 time: 0.537843 Oct 28 19:25:23.384534 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1926/3852] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:22 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1494 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:23.626117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:23.626741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:23.639231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.639964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.640464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.641329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.641915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.642365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.867662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:23.876386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-230bac0f-e7bd-4de3-abd9-0d033af1aa53 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1652 microversion: 2.1 time: 0.254389 Oct 28 19:25:23.876990 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1927/3853] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:23 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1652 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:23.900656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:23.901226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:23.907587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.908110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.908543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.909242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.909693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.910118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.992942 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-98046e5a-51f1-47a7-9072-a38643a7e67c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.095388 Oct 28 19:25:23.996860 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1927/3854] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:23 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:24.009045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:24.014192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:24.028906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.029761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.030385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.034411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.034554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.035675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.041002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:24.042504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:24.053635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.054801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.055593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.056624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.057331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.058034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.433545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:24.445179 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ad684f7-88b3-4558-959a-128d4044ec03 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1686 microversion: 2.1 time: 0.408988 Oct 28 19:25:24.445844 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1928/3855] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:24 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1686 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:24.451741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:24.452560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:24.458996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.459886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.465970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:24.468496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.472808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.473474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.474064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.477409 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f9641d9-645b-48eb-a401-2141177d5f1e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1659 microversion: 2.1 time: 0.478742 Oct 28 19:25:24.491265 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1928/3856] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:23 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1659 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:24.500935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:24.501690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:24.512509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.514327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.514806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.515533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.516051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.516474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.792257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:24.801124 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f97244ed-a452-43a5-9049-8e010e473565 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.353429 Oct 28 19:25:24.801862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1929/3857] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:24 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:24.817102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:24.826071 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-12c3fc21-7374-4f25-82d3-39241130b7f6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 200 len: 1477 microversion: 2.1 time: 0.333554 Oct 28 19:25:24.827508 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1929/3858] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:24 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:24.849857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1899996300"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:24.852702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:24.854881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:24.861603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.862400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.862865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.863602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.864267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.864836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.114113 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-645d3610-4361-4f3e-a05c-44669323cde2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7/action" status: 202 len: 0 microversion: 2.1 time: 0.268111 Oct 28 19:25:25.114817 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1930/3859] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:24 2022] POST /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:25:25.125711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f809f199-0b36-4981-84d2-0dd1cd82201c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ffd3310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:25.178445 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f809f199-0b36-4981-84d2-0dd1cd82201c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.056724 Oct 28 19:25:25.179240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1930/3860] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:25 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:25.474224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:25.474963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:25.481997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.482465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.483062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.483805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.484251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.484762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.505606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:25.506448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:25.514785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.515359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.515913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.516834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.517387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.517895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.718265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:25.724162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:25.727440 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d704b5a-a4b2-432b-aebb-048783f7a8cb tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1686 microversion: 2.1 time: 0.257832 Oct 28 19:25:25.728501 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1931/3861] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:25 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1686 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:25.740419 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb864255-9531-4f08-8e6c-1257c6b05c5e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.236539 Oct 28 19:25:25.741246 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1931/3862] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:25 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:25.765882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:25.766428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:25.772901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.773385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.773824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.774514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.775141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.775694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.824747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:25.826296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:25.833032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.833719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.834316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.835261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.835859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.836427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.137127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:26.142440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:26.148907 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44f473dc-ec86-419a-8db4-f2499faf057f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.386974 Oct 28 19:25:26.149735 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1932/3863] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:25 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:26.154644 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26aa2a10-5e1d-413c-a88c-96cefb2a2516 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.334202 Oct 28 19:25:26.155411 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1932/3864] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:25 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:26.175840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:26.176715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:26.183982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.184790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.185325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.186469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.187153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.187935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.197330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67eea256-c561-401a-96c8-a7c008fecce2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771d43a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:26.268674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67eea256-c561-401a-96c8-a7c008fecce2 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.077442 Oct 28 19:25:26.269398 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1933/3865] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:26 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:26.515870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:26.524021 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f3caa67-376a-4384-8b47-911e78e733ed tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.352473 Oct 28 19:25:26.524861 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1933/3866] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:26 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:26.548907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:26.549523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:26.558237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.558781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.559322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.560030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.560482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.560901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.765014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:26.766456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:26.774001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.774643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.775368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.776396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.777081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.777707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.795573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:26.809710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:26.824541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e19ad86a-229e-4159-a425-0a5263f83fe8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.279982 Oct 28 19:25:26.840335 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1934/3867] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:26 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:26.849927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:26.851009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:26.861935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.863391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.864740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.866171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:26.867093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:26.868553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.045886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:27.057678 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1c85cbc-0e8e-44e1-b7eb-ad9ee97133e2 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1686 microversion: 2.1 time: 0.296529 Oct 28 19:25:27.072808 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1934/3868] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:26 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1686 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:27.179413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:27.180022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:27.186401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.186997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.187808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.188460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.189028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.189530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.210730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:27.238619 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25299ef2-b6bf-4b71-904b-d0d3c1c37761 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.394492 Oct 28 19:25:27.239534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1935/3869] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:26 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:27.262708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:27.263626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:27.284297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.284297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.284297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.284297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.284297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.284297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.643205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:27.651880 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-db881825-8d80-4a8e-9d2f-b1d5800f0990 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.477826 Oct 28 19:25:27.652472 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1935/3870] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:27 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:27.662561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6e3c71d-f82d-46d1-a17b-c20e7b7b1fc1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76afdf70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:27.689977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:27.702235 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aba02d8a-911c-4274-b23e-73bdf238386b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.443515 Oct 28 19:25:27.715160 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1936/3871] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:27 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:27.760273 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6e3c71d-f82d-46d1-a17b-c20e7b7b1fc1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.101387 Oct 28 19:25:27.760852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1936/3872] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:27 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:27.966733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f1acf3e9-3c22-4ee8-89ec-704cad52f0ef req-91506459-66dc-4c21-8782-bf9cfd9d8d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf8bd2c-1aed-43f6-9773-98b79ee35739", "name": "network-vif-deleted", "tag": "410ee5dc-145e-4989-b3c0-0f8f513f4f26"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:27.988328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f1acf3e9-3c22-4ee8-89ec-704cad52f0ef req-91506459-66dc-4c21-8782-bf9cfd9d8d69 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.990445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f1acf3e9-3c22-4ee8-89ec-704cad52f0ef req-91506459-66dc-4c21-8782-bf9cfd9d8d69 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.995314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f1acf3e9-3c22-4ee8-89ec-704cad52f0ef req-91506459-66dc-4c21-8782-bf9cfd9d8d69 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.029169 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f1acf3e9-3c22-4ee8-89ec-704cad52f0ef req-91506459-66dc-4c21-8782-bf9cfd9d8d69 service nova] Creating event network-vif-deleted:410ee5dc-145e-4989-b3c0-0f8f513f4f26 for instance daf8bd2c-1aed-43f6-9773-98b79ee35739 on n-h2-862769-3 Oct 28 19:25:28.046724 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f1acf3e9-3c22-4ee8-89ec-704cad52f0ef req-91506459-66dc-4c21-8782-bf9cfd9d8d69 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074303 Oct 28 19:25:28.051002 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1937/3873] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:28.085042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:28.085912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:28.103529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:28.104154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:28.104675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.105877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:28.106346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:28.106965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.223136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:28.232237 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fb4d0e3c-8782-4caa-a8bc-494509d375a8 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 200 len: 1329 microversion: 2.1 time: 0.151926 Oct 28 19:25:28.232865 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1937/3874] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:28 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 1329 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:28.678232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:28.678930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:28.700012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:28.700753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:28.701348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.702244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:28.702889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:28.703506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.776562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d77e4e1-680f-4edd-9a7d-0240807bddd9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a4e0d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:28.870650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d77e4e1-680f-4edd-9a7d-0240807bddd9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.089714 Oct 28 19:25:28.871347 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1938/3875] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:28 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:29.010499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:29.022074 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b14cb6c1-6a6d-4d1b-acfe-1b15ed105e50 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.348183 Oct 28 19:25:29.032767 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1938/3876] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:28 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:29.083589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-afa0f9a5-871a-4f63-810e-afdd6b0cd97f req-b8940bcb-f3a3-4dd1-b028-32f45e1f94c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee9cd8-4486-48e8-b0db-5070b46158a7", "name": "network-vif-plugged", "status": "completed", "tag": "11172299-004a-48cf-bd9e-1472e3f6a716"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:29.112599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-afa0f9a5-871a-4f63-810e-afdd6b0cd97f req-b8940bcb-f3a3-4dd1-b028-32f45e1f94c1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:29.113474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-afa0f9a5-871a-4f63-810e-afdd6b0cd97f req-b8940bcb-f3a3-4dd1-b028-32f45e1f94c1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:29.114134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-afa0f9a5-871a-4f63-810e-afdd6b0cd97f req-b8940bcb-f3a3-4dd1-b028-32f45e1f94c1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:29.128068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-afa0f9a5-871a-4f63-810e-afdd6b0cd97f req-b8940bcb-f3a3-4dd1-b028-32f45e1f94c1 service nova] Creating event network-vif-plugged:11172299-004a-48cf-bd9e-1472e3f6a716 for instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 on n-h1-862769-3 Oct 28 19:25:29.135228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-afa0f9a5-871a-4f63-810e-afdd6b0cd97f req-b8940bcb-f3a3-4dd1-b028-32f45e1f94c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055185 Oct 28 19:25:29.136078 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1939/3877] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:29.261259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:29.262231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: daf8bd2c-1aed-43f6-9773-98b79ee35739] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:29.268987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:29.269769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:29.270454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:29.271415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:29.272140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:29.272774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:29.300447 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 could not be found. Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 HTTP/1.1 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 could not be found. Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'daf8bd2c-1aed-43f6-9773-98b79ee35739'} Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 could not be found. Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 could not be found. Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:29.307014 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 could not be found. Oct 28 19:25:29.310436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:29.312926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 404 to user: Instance daf8bd2c-1aed-43f6-9773-98b79ee35739 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:25:29.314414 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ef7fc18-a769-4b59-9cf2-34d1b027b93e tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739" status: 404 len: 111 microversion: 2.1 time: 0.061537 Oct 28 19:25:29.327441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b3d5061-d701-4d94-a694-7dab384d8157 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '.version_select at 0x7f1d76a71b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:29.334597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1939/3878] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:29 2022] GET /compute/v2.1/servers/daf8bd2c-1aed-43f6-9773-98b79ee35739 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:25:29.360896 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b3d5061-d701-4d94-a694-7dab384d8157 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487335839" status: 202 len: 0 microversion: 2.1 time: 0.040265 Oct 28 19:25:29.361914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1940/3879] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487335839 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:29.887878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-009e5491-f5f8-490d-8d85-9a7c5c42a6e7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77dc7af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:29.950754 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-009e5491-f5f8-490d-8d85-9a7c5c42a6e7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.067768 Oct 28 19:25:29.968080 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1940/3880] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:29 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:30.048888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:30.049631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:30.060901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:30.061401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:30.061842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:30.062736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:30.067322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:30.067769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:30.338457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:30.350203 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-accd434e-61db-4d6b-a9a6-23d119c46430 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.304636 Oct 28 19:25:30.352328 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1941/3881] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:30 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:30.971570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6a01f7b-831e-41a6-9c20-468ae36b6955 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77209ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:31.026494 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6a01f7b-831e-41a6-9c20-468ae36b6955 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.059778 Oct 28 19:25:31.035575 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1941/3882] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:30 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:31.373650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:31.374510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:31.381815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:31.382299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:31.394824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:31.396043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:31.396693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:31.397326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:31.735033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:31.747900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c87dc8f-dc35-41f8-962c-d28baeda8f08 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.378135 Oct 28 19:25:31.750968 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1942/3883] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:31 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:31.780612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:31.780612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:31.782351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:31.783741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:31.784317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:31.786085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:31.786734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:31.787302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:31.857471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:25:32.045384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1353b859-8e65-4615-8f50-dbdf5b3d59bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d771d4c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:32.074406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3947bdb-e837-433a-8d79-c64de412ab64 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 204 len: 0 microversion: 2.32 time: 0.720714 Oct 28 19:25:32.076388 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1942/3884] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:25:31 2022] DELETE /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:25:32.087222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:32.088762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:32.096192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:32.096898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:32.097602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:32.099140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:32.100092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:32.100721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:32.133294 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1353b859-8e65-4615-8f50-dbdf5b3d59bb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.094920 Oct 28 19:25:32.135221 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1943/3885] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:32 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:32.498714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:32.511939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:32.521441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:32.524968 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e961f816-f249-4a0e-b19e-62dc07067ff9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2957 microversion: 2.32 time: 0.443081 Oct 28 19:25:32.525594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1943/3886] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:32 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2957 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:32.775380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:32.776008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:32.791777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:32.792308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:32.792733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:32.793780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:32.799381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:32.800023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:33.149649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fcce9cae-cef9-4daa-bbe9-e84a8cf28aac tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a7c5e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:33.233254 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fcce9cae-cef9-4daa-bbe9-e84a8cf28aac tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.087379 Oct 28 19:25:33.241469 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1944/3887] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:33 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:33.414514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:33.427220 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9f0bc0a9-627b-4269-b560-ef079f6ce8d5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.655350 Oct 28 19:25:33.429995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1944/3888] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:32 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:33.556112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:33.556739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:33.578798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:33.579577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:33.585191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:33.586096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:33.587463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:33.588060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:34.001664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:34.027687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:34.032211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:34.036735 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e5936f7-dc7a-451b-9365-f1fdbb01d46b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2957 microversion: 2.32 time: 0.485619 Oct 28 19:25:34.038941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1945/3889] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:33 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2957 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:34.249669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-051d1ed1-7e43-4bc3-a752-811a11f2e05f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7ff9aee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:34.332652 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-051d1ed1-7e43-4bc3-a752-811a11f2e05f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.087622 Oct 28 19:25:34.334360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1945/3890] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:34 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:34.459421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:34.460044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:34.476583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:34.478671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:34.479573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:34.480892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:34.484493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:34.486110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:34.814757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:34.825441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6917ae0c-65e3-4871-a4e0-d1716186c40f tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.370987 Oct 28 19:25:34.827187 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1946/3891] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:34 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:35.069773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:35.070376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:35.077257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.077781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.078442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.079185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.079648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.080079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.351675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf4647b6-1509-4d4c-918d-69081af98c4f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a774c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:35.445237 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf4647b6-1509-4d4c-918d-69081af98c4f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.097597 Oct 28 19:25:35.447599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1947/3892] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:35 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:35.592956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:35.629916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:35.644286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:35.647506 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a81e1d31-0592-403e-b4a6-e02bc4317be9 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2957 microversion: 2.32 time: 0.582914 Oct 28 19:25:35.653932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1946/3893] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:35 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2957 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:35.852195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:35.853495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:35.867928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.872554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.873853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.875280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.879265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.879923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:36.464429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f1a0a1e5-bf8e-4451-8337-43b71b4fc617 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d772300d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:36.540578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f1a0a1e5-bf8e-4451-8337-43b71b4fc617 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.082215 Oct 28 19:25:36.541396 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1947/3894] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:36 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:36.681476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:36.682485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:36.695513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:36.697754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:36.701694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:36.702948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:36.703739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:36.704380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:37.731805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:37.740447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb69ba2b-6987-4d33-b3bd-8b6075411f93 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 1.892676 Oct 28 19:25:37.747231 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1948/3895] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:35 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:37.758615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-67dbce42-5c7a-4276-816c-d7132e2f03ee tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a71e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:37.831644 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-67dbce42-5c7a-4276-816c-d7132e2f03ee tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.083207 Oct 28 19:25:37.832370 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1949/3896] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:37 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:38.102407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:38.135921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:38.142196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:38.145142 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d83e88f-c489-4539-8ff5-947e2c0ca0d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2936 microversion: 2.32 time: 1.468372 Oct 28 19:25:38.161791 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1948/3897] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:36 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2936 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:38.733501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-afa49b00-9c28-4e0f-bd0e-107b97e69e10 req-895c938d-b741-4c75-a76d-af2aa47f6f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-unplugged", "status": "completed", "tag": "03f7e99b-6731-4c76-a80d-1812703f9eb8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:38.768846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:38.769507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:38.782410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:38.782885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:38.783336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:38.784108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:38.784591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:38.785018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:38.792808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-afa49b00-9c28-4e0f-bd0e-107b97e69e10 req-895c938d-b741-4c75-a76d-af2aa47f6f46 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:38.793330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-afa49b00-9c28-4e0f-bd0e-107b97e69e10 req-895c938d-b741-4c75-a76d-af2aa47f6f46 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:38.799183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-afa49b00-9c28-4e0f-bd0e-107b97e69e10 req-895c938d-b741-4c75-a76d-af2aa47f6f46 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:38.857363 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-afa49b00-9c28-4e0f-bd0e-107b97e69e10 req-895c938d-b741-4c75-a76d-af2aa47f6f46 service nova] Creating event network-vif-unplugged:03f7e99b-6731-4c76-a80d-1812703f9eb8 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:38.882751 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-afa49b00-9c28-4e0f-bd0e-107b97e69e10 req-895c938d-b741-4c75-a76d-af2aa47f6f46 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147766 Oct 28 19:25:38.883773 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1950/3898] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:38.899251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-845b70cc-7245-4ade-85eb-b0127e151612 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c46b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:38.996362 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-845b70cc-7245-4ade-85eb-b0127e151612 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.107858 Oct 28 19:25:38.997199 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1951/3899] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:38 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:39.180231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:39.181081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:39.201342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:39.202815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:39.203441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:39.205160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:39.208081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:39.209116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:39.615354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:39.631229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:39.636260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:39.638070 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-47d544a4-ba4a-4efe-a1df-6b5508b9a119 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2915 microversion: 2.32 time: 0.463472 Oct 28 19:25:39.667025 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1952/3900] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:39 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2915 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:25:39.848519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:39.849157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:39.870442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:39.878125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:39.887208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:39.888322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:39.889085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:39.889940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:39.924047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:39.946802 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c938c2f6-feef-4fd8-9544-b1d4c2570454 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 1.181656 Oct 28 19:25:39.948377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:25:39.948536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1949/3901] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:38 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:40.015303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43945b68-1846-4a06-9519-4c43ba6a5557 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77d77160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:40.113684 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43945b68-1846-4a06-9519-4c43ba6a5557 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.102499 Oct 28 19:25:40.114548 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1950/3902] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:40 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:40.175234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-40fe4645-9ffc-4455-9fdc-dcfc1c0e826b req-88984f68-7e49-4993-9483-00126c157950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-deleted", "tag": "6b647e6b-b284-4f51-8eb1-e1c929fd1742"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:40.214792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-40fe4645-9ffc-4455-9fdc-dcfc1c0e826b req-88984f68-7e49-4993-9483-00126c157950 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:40.215331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-40fe4645-9ffc-4455-9fdc-dcfc1c0e826b req-88984f68-7e49-4993-9483-00126c157950 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:40.215771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-40fe4645-9ffc-4455-9fdc-dcfc1c0e826b req-88984f68-7e49-4993-9483-00126c157950 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:40.260968 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-40fe4645-9ffc-4455-9fdc-dcfc1c0e826b req-88984f68-7e49-4993-9483-00126c157950 service nova] Creating event network-vif-deleted:6b647e6b-b284-4f51-8eb1-e1c929fd1742 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:40.278571 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-40fe4645-9ffc-4455-9fdc-dcfc1c0e826b req-88984f68-7e49-4993-9483-00126c157950 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104468 Oct 28 19:25:40.282812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1951/3903] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:40.296228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-adacb772-43d6-406e-bba1-06e99ab35f16 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 204 len: 0 microversion: 2.1 time: 0.422062 Oct 28 19:25:40.299862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1953/3904] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:25:39 2022] DELETE /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:25:40.309779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:40.310649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:40.323177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:40.326586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:40.327718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:40.328840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:40.329660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:40.331428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:40.347055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:40.674007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:40.674725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:40.683968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:40.684427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:40.684863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:40.685622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:40.686080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:40.686510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:40.796508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:40.805871 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7da7151-7f03-413f-8606-1ce41ab196db tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1506 microversion: 2.1 time: 0.500608 Oct 28 19:25:40.811125 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1952/3905] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:40 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:40.910443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-unplugged", "status": "completed", "tag": "a2159bfa-7eb3-44d5-8030-541b13200f39"}, {"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-unplugged", "status": "completed", "tag": "32e61231-4254-4b17-87a2-4cfe24506e43"}, {"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-unplugged", "status": "completed", "tag": "8b43571d-9302-4a3e-afb5-3cd7c6545571"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:40.930490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:40.931786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:40.932388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:40.958555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Creating event network-vif-unplugged:a2159bfa-7eb3-44d5-8030-541b13200f39 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:40.959309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Creating event network-vif-unplugged:32e61231-4254-4b17-87a2-4cfe24506e43 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:40.959969 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] Creating event network-vif-unplugged:8b43571d-9302-4a3e-afb5-3cd7c6545571 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:40.974431 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3b4e491a-bdfb-4c38-898f-c3f80ae2c056 req-c738a6dc-5928-409b-9f08-6baf2778cde7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.067593 Oct 28 19:25:40.981099 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1953/3906] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:40.989487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:41.002170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:41.015822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:41.016607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:41.017191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:41.018061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:41.018655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:41.019265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:41.096397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:41.114580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:41.125095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:41.125693 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8c724754-a76b-4432-a2ca-c89c5110e9dd tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2754 microversion: 2.32 time: 0.456093 Oct 28 19:25:41.138757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1954/3907] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:40 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2754 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:25:41.140280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cfdc8e5a-f969-41ee-8799-d805db6b0375 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a8a0d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:41.198781 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cfdc8e5a-f969-41ee-8799-d805db6b0375 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.062307 Oct 28 19:25:41.211890 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1955/3908] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:41 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:41.383872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:41.407200 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-12c9b1b8-4e19-48e0-9260-30d61e7c5414 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.420382 Oct 28 19:25:41.407896 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1954/3909] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:40 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:41.833739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:41.834363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:41.849228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:41.849735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:41.850171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:41.850926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:41.851382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:41.851882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:42.155031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:42.155573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:42.156708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:42.165746 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5f2a185c-7a75-4241-8d4e-7a9924b791a9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1506 microversion: 2.1 time: 0.335718 Oct 28 19:25:42.167852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1956/3910] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:41 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:42.204795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:42.207048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:42.207899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:42.210643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:42.211544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:42.212197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:42.227829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7144230a-31ca-4843-a061-49c63c94ff53 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d777c3d30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:42.299498 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7144230a-31ca-4843-a061-49c63c94ff53 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.076446 Oct 28 19:25:42.301487 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1957/3911] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:42 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:42.363490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8d2132a5-149a-4f8d-87ec-0716fa73fbb7 req-2eb108de-83b6-42b6-96a3-84dbf47be5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-deleted", "tag": "a2159bfa-7eb3-44d5-8030-541b13200f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:42.392662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d2132a5-149a-4f8d-87ec-0716fa73fbb7 req-2eb108de-83b6-42b6-96a3-84dbf47be5db service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:42.393345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d2132a5-149a-4f8d-87ec-0716fa73fbb7 req-2eb108de-83b6-42b6-96a3-84dbf47be5db service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:42.393907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d2132a5-149a-4f8d-87ec-0716fa73fbb7 req-2eb108de-83b6-42b6-96a3-84dbf47be5db service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:42.397780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:42.428377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8d2132a5-149a-4f8d-87ec-0716fa73fbb7 req-2eb108de-83b6-42b6-96a3-84dbf47be5db service nova] Creating event network-vif-deleted:a2159bfa-7eb3-44d5-8030-541b13200f39 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:42.472546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8d2132a5-149a-4f8d-87ec-0716fa73fbb7 req-2eb108de-83b6-42b6-96a3-84dbf47be5db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112528 Oct 28 19:25:42.473291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1958/3912] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:25:42.487359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:42.488166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:42.521389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:42.522559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:42.523039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:42.524584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:42.525058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:42.525487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:42.763797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:42.778049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:42.785351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:42.787267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0b51141-3403-41aa-a1ea-a4ae95415c4c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2660 microversion: 2.32 time: 0.636461 Oct 28 19:25:42.788002 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1955/3913] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:42 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2660 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:25:42.908674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:42.920328 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80db6475-b74e-4249-94dc-95d423f96b82 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.445004 Oct 28 19:25:42.923401 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1959/3914] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:42 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:43.193819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:43.194483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:43.210389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:43.210928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:43.216177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:43.229839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:43.234729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:43.237664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:43.318080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d0cb2e7-76cc-4d34-852c-349b8a4c8284 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76ab53a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:43.410607 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d0cb2e7-76cc-4d34-852c-349b8a4c8284 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.096572 Oct 28 19:25:43.411235 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1960/3915] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:43 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:43.615418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:43.629124 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f04d041-0f39-4095-a8d2-2deb4a15f5b4 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1464 microversion: 2.1 time: 0.435934 Oct 28 19:25:43.646049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1956/3916] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:43 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1464 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:43.820702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:43.821716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:43.830594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:43.831493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:43.832155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:43.833113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:43.833775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:43.834399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:43.911737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6a1e0890-05f0-41b9-a573-17846021fedf req-80c34676-5566-463c-8902-c02d08f42a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68acfcf-a0cf-4f77-af94-6426cdb03c6d", "name": "network-vif-deleted", "tag": "8d92b33f-bc8d-46df-83e6-4a0fdc60e24f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:43.933199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6a1e0890-05f0-41b9-a573-17846021fedf req-80c34676-5566-463c-8902-c02d08f42a3d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:43.935134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6a1e0890-05f0-41b9-a573-17846021fedf req-80c34676-5566-463c-8902-c02d08f42a3d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:43.936013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6a1e0890-05f0-41b9-a573-17846021fedf req-80c34676-5566-463c-8902-c02d08f42a3d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:43.977076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6a1e0890-05f0-41b9-a573-17846021fedf req-80c34676-5566-463c-8902-c02d08f42a3d service nova] Creating event network-vif-deleted:8d92b33f-bc8d-46df-83e6-4a0fdc60e24f for instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d on n-h1-862769-3 Oct 28 19:25:43.983436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6a1e0890-05f0-41b9-a573-17846021fedf req-80c34676-5566-463c-8902-c02d08f42a3d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076537 Oct 28 19:25:43.985450 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1957/3917] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:43.993337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:43.997512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:44.005319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:44.006165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:44.006843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:44.007907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:44.008647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:44.009847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:44.602023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:44.611748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:44.613209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:44.614443 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5013ab0d-64a4-4f90-8ac2-b18929deab6a tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2499 microversion: 2.32 time: 0.800385 Oct 28 19:25:44.622471 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1961/3918] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:43 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2499 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:44.637653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cbbc46cf-5f85-4886-953a-fb5eaaeabb1a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a02790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:44.692641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cbbc46cf-5f85-4886-953a-fb5eaaeabb1a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.068778 Oct 28 19:25:44.698283 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1962/3919] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:44 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:44.703574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-deleted", "tag": "03f7e99b-6731-4c76-a80d-1812703f9eb8"}, {"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-deleted", "tag": "32e61231-4254-4b17-87a2-4cfe24506e43"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:44.714918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:44.715660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:44.716280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:44.746239 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] Creating event network-vif-deleted:03f7e99b-6731-4c76-a80d-1812703f9eb8 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:44.747594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] Creating event network-vif-deleted:32e61231-4254-4b17-87a2-4cfe24506e43 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:44.756314 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6e284c03-b18a-4251-9183-3180a75b0b77 req-0838bab3-c31f-42b6-8292-db086cc301e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056321 Oct 28 19:25:44.759123 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1963/3920] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:44.766876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:44.780090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:44.788507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:44.790924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:44.791623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:44.797290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:44.798374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:44.799293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:44.879479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:44.880261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:44.880900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:44.881520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lazy-loading 'fault' on Instance uuid f68acfcf-a0cf-4f77-af94-6426cdb03c6d {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:25:45.224527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:45.235352 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53560121-6538-43e9-a962-97793338e641 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 1.248050 Oct 28 19:25:45.236768 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1958/3921] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:43 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:45.341406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:45.350299 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-73cc9d10-7b6b-4d8d-a286-f86539490c56 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 200 len: 1312 microversion: 2.1 time: 0.589643 Oct 28 19:25:45.356569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1964/3922] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:44 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 1312 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:45.662540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:45.663347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:45.673480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:45.673750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:45.674376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:45.674913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:45.675527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:45.676121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:45.709599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d86c28bd-e81a-48d0-85eb-a90d2ba02647 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a3f8b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:45.789287 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d86c28bd-e81a-48d0-85eb-a90d2ba02647 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.083536 Oct 28 19:25:45.790087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1965/3923] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:45 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:46.100819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:46.121049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:46.123342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:46.125409 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a2c6f8a2-65ed-4fdf-abb3-057b11534e9c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2228 microversion: 2.32 time: 0.467498 Oct 28 19:25:46.146173 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1959/3924] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:45 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2228 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:46.263081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:46.263933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:46.281361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.283307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.284971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.285933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.289089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.289854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.377840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:46.384457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: f68acfcf-a0cf-4f77-af94-6426cdb03c6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:46.410135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.411269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.411989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.414309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.422538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.423693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.446780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d could not be found. Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d HTTP/1.1 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d could not be found. Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f68acfcf-a0cf-4f77-af94-6426cdb03c6d'} Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d could not be found. Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d could not be found. Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:46.449356 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d could not be found. Oct 28 19:25:46.453117 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:46.455955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 404 to user: Instance f68acfcf-a0cf-4f77-af94-6426cdb03c6d could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:25:46.457054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee5448a9-e1a7-4ead-a1ad-dfa54db89716 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d" status: 404 len: 111 microversion: 2.1 time: 0.084404 Oct 28 19:25:46.461997 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1960/3925] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:46 2022] GET /compute/v2.1/servers/f68acfcf-a0cf-4f77-af94-6426cdb03c6d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:25:46.467744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:46.468568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:46.477987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.478807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.479577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.481650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.482247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.482913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.530481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:25:46.667620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a9211b4-5b68-46e0-b514-2c62f2a56ff5 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 204 len: 0 microversion: 2.1 time: 0.203511 Oct 28 19:25:46.673943 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1961/3926] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:25:46 2022] DELETE /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:25:46.681573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:46.682805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:46.690361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.691129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.691943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.692819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:46.693465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:46.694030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:46.715392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:46.731416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7808f71c-6574-4385-9cda-9f2ba066ccef tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.474535 Oct 28 19:25:46.732806 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1966/3927] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:46 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:46.808662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-147fbd8b-8cfa-42e6-8f64-e1a849314ff3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a02790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:46.953268 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-147fbd8b-8cfa-42e6-8f64-e1a849314ff3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.147429 Oct 28 19:25:46.958331 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1967/3928] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:46 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:47.069183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:47.082154 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2b3ef9b5-550c-4088-b702-68e24bfbaf44 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.405069 Oct 28 19:25:47.085898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1962/3929] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:46 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:47.158737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:47.159828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:47.167381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:47.168155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:47.169129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:47.170418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:47.171176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:47.172114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:47.305635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:47.318505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:47.324148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:47.329717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74bf28eb-089b-4014-9787-c55070fabb6e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2160 microversion: 2.32 time: 0.171603 Oct 28 19:25:47.330899 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1968/3930] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:47 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2160 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:47.339068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9c999cab-a0f1-4116-b121-6866d4fdc4f8 req-2294d5b1-f6f9-44ba-8c9c-c0b5c26ebfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb6f7b4-23ea-4b00-8f79-654bb19de4d1", "name": "network-vif-deleted", "tag": "8b43571d-9302-4a3e-afb5-3cd7c6545571"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:47.361557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c999cab-a0f1-4116-b121-6866d4fdc4f8 req-2294d5b1-f6f9-44ba-8c9c-c0b5c26ebfee service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:47.363735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c999cab-a0f1-4116-b121-6866d4fdc4f8 req-2294d5b1-f6f9-44ba-8c9c-c0b5c26ebfee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:47.365389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c999cab-a0f1-4116-b121-6866d4fdc4f8 req-2294d5b1-f6f9-44ba-8c9c-c0b5c26ebfee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:47.409244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9c999cab-a0f1-4116-b121-6866d4fdc4f8 req-2294d5b1-f6f9-44ba-8c9c-c0b5c26ebfee service nova] Creating event network-vif-deleted:8b43571d-9302-4a3e-afb5-3cd7c6545571 for instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 on n-h2-862769-3 Oct 28 19:25:47.415296 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9c999cab-a0f1-4116-b121-6866d4fdc4f8 req-2294d5b1-f6f9-44ba-8c9c-c0b5c26ebfee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080199 Oct 28 19:25:47.416477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1963/3931] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:47.760635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:47.761399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:47.775701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:47.776372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:47.779097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:47.780044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:47.783023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:47.783645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:47.975358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-61005d8c-3fc4-4f7a-a8a8-4ee676dd81ab tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77aa1a60>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:48.044756 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-61005d8c-3fc4-4f7a-a8a8-4ee676dd81ab tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.075622 Oct 28 19:25:48.045514 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1964/3932] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:47 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:48.115586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:48.116601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:48.128918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:48.137492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:48.140959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:48.144768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:48.152141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:48.152874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:48.277221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:48.292008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f73422c4-a8d8-4b63-b75b-5e49e60514cf tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1524 microversion: 2.1 time: 0.535841 Oct 28 19:25:48.292594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1969/3933] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:47 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1524 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:48.370025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:48.370025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:48.379916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:48.381238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:48.382209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:48.384174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:48.385020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:48.385630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:48.433369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:48.453446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf542a60-22f9-4d06-b7e2-8de80d54373b tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.341908 Oct 28 19:25:48.454762 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1965/3934] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:48 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:48.492333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:48.503774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:48.530316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:48.540586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84ca682f-9c34-4f50-999b-0402f58c251f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 2160 microversion: 2.32 time: 0.170102 Oct 28 19:25:48.558291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1970/3935] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:48 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 2160 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:49.068294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b592638-3e78-4136-8185-2ebccf195279 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d772305e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:49.161432 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b592638-3e78-4136-8185-2ebccf195279 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1440 microversion: 2.1 time: 0.102042 Oct 28 19:25:49.162623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1966/3936] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:49 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:49.317008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:49.318549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:49.335333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:49.340191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:49.341787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:49.342815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:49.348745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:49.349601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:49.486218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:49.487517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:49.502744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:49.503247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:49.503683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:49.504391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:49.504840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:49.505266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:49.946066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:49.955438 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea69799f-187e-4783-851b-bd0d003fecc7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1504 microversion: 2.1 time: 0.642286 Oct 28 19:25:49.988216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de03197eac374bf09c19018aa1417e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6b1cf2b07145eab7e090ed440efd5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:49.992511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1971/3937] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:49 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1504 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:50.001919 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9807e15b-f4d6-4fea-b0ce-996e76abe7d9 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 200 len: 1520 microversion: 2.1 time: 0.520123 Oct 28 19:25:50.007348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:50.023296 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1967/3938] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:49 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:50.027855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:50.073194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99fd14ca-1f24-4c22-9478-4c0aa70eba98 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'create', calling method: .version_select at 0x7f1d772305e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1367424815", "description": "tempest-description-1301662848"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:50.096731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:50.100370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:50.101129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:50.102375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:50.103174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:50.103891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:50.278622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:50.318237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:50.326234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:50.332371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2c95c27a-a9f6-4902-ba12-075b14ff2ac4 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.337857 Oct 28 19:25:50.334594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1972/3939] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:49 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:50.365386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6aa3f1c7-5eb6-4573-b3be-3f7ca6a8cc1b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a22f70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:50.455248 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6aa3f1c7-5eb6-4573-b3be-3f7ca6a8cc1b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1449 microversion: 2.1 time: 0.117344 Oct 28 19:25:50.456090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1973/3940] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:50 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1449 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:50.476670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5df9836c-86c5-4fb4-8e44-81ded9512b60 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a7c8b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:50.577037 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5df9836c-86c5-4fb4-8e44-81ded9512b60 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 200 len: 1449 microversion: 2.1 time: 0.105176 Oct 28 19:25:50.591057 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1974/3941] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:25:50 2022] GET /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 1449 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:50.596550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b04531fd-4020-40ca-b149-34922e490e31 req-c7ccc015-8459-4cfd-b612-ab92079c8e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1db064-f45c-4a74-8a9b-8f3c9cd85570", "name": "network-vif-deleted", "tag": "d9abd8d1-f438-426e-bd2e-e10cddaf5b5d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:50.618990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b04531fd-4020-40ca-b149-34922e490e31 req-c7ccc015-8459-4cfd-b612-ab92079c8e8d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:50.624319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b04531fd-4020-40ca-b149-34922e490e31 req-c7ccc015-8459-4cfd-b612-ab92079c8e8d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:50.624839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b04531fd-4020-40ca-b149-34922e490e31 req-c7ccc015-8459-4cfd-b612-ab92079c8e8d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:50.656258 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b04531fd-4020-40ca-b149-34922e490e31 req-c7ccc015-8459-4cfd-b612-ab92079c8e8d service nova] Creating event network-vif-deleted:d9abd8d1-f438-426e-bd2e-e10cddaf5b5d for instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 on n-h2-862769-3 Oct 28 19:25:50.669028 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b04531fd-4020-40ca-b149-34922e490e31 req-c7ccc015-8459-4cfd-b612-ab92079c8e8d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075998 Oct 28 19:25:50.669773 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1975/3942] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:50.674783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5268b513-086f-46e8-a3a9-32384cc294a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c46b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:50.786066 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99fd14ca-1f24-4c22-9478-4c0aa70eba98 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.761569 Oct 28 19:25:50.787680 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1968/3943] 10.222.0.44 () {60 vars in 1180 bytes} [Fri Oct 28 19:25:50 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:50.801606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1367424815"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:50.802151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:50.809504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:50.810004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:50.810846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:50.811799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:50.812213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:50.813078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:51.059999 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.security_group_api [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Adding security group 6cbcdc53-b54b-416b-b5f1-f05195aacb3d to port 90908dc6-a803-40c2-92ef-b6e97bac522b Oct 28 19:25:51.744772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-689185f5-1d80-4098-8dfa-571df0edcfc5 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action" status: 202 len: 0 microversion: 2.1 time: 0.947548 Oct 28 19:25:51.745606 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1969/3944] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:50 2022] POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:51.754440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:51.755311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] [instance: 9d1db064-f45c-4a74-8a9b-8f3c9cd85570] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:51.773582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:51.782842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:51.783667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:51.791854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:51.795687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:51.796521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:51.797668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:51.823949 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] HTTP exception thrown: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 could not be found. Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Request method failure captured: Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 HTTP/1.1 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtivwuKFiAeZ3mtd65Ka3GyV0ET4mXD6TmcPjqyNDNaZzqwBZQw7tFWB4MBErzrDAyWBrXcFPu2ifT8zOYbOc0wtR1UKKGU4r5B8WL4eU1nq7kheF6u5TANiHF2dSriR86fEKef_Cz8hYxGfelPhuLtPP4HG_UUvDKZqe4f69HLpWA Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a6b1cf2b07145eab7e090ed440efd5e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a6b1cf2b07145eab7e090ed440efd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 0a6b1cf2b07145eab7e090ed440efd5e Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-867503325 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: de03197eac374bf09c19018aa1417e88 Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-867503325-project Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 could not be found. Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9d1db064-f45c-4a74-8a9b-8f3c9cd85570'} Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 could not be found. Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 could not be found. Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:51.825879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 could not be found. Oct 28 19:25:51.830786 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:25:51.834202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] Returning 404 to user: Instance 9d1db064-f45c-4a74-8a9b-8f3c9cd85570 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:25:51.835325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-044a7e0b-4c1e-4f1e-8bf5-f1296ffd8de6 tempest-ServerRescueNegativeTestJSON-867503325 tempest-ServerRescueNegativeTestJSON-867503325-project] 10.222.0.44 "GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570" status: 404 len: 111 microversion: 2.1 time: 0.088657 Oct 28 19:25:51.836488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1970/3945] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:51 2022] GET /compute/v2.1/servers/9d1db064-f45c-4a74-8a9b-8f3c9cd85570 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:25:51.876346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:51.877180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:51.884458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:51.885890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:51.886607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:51.887752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:51.889164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:51.889861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:51.996617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:52.013652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:52.016941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:52.020497 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e1ad1bf-4b36-48f3-827c-66b2733baf1c tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.182603 Oct 28 19:25:52.022801 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1971/3946] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:51 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:52.047085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1367424815"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:52.048880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:52.068621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:52.069310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:52.069945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:52.071620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:52.072840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:52.074604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:52.192051 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5268b513-086f-46e8-a3a9-32384cc294a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 204 len: 0 microversion: 2.1 time: 1.520916 Oct 28 19:25:52.192912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1976/3947] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:50 2022] DELETE /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 0 bytes in 1523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:25:52.201775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:52.202400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:52.225662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:52.226245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:52.226717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:52.229184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:52.229667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:52.230103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:52.320662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:25:52.393526 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.security_group_api [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Removing security group 6cbcdc53-b54b-416b-b5f1-f05195aacb3d from port 90908dc6-a803-40c2-92ef-b6e97bac522b Oct 28 19:25:52.473069 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ade0119-9455-4c36-a13d-c8ee9899695e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 204 len: 0 microversion: 2.1 time: 0.275346 Oct 28 19:25:52.474509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1977/3948] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:25:52 2022] DELETE /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:25:52.712681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4b4b3dd6-d2cb-433d-9393-e0754f282f2e req-1f81f0cf-73e0-4969-ac4c-f53b50da7467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:52.735513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b4b3dd6-d2cb-433d-9393-e0754f282f2e req-1f81f0cf-73e0-4969-ac4c-f53b50da7467 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:52.735991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b4b3dd6-d2cb-433d-9393-e0754f282f2e req-1f81f0cf-73e0-4969-ac4c-f53b50da7467 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:52.736418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b4b3dd6-d2cb-433d-9393-e0754f282f2e req-1f81f0cf-73e0-4969-ac4c-f53b50da7467 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:52.758994 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4b4b3dd6-d2cb-433d-9393-e0754f282f2e req-1f81f0cf-73e0-4969-ac4c-f53b50da7467 service nova] Creating event network-changed:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:25:52.770599 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4b4b3dd6-d2cb-433d-9393-e0754f282f2e req-1f81f0cf-73e0-4969-ac4c-f53b50da7467 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071432 Oct 28 19:25:52.779799 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1978/3949] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 28 19:25:52.789654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1328092610", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a2a9fb07-7594-4148-91c4-67cde00ca3a4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:52.878104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] validate_networks() for [('a2a9fb07-7594-4148-91c4-67cde00ca3a4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:25:53.351755 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3586b9a5-86b0-4c8f-85c5-0be248817ee4 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action" status: 202 len: 0 microversion: 2.1 time: 1.327616 Oct 28 19:25:53.353284 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1972/3950] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:52 2022] POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:53.371373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:53.377869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:53.430574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:53.431220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:53.431675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:53.440063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:53.440978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:53.441433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:53.984981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:53.998738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:54.000219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:54.001447 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-526bad96-0b6a-4e3c-873e-cb8ae2dfc4ed tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.646672 Oct 28 19:25:54.016608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1973/3951] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:53 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:54.033368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:25:54.033953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9b54124-aefb-43cb-b989-e75219459951 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'create', calling method: .version_select at 0x7f1d7ffa04c0>, body: {"pool": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:54.034056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:25:54.034671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:25:54.035172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:25:54.035834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:25:54.046735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:54.047500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:54.048152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:54.049230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:54.049931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:54.050484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:54.097752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:25:54.111975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for user 6ea87a8ceb604f0aa3baa5453a3bd434 and project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:25:54.132036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:54.178180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:25:54.200650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:25:54.361738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b492727-c7ab-44e0-8e3b-9031c8052f36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580509 Oct 28 19:25:54.375805 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1979/3952] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:25:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:25:54.383164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99295434-a6d0-4286-8a3f-89b5b3f3345f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:54.383783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99295434-a6d0-4286-8a3f-89b5b3f3345f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:55.214116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99295434-a6d0-4286-8a3f-89b5b3f3345f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:55.229862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99295434-a6d0-4286-8a3f-89b5b3f3345f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1208 microversion: 2.1 time: 0.845257 Oct 28 19:25:55.230762 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1980/3953] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:54 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1208 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:55.243255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:55.246091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:55.266761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:55.267268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:55.267704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:55.274594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:55.275233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:55.275685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:55.444912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:55.461005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:55.472343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:55.473753 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fcd1f8bc-1f7c-4650-86c1-47f0a03956d7 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.241711 Oct 28 19:25:55.475962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1981/3954] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:55 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:55.489294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8b53a604-095e-42db-99a0-00a1df9c61f1 req-307c1c06-a03c-4c22-8069-fb928f65d9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:55.518617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b53a604-095e-42db-99a0-00a1df9c61f1 req-307c1c06-a03c-4c22-8069-fb928f65d9da service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:55.521223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b53a604-095e-42db-99a0-00a1df9c61f1 req-307c1c06-a03c-4c22-8069-fb928f65d9da service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:55.522555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b53a604-095e-42db-99a0-00a1df9c61f1 req-307c1c06-a03c-4c22-8069-fb928f65d9da service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:55.548950 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8b53a604-095e-42db-99a0-00a1df9c61f1 req-307c1c06-a03c-4c22-8069-fb928f65d9da service nova] Creating event network-changed:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:25:55.565040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8b53a604-095e-42db-99a0-00a1df9c61f1 req-307c1c06-a03c-4c22-8069-fb928f65d9da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086684 Oct 28 19:25:55.572505 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1982/3955] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:55.589075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d2c161e7-bb50-464b-a574-6213e7ccea70 req-3c958866-81b1-4c5c-a4f4-0a51fb8ec9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee9cd8-4486-48e8-b0db-5070b46158a7", "name": "network-vif-unplugged", "status": "completed", "tag": "11172299-004a-48cf-bd9e-1472e3f6a716"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:55.617504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d2c161e7-bb50-464b-a574-6213e7ccea70 req-3c958866-81b1-4c5c-a4f4-0a51fb8ec9ee service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:55.619720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d2c161e7-bb50-464b-a574-6213e7ccea70 req-3c958866-81b1-4c5c-a4f4-0a51fb8ec9ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:55.621323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d2c161e7-bb50-464b-a574-6213e7ccea70 req-3c958866-81b1-4c5c-a4f4-0a51fb8ec9ee service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:55.650352 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d2c161e7-bb50-464b-a574-6213e7ccea70 req-3c958866-81b1-4c5c-a4f4-0a51fb8ec9ee service nova] Creating event network-vif-unplugged:11172299-004a-48cf-bd9e-1472e3f6a716 for instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 on n-h1-862769-3 Oct 28 19:25:55.662363 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d2c161e7-bb50-464b-a574-6213e7ccea70 req-3c958866-81b1-4c5c-a4f4-0a51fb8ec9ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088239 Oct 28 19:25:55.665502 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1983/3956] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:56.258157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:56.259929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:56.281881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:56.282328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:56.285662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:56.286407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:56.286902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:56.289777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:56.767616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:56.780002 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07dbe871-eb63-4228-88bf-704f19c2477c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1268 microversion: 2.1 time: 0.528155 Oct 28 19:25:56.800281 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1984/3957] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:56 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1268 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:25:56.805929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:56.810506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:56.825400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:56.826244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:56.827337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:56.831784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:56.832836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:56.833424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:56.898235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:57.082346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:57.092745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:57.094258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:57.111481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75e13c42-8c88-4faf-98c6-01c47c08eafc tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.309630 Oct 28 19:25:57.112107 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1985/3958] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:56 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:57.733834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f23a2db0-45ed-4059-a98f-8baf48a97490 req-da67e09f-41fc-4aa0-a488-c7c333edd74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee9cd8-4486-48e8-b0db-5070b46158a7", "name": "network-vif-deleted", "tag": "11172299-004a-48cf-bd9e-1472e3f6a716"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:57.756748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f23a2db0-45ed-4059-a98f-8baf48a97490 req-da67e09f-41fc-4aa0-a488-c7c333edd74c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:57.760337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f23a2db0-45ed-4059-a98f-8baf48a97490 req-da67e09f-41fc-4aa0-a488-c7c333edd74c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:57.762014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f23a2db0-45ed-4059-a98f-8baf48a97490 req-da67e09f-41fc-4aa0-a488-c7c333edd74c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:57.796962 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f23a2db0-45ed-4059-a98f-8baf48a97490 req-da67e09f-41fc-4aa0-a488-c7c333edd74c service nova] Creating event network-vif-deleted:11172299-004a-48cf-bd9e-1472e3f6a716 for instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 on n-h1-862769-3 Oct 28 19:25:57.812754 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f23a2db0-45ed-4059-a98f-8baf48a97490 req-da67e09f-41fc-4aa0-a488-c7c333edd74c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081697 Oct 28 19:25:57.813641 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1986/3959] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:25:57.824107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:57.829321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:57.847023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:57.850746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:57.853970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:57.871494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:57.873916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:57.877326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:58.009162 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0534742e-8192-4007-883f-11a4af9210be tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.189382 Oct 28 19:25:58.013583 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1987/3960] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:57 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:58.022304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:58.024167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:58.035267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:58.036434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:58.037189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:58.038416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:58.039421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:58.040312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:58.457305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:58.484932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea07c73b-7fcc-4ff8-837f-54a11e7a261a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1266 microversion: 2.1 time: 0.468703 Oct 28 19:25:58.488212 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1988/3961] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:58 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1266 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:58.507283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:58.510905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:58.530460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:58.535962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:58.536651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:58.539684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:58.542439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:58.543457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:59.069681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:59.084013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-62c852a2-e353-44d5-af98-0142d52f2906 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1669 microversion: 2.1 time: 0.592706 Oct 28 19:25:59.086505 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1989/3962] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:58 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:59.108022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:59.112822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:59.137720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:59.138671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:59.139473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:59.140404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:59.141239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:59.141870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:59.430235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:59.443704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:59.446939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:59.448341 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fb48339a-a7d1-402c-9b85-b8bbbce1c619 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.358406 Oct 28 19:25:59.480210 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1990/3963] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:25:59 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:25:59.513493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:59.514167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:25:59.532666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:59.533317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:59.533826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:59.535219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:59.535745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:59.536223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:59.745115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:59.756818 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf917e68-c7d1-4830-a048-a32aa8db0866 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1266 microversion: 2.1 time: 0.248766 Oct 28 19:25:59.757791 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1991/3964] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:59 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:00.116081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:00.117436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:00.124531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:00.125298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:00.125922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:00.126882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:00.127606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:00.128219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.478249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9b54124-aefb-43cb-b989-e75219459951 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.454027 Oct 28 19:26:01.479565 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1974/3965] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Oct 28 19:25:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:01.487647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:01.488181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:01.488331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:01.496560 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a0f29ea-a4e4-4947-aa04-cf41520dae59 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1669 microversion: 2.1 time: 1.387467 Oct 28 19:26:01.511128 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1992/3966] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:00 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1669 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:01.521310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:01.521310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:01.521310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.523984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:01.524785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:01.532167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:01.533390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:01.533976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.534892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:01.541487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:01.542412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.553770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:01.558359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:01.558865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.618854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:01.758853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:01.777212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:01.782579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:01.788665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d72756f8-6dc2-496a-af29-2397d9e105b5 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.308002 Oct 28 19:26:01.794573 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1975/3967] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:01 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:01.806087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.220"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:01.808832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:01.820177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:01.820831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:01.821427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.822311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:01.822931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:01.823518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:01.835052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:01.844506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-caee6b4b-25b3-4b12-9b26-afc2455b37d8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.331675 Oct 28 19:26:01.861342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1993/3968] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:01 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:01.879797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "refresh_cache-f03481fd-5ed4-42af-add7-025ce96c4f01" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:26:01.881235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquired lock "refresh_cache-f03481fd-5ed4-42af-add7-025ce96c4f01" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:26:02.530054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:02.531518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:02.538965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:02.540250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:02.541023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:02.541916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:02.542558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:02.543205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:02.906071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:02.915962 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-83a097d7-7c1e-4097-bb1d-27af17887a52 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.390718 Oct 28 19:26:02.917218 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1994/3969] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:02 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:02.925808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:02.927488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:02.939161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:02.939658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:02.940274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:02.941147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:02.941782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:02.942381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:03.205222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:03.233579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:03.241239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:03.247242 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b8f9e1e-13bb-43f5-b168-724a0a544f33 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.326143 Oct 28 19:26:03.248397 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1995/3970] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:02 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:03.263326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:03.264903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:03.279657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:03.285128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:03.285720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:03.287129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:03.287953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:03.290327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:04.016085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:04.035850 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a66ce74-b0af-4249-bbc9-b75b08b38d07 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.785345 Oct 28 19:26:04.036575 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1996/3971] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:03 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:04.191841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2e19c7c8-afa7-4c6d-9e5d-a0a5a306fca0 req-136eb324-db24-4a7c-b4ca-d1083c2dc748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707bc10a-d5db-41f4-b4d2-63e819b35c40", "tag": "679e12c2-4416-4465-a337-bed15e767ca1"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:04.209893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:04.213219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e19c7c8-afa7-4c6d-9e5d-a0a5a306fca0 req-136eb324-db24-4a7c-b4ca-d1083c2dc748 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:04.214020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e19c7c8-afa7-4c6d-9e5d-a0a5a306fca0 req-136eb324-db24-4a7c-b4ca-d1083c2dc748 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:04.214599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2e19c7c8-afa7-4c6d-9e5d-a0a5a306fca0 req-136eb324-db24-4a7c-b4ca-d1083c2dc748 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:04.227803 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2e19c7c8-afa7-4c6d-9e5d-a0a5a306fca0 req-136eb324-db24-4a7c-b4ca-d1083c2dc748 service nova] Creating event network-changed:679e12c2-4416-4465-a337-bed15e767ca1 for instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 on n-h2-862769-3 Oct 28 19:26:04.233480 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2e19c7c8-afa7-4c6d-9e5d-a0a5a306fca0 req-136eb324-db24-4a7c-b4ca-d1083c2dc748 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055128 Oct 28 19:26:04.234593 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1997/3972] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:04.279680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:04.280769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:04.289968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:04.290553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:04.291128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:04.293076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:04.294532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:04.295559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:04.804685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:04.815494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:04.816934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:04.818150 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-55b788a4-bc39-4bb8-bfa9-dd295a3f8181 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.544340 Oct 28 19:26:04.829361 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1998/3973] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:04 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:05.059709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:05.061063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:05.070215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:05.075524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:05.076219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:05.077123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:05.077800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:05.078373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:05.219662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:05.481158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Building network info cache for instance {{(pid=120629) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:26:05.503498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:05.512666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5794f6e9-b59a-4e21-9d8b-6d0b7eed018d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.456948 Oct 28 19:26:05.516912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 1999/3974] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:05 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:05.930724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1177606373", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:06.049258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:26:06.053039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:26:06.054112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:26:06.055337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:26:06.059184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:26:06.075613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.077619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.078227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.079216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.079880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.080480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.100960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Getting quotas for project f0fd41f148e147c89539bb71efce8b4a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:26:06.107921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Getting quotas for user 976fe4767b9c47088e1b6410e9290c27 and project f0fd41f148e147c89539bb71efce8b4a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:26:06.124014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:26:06.126646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:26:06.218256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8cee12d-12ba-4098-b88a-0d24211f3664 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.694084 Oct 28 19:26:06.223489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2000/3975] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:26:06.229580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:06.244568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:06.252425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.252924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.256828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.257737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.274154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.274979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.439901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:06.470302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:06.483388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:06.486482 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-150d736c-c56d-4591-8534-2b71a3bfca1e tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.261761 Oct 28 19:26:06.488988 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2001/3976] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:06 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:06.503767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-572bae59-9fde-4163-8396-95d445c2de2a tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:06.505885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-572bae59-9fde-4163-8396-95d445c2de2a tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:06.821644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-572bae59-9fde-4163-8396-95d445c2de2a tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:06.832388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-572bae59-9fde-4163-8396-95d445c2de2a tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:06.835987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-572bae59-9fde-4163-8396-95d445c2de2a tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:06.840305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-572bae59-9fde-4163-8396-95d445c2de2a tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1278 microversion: 2.57 time: 0.347365 Oct 28 19:26:06.843908 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2002/3977] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:06 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:06.862337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-116556e6-3033-432d-87b7-e2524b3175da req-1da2f94d-71f1-4b01-82cf-8885d5c8cf6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:06.880403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Updating instance_info_cache with network_info: [{"id": "90908dc6-a803-40c2-92ef-b6e97bac522b", "address": "fa:16:3e:eb:e7:01", "network": {"id": "ddc971ba-e70f-412b-9da6-b7178e048b01", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2087624543-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "724ba6314aa149df897b118534b70b93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap90908dc6-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120629) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:26:06.888490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-116556e6-3033-432d-87b7-e2524b3175da req-1da2f94d-71f1-4b01-82cf-8885d5c8cf6d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.892824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-116556e6-3033-432d-87b7-e2524b3175da req-1da2f94d-71f1-4b01-82cf-8885d5c8cf6d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.894171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Releasing lock "refresh_cache-f03481fd-5ed4-42af-add7-025ce96c4f01" {{(pid=120629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:26:06.895091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55c6dff5-d433-48bd-8429-c4ecfc74e7a7 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action" status: 202 len: 0 microversion: 2.1 time: 5.099371 Oct 28 19:26:06.895734 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1976/3978] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:26:01 2022] POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action => generated 0 bytes in 5101 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:26:06.896857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-116556e6-3033-432d-87b7-e2524b3175da req-1da2f94d-71f1-4b01-82cf-8885d5c8cf6d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.921680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:06.924529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:06.932388 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-116556e6-3033-432d-87b7-e2524b3175da req-1da2f94d-71f1-4b01-82cf-8885d5c8cf6d service nova] Creating event network-changed:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:26:06.935828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.939494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.942178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.943053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-116556e6-3033-432d-87b7-e2524b3175da req-1da2f94d-71f1-4b01-82cf-8885d5c8cf6d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097513 Oct 28 19:26:06.944516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:06.945313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:06.945801 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2003/3979] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:06.946390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:06.956454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.220"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:07.457425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:07.465457 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-32d736ef-c0ed-4f33-a9c5-c4a5bb51b08b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.568697 Oct 28 19:26:07.471742 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1977/3980] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:06 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:07.515128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:07.516028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:07.525467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:07.525962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:07.526395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:07.527144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:07.527602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:07.528028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:07.630842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:07.638141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:07.638636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:07.639160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:07.639796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:07.640290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:07.640713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:07.766858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:07.777476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:07.778994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:07.780246 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fcaf5c5f-131a-4ea4-b5a3-2312c298f86f tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.269175 Oct 28 19:26:07.780890 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1978/3981] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:07 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:07.869948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:07.870567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:07.898167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:07.902087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:07.905014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:07.906869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:07.907543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:07.908139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:08.259547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:08.278012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:08.289806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:08.309697 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4dccdb49-a0a4-4e11-b92b-ece64ea915c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1330 microversion: 2.57 time: 0.443452 Oct 28 19:26:08.318929 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1979/3982] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:07 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1330 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:08.498350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:08.499003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:08.514238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:08.514776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:08.515237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:08.515956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:08.516410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:08.516839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:08.604246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "refresh_cache-f03481fd-5ed4-42af-add7-025ce96c4f01" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 19:26:08.604917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquired lock "refresh_cache-f03481fd-5ed4-42af-add7-025ce96c4f01" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 19:26:08.962030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:08.981276 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54f8470c-912f-4b02-a3d7-231fb3385e28 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.483707 Oct 28 19:26:08.998803 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1980/3983] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:08 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:09.011921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:09.016375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:09.038052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:09.042530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:09.048118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:09.052460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:09.056386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:09.057473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:09.648198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:09.687029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:09.692988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:09.694303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5f787376-e901-438b-9e46-d09a6a22ba6d tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.691037 Oct 28 19:26:09.694920 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1981/3984] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:08 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:09.711513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:09.712406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:09.722362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:09.727001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:09.727701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:09.728612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:09.729233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:09.729659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:09.880468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:09.896322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:09.897760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:09.898954 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e88427d-e68a-46b6-bc54-f812031dd980 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1336 microversion: 2.57 time: 0.191890 Oct 28 19:26:09.901052 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1982/3985] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:09 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1336 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:10.006182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:10.006841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:10.021579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:10.022223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:10.022670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:10.031400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:10.031930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:10.032384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:10.332708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:10.346990 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f99bb89-2407-4bd5-b5b1-fd6c424b937a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.339801 Oct 28 19:26:10.353003 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1983/3986] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:10 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:10.647478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Building network info cache for instance {{(pid=120628) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 19:26:10.652466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:10.656434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4471ef00-76b3-4f6a-96eb-728abf5a79e3 req-eb2d463e-af5b-45a7-92d7-60ef18d9794f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:10.677353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4471ef00-76b3-4f6a-96eb-728abf5a79e3 req-eb2d463e-af5b-45a7-92d7-60ef18d9794f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:10.678091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4471ef00-76b3-4f6a-96eb-728abf5a79e3 req-eb2d463e-af5b-45a7-92d7-60ef18d9794f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:10.678716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4471ef00-76b3-4f6a-96eb-728abf5a79e3 req-eb2d463e-af5b-45a7-92d7-60ef18d9794f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:10.707615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4471ef00-76b3-4f6a-96eb-728abf5a79e3 req-eb2d463e-af5b-45a7-92d7-60ef18d9794f service nova] Creating event network-changed:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:26:10.744295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4471ef00-76b3-4f6a-96eb-728abf5a79e3 req-eb2d463e-af5b-45a7-92d7-60ef18d9794f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091472 Oct 28 19:26:10.756374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1984/3987] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:26:10.782542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:10.787794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:10.828894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:10.830149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:10.832529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:10.837510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:10.840934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:10.841951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.028648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:11.047891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:11.054987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:11.056246 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-807fd2cf-393d-4603-ab57-91e516d32456 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1604 microversion: 2.32 time: 0.290232 Oct 28 19:26:11.057331 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1985/3988] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:10 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1604 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:11.062196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:11.063018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:11.070615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.071354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.071960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.072826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.073430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.074012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.248386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:11.258897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:11.264519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:11.269257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8954f9a-a8d4-46c6-8627-d989b7aeaca8 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1357 microversion: 2.57 time: 0.210671 Oct 28 19:26:11.287229 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1986/3989] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:11 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:11.300507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-54e0ea78-1183-49f1-8d52-bab4ec23588c req-0cf570d5-22eb-411d-a3f4-3fcbddef8db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707bc10a-d5db-41f4-b4d2-63e819b35c40", "name": "network-vif-plugged", "status": "completed", "tag": "679e12c2-4416-4465-a337-bed15e767ca1"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:11.318757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54e0ea78-1183-49f1-8d52-bab4ec23588c req-0cf570d5-22eb-411d-a3f4-3fcbddef8db8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.321270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54e0ea78-1183-49f1-8d52-bab4ec23588c req-0cf570d5-22eb-411d-a3f4-3fcbddef8db8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.322954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54e0ea78-1183-49f1-8d52-bab4ec23588c req-0cf570d5-22eb-411d-a3f4-3fcbddef8db8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.339513 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-54e0ea78-1183-49f1-8d52-bab4ec23588c req-0cf570d5-22eb-411d-a3f4-3fcbddef8db8 service nova] Creating event network-vif-plugged:679e12c2-4416-4465-a337-bed15e767ca1 for instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 on n-h2-862769-3 Oct 28 19:26:11.352428 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-54e0ea78-1183-49f1-8d52-bab4ec23588c req-0cf570d5-22eb-411d-a3f4-3fcbddef8db8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059244 Oct 28 19:26:11.355591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1987/3990] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:11.373178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:11.400618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:11.417313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.418169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.419597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.420491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.421119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.421801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.547146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:26:11.547740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:26:11.548348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:26:11.548890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:26:11.549736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:26:11.697245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:11.712266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.712361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.712750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.713978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.714619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.715200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.758718 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a8a9db4-d64e-4025-978f-482a8aae80b2 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "POST /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43/action" status: 202 len: 1138 microversion: 2.57 time: 0.401367 Oct 28 19:26:11.759774 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1988/3991] 10.222.0.44 () {62 vars in 1320 bytes} [Fri Oct 28 19:26:11 2022] POST /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43/action => generated 1138 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 19:26:11.777250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:11.778069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:11.794289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.794977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.795419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:11.796297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:11.796741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:11.797072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:12.501111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:12.513970 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6f9c205-3597-4970-995c-7bce7d3d1d5d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1308 microversion: 2.1 time: 0.752590 Oct 28 19:26:12.516387 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1989/3992] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:11 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1308 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:12.521388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:12.522482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:12.548979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:12.553175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:12.553599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:12.554351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:12.554834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:12.555261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:12.574749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:12.712223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Updating instance_info_cache with network_info: [{"id": "90908dc6-a803-40c2-92ef-b6e97bac522b", "address": "fa:16:3e:eb:e7:01", "network": {"id": "ddc971ba-e70f-412b-9da6-b7178e048b01", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2087624543-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "724ba6314aa149df897b118534b70b93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap90908dc6-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120628) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:26:12.726578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:12.739629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:12.742656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:12.746266 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a73e8df-b691-42a3-9431-36edfac6dfe1 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.228688 Oct 28 19:26:12.747965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Releasing lock "refresh_cache-f03481fd-5ed4-42af-add7-025ce96c4f01" {{(pid=120628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 19:26:12.750712 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a6064af-047e-4065-8e63-ac5c1f0f9b75 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action" status: 202 len: 0 microversion: 2.1 time: 5.803743 Oct 28 19:26:12.752740 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2004/3993] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:26:06 2022] POST /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01/action => generated 0 bytes in 5806 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 19:26:12.764925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:12.768443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:12.768985 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1990/3994] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:12 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:12.776209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-293d1c12-caa2-493e-88aa-fc660efc94fc tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '.version_select at 0x7f1d7ffd35e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:12.788139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:12.788864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:12.791035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:12.792380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:12.798216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:12.798967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:12.893241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:12.895645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:12.896345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:12.898582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lazy-loading 'fault' on Instance uuid cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:26:13.584584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:13.594910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:13.597627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e71e79dfbf1c413d9c3d5c3ab45299cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cca9c74aea5452981c3f96381b05cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:13.599165 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da1a931c-8a6f-4cc2-ba6f-c44faecc3ef6 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 200 len: 1371 microversion: 2.32 time: 0.845284 Oct 28 19:26:13.600332 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2005/3995] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:12 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 1371 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:13.606249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:13.607238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:13.614491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:13.615335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:13.615982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:13.617120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:13.617785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:13.618415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.101706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:14.113268 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77726298-da8b-4714-acf0-d59b03f4b56c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 200 len: 1488 microversion: 2.1 time: 0.511588 Oct 28 19:26:14.114224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2006/3996] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:13 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 1488 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:14.122109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:14.123080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:14.130464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:14.131623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:14.132309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.133613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:14.136101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:14.136864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.267587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:14.279749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:14.281270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:14.282564 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e6f8bde-e2e4-493e-90f2-72275c0eeae3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.166663 Oct 28 19:26:14.283726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2007/3997] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:14 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:14.288978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1207556284"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:14.292308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:14.303958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:14.304526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:14.307457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.307457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:14.308062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:14.308457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.676565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd676605-f5ba-4a86-a059-aa7cd94de6b8 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40/action" status: 202 len: 0 microversion: 2.1 time: 0.387311 Oct 28 19:26:14.686070 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2008/3998] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:26:14 2022] POST /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:26:14.709065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:14.710185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:14.730374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:14.731198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:14.731653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.732478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:14.733155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:14.733663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:14.755871 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] HTTP exception thrown: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Request method failure captured: Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 HTTP/1.1 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCs3gjeBeXg-WbfSdOhBJjYyeyKHVc6nEYH5Avvm9qIyYqXx9LpR1As7w5S8zGnbf0nzSbAgr-Yl9rhcUKbbiU6Fe4fS2AzMcTQ8UScXcg9lkIvwVCzVb4HlN1QnH7oJ9-74MYedKcv556Zkbt44HND32L3pjXFZ9idUa0oOs18wiWA Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2cca9c74aea5452981c3f96381b05cae Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cca9c74aea5452981c3f96381b05cae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2cca9c74aea5452981c3f96381b05cae Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TaggedBootDevicesTest-10057438-project Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: e71e79dfbf1c413d9c3d5c3ab45299cf Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TaggedBootDevicesTest-10057438-project Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'cbb6f7b4-23ea-4b00-8f79-654bb19de4d1'} Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:14.757578 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Returning 404 to user: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:26:14.764684 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01fd1e03-c9c7-4350-bff1-e968e4d4e772 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 404 len: 111 microversion: 2.32 time: 0.065006 Oct 28 19:26:14.766379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2009/3999] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:14 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:26:14.771487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3561e044-3361-4ca2-bbcb-fbc730b33bc6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a36550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:14.800280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-293d1c12-caa2-493e-88aa-fc660efc94fc tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/f4d54123-6f60-4baa-a2dd-1075e44d8393" status: 202 len: 0 microversion: 2.1 time: 2.029829 Oct 28 19:26:14.801163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1991/4000] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 19:26:12 2022] DELETE /compute/v2.1/os-floating-ips/f4d54123-6f60-4baa-a2dd-1075e44d8393 => generated 0 bytes in 2032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:26:14.814116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82c582cd-abcb-4290-a2fa-10d9aca85482 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '.version_select at 0x7f1d77aa18b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:14.859722 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82c582cd-abcb-4290-a2fa-10d9aca85482 tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803210710" status: 204 len: 0 microversion: 2.32 time: 0.051872 Oct 28 19:26:14.866956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1992/4001] 10.222.0.44 () {60 vars in 1259 bytes} [Fri Oct 28 19:26:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803210710 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:26:14.874616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-392bc328-db1a-4bc8-8d92-b6e9a7b6fbc9 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '.version_select at 0x7f1d772093a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:14.896604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3561e044-3361-4ca2-bbcb-fbc730b33bc6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.129563 Oct 28 19:26:14.898033 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2010/4002] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:14 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:15.311219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:15.312584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:15.321019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:15.321771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:15.322383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:15.323282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:15.323729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:15.324313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:15.498257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:15.511396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:15.513105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:15.514457 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-414f265d-7bd5-4655-831a-1da132ba4d84 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.207642 Oct 28 19:26:15.521801 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2011/4003] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:15 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:15.561466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-392bc328-db1a-4bc8-8d92-b6e9a7b6fbc9 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/6cbcdc53-b54b-416b-b5f1-f05195aacb3d" status: 202 len: 0 microversion: 2.1 time: 0.692273 Oct 28 19:26:15.562107 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1993/4004] 10.222.0.44 () {58 vars in 1272 bytes} [Fri Oct 28 19:26:14 2022] DELETE /compute/v2.1/os-security-groups/6cbcdc53-b54b-416b-b5f1-f05195aacb3d => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:26:15.571567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:15.572306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:15.586069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:15.586564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:15.587023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:15.587719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:15.588365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:15.588935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:15.644342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:26:15.870339 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cded889c-fed2-4319-9ecf-5ae1724a714d tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 204 len: 0 microversion: 2.1 time: 0.299624 Oct 28 19:26:15.872181 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2012/4005] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:26:15 2022] DELETE /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:26:15.884407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:15.885016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:15.904249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:15.905018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:15.905535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:15.906265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:15.906726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:15.913671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:15.926333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10ab5766-15bc-4456-bd37-2baf53f5c6d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769d4ca0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:16.035378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10ab5766-15bc-4456-bd37-2baf53f5c6d9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.124392 Oct 28 19:26:16.036563 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2013/4006] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:15 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:16.187026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:16.201368 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14d2a5c0-1574-4755-8b85-bf19ac6d4802 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1510 microversion: 2.1 time: 0.320635 Oct 28 19:26:16.215496 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1994/4007] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:15 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:16.548567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:16.549371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:16.558506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:16.563912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:16.566487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:16.568408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:16.570068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:16.572596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:16.574727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:16.752301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:16.766432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:16.768831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:16.771674 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d831a36-6a1b-44a8-8004-b45197435f92 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.226806 Oct 28 19:26:16.773665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2014/4008] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:16 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:17.066786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4bb0f951-efbe-4052-ac11-aa33913b41a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77c74790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:17.177911 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4bb0f951-efbe-4052-ac11-aa33913b41a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.116576 Oct 28 19:26:17.180101 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1995/4009] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:17 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:17.236776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:17.238902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:17.253542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:17.261967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:17.262519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:17.263000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:17.263759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:17.264863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:17.265291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:17.594272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:17.608205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e23babc-e3c5-4c15-bfd0-c4fe76acdbab tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1510 microversion: 2.1 time: 0.375652 Oct 28 19:26:17.625596 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2015/4010] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:17 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:17.815342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:17.816286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:17.833638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:17.834765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:17.835634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:17.837287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:17.838343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:17.839256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:17.963675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:18.010524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:18.023724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:18.024974 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dc3828de-73ab-4380-8dd7-454a1ccd8ad9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.218450 Oct 28 19:26:18.038743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1996/4011] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:17 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:18.198628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b410163-93cf-4a7a-877e-98da3788e503 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a024c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:18.284053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b410163-93cf-4a7a-877e-98da3788e503 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.091978 Oct 28 19:26:18.285428 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2016/4012] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:18 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:18.654178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:18.654858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:18.656906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:18.747797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:18.749832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:18.752629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:18.759426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:18.769536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:18.779931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:19.477585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:19.478445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:19.504348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:19.511418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:19.515458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:19.516481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:19.522108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:19.523265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:19.637415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:26:19.900036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8207208b-c161-4fe3-b24c-cbd4a96eee4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "DELETE /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 204 len: 0 microversion: 2.42 time: 1.441134 Oct 28 19:26:19.906347 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1997/4013] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:26:18 2022] DELETE /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 0 bytes in 1444 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:26:19.920169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:19.923501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:19.940138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:19.941169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:19.941971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:19.942944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:19.944555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:19.945250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:20.001483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.014466 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6114044-af91-4936-9027-9164b322b375 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1510 microversion: 2.1 time: 1.374523 Oct 28 19:26:20.020945 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2017/4014] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:18 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1510 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:20.062339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84f2d6b4-6218-439d-8e8b-11208870c9bf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a71430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:20.228013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84f2d6b4-6218-439d-8e8b-11208870c9bf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.181595 Oct 28 19:26:20.236922 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2018/4015] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:20 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:20.258445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-bb528828-bbff-4604-b8b1-5088777f5205 req-91dd537a-9b6e-4bf1-987f-d15fd501f615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707bc10a-d5db-41f4-b4d2-63e819b35c40", "name": "network-vif-plugged", "status": "completed", "tag": "679e12c2-4416-4465-a337-bed15e767ca1"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:20.264361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.274040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.284172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.285532 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-521b46dd-e7d6-495e-9224-ebb255948b9e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.377392 Oct 28 19:26:20.286177 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1998/4016] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:19 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:20.311973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:20.312678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:20.317312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bb528828-bbff-4604-b8b1-5088777f5205 req-91dd537a-9b6e-4bf1-987f-d15fd501f615 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:20.317809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bb528828-bbff-4604-b8b1-5088777f5205 req-91dd537a-9b6e-4bf1-987f-d15fd501f615 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:20.318250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bb528828-bbff-4604-b8b1-5088777f5205 req-91dd537a-9b6e-4bf1-987f-d15fd501f615 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:20.329553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:20.331267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:20.332774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:20.347162 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-bb528828-bbff-4604-b8b1-5088777f5205 req-91dd537a-9b6e-4bf1-987f-d15fd501f615 service nova] Creating event network-vif-plugged:679e12c2-4416-4465-a337-bed15e767ca1 for instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 on n-h2-862769-3 Oct 28 19:26:20.352231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:20.354228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-bb528828-bbff-4604-b8b1-5088777f5205 req-91dd537a-9b6e-4bf1-987f-d15fd501f615 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115864 Oct 28 19:26:20.355061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:20.355628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:20.356468 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2019/4017] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:20.368406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-252841b8-fb44-45a0-8fdf-89f4235460c6 req-04b50ca9-0706-4644-afde-f0967e0e6b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03481fd-5ed4-42af-add7-025ce96c4f01", "name": "network-vif-deleted", "tag": "90908dc6-a803-40c2-92ef-b6e97bac522b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:20.383638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-252841b8-fb44-45a0-8fdf-89f4235460c6 req-04b50ca9-0706-4644-afde-f0967e0e6b1a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:20.384329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-252841b8-fb44-45a0-8fdf-89f4235460c6 req-04b50ca9-0706-4644-afde-f0967e0e6b1a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:20.384907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-252841b8-fb44-45a0-8fdf-89f4235460c6 req-04b50ca9-0706-4644-afde-f0967e0e6b1a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:20.420394 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-252841b8-fb44-45a0-8fdf-89f4235460c6 req-04b50ca9-0706-4644-afde-f0967e0e6b1a service nova] Creating event network-vif-deleted:90908dc6-a803-40c2-92ef-b6e97bac522b for instance f03481fd-5ed4-42af-add7-025ce96c4f01 on n-h1-862769-3 Oct 28 19:26:20.448570 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-252841b8-fb44-45a0-8fdf-89f4235460c6 req-04b50ca9-0706-4644-afde-f0967e0e6b1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089195 Oct 28 19:26:20.449206 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2020/4018] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:20.774936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.785062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.793955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:20.795776 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-239c8d82-f315-4a81-8f39-d0271397fbe2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2962 microversion: 2.42 time: 0.487856 Oct 28 19:26:20.798668 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 1999/4019] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:20 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2962 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:21.053638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:21.054371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:21.071443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:21.072284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:21.072937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:21.076975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:21.079731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:21.085959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:21.242981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5aad4be8-5209-4f52-97a8-22e5946bf27d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76b1f3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:21.273317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:21.282075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fbd5680e-b62a-48d0-84d2-1c158df5a945 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1468 microversion: 2.1 time: 0.236926 Oct 28 19:26:21.291063 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2021/4020] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:21 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:21.314304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:21.324470 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5aad4be8-5209-4f52-97a8-22e5946bf27d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.085306 Oct 28 19:26:21.325071 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2000/4021] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:21 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:21.327690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:21.349145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:21.349655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:21.350099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:21.350845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:21.351338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:21.362428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:21.515326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:21.526843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:21.529108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:21.530772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a0f13c99-1b40-4c73-9437-06bb7dac68f3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.220214 Oct 28 19:26:21.541761 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2022/4022] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:21 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:21.829938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:21.831262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:21.834133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:21.840932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:21.841808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:21.842470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:21.843579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:21.844311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:21.844998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:22.165321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.188258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.193381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.195242 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-79ae34da-96fe-4ac2-87a6-c1b305a1ca22 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2962 microversion: 2.42 time: 0.372282 Oct 28 19:26:22.196865 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2001/4023] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:21 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2962 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:22.317376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:22.318797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:22.331555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:22.333719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:22.340967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1cdef1cb-cd45-4ae4-bd8c-6f2d6c2e27ab tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76b1f3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:22.345786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:22.351734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:22.352262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:22.353016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:22.369072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:22.465261 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1cdef1cb-cd45-4ae4-bd8c-6f2d6c2e27ab tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.128163 Oct 28 19:26:22.466036 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2002/4024] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:22 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:22.514404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.524072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed88a077-29fa-4a8e-b3f8-41aa04e7e764 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1293 microversion: 2.1 time: 0.210953 Oct 28 19:26:22.536646 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2023/4025] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:22 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1293 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:22.563547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:22.564685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:22.581816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:22.585443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:22.586297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:22.592187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:22.592947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:22.593561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:22.719353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.729076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.730910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:22.732357 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-332da627-12b0-4263-8403-4fbc9edd24a3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.176646 Oct 28 19:26:22.747934 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2003/4026] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:22 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:23.005744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:23.006237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:23.015990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.016786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.017214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.017930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.018378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.018820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.035328 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] HTTP exception thrown: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Request method failure captured: Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 HTTP/1.1 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCs3gjeBeXg-WbfSdOhBJjYyeyKHVc6nEYH5Avvm9qIyYqXx9LpR1As7w5S8zGnbf0nzSbAgr-Yl9rhcUKbbiU6Fe4fS2AzMcTQ8UScXcg9lkIvwVCzVb4HlN1QnH7oJ9-74MYedKcv556Zkbt44HND32L3pjXFZ9idUa0oOs18wiWA Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2cca9c74aea5452981c3f96381b05cae Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cca9c74aea5452981c3f96381b05cae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2cca9c74aea5452981c3f96381b05cae Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TaggedBootDevicesTest-10057438-project Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: e71e79dfbf1c413d9c3d5c3ab45299cf Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TaggedBootDevicesTest-10057438-project Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'cbb6f7b4-23ea-4b00-8f79-654bb19de4d1'} Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:26:23.037372 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Returning 404 to user: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a48b7141-3c75-4495-9e19-ed401126dd8b tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 404 len: 111 microversion: 2.32 time: 0.038834 Oct 28 19:26:23.042141 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2024/4027] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:26:22 2022] DELETE /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:26:23.049749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:23.050359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] [instance: cbb6f7b4-23ea-4b00-8f79-654bb19de4d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:23.063960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.064730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.065337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.067293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.067946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.068532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.090313 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] HTTP exception thrown: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Request method failure captured: Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 HTTP/1.1 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCs3gjeBeXg-WbfSdOhBJjYyeyKHVc6nEYH5Avvm9qIyYqXx9LpR1As7w5S8zGnbf0nzSbAgr-Yl9rhcUKbbiU6Fe4fS2AzMcTQ8UScXcg9lkIvwVCzVb4HlN1QnH7oJ9-74MYedKcv556Zkbt44HND32L3pjXFZ9idUa0oOs18wiWA Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2cca9c74aea5452981c3f96381b05cae Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2cca9c74aea5452981c3f96381b05cae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2cca9c74aea5452981c3f96381b05cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2cca9c74aea5452981c3f96381b05cae Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TaggedBootDevicesTest-10057438 Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TaggedBootDevicesTest-10057438-project Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: e71e79dfbf1c413d9c3d5c3ab45299cf Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TaggedBootDevicesTest-10057438-project Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'cbb6f7b4-23ea-4b00-8f79-654bb19de4d1'} Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:23.092145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] Returning 404 to user: Instance cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77057bd9-6317-472d-a4dc-34b38edf25ff tempest-TaggedBootDevicesTest-10057438 tempest-TaggedBootDevicesTest-10057438-project] 10.222.0.44 "GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1" status: 404 len: 111 microversion: 2.32 time: 0.048568 Oct 28 19:26:23.100123 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2004/4028] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:23 2022] GET /compute/v2.1/servers/cbb6f7b4-23ea-4b00-8f79-654bb19de4d1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:26:23.239176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:23.240036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:23.260927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.265840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.266367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.267206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.267741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.268227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.486178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b07fa895-1963-425d-9b19-e96b9a78f45f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77ca4f70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:23.644301 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b07fa895-1963-425d-9b19-e96b9a78f45f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.165993 Oct 28 19:26:23.646406 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2005/4029] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:23 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:23.656952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:23.658422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:23.681805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.683969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.686241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.689052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.692965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.694038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.827292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:23.827785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:23.832621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:23.833282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lazy-loading 'fault' on Instance uuid f03481fd-5ed4-42af-add7-025ce96c4f01 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:26:24.032682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5ade5f7734262881d9350659eba60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724ba6314aa149df897b118534b70b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.051041 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3493583f-56cf-47d1-bc5f-60d6216a2209 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 200 len: 1312 microversion: 2.1 time: 0.402291 Oct 28 19:26:24.063105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2006/4030] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:23 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:24.088367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:24.088993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:24.106366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:24.107185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:24.109799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:24.110682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:24.111341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:24.114999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:24.511263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.526168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.533142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.542184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.544423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.548691 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7036cb74-6048-4a9a-b85d-7145439d45eb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2962 microversion: 2.42 time: 1.321498 Oct 28 19:26:24.567091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:24.568920 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-517ea6c8-e949-41be-9dc4-c0499cfacd21 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.504474 Oct 28 19:26:24.569465 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2025/4031] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:23 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2962 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:24.570306 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2007/4032] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:24 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:24.661809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53265fb4-cb0c-40bb-ac61-0f4a31fbb08d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76cfb160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:24.783492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53265fb4-cb0c-40bb-ac61-0f4a31fbb08d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.125666 Oct 28 19:26:24.791457 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2026/4033] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:24 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:25.082892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:25.083552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] [instance: f03481fd-5ed4-42af-add7-025ce96c4f01] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:25.103386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:25.107338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:25.108123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:25.114070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:25.116829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:25.117693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:25.192276 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] HTTP exception thrown: Instance f03481fd-5ed4-42af-add7-025ce96c4f01 could not be found. Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Request method failure captured: Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 HTTP/1.1 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCyIwhxzP51DIASrOqM7kdb0J_qRXKci1WLXCOXvLkG2fXgBI-LfCTZoe0T24KcmJDSDXmcdO3eUGfm5S4UoDKmjMks3vz-cY4vfQQFXa5EygBJWjfnHIAJesXQT_T70ADA4pMkaxvLs2tfo1WWF6i-GT6tNGxkd6t9-3Wx8RRZZRvg Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 724ba6314aa149df897b118534b70b93 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1541514732 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/724ba6314aa149df897b118534b70b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_724ba6314aa149df897b118534b70b93", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/724ba6314aa149df897b118534b70b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/724ba6314aa149df897b118534b70b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1541514732 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 724ba6314aa149df897b118534b70b93 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1541514732 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueTestJSONUnderV235-1541514732-project Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 51a5ade5f7734262881d9350659eba60 Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1541514732-project Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance f03481fd-5ed4-42af-add7-025ce96c4f01 could not be found. Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'f03481fd-5ed4-42af-add7-025ce96c4f01'} Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03481fd-5ed4-42af-add7-025ce96c4f01 could not be found. Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03481fd-5ed4-42af-add7-025ce96c4f01 could not be found. Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:25.224908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03481fd-5ed4-42af-add7-025ce96c4f01 could not be found. Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:26:25.228526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] Returning 404 to user: Instance f03481fd-5ed4-42af-add7-025ce96c4f01 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:26:25.233312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69c16eb9-0863-4858-a58b-aef7343c4113 tempest-ServerRescueTestJSONUnderV235-1541514732 tempest-ServerRescueTestJSONUnderV235-1541514732-project] 10.222.0.44 "GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01" status: 404 len: 111 microversion: 2.1 time: 0.149465 Oct 28 19:26:25.240300 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2008/4034] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:25 2022] GET /compute/v2.1/servers/f03481fd-5ed4-42af-add7-025ce96c4f01 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:26:25.594250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:25.595097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:25.611239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:25.611725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:25.613416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:25.616756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:25.617437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:25.619324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:25.621303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:25.621916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:25.639128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:25.646303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:25.646789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:25.647747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:25.648909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:25.649352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:26.276464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:26.301636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:26.303820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:26.305338 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5e0fe84-6825-4ac2-8c02-69f791e22d23 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.687991 Oct 28 19:26:26.306613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2009/4035] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:25 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:26.325885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f5b0157-c288-4b05-93d1-2bd2bd030bf4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77296d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:26.467050 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f5b0157-c288-4b05-93d1-2bd2bd030bf4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.158837 Oct 28 19:26:26.467658 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2010/4036] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:26 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:26.835256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:26.845975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:26.854581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:26.856385 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cba6620f-a340-4f4a-94d6-f77fb68d0ffe tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2941 microversion: 2.42 time: 1.270169 Oct 28 19:26:26.858809 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2027/4037] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:25 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2941 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:27.358957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:27.359698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:27.397408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:27.399824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:27.402085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:27.405369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:27.407247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:27.408196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:27.483825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a176cdca-08af-47af-8b03-cd6e6b3521f3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769ce940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:27.649868 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a176cdca-08af-47af-8b03-cd6e6b3521f3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.170171 Oct 28 19:26:27.651300 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2028/4038] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:27 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:27.665478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4f00e9f4-d7b4-426f-8acd-903540c957de req-aec53535-7fb3-4765-9082-dc839285d4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-unplugged", "status": "completed", "tag": "f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:27.674529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:27.691316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:27.693221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4f00e9f4-d7b4-426f-8acd-903540c957de req-aec53535-7fb3-4765-9082-dc839285d4f5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:27.695319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4f00e9f4-d7b4-426f-8acd-903540c957de req-aec53535-7fb3-4765-9082-dc839285d4f5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:27.695933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:27.698210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4f00e9f4-d7b4-426f-8acd-903540c957de req-aec53535-7fb3-4765-9082-dc839285d4f5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:27.706338 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b08e087d-a7ac-4f59-ac2b-c10921c11fdd tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.354260 Oct 28 19:26:27.707787 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2011/4039] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:27 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:27.728866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4f00e9f4-d7b4-426f-8acd-903540c957de req-aec53535-7fb3-4765-9082-dc839285d4f5 service nova] Creating event network-vif-unplugged:f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:27.739963 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4f00e9f4-d7b4-426f-8acd-903540c957de req-aec53535-7fb3-4765-9082-dc839285d4f5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083204 Oct 28 19:26:27.743621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2029/4040] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:27.887849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:27.888578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:27.906993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:27.909640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:27.911473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:27.912803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:27.914386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:27.917598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:28.444416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:28.475141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:28.487911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:28.492939 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0a964074-fb4f-482f-a2fa-8e67ee719a99 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2920 microversion: 2.42 time: 0.608181 Oct 28 19:26:28.526719 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2012/4041] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:27 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2920 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:28.673708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2e25090-8eba-4c6b-b3be-97b169f39ade tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769d4820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:28.754378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:28.755194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:28.771818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:28.774930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:28.776454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:28.777330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:28.780744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:28.783318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:28.820186 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2e25090-8eba-4c6b-b3be-97b169f39ade tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.150620 Oct 28 19:26:28.830732 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2030/4042] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:28 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:29.544291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:29.545045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:29.577266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:29.577786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:29.578237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:29.584256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:29.585204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:29.585816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:29.638835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:29.667122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:29.678018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:29.689340 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fdfa9a2-102e-4c76-8a3b-4ce204ecffe6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.937642 Oct 28 19:26:29.691433 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2013/4043] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:28 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:29.847036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4e98a34-0270-4dd4-af6c-c3db5f607847 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d772960d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:30.031942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4e98a34-0270-4dd4-af6c-c3db5f607847 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.192645 Oct 28 19:26:30.032901 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2014/4044] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:29 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:30.077984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-unplugged", "status": "completed", "tag": "28d81463-0059-42be-868c-058c68f736c0"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-unplugged", "status": "completed", "tag": "34895f9e-4c59-4b18-9ec2-caff3e73d280"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-unplugged", "status": "completed", "tag": "9cc771af-ac85-45d1-abee-094430b22ea8"}, {"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-unplugged", "status": "completed", "tag": "d7a208a2-6068-4367-b33a-210bdb57b27d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:30.119970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:30.120695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:30.121348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:30.190531 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Creating event network-vif-unplugged:28d81463-0059-42be-868c-058c68f736c0 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:30.196295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Creating event network-vif-unplugged:34895f9e-4c59-4b18-9ec2-caff3e73d280 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:30.203581 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Creating event network-vif-unplugged:9cc771af-ac85-45d1-abee-094430b22ea8 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:30.207780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] Creating event network-vif-unplugged:d7a208a2-6068-4367-b33a-210bdb57b27d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:30.246103 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a8f9d41c-2e96-4c31-8c0e-10ca5b81adc4 req-0ce208b5-9938-448e-850b-125f175c61b9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.194381 Oct 28 19:26:30.246765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2015/4045] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:30.513537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:30.528249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:30.542405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:30.549835 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aba45ef0-69fb-4d18-ba55-0c76fb5f8ae0 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2920 microversion: 2.42 time: 1.009614 Oct 28 19:26:30.573684 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2031/4046] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:29 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2920 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:30.740282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:30.741015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:30.760910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:30.762126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:30.762929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:30.763861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:30.764556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:30.765235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:30.769669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:31.025582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:31.057136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-41f38179-a956-4cf2-b6cb-7156e15090ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769d4700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:31.059239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:31.066788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:31.075452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-577b69b4-9ad9-42f4-882a-a35103ee2d57 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.339152 Oct 28 19:26:31.132061 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2016/4047] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:30 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:31.183630 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-41f38179-a956-4cf2-b6cb-7156e15090ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.130958 Oct 28 19:26:31.185248 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2032/4048] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:31 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:31.566007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7b7e990e-5521-410a-aca7-822f85d704ab req-e622df3a-6d73-4654-8897-2bd0d94666a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-deleted", "tag": "f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:31.588309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:31.591195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:31.611743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:31.613340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7b7e990e-5521-410a-aca7-822f85d704ab req-e622df3a-6d73-4654-8897-2bd0d94666a2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:31.614080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7b7e990e-5521-410a-aca7-822f85d704ab req-e622df3a-6d73-4654-8897-2bd0d94666a2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:31.614452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:31.614755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7b7e990e-5521-410a-aca7-822f85d704ab req-e622df3a-6d73-4654-8897-2bd0d94666a2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:31.615315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:31.618495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:31.624733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:31.625464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:31.665108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7b7e990e-5521-410a-aca7-822f85d704ab req-e622df3a-6d73-4654-8897-2bd0d94666a2 service nova] Creating event network-vif-deleted:f6be9e7c-3f30-40c5-ae3c-1b07bc0cc46d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:31.702643 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7b7e990e-5521-410a-aca7-822f85d704ab req-e622df3a-6d73-4654-8897-2bd0d94666a2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143915 Oct 28 19:26:31.708154 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2017/4049] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:32.137249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:32.142930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:32.171430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:32.172544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:32.173406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:32.177596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:32.178663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:32.184340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:32.807019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:32.817183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:32.823320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:32.826115 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1815cee2-2807-4d1f-8c12-d9d6d4e94a98 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.699994 Oct 28 19:26:32.828052 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2018/4050] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:32 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:32.838091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac103aaf-af95-45c3-9a30-f8c804c9548e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d772969d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:32.920928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac103aaf-af95-45c3-9a30-f8c804c9548e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.091393 Oct 28 19:26:32.922251 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2019/4051] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:32 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:33.000267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:33.012506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:33.036847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:33.038255 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-723f7b44-9e2d-4367-9e7b-cd06d75abffb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2873 microversion: 2.42 time: 1.454020 Oct 28 19:26:33.038876 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2033/4052] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:31 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2873 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:33.839490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c0b67062-411b-4680-9838-587a5406b92b req-d5fd4c0d-6dab-430e-b6cb-9c33402c6414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-deleted", "tag": "d7a208a2-6068-4367-b33a-210bdb57b27d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:33.858169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:33.859226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:33.873176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.881316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c0b67062-411b-4680-9838-587a5406b92b req-d5fd4c0d-6dab-430e-b6cb-9c33402c6414 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.887501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.889584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.893573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.895655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c0b67062-411b-4680-9838-587a5406b92b req-d5fd4c0d-6dab-430e-b6cb-9c33402c6414 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.897016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.897631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c0b67062-411b-4680-9838-587a5406b92b req-d5fd4c0d-6dab-430e-b6cb-9c33402c6414 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.907473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.954332 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c0b67062-411b-4680-9838-587a5406b92b req-d5fd4c0d-6dab-430e-b6cb-9c33402c6414 service nova] Creating event network-vif-deleted:d7a208a2-6068-4367-b33a-210bdb57b27d for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:34.011100 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c0b67062-411b-4680-9838-587a5406b92b req-d5fd4c0d-6dab-430e-b6cb-9c33402c6414 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166557 Oct 28 19:26:34.012060 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2020/4053] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:34.024606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0495429-64c1-4eba-9be9-4cd6037c0f91 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76b1fee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:34.166311 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0495429-64c1-4eba-9be9-4cd6037c0f91 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.152838 Oct 28 19:26:34.174718 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2021/4054] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:34 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:34.178566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:34.188419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:34.201429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:34.201983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:34.202448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:34.207434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:34.207920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:34.208359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:34.321365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:34.338105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:34.339624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:34.350116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4db32a67-6acb-4bbf-972c-84c6132f1484 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.494937 Oct 28 19:26:34.355017 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2034/4055] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:33 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:35.181449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dbc15621-03a0-46d6-97b7-e3a44945f976 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a368b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:35.288448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dbc15621-03a0-46d6-97b7-e3a44945f976 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.110729 Oct 28 19:26:35.290060 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2035/4056] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:35 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:35.383546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:35.386275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:35.408788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:35.417350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:35.418251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:35.421146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:35.428704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:35.432281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:35.851386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:35.864225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:35.874127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:35.889158 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bfc69f2-84ff-4309-bafe-b7d1b583e9c3 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.509392 Oct 28 19:26:35.896219 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2036/4057] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:35 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:36.117709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c111e56c-e7fc-400d-b587-7512103624d2 req-915045d7-015d-46e5-b38c-6548d79d05e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-deleted", "tag": "28d81463-0059-42be-868c-058c68f736c0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:36.147819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c111e56c-e7fc-400d-b587-7512103624d2 req-915045d7-015d-46e5-b38c-6548d79d05e3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:36.150161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c111e56c-e7fc-400d-b587-7512103624d2 req-915045d7-015d-46e5-b38c-6548d79d05e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:36.152032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c111e56c-e7fc-400d-b587-7512103624d2 req-915045d7-015d-46e5-b38c-6548d79d05e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:36.184571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:36.198933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:36.212112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:36.216594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c111e56c-e7fc-400d-b587-7512103624d2 req-915045d7-015d-46e5-b38c-6548d79d05e3 service nova] Creating event network-vif-deleted:28d81463-0059-42be-868c-058c68f736c0 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:36.237250 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c111e56c-e7fc-400d-b587-7512103624d2 req-915045d7-015d-46e5-b38c-6548d79d05e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123292 Oct 28 19:26:36.243597 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2037/4058] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:26:36.243821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-879bf0d8-990f-4077-b6a3-f85769ee16cb tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2600 microversion: 2.42 time: 2.070842 Oct 28 19:26:36.245057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2022/4059] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:34 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2600 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:36.304926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d5845460-883a-4ffe-b094-3c076a7eb621 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769ce430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:36.400276 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d5845460-883a-4ffe-b094-3c076a7eb621 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.099820 Oct 28 19:26:36.401949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2038/4060] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:36 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:36.931793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:36.932425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:36.948937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:36.949430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:36.964228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:36.965220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:36.965712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:36.966143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:37.273956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:37.274774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:37.307778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:37.308299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:37.308745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:37.309485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:37.309939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:37.310365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:37.798361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:37.809808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:37.835402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:37.840441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fccc1af-1f03-4e3c-b05b-7a421c94ed89 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.913116 Oct 28 19:26:37.847082 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2023/4061] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:36 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:37.868761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea6fde0b-92db-4b94-9c69-65c8c95023f9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7723a8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:37.976656 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea6fde0b-92db-4b94-9c69-65c8c95023f9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.125884 Oct 28 19:26:37.977965 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2024/4062] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:37 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:38.052272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:38.074505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:38.076510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:38.078573 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-248aa74e-2601-4d7e-92dc-025cdf25fc48 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2392 microversion: 2.42 time: 0.808656 Oct 28 19:26:38.079667 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2039/4063] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:37 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2392 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:38.293083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-779490b2-244d-45a0-886e-3e51bd0edf78 req-ae5b41f2-3bd7-4a9d-9549-f075d9501057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-deleted", "tag": "9cc771af-ac85-45d1-abee-094430b22ea8"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:38.342333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-779490b2-244d-45a0-886e-3e51bd0edf78 req-ae5b41f2-3bd7-4a9d-9549-f075d9501057 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:38.343263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-779490b2-244d-45a0-886e-3e51bd0edf78 req-ae5b41f2-3bd7-4a9d-9549-f075d9501057 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:38.346128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-779490b2-244d-45a0-886e-3e51bd0edf78 req-ae5b41f2-3bd7-4a9d-9549-f075d9501057 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:38.377219 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-779490b2-244d-45a0-886e-3e51bd0edf78 req-ae5b41f2-3bd7-4a9d-9549-f075d9501057 service nova] Creating event network-vif-deleted:9cc771af-ac85-45d1-abee-094430b22ea8 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:38.408608 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-779490b2-244d-45a0-886e-3e51bd0edf78 req-ae5b41f2-3bd7-4a9d-9549-f075d9501057 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119468 Oct 28 19:26:38.409727 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2025/4064] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:26:38.458526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:38.459329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:38.484575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:38.486859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:38.487990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:38.493569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:38.499241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:38.499831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:38.876286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:38.877149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:38.891126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:38.891749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:38.892455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:38.895785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:38.896595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:38.900691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:39.110438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:39.125278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:39.127447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:39.128980 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c8c8026-9f09-477a-bd25-716f991ba43f tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.257193 Oct 28 19:26:39.135167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2026/4065] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:38 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:39.140579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9427e37c-683e-4d72-96f1-1e0a981710cb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7c11c550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:39.257647 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9427e37c-683e-4d72-96f1-1e0a981710cb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.120696 Oct 28 19:26:39.263086 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2027/4066] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:39 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:39.273086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:39.273624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:39.292656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:39.294070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:39.294707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:39.295634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:39.296832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:39.297451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:40.448027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:40.457184 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bcaa0316-712e-43d1-ac21-f3afdd4a7d14 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 2.002506 Oct 28 19:26:40.474113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2040/4067] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:38 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:40.501919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:40.503805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:40.538841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:40.541906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:40.542405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:40.547792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:40.549906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:40.550367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:40.666312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:40.702541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:40.714339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:40.715740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27b07355-27e5-4cb2-a68b-8d95be2a6da9 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2234 microversion: 2.42 time: 1.451312 Oct 28 19:26:40.716351 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2028/4068] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:39 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2234 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:40.730047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15d1fb31-ad73-44b3-9cad-cd5053cd07a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d77bc95e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:40.828442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15d1fb31-ad73-44b3-9cad-cd5053cd07a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.103755 Oct 28 19:26:40.830714 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2029/4069] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:40 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:40.846300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:40.858474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:40.884718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:40.888625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:40.891134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:40.893036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:40.895793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:40.896985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:41.132341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:41.141627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:41.162942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:41.164825 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-883144d5-3e8a-4046-96ac-4a1cfbd418a6 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.689296 Oct 28 19:26:41.169239 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2041/4070] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:40 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:41.742762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:41.748357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:41.749092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:41.755205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a2529e26-29be-4495-b244-40114144bdea tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.921325 Oct 28 19:26:41.763022 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2030/4071] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:40 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:41.773994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:41.774526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:41.775004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:41.775758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:41.776218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:41.776647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:41.786918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:41.787557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:41.796877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:41.797552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:41.798324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:41.799222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:41.799950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:41.800527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:42.096382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.144558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.148683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.155549 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e0f3146f-79a5-4f03-a550-1e6cdad2c32e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 2166 microversion: 2.42 time: 0.409972 Oct 28 19:26:42.158468 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2042/4072] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:41 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 2166 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:42.175440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51bbbd7a-df7c-4d89-a923-cbc0a010f480 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7699cc10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:42.290423 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51bbbd7a-df7c-4d89-a923-cbc0a010f480 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.130337 Oct 28 19:26:42.291103 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2043/4073] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:42 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:42.307515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:42.318119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:42.342683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:42.343405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:42.344119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:42.345131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:42.345805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:42.356960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:42.463179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.475525 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a7c73d7-4deb-44a3-a19f-5241fe06fe5c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.693940 Oct 28 19:26:42.486840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2031/4074] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:41 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:42.529054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7fd51a99-52ce-4ed6-b11f-129be8313dce req-9ba2f76d-455a-41e2-90d0-95c47cdef547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ff7a04-9790-42e5-baea-6bd60b3f3003", "name": "network-vif-deleted", "tag": "34895f9e-4c59-4b18-9ec2-caff3e73d280"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:42.577124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7fd51a99-52ce-4ed6-b11f-129be8313dce req-9ba2f76d-455a-41e2-90d0-95c47cdef547 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:42.579915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7fd51a99-52ce-4ed6-b11f-129be8313dce req-9ba2f76d-455a-41e2-90d0-95c47cdef547 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:42.580640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7fd51a99-52ce-4ed6-b11f-129be8313dce req-9ba2f76d-455a-41e2-90d0-95c47cdef547 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:42.658270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7fd51a99-52ce-4ed6-b11f-129be8313dce req-9ba2f76d-455a-41e2-90d0-95c47cdef547 service nova] Creating event network-vif-deleted:34895f9e-4c59-4b18-9ec2-caff3e73d280 for instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 on n-h1-862769-3 Oct 28 19:26:42.679922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7fd51a99-52ce-4ed6-b11f-129be8313dce req-9ba2f76d-455a-41e2-90d0-95c47cdef547 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187863 Oct 28 19:26:42.681643 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2032/4075] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:42.711878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:42.712611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:42.732776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.734368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:42.734900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:42.735364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:42.736043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:42.736490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:42.736905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:42.758062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.765211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:42.769894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7d938955-345f-4dcb-83bf-985c0ccf6728 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1366 microversion: 2.57 time: 0.473161 Oct 28 19:26:42.777609 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2044/4076] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:42 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1366 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:43.094550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:43.104975 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6516e609-642f-4fba-83ce-4c1af3d632ec tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.420263 Oct 28 19:26:43.105572 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2033/4077] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:42 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:43.188793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:43.189648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:43.211825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:43.214473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:43.215896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:43.232213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:43.232700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:43.240434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:43.308651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aaf7f434-250c-4e5a-9cd4-fb1b18211305 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d80094ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:43.424208 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aaf7f434-250c-4e5a-9cd4-fb1b18211305 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.121017 Oct 28 19:26:43.433990 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2034/4078] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:43 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:43.450219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:43.456006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-631800836", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "4e4640cd-261b-42b5-9b7b-42f460667021"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:43.472556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:43.479322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:43.482796 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-859201ac-d880-40cc-87d1-5324018d9a10 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.297973 Oct 28 19:26:43.500574 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2045/4079] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:43 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:43.650377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] validate_networks() for [('4e4640cd-261b-42b5-9b7b-42f460667021', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:26:43.819603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:43.820211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:43.840867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:43.845229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:43.849974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:43.852948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:43.865925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:43.866593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:44.094798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:44.107381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:44.111610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:44.114660 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7c9bb3a-bc36-4722-ba87-a8836df93da0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1384 microversion: 2.57 time: 0.309686 Oct 28 19:26:44.116039 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2046/4080] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:43 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1384 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:44.447422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-598fec8e-6cc6-41a1-9518-c3641d920156 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a36700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:44.572874 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-598fec8e-6cc6-41a1-9518-c3641d920156 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.136301 Oct 28 19:26:44.573485 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2047/4081] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:44 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:44.590137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:44.590841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:44.621168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:44.623795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:44.624426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:44.626133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:44.630681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:44.632585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:45.645423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:45.661563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:45.663333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:45.664868 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-824befcd-772f-446f-96c1-c14e1e4021a5 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 1.090133 Oct 28 19:26:45.686929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2048/4082] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:44 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:45.701240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:45.702275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:45.715706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:45.720339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:45.721302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:45.722969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:45.725798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:45.726446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:45.978518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:45.989846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:45.998654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:46.011346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:46.012674 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba735941-7361-4038-bb12-4048671d16c9 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1372 microversion: 2.57 time: 0.324293 Oct 28 19:26:46.016549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2049/4083] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:45 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1372 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:46.034544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-abe1483a-e5de-407a-aced-8038f2027813 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769a2700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:46.157223 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-abe1483a-e5de-407a-aced-8038f2027813 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.139513 Oct 28 19:26:46.157818 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2050/4084] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:46 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:46.695848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:46.697485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:46.713839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:46.714771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:46.715413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:46.718272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:46.719117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:46.721945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:46.935535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:46.953955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:46.965498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:46.970123 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35ad6422-8a1c-42dc-a91a-f19b51bbf76e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.279131 Oct 28 19:26:46.973673 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2051/4085] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:46 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:47.050118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:26:47.051172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:26:47.052000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:26:47.053423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:26:47.054012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:26:47.062525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:47.064520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:47.095703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.098425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.100120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.108046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.109363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.113620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.119285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.120093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.122097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.126358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.133569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.134745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.212717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:26:47.254993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for user 42f0003698694056b69b98933c84cd8a and project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:26:47.294735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:26:47.308589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:26:47.334370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:47.350530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:47.354684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:47.356527 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f19703d6-5bae-4797-8e5d-76d550ab2060 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1357 microversion: 2.57 time: 0.299344 Oct 28 19:26:47.374728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2052/4086] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:47 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:47.374728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95b60121-6623-4ebb-94f2-502ab7bb2b73 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7699caf0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:47.454907 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95b60121-6623-4ebb-94f2-502ab7bb2b73 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1414 microversion: 2.1 time: 0.093973 Oct 28 19:26:47.455780 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2053/4087] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:47 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:47.460591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:47.464164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:47.467417 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9ab1515c-1a45-4e2d-bfd3-54bb8b4f3d73 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.020527 Oct 28 19:26:47.478400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2035/4088] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:26:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:26:47.481854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.483653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.487488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.488397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.488979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.489846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.490026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4a06af5-c391-4e37-9db7-9dcad1f85979 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:47.503426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4a06af5-c391-4e37-9db7-9dcad1f85979 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:47.559451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:26:47.755777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4a06af5-c391-4e37-9db7-9dcad1f85979 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:47.777310 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4a06af5-c391-4e37-9db7-9dcad1f85979 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1214 microversion: 2.1 time: 0.297378 Oct 28 19:26:47.778814 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2036/4089] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:47 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:47.871857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc25e322-2cb0-45b5-a1d9-676fc9d19c0e tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 204 len: 0 microversion: 2.57 time: 0.411476 Oct 28 19:26:47.883241 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2054/4090] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:26:47 2022] DELETE /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:26:47.893446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:47.895028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:47.911667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.912092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.912522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.928893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.929396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.929939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.013104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:48.013837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:48.032673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:48.033283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:48.066614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.079864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:48.090365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:48.092377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.636936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.646269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.660155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.664712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.671992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.673351 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3664661-0e85-45d3-83e9-6a0fdf0a8c18 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1363 microversion: 2.57 time: 0.785638 Oct 28 19:26:48.687649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.688947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-709665a7-a230-4bac-bb57-3f2477ca4ea7 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.689326 Oct 28 19:26:48.689550 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2055/4091] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:47 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:48.699307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2037/4092] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:47 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1363 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:48.722827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c195133-04a3-4192-80c0-9bdf0343c045 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769d43a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:48.801914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:48.802556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:48.806359 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c195133-04a3-4192-80c0-9bdf0343c045 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1423 microversion: 2.1 time: 0.115248 Oct 28 19:26:48.817222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:48.817755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:48.818211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.818992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:48.819446 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2056/4093] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:48 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1423 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:48.819570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:48.820480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.844506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d6201af-7568-48c0-aa9a-978529c8b11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769ae040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:48.949164 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d6201af-7568-48c0-aa9a-978529c8b11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 200 len: 1423 microversion: 2.1 time: 0.120477 Oct 28 19:26:48.949886 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2057/4094] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:26:48 2022] GET /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:49.014793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:49.043516 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a90e35f-f0de-4090-bb8d-e1cf4462a2b2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1266 microversion: 2.1 time: 0.245684 Oct 28 19:26:49.047177 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2038/4095] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:48 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:49.174066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1788796381", "imageRef": "cb860721-af74-4244-9bf5-3e26f27f18fa", "flavorRef": "452", "networks": [{"uuid": "a2a9fb07-7594-4148-91c4-67cde00ca3a4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:49.199076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:49.295093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] validate_networks() for [('a2a9fb07-7594-4148-91c4-67cde00ca3a4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:26:49.724025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:49.725060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:49.756977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:49.757658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:49.770031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:49.773074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:49.783029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:49.784087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:50.774419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:50.782012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:50.783507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '976fe4767b9c47088e1b6410e9290c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fd41f148e147c89539bb71efce8b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:50.784681 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2de6a862-bc45-4632-87e2-e696780291e0 tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 200 len: 1363 microversion: 2.57 time: 1.068257 Oct 28 19:26:50.808930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2039/4096] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:49 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 1363 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:50.828868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:50.829497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:50.843949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:50.851998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:50.852733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:50.853690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:50.854298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:50.854933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.102479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:51.116781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:51.118312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:51.119618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f9fde25-d8fe-4bb5-aa68-e28a05fa23aa tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.300540 Oct 28 19:26:51.120208 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2040/4097] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:50 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:51.168138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:51.169693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:51.188369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.190304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.190895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.194354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.194974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.195540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.311981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:51.321592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93963af0-6d3a-410a-981c-040322548363 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1272 microversion: 2.1 time: 0.168120 Oct 28 19:26:51.339782 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2041/4098] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:51 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:51.471831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:26:51.472383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:26:51.473144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:26:51.473367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:26:51.474008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:26:51.496516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.498658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.501279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.502285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.503800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.505754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.547167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:26:51.555213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for user 6ea87a8ceb604f0aa3baa5453a3bd434 and project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:26:51.593910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:26:51.601382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb860721-af74-4244-9bf5-3e26f27f18fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:26:51.718396 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5d77f729-0baa-476c-b5b8-950d5670c11e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.550478 Oct 28 19:26:51.720015 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2058/4099] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:26:51.731290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5cfe1c03-12fa-464c-baf7-2b2cbd3396d7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:51.732196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5cfe1c03-12fa-464c-baf7-2b2cbd3396d7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:51.836000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:51.837299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] [instance: e7f0e661-786e-4f9b-9651-93a8f905ab43] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:51.861765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.862491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.862969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.866154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.866860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.867922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.909344 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] HTTP exception thrown: Instance e7f0e661-786e-4f9b-9651-93a8f905ab43 could not be found. Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Request method failure captured: Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 HTTP/1.1 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCzNbpSHfsWJ5piZ0llr-Kz2jva0Vu2rbIbpmEG-BoQEBJP3OYpTYcVFm8xI2tR7qt6DKr7Yw4xCKAxYFZOh77GTW-bX1T6SmsFmZX_iABWnZ858pwUhG55LPpchwEaSEmyRAm5GpyZz7ZjTKLInpT4wPMYGNH_G37PS1OYAMutke-c Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.57 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f0fd41f148e147c89539bb71efce8b4a Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerShowV257Test-700324566 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f0fd41f148e147c89539bb71efce8b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f0fd41f148e147c89539bb71efce8b4a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f0fd41f148e147c89539bb71efce8b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f0fd41f148e147c89539bb71efce8b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerShowV257Test-700324566 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f0fd41f148e147c89539bb71efce8b4a Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerShowV257Test-700324566 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerShowV257Test-700324566-project Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 976fe4767b9c47088e1b6410e9290c27 Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerShowV257Test-700324566-project Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e7f0e661-786e-4f9b-9651-93a8f905ab43 could not be found. Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e7f0e661-786e-4f9b-9651-93a8f905ab43'} Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f0e661-786e-4f9b-9651-93a8f905ab43 could not be found. Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f0e661-786e-4f9b-9651-93a8f905ab43 could not be found. Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:51.913787 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f0e661-786e-4f9b-9651-93a8f905ab43 could not be found. Oct 28 19:26:51.918595 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:26:51.922350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] Returning 404 to user: Instance e7f0e661-786e-4f9b-9651-93a8f905ab43 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:26:51.924992 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3e2f7f54-8520-4b5f-b73f-dc5fac39b2cb tempest-ServerShowV257Test-700324566 tempest-ServerShowV257Test-700324566-project] 10.222.0.44 "GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43" status: 404 len: 111 microversion: 2.57 time: 0.094225 Oct 28 19:26:51.926863 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2059/4100] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:51 2022] GET /compute/v2.1/servers/e7f0e661-786e-4f9b-9651-93a8f905ab43 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:26:51.989110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5cfe1c03-12fa-464c-baf7-2b2cbd3396d7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:52.002554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5cfe1c03-12fa-464c-baf7-2b2cbd3396d7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1208 microversion: 2.1 time: 0.275107 Oct 28 19:26:52.003299 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2042/4101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:51 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1208 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:52.162410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:52.165703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:52.191885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:52.193902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:52.195345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:52.196689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:52.200590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:52.204235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:52.353619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:52.354617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:52.356997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:52.373194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:52.375341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:52.376527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:52.380210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:52.381184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:52.382371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:52.692229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:52.727290 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-13c01124-8f72-49e1-902b-0fe211a02234 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1272 microversion: 2.1 time: 0.378933 Oct 28 19:26:52.752959 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2043/4102] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:52 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1272 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:52.763656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:52.785639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:52.792335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:52.797357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-844ba0d5-14fa-4b81-a4d7-4a78728b457d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.645969 Oct 28 19:26:52.804892 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2060/4103] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:52 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:53.032317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:53.034129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:53.050850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.052807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.053950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.055657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.057037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.057482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.072507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:53.321624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:53.338621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a662531-a501-45a4-a579-4c89c3e737fe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1212 microversion: 2.1 time: 0.311572 Oct 28 19:26:53.343143 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2044/4104] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:53 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1212 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:53.444816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c8fada78-dc71-4f22-8b84-46f103b752cc req-e2f6e170-5d0b-4bad-9450-19e9355d4474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707bc10a-d5db-41f4-b4d2-63e819b35c40", "name": "network-vif-unplugged", "status": "completed", "tag": "679e12c2-4416-4465-a337-bed15e767ca1"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:53.468722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c8fada78-dc71-4f22-8b84-46f103b752cc req-e2f6e170-5d0b-4bad-9450-19e9355d4474 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.471543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c8fada78-dc71-4f22-8b84-46f103b752cc req-e2f6e170-5d0b-4bad-9450-19e9355d4474 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.472298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c8fada78-dc71-4f22-8b84-46f103b752cc req-e2f6e170-5d0b-4bad-9450-19e9355d4474 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.513716 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c8fada78-dc71-4f22-8b84-46f103b752cc req-e2f6e170-5d0b-4bad-9450-19e9355d4474 service nova] Creating event network-vif-unplugged:679e12c2-4416-4465-a337-bed15e767ca1 for instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 on n-h2-862769-3 Oct 28 19:26:53.527042 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c8fada78-dc71-4f22-8b84-46f103b752cc req-e2f6e170-5d0b-4bad-9450-19e9355d4474 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086262 Oct 28 19:26:53.532647 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2061/4105] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:53.762059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:53.762843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:53.777078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.780062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.781429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.782231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.784120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.785125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.838808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:53.839917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:53.853015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.855417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.857640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.859222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.859848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.862303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:54.236458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:54.252260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:54.253911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:54.262783 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24c90b35-b7a1-4f5a-a08b-af807b6a9e0d tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.428591 Oct 28 19:26:54.268601 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2062/4106] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:53 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:54.366901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:54.367724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:54.379305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:54.379793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:54.380230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:54.380920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:54.381369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:54.381790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:54.642613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:54.652684 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6277b872-8a76-49a8-a631-3ad939430189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1266 microversion: 2.1 time: 0.288323 Oct 28 19:26:54.672534 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2063/4107] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:54 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:55.233550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:55.249582 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2d3571d-a11c-458c-8aa3-18e4137309e4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 1.490917 Oct 28 19:26:55.254062 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2045/4108] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:53 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:55.288889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:55.289495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:55.303553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:55.309772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:55.310517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:55.312628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:55.314329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:55.320822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:55.679537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:55.680529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:55.700409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:55.701232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:55.701911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:55.702840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:55.706130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:55.709300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:55.830022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:55.845672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:55.847145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:55.848403 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d63c246f-de7c-4a14-af58-fda98867d400 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.563480 Oct 28 19:26:55.863424 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2064/4109] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:55 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:56.022277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:56.034524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53fd7f44-3836-4ca9-a321-ebd3a47a1559 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1266 microversion: 2.1 time: 0.358087 Oct 28 19:26:56.054526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2046/4110] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:55 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1266 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:56.278001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:56.278970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:56.293526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:56.295036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:56.301670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:56.302670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:56.306445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:56.307137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:56.879334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:56.879945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:56.893234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:56.893929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:56.894522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:56.899834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:56.900686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:56.901271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:57.169619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:57.971844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:57.993787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:58.004733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:58.014511 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa318ca4-5617-4ad4-ae70-2cf2cf14b4e4 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 1.139063 Oct 28 19:26:58.031032 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2047/4111] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:56 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:26:58.039217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:58.040254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:58.048030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:58.048917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:58.049589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:58.050559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:58.051464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:58.052114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:58.645883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:58.659346 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc93a78e-1331-40bf-b470-a57923fb2a42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 2.385835 Oct 28 19:26:58.670043 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2065/4112] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:56 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 2397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:58.732544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:58.773123 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99e77a9f-b82c-4a52-a4b6-cac788f955b9 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1266 microversion: 2.1 time: 0.740375 Oct 28 19:26:58.780516 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2048/4113] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:58 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1266 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:59.042718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:59.044427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:59.064023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.070454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.078991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.085494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.086089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.086554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.350061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:59.383781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:59.390799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:59.392082 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d430ac53-296f-4be3-be37-cd9ab8335f06 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.354172 Oct 28 19:26:59.409387 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2066/4114] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:26:59 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:26:59.697615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:59.698246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:59.746232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.751926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.752968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.756619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.761275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.765298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.806766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:59.807991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:26:59.831449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.837604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.841582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.845302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.845823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.851792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:00.629064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:00.641748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51b97068-0f4b-45e5-9fc4-ec605593f9b1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1266 microversion: 2.1 time: 0.839962 Oct 28 19:27:00.654760 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2067/4115] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:59 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1266 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:00.654760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:00.654760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:00.674310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:00.675122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:00.681476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:00.683926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:00.684572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:00.688885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:00.977793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:00.993322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-331d8ebe-edfa-469a-be18-696d1acb6f1d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 1.300385 Oct 28 19:27:00.998103 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2049/4116] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:59 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:01.017740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:01.035067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:01.036973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:01.038508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-42b2e7de-c581-474f-a850-162626ea976f tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.394772 Oct 28 19:27:01.040545 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2068/4117] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:00 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:01.689455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:01.690870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:01.707291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:01.708015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:01.708698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:01.711130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:01.719904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:01.722032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:01.994100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=10 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:02.026796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:02.028076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:02.039591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:02.042077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:02.059349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:02.064101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:02.066265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:02.067701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:02.070834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:02.074642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:02.277657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:02.297032 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff0e4b39-8d36-44d6-a8fb-7ec910eeaf0e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1266 microversion: 2.1 time: 0.610393 Oct 28 19:27:02.299603 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2050/4118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:01 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1266 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:02.309713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:02.310333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:02.348683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:02.350608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:02.357465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:02.359915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:02.361830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:02.363862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:02.915413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:02.978236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:02.982008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:02.984253 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-773fc418-bfdf-4f66-8e93-60400b5866ee tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.682121 Oct 28 19:27:02.985558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2051/4119] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:02 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:03.327257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:03.329380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:03.377682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:03.391575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:03.392708 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee23f851-f6a2-4666-8cc6-066c27f9c7c1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 1.372362 Oct 28 19:27:03.393324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2069/4120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:02 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:03.396159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:03.399312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:03.401298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:03.413621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:03.414085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:03.935881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d976f0b2-756d-4921-a06b-91ee505472ef req-192be9e2-6480-4fad-be3a-91c68e962d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42007865-5ba7-4202-9c7a-af9eb42578f5", "tag": "df8f3b4d-df8f-455b-9582-7c7a5acae42f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:03.972164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d976f0b2-756d-4921-a06b-91ee505472ef req-192be9e2-6480-4fad-be3a-91c68e962d93 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:03.972652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d976f0b2-756d-4921-a06b-91ee505472ef req-192be9e2-6480-4fad-be3a-91c68e962d93 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:03.973076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d976f0b2-756d-4921-a06b-91ee505472ef req-192be9e2-6480-4fad-be3a-91c68e962d93 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:04.050249 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d976f0b2-756d-4921-a06b-91ee505472ef req-192be9e2-6480-4fad-be3a-91c68e962d93 service nova] Creating event network-changed:df8f3b4d-df8f-455b-9582-7c7a5acae42f for instance 42007865-5ba7-4202-9c7a-af9eb42578f5 on n-h1-862769-3 Oct 28 19:27:04.082860 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d976f0b2-756d-4921-a06b-91ee505472ef req-192be9e2-6480-4fad-be3a-91c68e962d93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152104 Oct 28 19:27:04.089650 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2070/4121] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:27:04.102355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:04.117317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:04.140965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:04.147236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:04.147737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:04.148501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:04.154887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:04.155851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:04.259677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:04.547768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:04.557942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:04.571348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:04.572573 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71af80c8-52d7-4562-92d9-7c0306ba9801 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 1.255002 Oct 28 19:27:04.584439 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2052/4122] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:03 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:04.590176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:04.594222 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa58f811-332b-4f4c-9213-138693fea869 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.496961 Oct 28 19:27:04.597578 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2071/4123] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:04 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:04.624449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:04.625027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:04.642282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:04.642910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:04.643627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:04.644343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:04.644844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:04.645280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:05.600686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:05.604653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:05.617526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:05.625692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:05.626613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:05.627601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:05.629322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:05.632672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:06.111379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:06.140598 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0c59432-9afc-4656-b58b-0553a4628189 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 0.546654 Oct 28 19:27:06.143033 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2072/4124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:05 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:06.157114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:06.165472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:06.189896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:06.191517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:06.193096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:06.194041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:06.195984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:06.199432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:06.428016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:06.460468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:06.470805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:06.479779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85855adc-1869-47b3-95a2-1cf61b964d4a tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.331313 Oct 28 19:27:06.489461 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2073/4125] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:06 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:06.771614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:06.783350 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7cfb441e-9400-400f-9e62-be645bd944ff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 2.196142 Oct 28 19:27:06.789815 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2053/4126] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:04 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:07.198323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:07.214949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:07.277450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:07.277942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:07.278380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:07.299734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:07.303027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:07.304330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:07.519995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:07.521699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:07.549110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:07.549653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:07.550227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:07.564236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:07.564236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:07.564568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:07.816908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:07.843605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:07.851542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:07.852903 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27dbfac1-8feb-4ba2-bedd-ebc09250de34 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.339228 Oct 28 19:27:07.854655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2054/4127] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:07 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:07.865533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:07.871993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:07.894725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:07.895583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:07.900659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:07.907913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:07.911895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:07.912629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:08.841199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:08.852370 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efd54052-fba1-4ad2-9ffb-99f9d55f4756 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 1.686897 Oct 28 19:27:08.860364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2074/4128] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:07 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:08.887102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:08.888572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:08.909882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:08.915433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:08.916969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:08.918029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:08.920930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:08.927448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:09.322126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:09.346591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b7d662c6-c045-49a9-80af-3f91cc329dff tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 1.490684 Oct 28 19:27:09.347952 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2055/4129] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:07 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:09.798346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:09.819089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:09.821565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:09.828762 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d9d62046-3a72-48f5-835f-6e1aca101837 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.947751 Oct 28 19:27:09.832250 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2075/4130] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:08 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:09.883066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:09.883951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:09.895954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:09.904222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:09.906038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:09.906878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:09.907353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:09.907786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:10.379574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:10.380186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:10.394784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:10.395385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:10.395716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:10.405559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:10.411593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:10.412298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:11.777189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:11.795721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c34f976b-070c-49a3-9fca-0803b05ac9ef tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 1.915219 Oct 28 19:27:11.822051 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2056/4131] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:09 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:12.221949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-661969856", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:12.377619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:13.401866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:13.413445 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-013b1d54-c755-41ba-871d-87fb87c62e42 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 3.036170 Oct 28 19:27:13.416163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2076/4132] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:10 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:13.436861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:13.446637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:13.476402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:13.477279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:13.477966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:13.488834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:13.492678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:13.495185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:14.398768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:14.411810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:14.420581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:14.422036 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1fc62916-435b-4575-bea7-9f0ac5e5df5e tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 1.004826 Oct 28 19:27:14.422746 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2077/4133] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:13 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:14.451600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-911dac83-2bd4-4e75-aa25-f55d4004b7b1 req-c8387997-8500-479e-a924-2dbcee4f10e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c152010-7b9e-4d32-87e4-8ebc92783c4b", "tag": "2413d436-3b1c-4da7-a1cb-37c9f9df7c15"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:14.471878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-911dac83-2bd4-4e75-aa25-f55d4004b7b1 req-c8387997-8500-479e-a924-2dbcee4f10e8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:14.482152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-911dac83-2bd4-4e75-aa25-f55d4004b7b1 req-c8387997-8500-479e-a924-2dbcee4f10e8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:14.483055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-911dac83-2bd4-4e75-aa25-f55d4004b7b1 req-c8387997-8500-479e-a924-2dbcee4f10e8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:14.503922 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-911dac83-2bd4-4e75-aa25-f55d4004b7b1 req-c8387997-8500-479e-a924-2dbcee4f10e8 service nova] Creating event network-changed:2413d436-3b1c-4da7-a1cb-37c9f9df7c15 for instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b on n-h2-862769-3 Oct 28 19:27:14.518301 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-911dac83-2bd4-4e75-aa25-f55d4004b7b1 req-c8387997-8500-479e-a924-2dbcee4f10e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094177 Oct 28 19:27:14.519341 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2078/4134] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:14.524772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:14.530486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:14.548130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:14.550682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:14.551417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:14.556131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:14.556923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:14.560814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:15.501164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:15.515041 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-337154e2-d629-4349-ac2e-57bfa4d4967f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 0.994176 Oct 28 19:27:15.517235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:15.518243 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2079/4135] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:14 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:15.535955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:15.536653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:15.538469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:15.551419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:15.559677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:15.563986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:15.601028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:15.601666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:15.604032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:15.604781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:15.604979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:15.605549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:15.608075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:15.608955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:15.610128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:15.615407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:15.622216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:15.630093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:15.714515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:15.723792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:15.742848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:15.745402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:15.887079 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e98374c-d5bc-4650-b8ea-ecdf28fc8b8c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.062820 Oct 28 19:27:15.893317 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2057/4136] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:15.905248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-cede1f3b-f4a6-4ee4-af16-e4d06dcca75d req-644c0763-a372-451b-b3b0-43903c4f0005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42007865-5ba7-4202-9c7a-af9eb42578f5", "name": "network-vif-plugged", "status": "completed", "tag": "df8f3b4d-df8f-455b-9582-7c7a5acae42f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:15.951640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cede1f3b-f4a6-4ee4-af16-e4d06dcca75d req-644c0763-a372-451b-b3b0-43903c4f0005 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:15.952349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cede1f3b-f4a6-4ee4-af16-e4d06dcca75d req-644c0763-a372-451b-b3b0-43903c4f0005 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:15.952856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cede1f3b-f4a6-4ee4-af16-e4d06dcca75d req-644c0763-a372-451b-b3b0-43903c4f0005 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:15.982510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-cede1f3b-f4a6-4ee4-af16-e4d06dcca75d req-644c0763-a372-451b-b3b0-43903c4f0005 service nova] Creating event network-vif-plugged:df8f3b4d-df8f-455b-9582-7c7a5acae42f for instance 42007865-5ba7-4202-9c7a-af9eb42578f5 on n-h1-862769-3 Oct 28 19:27:15.994260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-cede1f3b-f4a6-4ee4-af16-e4d06dcca75d req-644c0763-a372-451b-b3b0-43903c4f0005 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095290 Oct 28 19:27:15.997762 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2058/4137] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:16.017994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:16.019421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:16.037754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:16.038495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:16.040548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:16.042702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:16.043700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:16.046348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:16.246599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:16.259906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:16.269234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:16.270565 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a0ab434-bded-497d-98c4-8049d43abd75 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1604 microversion: 2.42 time: 0.269926 Oct 28 19:27:16.271755 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2059/4138] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:15 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1604 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:16.276410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d403109f-5d8f-4535-857b-728b3add912d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:16.282640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d403109f-5d8f-4535-857b-728b3add912d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:16.441451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d403109f-5d8f-4535-857b-728b3add912d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:16.472809 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d403109f-5d8f-4535-857b-728b3add912d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1192 microversion: 2.1 time: 0.199846 Oct 28 19:27:16.489095 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2060/4139] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:16 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1192 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:16.545669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:16.546378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:16.573426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:16.576246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:16.579587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:16.580625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:16.584511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:16.584968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:17.191335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:17.201095 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ee77e74-28a3-4f3f-9cc6-c695844a90fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 1.681438 Oct 28 19:27:17.207937 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2080/4140] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:15 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:17.376857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8dd91c3-e0c3-40c7-850e-7c8059b0a19c tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] Calling method '.version_select at 0x7f1d769499d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:17.445325 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8dd91c3-e0c3-40c7-850e-7c8059b0a19c tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.235968 Oct 28 19:27:17.446959 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2081/4141] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:27:17 2022] GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c/defaults => generated 371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:17.452103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:17.452923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:17.459622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:17.460118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:17.460695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:17.461600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:17.462207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:17.462822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:17.507098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:17.507961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:17.508552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:17.509846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lazy-loading 'fault' on Instance uuid 44ff7a04-9790-42e5-baea-6bd60b3f3003 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:27:17.575447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:17.609948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:17.618395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de0e0089caf3413f89b608d5a6ac63a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2546fc671294f799bacfc3340e4cb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:17.620928 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b43e191a-decb-476e-a905-a788398cf953 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 200 len: 1371 microversion: 2.42 time: 0.172838 Oct 28 19:27:17.640685 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2082/4142] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:17 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:27:17.658188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4da7bc65-1fc2-489d-b6cd-896a6af97dac tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] Calling method '.version_select at 0x7f1d76949dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:17.762225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:17.767539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4da7bc65-1fc2-489d-b6cd-896a6af97dac tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c" status: 200 len: 371 microversion: 2.1 time: 0.114092 Oct 28 19:27:17.768482 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2083/4143] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:27:17 2022] GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:17.773139 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4f831efc-765b-4123-a4c1-902f1af30591 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 1.232101 Oct 28 19:27:17.776792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:17.777711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:17.784437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:17.785108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:17.785708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:17.787014 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2061/4144] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:16 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:17.787619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:17.788256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:17.788944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:17.792271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62c9234e-de7a-4d1c-a8bf-a15430f78482 tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] Calling method '.version_select at 0x7f1d7ff748b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:17.920136 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62c9234e-de7a-4d1c-a8bf-a15430f78482 tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.131684 Oct 28 19:27:17.921899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2062/4145] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:27:17 2022] GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c/defaults => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:17.938335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fcb442f1-1218-4e61-b6a8-3d21b3dfab89 tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] Calling method '.version_select at 0x7f1d7c177a60>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:17.949597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:17.966072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e7f5a93-d5bd-4df7-8954-1f671a4cd359 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1252 microversion: 2.1 time: 0.196412 Oct 28 19:27:17.970558 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2084/4146] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:17 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:18.036306 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fcb442f1-1218-4e61-b6a8-3d21b3dfab89 tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c" status: 200 len: 371 microversion: 2.1 time: 0.100522 Oct 28 19:27:18.037922 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2063/4147] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 19:27:17 2022] GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:27:18.052436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6c93c4a-782f-4cae-91bf-5055b08e0f4c tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] Calling method '.version_select at 0x7f1d769600d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:18.164666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6c93c4a-782f-4cae-91bf-5055b08e0f4c tempest-QuotasTestJSON-1749159894 tempest-QuotasTestJSON-1749159894-project] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c?user_id=9409101e90084606a34132d642a00953" status: 200 len: 371 microversion: 2.1 time: 0.117191 Oct 28 19:27:18.165260 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2085/4148] 10.222.0.44 () {58 vars in 1323 bytes} [Fri Oct 28 19:27:18 2022] GET /compute/v2.1/os-quota-sets/028d3b45e85a4a94b6764dfcad8ee72c?user_id=9409101e90084606a34132d642a00953 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:18.232341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:18.233205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:18.241194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:18.246820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:18.247473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:18.248311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:18.248782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:18.249207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:18.656128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:18.657386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:18.666333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:18.678142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:18.678941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:18.679856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:18.680620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:18.681200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:18.698212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:18.714495 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] HTTP exception thrown: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:18.715663 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df20ec54-7911-4f10-930b-9201d84a63d5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1314 microversion: 2.1 time: 0.482306 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Request method failure captured: Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 HTTP/1.1 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtjD3vLj9dlmaZk0hTjNhkJLAXKopN255EYJtnhxwrn4pq7zLWI0viaDjm2GVJE5dOC0rRS2qbojGHVX0cZ7FeK-gY68JUklUq2I0wVjkyCQwDDPqrIv7U4S53apIaQvdBtQCaNt2wlQMWtjQmM8bEnavQ8d3BfvqQRd0ek4zrk4WE Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: a2546fc671294f799bacfc3340e4cb8e Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a2546fc671294f799bacfc3340e4cb8e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: a2546fc671294f799bacfc3340e4cb8e Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TaggedBootDevicesTest_v242-1882218753-project Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: de0e0089caf3413f89b608d5a6ac63a7 Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1882218753-project Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '44ff7a04-9790-42e5-baea-6bd60b3f3003'} Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:18.716248 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Returning 404 to user: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:18.720820 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0d534fa0-fe3c-4a1d-b9ad-a6c49f3d5707 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 404 len: 111 microversion: 2.42 time: 0.065795 Oct 28 19:27:18.721684 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2064/4149] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:18 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:18.725523 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2086/4150] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:18 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:27:18.743087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2923379e-4319-4a50-a6b0-f08318dfc08b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '.version_select at 0x7f1d7ff74af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:18.774538 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2923379e-4319-4a50-a6b0-f08318dfc08b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202489765" status: 204 len: 0 microversion: 2.42 time: 0.036543 Oct 28 19:27:18.777004 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2065/4151] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202489765 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:27:18.797296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:18.798302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:18.805248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:18.806166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:18.806882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:18.807788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:18.808455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:18.809085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:18.993364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:18.994142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:19.008201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:19.008913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:19.009489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:19.010365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:19.011009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:19.013311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:19.023216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:19.245144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:19.258939 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef9662b8-7875-4615-b3c5-6f2579487914 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1250 microversion: 2.1 time: 0.268960 Oct 28 19:27:19.260752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2066/4152] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:18 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1250 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:19.311115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:19.332680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-626e6532-72bf-49b3-827f-f78f6a549a2d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 0.540248 Oct 28 19:27:19.351425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2087/4153] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:18 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:19.542931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4e096caa-d8ac-4866-9f2c-1d5df961fea3 req-f752a937-8533-434c-815d-02756829f80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c152010-7b9e-4d32-87e4-8ebc92783c4b", "name": "network-vif-plugged", "status": "completed", "tag": "2413d436-3b1c-4da7-a1cb-37c9f9df7c15"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:19.563618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e096caa-d8ac-4866-9f2c-1d5df961fea3 req-f752a937-8533-434c-815d-02756829f80b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:19.564138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e096caa-d8ac-4866-9f2c-1d5df961fea3 req-f752a937-8533-434c-815d-02756829f80b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:19.564585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e096caa-d8ac-4866-9f2c-1d5df961fea3 req-f752a937-8533-434c-815d-02756829f80b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:19.587228 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4e096caa-d8ac-4866-9f2c-1d5df961fea3 req-f752a937-8533-434c-815d-02756829f80b service nova] Creating event network-vif-plugged:2413d436-3b1c-4da7-a1cb-37c9f9df7c15 for instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b on n-h2-862769-3 Oct 28 19:27:19.599597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4e096caa-d8ac-4866-9f2c-1d5df961fea3 req-f752a937-8533-434c-815d-02756829f80b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060475 Oct 28 19:27:19.600489 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2067/4154] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:19.742182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:19.746553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:19.770167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:19.778748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:19.784057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:19.784666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:19.786887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:19.788522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:19.789234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.241051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:20.255825 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-048147bd-4280-42f2-8616-0e671af2de27 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1501 microversion: 2.1 time: 0.518141 Oct 28 19:27:20.271151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2088/4155] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:19 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1501 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:20.285168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:20.285804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:20.296538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:20.297162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:20.318637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:20.319157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:20.319596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.320313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:20.320767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:20.321192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.334005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:20.334491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:20.335463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.336191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:20.336653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:20.337076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.762168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:20.775984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e6b5c477-9f2a-4d06-b628-8ec58db59758 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1292 microversion: 2.1 time: 0.484963 Oct 28 19:27:20.776965 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2089/4156] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:20 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1292 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:20.785335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:20.797537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:20.804007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:20.804854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:20.805511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.807623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:20.808308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:20.811398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:20.843452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.security_group_api [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Removing security group e99f2c6b-4936-431e-a111-4012aa03abc0 from port df8f3b4d-df8f-455b-9582-7c7a5acae42f Oct 28 19:27:21.915637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:21.925204 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a749833-6202-44a3-b87f-81a37d089274 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1308 microversion: 2.1 time: 1.143728 Oct 28 19:27:21.925790 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2090/4157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:20 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1308 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:22.141224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a62fe0a6-e236-4f37-8298-4b320ae38bb3 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Action: 'create', calling method: .version_select at 0x7f1d76a020d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1035106674"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:22.262316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac7c9fe9-bfb4-4413-b124-a6fddcd31054 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5/action" status: 202 len: 0 microversion: 2.1 time: 1.982915 Oct 28 19:27:22.263774 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2068/4158] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:27:20 2022] POST /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5/action => generated 0 bytes in 1986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:27:22.270295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:22.271275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:22.293440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:22.294250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:22.315065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:22.315894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:22.316378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:22.318964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:22.699457 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a62fe0a6-e236-4f37-8298-4b320ae38bb3 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.762787 Oct 28 19:27:22.700592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2091/4159] 10.222.0.44 () {60 vars in 1155 bytes} [Fri Oct 28 19:27:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 765 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 19:27:22.710985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:22.712040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:22.739221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:22.739912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:22.740486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:22.741367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:22.741975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:22.742534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:22.871442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:22.885188 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e73e3ce-4baf-4fc1-8219-f691ac6325cd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1292 microversion: 2.1 time: 0.617411 Oct 28 19:27:22.891278 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2069/4160] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:22 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1292 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:22.905376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dffd1220-ca11-4199-9415-5be452f5f670 req-05e36b17-f6a6-4af8-a720-ac45a8ff4004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42007865-5ba7-4202-9c7a-af9eb42578f5", "tag": "df8f3b4d-df8f-455b-9582-7c7a5acae42f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:22.922935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:22.937006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dffd1220-ca11-4199-9415-5be452f5f670 req-05e36b17-f6a6-4af8-a720-ac45a8ff4004 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:22.937496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dffd1220-ca11-4199-9415-5be452f5f670 req-05e36b17-f6a6-4af8-a720-ac45a8ff4004 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:22.937919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dffd1220-ca11-4199-9415-5be452f5f670 req-05e36b17-f6a6-4af8-a720-ac45a8ff4004 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:22.967679 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dffd1220-ca11-4199-9415-5be452f5f670 req-05e36b17-f6a6-4af8-a720-ac45a8ff4004 service nova] Creating event network-changed:df8f3b4d-df8f-455b-9582-7c7a5acae42f for instance 42007865-5ba7-4202-9c7a-af9eb42578f5 on n-h1-862769-3 Oct 28 19:27:22.969550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:22.978385 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dffd1220-ca11-4199-9415-5be452f5f670 req-05e36b17-f6a6-4af8-a720-ac45a8ff4004 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083782 Oct 28 19:27:22.981438 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2070/4161] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:22.989585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b4fcb61-2d28-47c9-91bf-b4973acfce06 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76bb7550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:22.990554 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b710111f-6bd5-4d12-8caf-4e72f5548393 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1459 microversion: 2.1 time: 0.288672 Oct 28 19:27:22.993492 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2092/4162] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:22 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1459 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:23.005690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:23.006623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:23.022626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:23.023603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:23.024282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:23.025218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:23.025911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:23.026554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:23.034397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:23.117715 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b4fcb61-2d28-47c9-91bf-b4973acfce06 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 200 len: 345 microversion: 2.1 time: 0.132233 Oct 28 19:27:23.118290 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2071/4163] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:27:22 2022] GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:23.123104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:23.124607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:23.158082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:23.158082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:23.158082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:23.158082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:23.158082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:23.158082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.048372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:24.061121 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d75e1ac6-cd6e-4657-8c19-728b7cdd6b1d tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1487 microversion: 2.1 time: 1.063629 Oct 28 19:27:24.064821 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2093/4164] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:22 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1487 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:24.085793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-78930e8b-ed3b-4f12-b5b0-0caede5ac95b req-379014c8-2ef2-400b-82e1-6a558ec52482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d482530a-34f7-48c7-83d8-490a6ef992a9", "tag": "c99ea8af-90af-4b9e-b581-5b4aebab1949"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:24.107816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-78930e8b-ed3b-4f12-b5b0-0caede5ac95b req-379014c8-2ef2-400b-82e1-6a558ec52482 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.111426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-78930e8b-ed3b-4f12-b5b0-0caede5ac95b req-379014c8-2ef2-400b-82e1-6a558ec52482 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.111871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-78930e8b-ed3b-4f12-b5b0-0caede5ac95b req-379014c8-2ef2-400b-82e1-6a558ec52482 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.139877 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-78930e8b-ed3b-4f12-b5b0-0caede5ac95b req-379014c8-2ef2-400b-82e1-6a558ec52482 service nova] Creating event network-changed:c99ea8af-90af-4b9e-b581-5b4aebab1949 for instance d482530a-34f7-48c7-83d8-490a6ef992a9 on n-h2-862769-3 Oct 28 19:27:24.148984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-78930e8b-ed3b-4f12-b5b0-0caede5ac95b req-379014c8-2ef2-400b-82e1-6a558ec52482 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082460 Oct 28 19:27:24.161687 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2094/4165] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:24.168331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:24.169369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:24.188030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.188569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.189025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.189781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.190241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.190671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.270244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:24.287370 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a305898-bb5b-43a1-8f7f-6da66d2ff2fc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 1.166625 Oct 28 19:27:24.288630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2072/4166] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:23 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:24.331781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:24.344093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:24.353283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.353773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.354212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.354946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.355405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.359986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.419785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:27:24.623527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:24.631541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-36925a21-8130-4279-a0b7-ed3613ea5a4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 204 len: 0 microversion: 2.1 time: 0.314253 Oct 28 19:27:24.632487 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2073/4167] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:27:24 2022] DELETE /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:27:24.637912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ae82f2d-32c2-488b-b730-7e7f974f89dc tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76b1faf0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:24.673902 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3581e74a-5225-49d2-bdea-a4c3abfa90dd tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1292 microversion: 2.1 time: 0.497799 Oct 28 19:27:24.674622 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2095/4168] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:24 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1292 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:24.696400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:24.698601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:24.712222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.712736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.713176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.713902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.714361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.716197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.768417 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ae82f2d-32c2-488b-b730-7e7f974f89dc tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 200 len: 346 microversion: 2.1 time: 0.134512 Oct 28 19:27:24.769201 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2074/4169] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:27:24 2022] GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:24.781664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:24.782588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:24.798219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.799100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.799754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:24.800697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:24.801349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:24.801937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:25.236564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:25.247315 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95dddf33-ea20-41b8-82fb-50829d4c7553 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.561110 Oct 28 19:27:25.252327 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2096/4170] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:24 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:25.268973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:25.273472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb33e6a8-9a27-4006-915d-7324dae7e269 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Action: 'create', calling method: .version_select at 0x7f1d7690f940>, body: {"snapshot": {"volume_id": "2ce3a35c-8c44-4474-b735-d871d8aeff8f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-455427330"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:25.279794 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fda3d05d-1e99-4f6e-8ea0-d0937348fbe0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1493 microversion: 2.1 time: 0.509268 Oct 28 19:27:25.283070 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2075/4171] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:24 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1493 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:25.421191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1376432861", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:25.522033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] validate_networks() for [('36d96f74-08a9-41e6-b957-eb52f0325134', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:25.605861 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb33e6a8-9a27-4006-915d-7324dae7e269 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.343531 Oct 28 19:27:25.606651 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2097/4172] 10.222.0.44 () {60 vars in 1162 bytes} [Fri Oct 28 19:27:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:25.621565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:25.622350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:25.649634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:25.655908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:25.657775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:25.658844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:25.661120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:25.667423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:25.667817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.189280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:26.209280 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-27b10fd9-ef18-40b3-912d-c7710d022309 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.591820 Oct 28 19:27:26.214912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2098/4173] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:25 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:26.246737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-020058f2-6ff9-4465-aa70-577f521afeaf tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d769a2ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:26.261551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:26.261980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:26.262455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:26.262900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:26.263315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:26.274935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:26.275430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:26.275870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.276774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:26.277511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:26.278218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.299121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Getting quotas for project f863f63a99324431a4e9d92e311d2567. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:26.309385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Getting quotas for user 44942f0796ee463b954bb0032470e8fb and project f863f63a99324431a4e9d92e311d2567. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:26.313228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-020058f2-6ff9-4465-aa70-577f521afeaf tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 200 len: 286 microversion: 2.1 time: 0.074818 Oct 28 19:27:26.313957 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2099/4174] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:27:26 2022] GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:26.324791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:26.325549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:26.338217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:26.339125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:26.340079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:26.340767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.341780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:26.344602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:26.345465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:26.346148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.504263 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-61f9acbe-ec87-45d1-b40f-bbf8d522ac4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206254 Oct 28 19:27:26.504845 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2076/4175] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:26.515841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:26.517185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:26.531273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:26.533638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:26.536274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.539284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:26.540309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:26.541595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:26.972905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:26.984413 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f66bb43-74ff-422f-98a8-c481a800acf9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1292 microversion: 2.1 time: 0.663171 Oct 28 19:27:26.988943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2100/4176] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:26 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1292 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:27.001325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:27.002570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:27.017388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:27.017803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:27.024390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:27.025211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:27.027849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:27.035691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:27.089356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:27.099403 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a597ab08-2538-42a7-bb05-1853e40fe0ad tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.593314 Oct 28 19:27:27.116823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2077/4177] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:26 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:27.144034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6cabe2d5-9564-4cc5-acfc-118a824b10b1 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76adeb80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:27.284212 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6cabe2d5-9564-4cc5-acfc-118a824b10b1 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.166004 Oct 28 19:27:27.284943 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2078/4178] 10.222.0.44 () {58 vars in 1140 bytes} [Fri Oct 28 19:27:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:27.289802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7edab260-d65f-4855-9959-32b3dffaa81b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:27.290566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7edab260-d65f-4855-9959-32b3dffaa81b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:28.156708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:28.583270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7edab260-d65f-4855-9959-32b3dffaa81b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:28.592826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7edab260-d65f-4855-9959-32b3dffaa81b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1217 microversion: 2.1 time: 1.306631 Oct 28 19:27:28.596089 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2079/4179] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:27 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1217 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:28.620900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d8a3b3a-808e-45cb-8ff6-7364e0804c08 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76ad7af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:28.741048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d8a3b3a-808e-45cb-8ff6-7364e0804c08 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 200 len: 286 microversion: 2.1 time: 0.143546 Oct 28 19:27:28.742129 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2080/4180] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:27:28 2022] GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:28.748593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-8761759", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "4e4640cd-261b-42b5-9b7b-42f460667021"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:28.924916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] validate_networks() for [('4e4640cd-261b-42b5-9b7b-42f460667021', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:29.359178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:29.373388 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a060f0f-0bd9-4989-8d95-0816b272b3a3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 200 len: 1493 microversion: 2.1 time: 2.381177 Oct 28 19:27:29.373998 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2101/4181] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:26 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 1493 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:29.412649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:29.419371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:29.427707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:29.428541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:29.429259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:29.430930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:29.431594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:29.432354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:30.939574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:30.953583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8487c0e8-9c2e-4065-a551-2c55716513d2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1292 microversion: 2.1 time: 1.562806 Oct 28 19:27:30.955878 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2102/4182] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:29 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1292 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:30.981139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8e462d5e-ff8b-43b1-ae86-b0be56e93d93 req-2d90328a-9baf-4fc0-a73c-842d553e22db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c152010-7b9e-4d32-87e4-8ebc92783c4b", "name": "network-vif-deleted", "tag": "2413d436-3b1c-4da7-a1cb-37c9f9df7c15"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:30.992605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e462d5e-ff8b-43b1-ae86-b0be56e93d93 req-2d90328a-9baf-4fc0-a73c-842d553e22db service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:30.993455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e462d5e-ff8b-43b1-ae86-b0be56e93d93 req-2d90328a-9baf-4fc0-a73c-842d553e22db service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:30.994088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e462d5e-ff8b-43b1-ae86-b0be56e93d93 req-2d90328a-9baf-4fc0-a73c-842d553e22db service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.019504 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8e462d5e-ff8b-43b1-ae86-b0be56e93d93 req-2d90328a-9baf-4fc0-a73c-842d553e22db service nova] Creating event network-vif-deleted:2413d436-3b1c-4da7-a1cb-37c9f9df7c15 for instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b on n-h2-862769-3 Oct 28 19:27:31.025621 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8e462d5e-ff8b-43b1-ae86-b0be56e93d93 req-2d90328a-9baf-4fc0-a73c-842d553e22db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054827 Oct 28 19:27:31.026857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2103/4183] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:31.032888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.033926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:31.041499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.042251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.042932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.044219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.044959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.045569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.057481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:31.057980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:31.058465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:31.058897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:31.059303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:31.089301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.089793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.090228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.090973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.091914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.091914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.145800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:31.152752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Getting quotas for user 42f0003698694056b69b98933c84cd8a and project 488f01035c694382b597fcadb399bccc. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:31.175094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:31.178202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:31.253758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:31.257965 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6935871-4ade-476e-a9a3-024e79c3c2fa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514512 Oct 28 19:27:31.258647 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2081/4184] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:31.262959 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4130edec-6078-4745-8bb1-215d32e41ec0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1275 microversion: 2.1 time: 0.234620 Oct 28 19:27:31.263368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe4e41b2-4063-4b1f-9bd5-00bee4455342 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d77296e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.268188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2104/4185] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:31 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:31.317148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.317767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:31.326434 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe4e41b2-4063-4b1f-9bd5-00bee4455342 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 200 len: 287 microversion: 2.1 time: 0.066605 Oct 28 19:27:31.327063 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2082/4186] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:27:31 2022] GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:31.334413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0ca0e872-3a36-47a7-b0ee-61ee093eeb26 req-727d1a52-f54c-4398-a560-04328d153941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d482530a-34f7-48c7-83d8-490a6ef992a9", "name": "network-vif-plugged", "status": "completed", "tag": "c99ea8af-90af-4b9e-b581-5b4aebab1949"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:31.336129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.336812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.337394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.338538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.339746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.340352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.354710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ca0e872-3a36-47a7-b0ee-61ee093eeb26 req-727d1a52-f54c-4398-a560-04328d153941 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.358815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ca0e872-3a36-47a7-b0ee-61ee093eeb26 req-727d1a52-f54c-4398-a560-04328d153941 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.359285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ca0e872-3a36-47a7-b0ee-61ee093eeb26 req-727d1a52-f54c-4398-a560-04328d153941 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:31.365605 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b HTTP/1.1 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9c152010-7b9e-4d32-87e4-8ebc92783c4b'} Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:31.368666 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:31.372401 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:31.372401 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:31.372401 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:31.372401 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:31.372401 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:27:31.372401 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:31.376375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:31.377973 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f991fe42-519e-49a2-8123-6335a1463515 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 404 len: 111 microversion: 2.1 time: 0.099809 Oct 28 19:27:31.380982 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2105/4187] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:31 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:27:31.383295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0ca0e872-3a36-47a7-b0ee-61ee093eeb26 req-727d1a52-f54c-4398-a560-04328d153941 service nova] Creating event network-vif-plugged:c99ea8af-90af-4b9e-b581-5b4aebab1949 for instance d482530a-34f7-48c7-83d8-490a6ef992a9 on n-h2-862769-3 Oct 28 19:27:31.391800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc848ed6-aad4-4e46-9b56-57b6ceec8bf6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.394500 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0ca0e872-3a36-47a7-b0ee-61ee093eeb26 req-727d1a52-f54c-4398-a560-04328d153941 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065976 Oct 28 19:27:31.395587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc848ed6-aad4-4e46-9b56-57b6ceec8bf6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:31.409054 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2083/4188] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:31.427173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4827bb85-bac8-4340-939f-97c75c35d097 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76ab4b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.574549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cc848ed6-aad4-4e46-9b56-57b6ceec8bf6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:31.589230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc848ed6-aad4-4e46-9b56-57b6ceec8bf6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1212 microversion: 2.1 time: 0.206859 Oct 28 19:27:31.593878 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2106/4189] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:31 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1212 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:31.598788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c5fa874-977e-4c89-8229-540eaf1e3c9c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76927af0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.668470 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4827bb85-bac8-4340-939f-97c75c35d097 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 202 len: 0 microversion: 2.1 time: 0.257989 Oct 28 19:27:31.669349 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2084/4190] 10.222.0.44 () {58 vars in 1254 bytes} [Fri Oct 28 19:27:31 2022] DELETE /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:27:31.677706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c0e2926-d3eb-4167-b2c2-63819894c94f tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d77296ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.755778 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c0e2926-d3eb-4167-b2c2-63819894c94f tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 200 len: 286 microversion: 2.1 time: 0.081769 Oct 28 19:27:31.756946 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2085/4191] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:27:31 2022] GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:27:31.983028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:31.984077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:31.994846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:31.998664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:31.999372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:32.000277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:32.003500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:32.004131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:32.875738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:32.887797 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9be380be-b65c-45e7-b389-9075d7561ca4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1292 microversion: 2.1 time: 0.909304 Oct 28 19:27:32.895081 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2086/4192] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:31 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1292 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:32.900547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:32.909236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:32.923284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:32.923783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:32.924409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:32.925234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:32.925686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:32.926109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:33.072839 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c5fa874-977e-4c89-8229-540eaf1e3c9c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 204 len: 0 microversion: 2.1 time: 1.477681 Oct 28 19:27:33.073510 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2107/4193] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:31 2022] DELETE /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 0 bytes in 1479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:27:33.078943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:33.079563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:33.097614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:33.100034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:33.100725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:33.101317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:33.106826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:33.109145 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0cd16bbf-e06c-41bc-b8ac-64081961645c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1275 microversion: 2.1 time: 0.212619 Oct 28 19:27:33.111412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:33.112724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:33.131051 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2087/4194] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:32 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:33.139879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0dc5c5e-4d31-48e2-8ada-8562dc256515 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76b5c430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:33.212312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0dc5c5e-4d31-48e2-8ada-8562dc256515 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 200 len: 286 microversion: 2.1 time: 0.079568 Oct 28 19:27:33.219027 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2088/4195] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:27:33 2022] GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:33.232049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:33.233932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:33.272621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:33.273526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:33.273975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:33.274770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:33.277846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:33.278246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:33.348649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:27:33.382978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:33.403395 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a72c2a0-da1d-4859-99cd-f7c235b2029d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1264 microversion: 2.1 time: 0.326914 Oct 28 19:27:33.406271 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2108/4196] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:33 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1264 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:33.451576 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bd5c57fe-e58d-48db-a0a5-83f050128b82 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 204 len: 0 microversion: 2.1 time: 0.230307 Oct 28 19:27:33.452282 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2089/4197] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:27:33 2022] DELETE /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:27:33.671139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-458872917", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a2a9fb07-7594-4148-91c4-67cde00ca3a4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:33.771446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] validate_networks() for [('a2a9fb07-7594-4148-91c4-67cde00ca3a4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:33.915736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:33.917630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:33.925656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:33.928372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:33.929397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:33.931070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:33.931728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:33.932966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.368800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:34.384833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e073d566-4dff-4c8e-96ed-d870ce799f1f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1473 microversion: 2.1 time: 0.475607 Oct 28 19:27:34.386047 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2090/4198] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:33 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1473 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:34.393631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:34.394756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:34.415573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:34.415887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:34.417841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.418798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:34.419826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:34.420866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.870246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:34.895791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:34.896784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:34.897399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:34.898648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:34.899311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:34.912049 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d647fa40-7a66-45a7-ba4f-19c38be9123e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.519981 Oct 28 19:27:34.915273 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2091/4199] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:34 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:34.927552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:34.927552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:34.927552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.927552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:34.927552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:34.928051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d076a56e-7131-474e-9928-54e777dc6560 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76b5cf70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:34.928488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.962972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:34.975900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Getting quotas for user 6ea87a8ceb604f0aa3baa5453a3bd434 and project 3ebb5a1d5abd4b3a88ff15a95746b717. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:34.976206 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d076a56e-7131-474e-9928-54e777dc6560 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] HTTP exception thrown: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d076a56e-7131-474e-9928-54e777dc6560 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Request method failure captured: Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 HTTP/1.1 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ZlJH6teuEX2CJSAXN5g9RQgKX7FrcNcRPztsdEPtEpZ2uwEWho_pWuv36-e1hekoSIL84Jd1oNN214-gp7HmaqSiYNxkOBJ3EzkmX1uUwnTOFH1A16UNBVLd6cZ3cgEXt4erPYS1ZVkymXN_hAjZNFH2rtSk-UINUi20LZPZL3PA Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2016bd792c3641479fd425beca6a2a74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3b84c39754eb4cd99f82b8dfbe6c357c Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: exception: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'fbd4fd41-c084-44e6-98cf-e8bfd3b5c221'} Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. (HTTP 404) (Request-ID: req-de01034c-67f9-4ce6-b63b-f1f4df4275ec) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:27:34.984697 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:34.989441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d076a56e-7131-474e-9928-54e777dc6560 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Returning 404 to user: Snapshot fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:34.993833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d076a56e-7131-474e-9928-54e777dc6560 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221" status: 404 len: 111 microversion: 2.1 time: 0.072322 Oct 28 19:27:34.994767 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2092/4200] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 19:27:34 2022] GET /compute/v2.1/os-snapshots/fbd4fd41-c084-44e6-98cf-e8bfd3b5c221 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:27:35.001929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:35.003269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:35.004548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:35.004696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:35.027547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:35.029159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:35.031596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:35.033894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:35.035076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:35.036521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:35.072190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:35.079046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae7aee20-4e53-4e8e-af3f-ab45db258b9a tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412165 Oct 28 19:27:35.079855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2109/4201] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:35.086916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-201755994", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:35.189030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:35.291096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:35.308948 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c536345-3116-42ce-abd5-8225634cdb05 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1282 microversion: 2.1 time: 0.307403 Oct 28 19:27:35.309663 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2093/4202] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:34 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:35.334935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:35.339885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:35.347580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:35.348289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:35.348964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:35.350054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:35.350865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:35.351502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:35.374597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] HTTP exception thrown: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Request method failure captured: Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 HTTP/1.1 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtjD3vLj9dlmaZk0hTjNhkJLAXKopN255EYJtnhxwrn4pq7zLWI0viaDjm2GVJE5dOC0rRS2qbojGHVX0cZ7FeK-gY68JUklUq2I0wVjkyCQwDDPqrIv7U4S53apIaQvdBtQCaNt2wlQMWtjQmM8bEnavQ8d3BfvqQRd0ek4zrk4WE Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: a2546fc671294f799bacfc3340e4cb8e Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a2546fc671294f799bacfc3340e4cb8e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: a2546fc671294f799bacfc3340e4cb8e Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TaggedBootDevicesTest_v242-1882218753-project Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: de0e0089caf3413f89b608d5a6ac63a7 Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1882218753-project Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '44ff7a04-9790-42e5-baea-6bd60b3f3003'} Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:27:35.376653 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Returning 404 to user: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:35.380903 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c64de81f-9026-445f-819f-81ef0444276b tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "DELETE /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 404 len: 111 microversion: 2.42 time: 0.057722 Oct 28 19:27:35.382399 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2094/4203] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:27:35 2022] DELETE /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:27:35.387559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-37376043-a77f-44d1-93f5-4072bd47a45d tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76ad7b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:35.467912 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-37376043-a77f-44d1-93f5-4072bd47a45d tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 202 len: 0 microversion: 2.1 time: 0.084308 Oct 28 19:27:35.472156 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2095/4204] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:27:35 2022] DELETE /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:27:35.480766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73da0655-d9f1-48a4-a66f-658197a555f5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:35.498299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73da0655-d9f1-48a4-a66f-658197a555f5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:36.165006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73da0655-d9f1-48a4-a66f-658197a555f5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:36.179136 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73da0655-d9f1-48a4-a66f-658197a555f5 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1207 microversion: 2.1 time: 0.705060 Oct 28 19:27:36.180654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2096/4205] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:35 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1207 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:36.197200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:36.198730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] [instance: 44ff7a04-9790-42e5-baea-6bd60b3f3003] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:36.208551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.210675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.211735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.213374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.217173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.218536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.238517 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] HTTP exception thrown: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Request method failure captured: Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 HTTP/1.1 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtjD3vLj9dlmaZk0hTjNhkJLAXKopN255EYJtnhxwrn4pq7zLWI0viaDjm2GVJE5dOC0rRS2qbojGHVX0cZ7FeK-gY68JUklUq2I0wVjkyCQwDDPqrIv7U4S53apIaQvdBtQCaNt2wlQMWtjQmM8bEnavQ8d3BfvqQRd0ek4zrk4WE Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: a2546fc671294f799bacfc3340e4cb8e Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a2546fc671294f799bacfc3340e4cb8e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2546fc671294f799bacfc3340e4cb8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: a2546fc671294f799bacfc3340e4cb8e Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1882218753 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TaggedBootDevicesTest_v242-1882218753-project Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: de0e0089caf3413f89b608d5a6ac63a7 Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1882218753-project Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '44ff7a04-9790-42e5-baea-6bd60b3f3003'} Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:36.240782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. Oct 28 19:27:36.244658 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:36.248136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] Returning 404 to user: Instance 44ff7a04-9790-42e5-baea-6bd60b3f3003 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:36.250777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2202b639-e6ef-41fb-be6b-5be22b3516c2 tempest-TaggedBootDevicesTest_v242-1882218753 tempest-TaggedBootDevicesTest_v242-1882218753-project] 10.222.0.44 "GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003" status: 404 len: 111 microversion: 2.42 time: 0.068376 Oct 28 19:27:36.251866 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2097/4206] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:27:36 2022] GET /compute/v2.1/servers/44ff7a04-9790-42e5-baea-6bd60b3f3003 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:27:36.281221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43bc1251-6f66-4bb5-a20a-0566b7c6e3d3 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76ab5b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:36.385338 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43bc1251-6f66-4bb5-a20a-0566b7c6e3d3 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 200 len: 345 microversion: 2.1 time: 0.131272 Oct 28 19:27:36.385929 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2098/4207] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:27:36 2022] GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:36.401586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:36.402424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:36.429973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.430861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.433260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.435372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.439697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.441706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.641392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:36.641900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:36.642293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:36.642724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:36.643149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:36.668702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.669545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.669991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.679802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.680298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.695786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.755323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:36.768616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:36.807573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:36.812663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 45e80111-ba2a-4f61-83be-fac8bc4a9436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:36.902530 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f62bbe24-daba-4020-b5ae-667b04e2ddb5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.819265 Oct 28 19:27:36.905753 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2110/4208] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:36.919711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:36.920714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:36.956801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.957421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.958293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:36.960963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:36.962598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:36.964837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:37.016466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:37.030981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54c1cf43-36d8-41fb-a101-81a00816dc5d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.634578 Oct 28 19:27:37.035351 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2099/4209] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:36 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:37.049805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-80e18a6f-1b95-4837-8699-7ba47ee6c482 req-e62f2210-066e-45a5-ae9f-18cabda87ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:37.077055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-80e18a6f-1b95-4837-8699-7ba47ee6c482 req-e62f2210-066e-45a5-ae9f-18cabda87ee2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:37.077832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-80e18a6f-1b95-4837-8699-7ba47ee6c482 req-e62f2210-066e-45a5-ae9f-18cabda87ee2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:37.078489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-80e18a6f-1b95-4837-8699-7ba47ee6c482 req-e62f2210-066e-45a5-ae9f-18cabda87ee2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:37.104884 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-80e18a6f-1b95-4837-8699-7ba47ee6c482 req-e62f2210-066e-45a5-ae9f-18cabda87ee2 service nova] Creating event network-changed:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:27:37.115692 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-80e18a6f-1b95-4837-8699-7ba47ee6c482 req-e62f2210-066e-45a5-ae9f-18cabda87ee2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079036 Oct 28 19:27:37.121526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2100/4210] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:37.130594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1c7665e-9d7e-458c-9c49-b2c7c373d59e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:37.135769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1c7665e-9d7e-458c-9c49-b2c7c373d59e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 45e80111-ba2a-4f61-83be-fac8bc4a9436] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:37.176709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1c7665e-9d7e-458c-9c49-b2c7c373d59e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 45e80111-ba2a-4f61-83be-fac8bc4a9436] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:27:37.244861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:37.256607 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-afcbb980-da40-4cfd-8797-1d4d622f57e6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1270 microversion: 2.1 time: 0.348540 Oct 28 19:27:37.260097 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2111/4211] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:36 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:37.271396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:37.272319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:37.286992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:37.288365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:37.290723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:37.292463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:37.293200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:37.295106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:37.586142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:37.601363 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2f2cd06-5dea-42e0-a558-5ca1ead6614b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1265 microversion: 2.1 time: 0.339960 Oct 28 19:27:37.601977 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2112/4212] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:37 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:37.618917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23c9d812-2f7a-47a6-bd0b-82de2dbb0fa7 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76cfb040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:37.624417 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1c7665e-9d7e-458c-9c49-b2c7c373d59e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436" status: 204 len: 0 microversion: 2.1 time: 0.501126 Oct 28 19:27:37.628140 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2101/4213] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:27:37 2022] DELETE /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:27:37.641863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2bf57898-9d0e-45c5-abf7-adfbb79b550b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:37.642069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2bf57898-9d0e-45c5-abf7-adfbb79b550b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 45e80111-ba2a-4f61-83be-fac8bc4a9436] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:37.661996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:37.732922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2bf57898-9d0e-45c5-abf7-adfbb79b550b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:27:37.733618 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23c9d812-2f7a-47a6-bd0b-82de2dbb0fa7 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 200 len: 345 microversion: 2.1 time: 0.130577 Oct 28 19:27:37.741720 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2113/4214] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:27:37 2022] GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2bf57898-9d0e-45c5-abf7-adfbb79b550b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 HTTP/1.1 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '45e80111-ba2a-4f61-83be-fac8bc4a9436'} Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:37.741822 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2bf57898-9d0e-45c5-abf7-adfbb79b550b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:37.745463 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2bf57898-9d0e-45c5-abf7-adfbb79b550b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436" status: 404 len: 111 microversion: 2.1 time: 0.111091 Oct 28 19:27:37.753886 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2102/4215] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:37 2022] GET /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:27:37.953679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1656708638", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:38.062943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:38.063576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:38.086609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:38.087521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:38.091572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:38.093165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:38.093954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:38.094541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:38.122317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:38.920213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:38.929161 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a47b41f4-a167-4487-86cc-becdbcb3aa70 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.877265 Oct 28 19:27:38.929749 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2103/4216] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:38 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:39.002644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9e23a9ed-9b24-4b23-a08d-04ae69cc4646 req-fb5c93da-755f-46f4-bcd8-91b618fea294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707bc10a-d5db-41f4-b4d2-63e819b35c40", "name": "network-vif-deleted", "tag": "679e12c2-4416-4465-a337-bed15e767ca1"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:39.045988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9e23a9ed-9b24-4b23-a08d-04ae69cc4646 req-fb5c93da-755f-46f4-bcd8-91b618fea294 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:39.048379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9e23a9ed-9b24-4b23-a08d-04ae69cc4646 req-fb5c93da-755f-46f4-bcd8-91b618fea294 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:39.048834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9e23a9ed-9b24-4b23-a08d-04ae69cc4646 req-fb5c93da-755f-46f4-bcd8-91b618fea294 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:39.156692 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9e23a9ed-9b24-4b23-a08d-04ae69cc4646 req-fb5c93da-755f-46f4-bcd8-91b618fea294 service nova] Creating event network-vif-deleted:679e12c2-4416-4465-a337-bed15e767ca1 for instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 on n-h2-862769-3 Oct 28 19:27:39.181844 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9e23a9ed-9b24-4b23-a08d-04ae69cc4646 req-fb5c93da-755f-46f4-bcd8-91b618fea294 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194314 Oct 28 19:27:39.190578 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2104/4217] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:39.223206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:39.227234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:39.256140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:39.266548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:39.268217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:39.269142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:39.269749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:39.273738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:39.555113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:39.564317 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a46bbea-7e11-419e-8f3d-9db8c37fa02f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.371516 Oct 28 19:27:39.569683 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2105/4218] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:39 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:39.574556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:39.575193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:39.594750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:39.595250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:39.595851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:39.597287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:39.600602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:39.601226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:39.846682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:39.860284 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-063ca39a-13ba-4560-b963-f8c4dba325bc tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1265 microversion: 2.1 time: 0.289401 Oct 28 19:27:39.860897 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2106/4219] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:39 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:39.876942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a49510a-1fe6-4c19-9775-5abd46c55598 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76a7e550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:39.964349 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1a49510a-1fe6-4c19-9775-5abd46c55598 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] HTTP exception thrown: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a49510a-1fe6-4c19-9775-5abd46c55598 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Request method failure captured: Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f HTTP/1.1 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ZlJH6teuEX2CJSAXN5g9RQgKX7FrcNcRPztsdEPtEpZ2uwEWho_pWuv36-e1hekoSIL84Jd1oNN214-gp7HmaqSiYNxkOBJ3EzkmX1uUwnTOFH1A16UNBVLd6cZ3cgEXt4erPYS1ZVkymXN_hAjZNFH2rtSk-UINUi20LZPZL3PA Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2016bd792c3641479fd425beca6a2a74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3b84c39754eb4cd99f82b8dfbe6c357c Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: exception: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2ce3a35c-8c44-4474-b735-d871d8aeff8f'} Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. (HTTP 404) (Request-ID: req-6e58a29d-c04f-469d-9624-c76d1dd552ad) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:27:39.967307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a49510a-1fe6-4c19-9775-5abd46c55598 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Returning 404 to user: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a49510a-1fe6-4c19-9775-5abd46c55598 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 404 len: 109 microversion: 2.1 time: 0.106869 Oct 28 19:27:39.973232 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2107/4220] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:27:39 2022] GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:27:39.983917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:39.985005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:40.007282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.011423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.014381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.015679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.016389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.020405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.054340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:40.054930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:40.055459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:40.055899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:40.056372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:40.080504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.088320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.089188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.090183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.090858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.091838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.129329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:40.135265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:40.155006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:40.157643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:40.236290 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-235c8277-354c-4d02-88c7-1983ef96f73a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.286852 Oct 28 19:27:40.249795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2114/4221] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:40.256508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebb502db-a540-4b8d-8abc-ec9056c526dd tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76989a60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:40.291008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ebb502db-a540-4b8d-8abc-ec9056c526dd tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] HTTP exception thrown: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebb502db-a540-4b8d-8abc-ec9056c526dd tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Request method failure captured: Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f HTTP/1.1 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ZlJH6teuEX2CJSAXN5g9RQgKX7FrcNcRPztsdEPtEpZ2uwEWho_pWuv36-e1hekoSIL84Jd1oNN214-gp7HmaqSiYNxkOBJ3EzkmX1uUwnTOFH1A16UNBVLd6cZ3cgEXt4erPYS1ZVkymXN_hAjZNFH2rtSk-UINUi20LZPZL3PA Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2016bd792c3641479fd425beca6a2a74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3b84c39754eb4cd99f82b8dfbe6c357c Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: exception: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '2ce3a35c-8c44-4474-b735-d871d8aeff8f'} Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. (HTTP 404) (Request-ID: req-f4c04aed-b9d8-4fe2-bb7a-02444a59c215) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:27:40.293131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.297300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebb502db-a540-4b8d-8abc-ec9056c526dd tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Returning 404 to user: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:40.305379 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebb502db-a540-4b8d-8abc-ec9056c526dd tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 404 len: 109 microversion: 2.1 time: 0.044685 Oct 28 19:27:40.311405 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2115/4222] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:27:40 2022] DELETE /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:27:40.322451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a6f99f3-55be-4bc6-8945-ea6faebf2118 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:40.324902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a6f99f3-55be-4bc6-8945-ea6faebf2118 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:40.426987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:40.435440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ae9da38-288d-4c5f-ac94-7a19cfd9759a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.465114 Oct 28 19:27:40.446716 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2108/4223] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:39 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:40.455560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce0ce240-8a8b-4bbc-980b-d6dd0deace12 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Calling method '.version_select at 0x7f1d76ade3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:40.503019 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ce0ce240-8a8b-4bbc-980b-d6dd0deace12 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] HTTP exception thrown: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce0ce240-8a8b-4bbc-980b-d6dd0deace12 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Request method failure captured: Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f HTTP/1.1 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ZlJH6teuEX2CJSAXN5g9RQgKX7FrcNcRPztsdEPtEpZ2uwEWho_pWuv36-e1hekoSIL84Jd1oNN214-gp7HmaqSiYNxkOBJ3EzkmX1uUwnTOFH1A16UNBVLd6cZ3cgEXt4erPYS1ZVkymXN_hAjZNFH2rtSk-UINUi20LZPZL3PA Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2016bd792c3641479fd425beca6a2a74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2016bd792c3641479fd425beca6a2a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 2016bd792c3641479fd425beca6a2a74 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-977629286 Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3b84c39754eb4cd99f82b8dfbe6c357c Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-977629286-project Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: exception: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2ce3a35c-8c44-4474-b735-d871d8aeff8f'} Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. (HTTP 404) (Request-ID: req-2969565c-564f-49c6-abb8-694125f696f4) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:27:40.504986 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce0ce240-8a8b-4bbc-980b-d6dd0deace12 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] Returning 404 to user: Volume 2ce3a35c-8c44-4474-b735-d871d8aeff8f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce0ce240-8a8b-4bbc-980b-d6dd0deace12 tempest-VolumesSnapshotsTestJSON-977629286 tempest-VolumesSnapshotsTestJSON-977629286-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f" status: 404 len: 109 microversion: 2.1 time: 0.068971 Oct 28 19:27:40.508722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2109/4224] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:27:40 2022] GET /compute/v2.1/os-volumes/2ce3a35c-8c44-4474-b735-d871d8aeff8f => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:27:40.560700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a6f99f3-55be-4bc6-8945-ea6faebf2118 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:40.574563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a6f99f3-55be-4bc6-8945-ea6faebf2118 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1221 microversion: 2.1 time: 0.261849 Oct 28 19:27:40.578028 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2116/4225] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:40 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:40.590498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:40.591424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:40.600418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.600916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.601350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.605251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.607133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.607587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.888255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:40.888255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:40.896104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.896593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.897023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:40.897732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:40.898181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:40.898600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:41.089773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:41.098423 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72b33d89-414f-497a-bf36-cea06d372ff7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.514538 Oct 28 19:27:41.099597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2110/4226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:40 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:41.124902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:41.133991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f41b6afd-e67a-443d-a9f8-8099db7f8258 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1265 microversion: 2.1 time: 0.250834 Oct 28 19:27:41.167788 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2117/4227] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:40 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:41.455867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:41.471925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:41.472546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:41.482612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:41.485976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:41.487892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:41.494230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:41.496258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:41.497994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:41.619514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:41.623278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:41.645008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:41.648446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:41.649821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:41.651312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:41.651806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:41.652609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:41.824787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:41.838978 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fade9949-aa78-4a5c-98ae-4cf62c063846 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1273 microversion: 2.1 time: 0.239810 Oct 28 19:27:41.865748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2118/4228] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:41 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:41.914922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:41.925782 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11a3699f-35ae-473d-a423-e179c65dbe1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.470618 Oct 28 19:27:41.941517 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2111/4229] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:41 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:42.126947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:42.128401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:42.137048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.138405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.139360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.140364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.141122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.144898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.192365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:42.193056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:42.211080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.211700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.212311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.217664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.218610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.219127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.496214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:42.507020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a3bc1d9-de4a-43db-80f9-0b9c7a6307e5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.389128 Oct 28 19:27:42.512787 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2119/4230] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:42 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:42.661126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:42.682458 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-86ef7eeb-5cc5-4d43-b140-ceb244ada638 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.494045 Oct 28 19:27:42.685337 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2112/4231] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:42 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:42.871206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:42.871846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:42.889543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.892297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.892821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.900267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.902193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.902660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.953671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:42.954375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:42.964487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.964989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.978761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:42.979853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:42.980406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:42.980856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:43.093133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:43.097343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:43.115002 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07af617c-05ef-4234-bbce-faf65d4352ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1279 microversion: 2.1 time: 0.249947 Oct 28 19:27:43.115635 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2120/4232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:42 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:43.240722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0c6bfdf2-6b71-422e-b880-f80f0e1ca5a5 req-4d0a7915-2a99-4076-b1f7-4f6b75acb0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce09057f-2c6a-44bb-b4ce-944ed126a6fb", "tag": "c302d473-43be-46f4-88db-c8a7067c7497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:43.247842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:43.265876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0c6bfdf2-6b71-422e-b880-f80f0e1ca5a5 req-4d0a7915-2a99-4076-b1f7-4f6b75acb0f2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:43.266423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0c6bfdf2-6b71-422e-b880-f80f0e1ca5a5 req-4d0a7915-2a99-4076-b1f7-4f6b75acb0f2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:43.266807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0c6bfdf2-6b71-422e-b880-f80f0e1ca5a5 req-4d0a7915-2a99-4076-b1f7-4f6b75acb0f2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:43.313191 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0c6bfdf2-6b71-422e-b880-f80f0e1ca5a5 req-4d0a7915-2a99-4076-b1f7-4f6b75acb0f2 service nova] Creating event network-changed:c302d473-43be-46f4-88db-c8a7067c7497 for instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb on n-h2-862769-3 Oct 28 19:27:43.341593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0c6bfdf2-6b71-422e-b880-f80f0e1ca5a5 req-4d0a7915-2a99-4076-b1f7-4f6b75acb0f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104689 Oct 28 19:27:43.342208 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2121/4233] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:27:43.342561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:43.357394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8bcec38-690d-482a-b282-e303a3bb133e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.406791 Oct 28 19:27:43.360021 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2113/4234] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:42 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:43.540506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:43.541131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:43.557456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:43.557951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:43.558382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:43.579122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:43.579634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:43.580077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:43.712151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:43.712764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:43.720952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:43.732187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:43.732638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:43.743940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:43.744941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:43.746102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:44.064209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:44.105291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-998fca19-e644-475f-93e0-179a4e1fee44 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.568414 Oct 28 19:27:44.106620 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2122/4235] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:43 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:44.147771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:44.148697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:44.174491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:44.176259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:44.176840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:44.181992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:44.185494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:44.185900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:44.218904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:44.235162 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0206053a-a059-41e8-b4aa-a2f854e2beeb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.527230 Oct 28 19:27:44.246367 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2114/4236] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:43 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:44.386871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:44.388324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:44.402437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:44.403342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:44.406050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:44.407184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:44.409690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:44.414007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:44.425002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:44.436935 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e52b819-6b40-4827-9e0c-8ea04b9e79d4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1279 microversion: 2.1 time: 0.296278 Oct 28 19:27:44.443370 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2123/4237] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:44 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1279 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:44.613238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-275e58d2-63df-41d9-8e88-8bc1f8cc0163 req-a3aaae24-6918-43e1-9141-543f77d969bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "name": "network-vif-plugged", "status": "completed", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:44.659824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-275e58d2-63df-41d9-8e88-8bc1f8cc0163 req-a3aaae24-6918-43e1-9141-543f77d969bd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:44.669949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-275e58d2-63df-41d9-8e88-8bc1f8cc0163 req-a3aaae24-6918-43e1-9141-543f77d969bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:44.672517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-275e58d2-63df-41d9-8e88-8bc1f8cc0163 req-a3aaae24-6918-43e1-9141-543f77d969bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:44.720473 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-275e58d2-63df-41d9-8e88-8bc1f8cc0163 req-a3aaae24-6918-43e1-9141-543f77d969bd service nova] Creating event network-vif-plugged:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:27:44.739917 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-275e58d2-63df-41d9-8e88-8bc1f8cc0163 req-a3aaae24-6918-43e1-9141-543f77d969bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133125 Oct 28 19:27:44.744703 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2124/4238] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:44.856710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:44.866454 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd301cfc-6d99-4c0c-8170-b1098bbb5aaf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.483776 Oct 28 19:27:44.867082 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2115/4239] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:44 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:45.132671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:45.133682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:45.146451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.147237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.148025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.148898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.149508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.154038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.272613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:45.273573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:45.281447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.288684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.289144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.289904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.290362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.296183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.460908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:45.469910 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-002fa9a7-6a0e-4b1a-9812-831731163fd8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.341649 Oct 28 19:27:45.474098 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2125/4240] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:45 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:45.491988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:45.493312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:45.501177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.502221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.503034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.504634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.505809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.506456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.598948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:45.610409 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65096924-55ec-4e6d-afbf-a400b76f90c4 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.341614 Oct 28 19:27:45.627580 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2116/4241] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:45 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:45.687535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:45.700955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b61c1271-423f-4d29-9399-fd42bbac2d4e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1279 microversion: 2.1 time: 0.222543 Oct 28 19:27:45.703243 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2126/4242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:45 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:45.894840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:45.895652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:45.911033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.917343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.918511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:45.920472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:45.921196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:45.921987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:46.189814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:46.202001 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1edcc749-681f-47b3-9106-f708241fa0e8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1317 microversion: 2.1 time: 0.311883 Oct 28 19:27:46.203520 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2117/4243] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:45 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:46.497170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:46.498086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:46.518315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:46.518972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:46.519511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:46.520337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:46.524756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:46.525337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:46.636385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:46.640110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:46.671865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:46.676883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:46.677394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:46.699155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:46.703667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:46.704176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:46.816319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:46.844222 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cce11dd7-8c0e-40cc-a2e5-4ee9bbf0a6c4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.336286 Oct 28 19:27:46.847133 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2127/4244] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:46 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:46.858379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:46.867526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:46.878393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:46.881908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:46.882642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:46.883644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:46.888410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:46.889144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:47.090408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:47.101619 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f60602be-9f8c-4cdc-9875-6b68aa35e7cf tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.470267 Oct 28 19:27:47.102211 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2118/4245] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:46 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:47.233782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:47.235222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:47.245741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:47.246231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:47.246656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:47.247421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:47.247865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:47.248277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:47.251991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:47.263577 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-19572c52-b824-48ba-a907-82a6f8a65cf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.415181 Oct 28 19:27:47.264400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2128/4246] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:46 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:47.311611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:47.356340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=28 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:47.582938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:47.592429 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03145d0b-eb66-4f57-b567-9bb655104883 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.366369 Oct 28 19:27:47.606720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2119/4247] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:47 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:47.873977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:47.875314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:47.888561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:47.889277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:47.889904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:47.893258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:47.893919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:47.894513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:47.913729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1357656599", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:48.030574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] validate_networks() for [('36d96f74-08a9-41e6-b957-eb52f0325134', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:27:48.335836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:48.347422 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d69f208d-d037-42aa-91d6-4200845f845d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.478270 Oct 28 19:27:48.359185 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2129/4248] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:47 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:48.375961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:48.376585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:48.391029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:48.391528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:48.391974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:48.392683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:48.393138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:48.393557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:48.819889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:48.828434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f2a99186-41f7-458f-9843-b82755268e7e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.461042 Oct 28 19:27:48.843090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2130/4249] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:48 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:48.850256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:48.851140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:48.857637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:48.859505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:48.860624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:48.861886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:48.863264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:48.864575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.087746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:27:49.088908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:27:49.089967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:27:49.090526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:27:49.091202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:27:49.113860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.121338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.121884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.122874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.123361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.123987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.188281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Getting quotas for project f863f63a99324431a4e9d92e311d2567. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:27:49.199639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Getting quotas for user 44942f0796ee463b954bb0032470e8fb and project f863f63a99324431a4e9d92e311d2567. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:27:49.219100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:27:49.223208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:27:49.240794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:49.254018 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bc06c1d-7ace-41c9-a0a8-0966c6c7898a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.409356 Oct 28 19:27:49.256830 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2131/4250] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:48 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:49.303240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2714d522-fbe1-4f39-aedb-6ec8987da240 req-0cb17170-1215-4d71-a0fb-95ec70432724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6e3768-cf94-48fd-9ef7-07d88da0da4b", "tag": "d611d3d9-7d11-4ad3-bbd7-74e3b0fa43cc"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:49.343545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2714d522-fbe1-4f39-aedb-6ec8987da240 req-0cb17170-1215-4d71-a0fb-95ec70432724 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.344029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2714d522-fbe1-4f39-aedb-6ec8987da240 req-0cb17170-1215-4d71-a0fb-95ec70432724 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.344452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2714d522-fbe1-4f39-aedb-6ec8987da240 req-0cb17170-1215-4d71-a0fb-95ec70432724 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.386539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2714d522-fbe1-4f39-aedb-6ec8987da240 req-0cb17170-1215-4d71-a0fb-95ec70432724 service nova] Creating event network-changed:d611d3d9-7d11-4ad3-bbd7-74e3b0fa43cc for instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b on n-h1-862769-3 Oct 28 19:27:49.412260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-631c1c17-2dc8-47a4-ac00-9261658bd43a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502674 Oct 28 19:27:49.413406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2714d522-fbe1-4f39-aedb-6ec8987da240 req-0cb17170-1215-4d71-a0fb-95ec70432724 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151151 Oct 28 19:27:49.414062 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2132/4251] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:49.422180 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2120/4252] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:27:49.435126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:49.436451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59878666-b50f-4621-bc64-f3fd556eb7c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:49.443542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:49.443763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59878666-b50f-4621-bc64-f3fd556eb7c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:49.464391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.467463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.468132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.470714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.471694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.474980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.663969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-59878666-b50f-4621-bc64-f3fd556eb7c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:49.676854 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59878666-b50f-4621-bc64-f3fd556eb7c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1217 microversion: 2.1 time: 0.250040 Oct 28 19:27:49.680107 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2121/4253] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:49 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:49.855866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:49.857022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:49.864810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.865402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.865702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:49.866392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:49.866868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:49.867284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:50.109005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:50.444661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:50.459225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58364d2b-2520-47c9-9d7e-f2cbf07b1ee4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 1.039311 Oct 28 19:27:50.460264 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2133/4254] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:49 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:50.471851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:50.472767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:50.487515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:50.496406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:50.497182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:50.498191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:50.498897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:50.499495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:50.569068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=22 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:51.080477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:51.096282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1f8eb95-3e61-45eb-a3f6-bdf4a65aa806 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 1.242531 Oct 28 19:27:51.097372 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2122/4255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:49 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:51.114757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:51.116232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:51.128002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:51.129845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:51.130560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:51.131451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:51.132052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:51.132621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:51.243849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:51.257685 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-124d95e5-32ef-410a-82ec-0ddd33499c32 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1269 microversion: 2.1 time: 0.158556 Oct 28 19:27:51.258415 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2123/4256] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:51 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:51.305399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:51.314568 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02ed4bc9-f676-4493-96eb-f62a940ac62a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.853057 Oct 28 19:27:51.315805 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2134/4257] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:50 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:51.486075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:51.486800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:51.499789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:51.502452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:51.503425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:51.505924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:51.506567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:51.509236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:51.596253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2cc6509a-c699-4fb5-a5b4-b1dbca945a92 req-76776148-a2f3-47ef-8b88-41079a0b15de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce09057f-2c6a-44bb-b4ce-944ed126a6fb", "name": "network-vif-plugged", "status": "completed", "tag": "c302d473-43be-46f4-88db-c8a7067c7497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:51.630751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2cc6509a-c699-4fb5-a5b4-b1dbca945a92 req-76776148-a2f3-47ef-8b88-41079a0b15de service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:51.631415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2cc6509a-c699-4fb5-a5b4-b1dbca945a92 req-76776148-a2f3-47ef-8b88-41079a0b15de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:51.631793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2cc6509a-c699-4fb5-a5b4-b1dbca945a92 req-76776148-a2f3-47ef-8b88-41079a0b15de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:51.667202 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2cc6509a-c699-4fb5-a5b4-b1dbca945a92 req-76776148-a2f3-47ef-8b88-41079a0b15de service nova] Creating event network-vif-plugged:c302d473-43be-46f4-88db-c8a7067c7497 for instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb on n-h2-862769-3 Oct 28 19:27:51.675857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2cc6509a-c699-4fb5-a5b4-b1dbca945a92 req-76776148-a2f3-47ef-8b88-41079a0b15de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083817 Oct 28 19:27:51.677406 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2135/4258] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:27:52.120256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:52.120953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:52.130592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.131115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.132882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.135191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.136044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.136479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.167176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:52.181601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e190ac69-7039-4822-8f35-13cd18a77b84 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1312 microversion: 2.1 time: 0.699959 Oct 28 19:27:52.182614 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2124/4259] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:51 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1312 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:52.191596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-22b03a28-59ec-47c9-8901-943386b3dd31 req-189acca5-26db-4a25-af6b-108c9dc2ea32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3084f05-651a-4b79-9773-d0f9a63e0677", "tag": "23e14330-80cf-4e48-a360-34f5dabd0abe"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:52.214854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-22b03a28-59ec-47c9-8901-943386b3dd31 req-189acca5-26db-4a25-af6b-108c9dc2ea32 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.215360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-22b03a28-59ec-47c9-8901-943386b3dd31 req-189acca5-26db-4a25-af6b-108c9dc2ea32 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.216050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-22b03a28-59ec-47c9-8901-943386b3dd31 req-189acca5-26db-4a25-af6b-108c9dc2ea32 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.243207 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-22b03a28-59ec-47c9-8901-943386b3dd31 req-189acca5-26db-4a25-af6b-108c9dc2ea32 service nova] Creating event network-changed:23e14330-80cf-4e48-a360-34f5dabd0abe for instance d3084f05-651a-4b79-9773-d0f9a63e0677 on n-h2-862769-3 Oct 28 19:27:52.248854 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-22b03a28-59ec-47c9-8901-943386b3dd31 req-189acca5-26db-4a25-af6b-108c9dc2ea32 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064634 Oct 28 19:27:52.249494 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2125/4260] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:52.300228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:52.301102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:52.310172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.310874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.311553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.312968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.313652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.315176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.427430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:52.441060 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2abed111-f457-41b2-8001-a9897a8876a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1275 microversion: 2.1 time: 0.155756 Oct 28 19:27:52.455227 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2126/4261] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:52 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:52.455227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:52.455227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:52.477223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.477223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.477223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.479143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:52.480420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:52.481388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:52.511794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:52.520616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c22c239f-1d91-429d-9207-82ee3f803653 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.405406 Oct 28 19:27:52.521151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2136/4262] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:52 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:53.096553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:53.105010 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d9d685e-68a1-4948-bfcb-6c5f4399f78a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.661154 Oct 28 19:27:53.114978 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2127/4263] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:52 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:53.211139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:53.212587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:53.223111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.223995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.230218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.231756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.234272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.235240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.470471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:53.480949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:53.494671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.496976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.498652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.501250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.501953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.505580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.706900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:53.718374 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b9f1a02-4f08-41aa-9d52-8e98ff7442f5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1275 microversion: 2.1 time: 0.253395 Oct 28 19:27:53.730051 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2128/4264] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:53 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:53.739863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:53.742788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:53.743381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:53.748477 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94e51a8c-629b-4425-a804-6cfd1d90264c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1498 microversion: 2.1 time: 0.542797 Oct 28 19:27:53.769494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.770387 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2137/4265] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:53 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1498 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:53.771695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.772675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.773568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.778182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:53.781055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:53.782377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.782860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.796845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.799895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.801297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.803218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:53.804802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:53.805919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:53.991687 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ef2da85-29a5-4379-b98b-a08c2867c832 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb/action" status: 202 len: 0 microversion: 2.1 time: 0.218896 Oct 28 19:27:53.995983 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2138/4266] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:27:53 2022] POST /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:27:54.014318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:54.021390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:54.045620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:54.054290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:54.055499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:54.057840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:54.062998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:54.063994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:54.084266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:54.326962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:54.336740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5741e36a-83c6-4a5f-80ed-08fbbfd02f68 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.605493 Oct 28 19:27:54.341820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2129/4267] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:53 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:54.347326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:54.347326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:54.366897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:54.367389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:54.367831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:54.368519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:54.368966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:54.370113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:54.753146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:54.771057 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d083049-94fa-4117-a29e-85ad9624f143 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1503 microversion: 2.1 time: 0.773148 Oct 28 19:27:54.773202 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2139/4268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:53 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1503 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:54.789346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:54.790300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:54.810517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:54.815006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:54.816247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:54.817922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:54.819903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:54.820644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:54.861265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:54.878168 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62c84fd9-384a-41fe-9b04-6c658ddc6867 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.529709 Oct 28 19:27:54.880482 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2130/4269] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:54 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:54.957233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:54.968761 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f5c54313-82c7-4db1-8a55-fdbaf3833b75 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1275 microversion: 2.1 time: 0.194215 Oct 28 19:27:54.969364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2140/4270] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:54 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:55.370448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:55.371136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:55.388861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:55.389368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:55.395401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:55.396438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:55.397693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:55.400929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:55.798125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:55.799896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:55.815266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:55.823528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:55.824406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:55.825804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:55.826573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:55.827187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:56.350604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:56.362524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-36679bca-a850-45dd-ab25-dd38cb96a84f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 1.002582 Oct 28 19:27:56.379261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2131/4271] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:55 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:56.388630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:56.390217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:56.401580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:56.403886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:56.404730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:56.405875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:56.406495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:56.407113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:56.778901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:56.800667 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ce372a1a-9195-47c5-a690-6a375e9482e3 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1483 microversion: 2.1 time: 1.004203 Oct 28 19:27:56.803486 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2141/4272] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:55 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1483 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:56.821966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:56.825984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:56.855168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:56.855684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:56.861450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:56.864310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:56.868516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:56.869046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:56.943401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:56.957009 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a744743-f118-43e1-a41c-20aefd228ab9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.575366 Oct 28 19:27:56.961736 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2132/4273] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:56 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:56.976978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4d32fa03-ff51-46fa-b4f3-7ae740d75939 req-1b5473ca-6f69-49e1-80a0-7aae06cbe893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6e3768-cf94-48fd-9ef7-07d88da0da4b", "name": "network-vif-plugged", "status": "completed", "tag": "d611d3d9-7d11-4ad3-bbd7-74e3b0fa43cc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:57.008537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4d32fa03-ff51-46fa-b4f3-7ae740d75939 req-1b5473ca-6f69-49e1-80a0-7aae06cbe893 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.009031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4d32fa03-ff51-46fa-b4f3-7ae740d75939 req-1b5473ca-6f69-49e1-80a0-7aae06cbe893 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.009460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4d32fa03-ff51-46fa-b4f3-7ae740d75939 req-1b5473ca-6f69-49e1-80a0-7aae06cbe893 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.060990 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4d32fa03-ff51-46fa-b4f3-7ae740d75939 req-1b5473ca-6f69-49e1-80a0-7aae06cbe893 service nova] Creating event network-vif-plugged:d611d3d9-7d11-4ad3-bbd7-74e3b0fa43cc for instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b on n-h1-862769-3 Oct 28 19:27:57.080649 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4d32fa03-ff51-46fa-b4f3-7ae740d75939 req-1b5473ca-6f69-49e1-80a0-7aae06cbe893 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113839 Oct 28 19:27:57.081709 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2133/4274] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:57.095670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:57.100467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:57.116335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.119160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.120518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.122664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.124754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.127378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.197690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lazy-loading 'flavor' on Instance uuid ce09057f-2c6a-44bb-b4ce-944ed126a6fb {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:27:57.300436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:57.321034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3599a168-59fe-4415-82de-2fd39280c9b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 0.513424 Oct 28 19:27:57.322161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2142/4275] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:56 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:57.400601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:57.403208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:57.419599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.424802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.427189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.429226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.430332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.432258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.589612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8b60a25e-290e-4d47-abfc-9775c999cd36 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb/action" status: 202 len: 0 microversion: 2.1 time: 0.504575 Oct 28 19:27:57.591228 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2134/4276] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:27:57 2022] POST /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:27:57.602515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:57.605504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:57.616504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.617470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.618363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.622769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:57.624307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:57.624840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:57.971570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:57.994548 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f10dacef-9ad9-4692-9ba8-7fbd7ce89f4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1307 microversion: 2.1 time: 0.611913 Oct 28 19:27:58.006864 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2143/4277] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:57 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1307 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:58.012232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:58.022355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:58.034486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:58.039903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:58.041693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:58.042534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:58.043395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:58.045176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:58.179593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:58.193088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-324c1be6-411c-4fdd-9940-7a4f276051aa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1489 microversion: 2.1 time: 0.598016 Oct 28 19:27:58.193924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2135/4278] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:57 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1489 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:58.344322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:58.345167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:58.351528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:58.352204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:58.352789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:58.353669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:58.354295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:58.354907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:58.658981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:58.671300 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65a4ffe7-9f01-432f-a8ae-c4741a16e283 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 0.662853 Oct 28 19:27:58.673088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2144/4279] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:58 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:58.782516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4e89c4d5-ae16-405a-84d3-c4d41a772895 req-e5bc5859-d99a-436d-bfcc-1aea22e990c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e536842-38fb-4b72-9bbe-f32123e53811", "tag": "747a8d0f-8f13-48e2-8568-bd7a0b92f2b3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:58.818567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4e89c4d5-ae16-405a-84d3-c4d41a772895 req-e5bc5859-d99a-436d-bfcc-1aea22e990c0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:58.819385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4e89c4d5-ae16-405a-84d3-c4d41a772895 req-e5bc5859-d99a-436d-bfcc-1aea22e990c0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:58.820170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4e89c4d5-ae16-405a-84d3-c4d41a772895 req-e5bc5859-d99a-436d-bfcc-1aea22e990c0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:58.858021 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4e89c4d5-ae16-405a-84d3-c4d41a772895 req-e5bc5859-d99a-436d-bfcc-1aea22e990c0 service nova] Creating event network-changed:747a8d0f-8f13-48e2-8568-bd7a0b92f2b3 for instance 4e536842-38fb-4b72-9bbe-f32123e53811 on n-h1-862769-3 Oct 28 19:27:58.865585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:58.869837 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4e89c4d5-ae16-405a-84d3-c4d41a772895 req-e5bc5859-d99a-436d-bfcc-1aea22e990c0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092402 Oct 28 19:27:58.874792 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2145/4280] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:27:58.883580 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e41824da-a2b9-4356-842c-5a344d8c8d56 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 0.543004 Oct 28 19:27:58.884197 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2136/4281] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:58 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:27:59.034272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:59.035119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:59.050981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:59.051936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:59.052557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:59.053677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:59.054314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:59.054971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:59.126906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-8a2edba2-eb0a-4f43-9e3a-aa3e5ff509c0 req-ab9e6445-ff9e-4c1e-8953-ab0669267e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3084f05-651a-4b79-9773-d0f9a63e0677", "name": "network-vif-plugged", "status": "completed", "tag": "23e14330-80cf-4e48-a360-34f5dabd0abe"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:59.152679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8a2edba2-eb0a-4f43-9e3a-aa3e5ff509c0 req-ab9e6445-ff9e-4c1e-8953-ab0669267e23 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:59.159415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8a2edba2-eb0a-4f43-9e3a-aa3e5ff509c0 req-ab9e6445-ff9e-4c1e-8953-ab0669267e23 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:59.159956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8a2edba2-eb0a-4f43-9e3a-aa3e5ff509c0 req-ab9e6445-ff9e-4c1e-8953-ab0669267e23 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:59.182277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:59.183723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:59.194214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-8a2edba2-eb0a-4f43-9e3a-aa3e5ff509c0 req-ab9e6445-ff9e-4c1e-8953-ab0669267e23 service nova] Creating event network-vif-plugged:23e14330-80cf-4e48-a360-34f5dabd0abe for instance d3084f05-651a-4b79-9773-d0f9a63e0677 on n-h2-862769-3 Oct 28 19:27:59.204549 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-8a2edba2-eb0a-4f43-9e3a-aa3e5ff509c0 req-ab9e6445-ff9e-4c1e-8953-ab0669267e23 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084086 Oct 28 19:27:59.207337 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2137/4282] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:59.229350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:59.235444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:27:59.260200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:59.262564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:59.265835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:59.267232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:59.267864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:59.271526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:59.668638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:59.998712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:00.019044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:00.024389 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94fd0071-1b40-4b4e-b5f3-34e0e5cdf73b tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1510 microversion: 2.1 time: 0.795620 Oct 28 19:28:00.033674 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2138/4283] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:59 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:00.052607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:00.053797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1e7b3ef-32c3-46ac-8408-aa4582f9cec7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1486 microversion: 2.1 time: 1.020395 Oct 28 19:28:00.070446 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2146/4284] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:59 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1486 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:00.081604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:00.093033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:00.093667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:00.108233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:00.108737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:00.109178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:00.109895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:00.110349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:00.110798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:00.114645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:00.116977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:00.117761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:00.124942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:00.130221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:00.131960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:01.028775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:01.040488 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0a40c00-2988-470f-99a1-f4833e930cba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1321 microversion: 2.1 time: 1.000161 Oct 28 19:28:01.041131 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2139/4285] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:00 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1321 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:01.053534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-824582199"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:01.062396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:01.083232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:01.083770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:01.084217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:01.084950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:01.088987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:01.090827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:01.210978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:01.222810 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-838d6a0b-ba4e-4aff-8d71-c55c087a5570 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 1.141417 Oct 28 19:28:01.223696 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2147/4286] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:00 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:01.254799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:01.255436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:01.282873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:01.285571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:01.286050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:01.286812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:01.290070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:01.291267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:01.540602 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fcc0ded5-5fbb-4b95-ab35-468d77c7be87 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "POST /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b/action" status: 202 len: 0 microversion: 2.1 time: 0.496133 Oct 28 19:28:01.541554 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2140/4287] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:01 2022] POST /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:28:01.554509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df7ff740-db7e-4e16-a369-920155355504 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a090d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:01.597104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:01.620471 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fcefb2df-6d2e-43c5-b311-fa4a82877585 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.394961 Oct 28 19:28:01.625179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2148/4288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:01 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:01.700406 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df7ff740-db7e-4e16-a369-920155355504 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7" status: 200 len: 1413 microversion: 2.1 time: 0.151325 Oct 28 19:28:01.701141 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2141/4289] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:28:01 2022] GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:01.717366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a2718f6-607c-4953-b785-d716caf2194f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769d4c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:01.750802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b5f80602-025b-49f1-9d70-be92b96d7504 req-21a614eb-1bec-476f-a602-ac665e12610c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce09057f-2c6a-44bb-b4ce-944ed126a6fb", "name": "network-vif-plugged", "status": "completed", "tag": "c302d473-43be-46f4-88db-c8a7067c7497"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:01.772523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b5f80602-025b-49f1-9d70-be92b96d7504 req-21a614eb-1bec-476f-a602-ac665e12610c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:01.775958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b5f80602-025b-49f1-9d70-be92b96d7504 req-21a614eb-1bec-476f-a602-ac665e12610c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:01.780715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b5f80602-025b-49f1-9d70-be92b96d7504 req-21a614eb-1bec-476f-a602-ac665e12610c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:01.813530 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b5f80602-025b-49f1-9d70-be92b96d7504 req-21a614eb-1bec-476f-a602-ac665e12610c service nova] Creating event network-vif-plugged:c302d473-43be-46f4-88db-c8a7067c7497 for instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb on n-h2-862769-3 Oct 28 19:28:01.831548 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b5f80602-025b-49f1-9d70-be92b96d7504 req-21a614eb-1bec-476f-a602-ac665e12610c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086827 Oct 28 19:28:01.835071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a2718f6-607c-4953-b785-d716caf2194f tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7" status: 200 len: 1413 microversion: 2.1 time: 0.122943 Oct 28 19:28:01.835874 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2149/4290] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:28:01 2022] GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:01.839580 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2142/4291] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:28:01.851133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-abc0aa49-699f-4be1-83fe-363c25294f30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d7693a940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:02.072067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:02.072793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:02.092848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:02.095654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:02.096113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:02.100351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:02.104421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:02.107451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:02.257850 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-abc0aa49-699f-4be1-83fe-363c25294f30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7" status: 204 len: 0 microversion: 2.1 time: 0.410304 Oct 28 19:28:02.259418 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2150/4292] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:01 2022] DELETE /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:02.267937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:02.268684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:02.276786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:02.277841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:02.278514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:02.281140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:02.281884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:02.282491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:02.831074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:02.847130 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f5ae4a47-83af-491a-9137-5077acb50e8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 0.585883 Oct 28 19:28:02.847754 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2151/4293] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:02 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:02.892457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2055f7b5-0122-43f2-9dc6-f32f8925469b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76998c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:02.932279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2055f7b5-0122-43f2-9dc6-f32f8925469b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Image not found. Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2055f7b5-0122-43f2-9dc6-f32f8925469b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 HTTP/1.1 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e503480e-5c96-4969-9179-69a2f98d9df7'} Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e503480e-5c96-4969-9179-69a2f98d9df7 Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:28:02.934762 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e503480e-5c96-4969-9179-69a2f98d9df7 could not be found. Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:28:02.939529 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:02.946731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2055f7b5-0122-43f2-9dc6-f32f8925469b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:02.946731 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2055f7b5-0122-43f2-9dc6-f32f8925469b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7" status: 404 len: 62 microversion: 2.1 time: 0.079974 Oct 28 19:28:02.946731 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2152/4294] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:28:02 2022] GET /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:02.949684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:02.951339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:02.958017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:02.958523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:02.958991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:02.959714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:02.960177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:02.960610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:03.050012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:03.069524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e5083b0-2a2d-4595-8565-a04419535a7e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1503 microversion: 2.1 time: 1.002989 Oct 28 19:28:03.106462 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2143/4295] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:02 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1503 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:03.116467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:03.117100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:03.144767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:03.151613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:03.152427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:03.153543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:03.159580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:03.160374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:03.253806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:03.268116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-60c64248-9bea-4cf7-836b-fcaa96bfb15d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.322029 Oct 28 19:28:03.268726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2153/4296] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:02 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:03.305030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:03.307584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:03.333592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:03.334417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:03.337478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:03.342264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:03.344115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:03.347260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:03.933365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:03.941303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:03.947877 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a5cfcd1-2f1b-418b-b445-5fe39e9350ab tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1503 microversion: 2.1 time: 0.672989 Oct 28 19:28:03.962731 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2154/4297] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:03 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1503 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:03.969456 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07beba13-29b0-4481-9715-dcfd024a0507 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1498 microversion: 2.1 time: 0.859358 Oct 28 19:28:03.970492 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2144/4298] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:03 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1498 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:03.977605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:03.977835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:03.983678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:03.986276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:03.999906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:04.003916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:04.007707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:04.009478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:04.012702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:04.020228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:04.022237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:04.023086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:04.023792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:04.024562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:04.025030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:04.025173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:04.025463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:04.105211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:28:04.380470 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6f4386f-8b6f-44db-8414-7ab36f5a1eba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 204 len: 0 microversion: 2.1 time: 0.406180 Oct 28 19:28:04.389820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2145/4299] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:03 2022] DELETE /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:04.407313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:04.408522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:04.429542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:04.431594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:04.433183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:04.434486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:04.435266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:04.436489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.065693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:05.073851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c17e5f82-8462-40d4-8795-9438ffe59045 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 1.124254 Oct 28 19:28:05.078183 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2155/4300] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:03 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:05.083149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:05.083766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:05.114787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.115295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.115735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.116538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.117019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.117445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.330084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:05.343286 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63c843fb-7b20-4565-aa6c-d29de2bae7ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.947305 Oct 28 19:28:05.344034 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2146/4301] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:04 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:05.360268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:05.361046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:05.385397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.388009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.391484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.396238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.397520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.398433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.629189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:05.638844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15431ad9-305a-4e4a-a2d5-be8dbcd43960 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1509 microversion: 2.1 time: 0.559391 Oct 28 19:28:05.645064 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2156/4302] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:05 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1509 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:05.843593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:05.857462 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c020f63-0a7a-4852-b238-c38f42deeffe tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1504 microversion: 2.1 time: 0.511023 Oct 28 19:28:05.858835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2147/4303] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:05 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:06.104187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:06.113191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:06.145456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.146232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.149759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.150955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.155673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.157361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.373661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:06.374525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:06.433584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.434481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.435200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.436318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.437018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.437642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.535031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:06.569425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2281253-725e-41b9-8a3c-23ea424509ac tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 0.472821 Oct 28 19:28:06.570330 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2157/4304] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:06 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:06.672493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:06.673688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:06.704491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.708820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.710863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.713780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.716868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.718062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.016096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:07.078166 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-367980b5-9c6c-4be3-8a19-845bc1bb324c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.706465 Oct 28 19:28:07.084023 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2148/4305] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:06 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:07.107049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0cf207a0-6924-434b-931e-b0b7e39edc03 req-352d80d5-13e2-4613-8bf2-63bbf6861fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e536842-38fb-4b72-9bbe-f32123e53811", "name": "network-vif-plugged", "status": "completed", "tag": "747a8d0f-8f13-48e2-8568-bd7a0b92f2b3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:07.134481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0cf207a0-6924-434b-931e-b0b7e39edc03 req-352d80d5-13e2-4613-8bf2-63bbf6861fb6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.141119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0cf207a0-6924-434b-931e-b0b7e39edc03 req-352d80d5-13e2-4613-8bf2-63bbf6861fb6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.142094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0cf207a0-6924-434b-931e-b0b7e39edc03 req-352d80d5-13e2-4613-8bf2-63bbf6861fb6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.190513 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0cf207a0-6924-434b-931e-b0b7e39edc03 req-352d80d5-13e2-4613-8bf2-63bbf6861fb6 service nova] Creating event network-vif-plugged:747a8d0f-8f13-48e2-8568-bd7a0b92f2b3 for instance 4e536842-38fb-4b72-9bbe-f32123e53811 on n-h1-862769-3 Oct 28 19:28:07.204001 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0cf207a0-6924-434b-931e-b0b7e39edc03 req-352d80d5-13e2-4613-8bf2-63bbf6861fb6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115631 Oct 28 19:28:07.205569 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2149/4306] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:07.213360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:07.215336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:07.258511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.259242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.261949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.263457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.264034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.264533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.590191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:07.605004 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a59cc44-0d97-4197-94b1-f20e07a42a37 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1509 microversion: 2.1 time: 0.940716 Oct 28 19:28:07.607600 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2158/4307] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:06 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1509 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:07.615161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:07.615870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:07.638751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.640442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.641114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.642370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.646660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.647449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.707920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:08.193137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:08.208807 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f1e0d354-9cb4-486b-b156-c84d7479ea36 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1486 microversion: 2.1 time: 1.001805 Oct 28 19:28:08.213042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:08.251521 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53aaacf0-c944-47d5-824a-a1a659a5060a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 0.632823 Oct 28 19:28:08.255647 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2150/4308] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:07 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1486 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:08.257097 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2159/4309] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:07 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:08.260763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:08.261481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:08.277235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:08.288961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.290097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:08.290982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.294237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.301789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.307164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.315660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.332678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.333191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.333640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.334385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.334894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.335354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.450899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:28:08.644689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:08.667471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f10a2609-d951-4b68-89e7-def33d5f7e0d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.408790 Oct 28 19:28:08.670755 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2151/4310] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:08 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:08.677763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:08.678974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:08.700180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.702646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.704425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.705400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.708098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.708783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.747187 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ac751f8-ba72-480b-bb8c-bfbc6bce7f26 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 204 len: 0 microversion: 2.1 time: 0.486522 Oct 28 19:28:08.750252 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2160/4311] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:08 2022] DELETE /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:08.795992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f054f19f-30b5-4075-bffd-d27505293782 req-18d75fcf-d1bf-45f5-84a3-47c1014b1a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3084f05-651a-4b79-9773-d0f9a63e0677", "name": "network-vif-deleted", "tag": "23e14330-80cf-4e48-a360-34f5dabd0abe"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:08.828925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f054f19f-30b5-4075-bffd-d27505293782 req-18d75fcf-d1bf-45f5-84a3-47c1014b1a4a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.830817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f054f19f-30b5-4075-bffd-d27505293782 req-18d75fcf-d1bf-45f5-84a3-47c1014b1a4a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.831469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f054f19f-30b5-4075-bffd-d27505293782 req-18d75fcf-d1bf-45f5-84a3-47c1014b1a4a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.857755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:08.865388 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f054f19f-30b5-4075-bffd-d27505293782 req-18d75fcf-d1bf-45f5-84a3-47c1014b1a4a service nova] Creating event network-vif-deleted:23e14330-80cf-4e48-a360-34f5dabd0abe for instance d3084f05-651a-4b79-9773-d0f9a63e0677 on n-h2-862769-3 Oct 28 19:28:08.868821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ecb8396-f8b2-420d-a3b3-4e4a23e394cf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 200 len: 1306 microversion: 2.1 time: 0.193941 Oct 28 19:28:08.871282 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2152/4312] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:08 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:08.877405 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f054f19f-30b5-4075-bffd-d27505293782 req-18d75fcf-d1bf-45f5-84a3-47c1014b1a4a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124674 Oct 28 19:28:08.878504 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2161/4313] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:08.884868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-08fc0cef-d3ca-460b-904f-40cdfb6bfafb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76a7e8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:08.931107 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-08fc0cef-d3ca-460b-904f-40cdfb6bfafb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Image not found. Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-08fc0cef-d3ca-460b-904f-40cdfb6bfafb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 HTTP/1.1 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e503480e-5c96-4969-9179-69a2f98d9df7'} Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e503480e-5c96-4969-9179-69a2f98d9df7 to delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e503480e-5c96-4969-9179-69a2f98d9df7 could not be found. Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.933490 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:28:08.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:08.942039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-08fc0cef-d3ca-460b-904f-40cdfb6bfafb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:08.943338 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-08fc0cef-d3ca-460b-904f-40cdfb6bfafb tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7" status: 404 len: 62 microversion: 2.1 time: 0.070818 Oct 28 19:28:08.944530 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2153/4314] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:08 2022] DELETE /compute/v2.1/images/e503480e-5c96-4969-9179-69a2f98d9df7 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:08.955172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:08.955771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:08.978132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.978647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.985873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:08.990772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:08.991448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:08.994250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.128582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:28:09.305163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:09.305944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:09.325919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.333737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.334485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.335999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.336499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.336921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.361027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.compute.api [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Instance is already in deleting state, ignoring this request Oct 28 19:28:09.361878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7cad2e89-3bb4-4f16-a9cb-71a79addfd55 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 204 len: 0 microversion: 2.1 time: 0.412942 Oct 28 19:28:09.373258 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2162/4315] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:08 2022] DELETE /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:09.387943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:09.395358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:09.408519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.412415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.415701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.424758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.442563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.443143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.082039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:10.084758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:10.101561 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5d7e881a-48ad-498f-a431-ed05758e6b4f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1317 microversion: 2.1 time: 0.801082 Oct 28 19:28:10.102359 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2154/4316] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:09 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:10.118508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:10.119376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:10.136891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:10.137590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:10.138181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.139089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:10.139691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:10.140261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.159988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:10.174461 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71660491-45e6-4798-9f51-0179b7d6a66c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1492 microversion: 2.1 time: 0.800014 Oct 28 19:28:10.181098 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2163/4317] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:09 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1492 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:10.186129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:10.195589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:10.213395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:10.216885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:10.217667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.220508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:10.221165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:10.221808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.253972 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 HTTP/1.1 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd3084f05-651a-4b79-9773-d0f9a63e0677'} Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:10.255864 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:10.260322 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:10.260322 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:10.260322 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:10.260322 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:10.260322 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:28:10.260322 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:10.276795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:10.277839 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c92378fa-2c88-42b7-a228-ca54b9aa8a82 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 404 len: 111 microversion: 2.1 time: 0.095552 Oct 28 19:28:10.279063 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2164/4318] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:10 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:10.294726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-17340e5f-e215-4b0f-86d2-af7d3ebcb286 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: .version_select at 0x7f1d7690caf0>, body: {"keypair": {"name": "tempest-key-928124342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnBk+4LHA2UdhF/o22agJwxbOOfABqbUfaBKjpn4Fzy58QTqiElxO5yPVbTFBpY9OD8DTPPkhCkCmFvHpJ0tIyFxjwxAm0r3rhmbFQiyKZimLdET6nli+o1wIWqnIhFRA=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:10.345360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-17340e5f-e215-4b0f-86d2-af7d3ebcb286 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:10.356680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-17340e5f-e215-4b0f-86d2-af7d3ebcb286 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:10.412191 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-17340e5f-e215-4b0f-86d2-af7d3ebcb286 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.122646 Oct 28 19:28:10.413509 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2165/4319] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:28:10 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:10.424912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29ba963d-2872-4b57-bf16-e415b36c898b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '.version_select at 0x7f1d768eda60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:10.430015 n-d-862769-3 devstack@n-api.service[120628]: WARNING oslo_db.sqlalchemy.utils [None req-29ba963d-2872-4b57-bf16-e415b36c898b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 19:28:10.443162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:10.445270 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29ba963d-2872-4b57-bf16-e415b36c898b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.024275 Oct 28 19:28:10.446192 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2166/4320] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:28:10 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:28:10.567403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:10.582495 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9354a608-bb72-459c-ad8f-8f6f93d80809 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.478629 Oct 28 19:28:10.585833 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2155/4321] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:10 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:11.117920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1492576087", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-key-928124342", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:11.127841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:11.128610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:11.138416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:11.139830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:11.144561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:11.147303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:11.148062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:11.149003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:11.260569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:28:12.349616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:12.365025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e8b2f14-7f94-4de5-a82b-05e964a47b50 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1505 microversion: 2.1 time: 1.239455 Oct 28 19:28:12.371022 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2156/4322] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:11 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1505 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:12.376106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:12.380041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:12.394065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:12.399388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:12.400073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:12.401347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:12.402291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:12.402985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:12.638734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:12.650909 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cfee010d-ad04-40e7-9682-e037bfe834e3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1450 microversion: 2.1 time: 0.278414 Oct 28 19:28:12.672851 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2157/4323] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:12 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1450 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:12.678110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:12.679012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:12.686414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:12.687211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:12.687832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:12.688699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:12.689299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:12.691172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.126601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:13.136847 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18294f6f-5a15-43a6-9c1f-d3a56f4ca4f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.462593 Oct 28 19:28:13.151926 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2158/4324] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:12 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:13.151926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:13.151926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:13.152434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:28:13.152871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:28:13.153107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:28:13.153804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:28:13.154364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:28:13.158053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.158754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.159537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.161334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.162171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.162764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.192404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.192898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.193345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.202072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:28:13.207879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.208453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.208896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.318537 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14cd35f3-bc12-41cc-84f0-bc8bc05bf373 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 204 len: 0 microversion: 2.1 time: 0.175442 Oct 28 19:28:13.319465 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2159/4325] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:13 2022] DELETE /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:13.326229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a5182e82-80da-42fd-acf9-8a7047bec9f2 req-1e71fbf9-e986-4f0f-8015-4f2980ac7a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6e3768-cf94-48fd-9ef7-07d88da0da4b", "name": "network-vif-deleted", "tag": "d611d3d9-7d11-4ad3-bbd7-74e3b0fa43cc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:13.333622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:13.337519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5182e82-80da-42fd-acf9-8a7047bec9f2 req-1e71fbf9-e986-4f0f-8015-4f2980ac7a5a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.338077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5182e82-80da-42fd-acf9-8a7047bec9f2 req-1e71fbf9-e986-4f0f-8015-4f2980ac7a5a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.339153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5182e82-80da-42fd-acf9-8a7047bec9f2 req-1e71fbf9-e986-4f0f-8015-4f2980ac7a5a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.352819 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a5182e82-80da-42fd-acf9-8a7047bec9f2 req-1e71fbf9-e986-4f0f-8015-4f2980ac7a5a service nova] Creating event network-vif-deleted:d611d3d9-7d11-4ad3-bbd7-74e3b0fa43cc for instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b on n-h1-862769-3 Oct 28 19:28:13.353501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:13.364487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a5182e82-80da-42fd-acf9-8a7047bec9f2 req-1e71fbf9-e986-4f0f-8015-4f2980ac7a5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043225 Oct 28 19:28:13.371561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2160/4326] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:13.378798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:13.379777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:13.388706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.390003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.390603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.391583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.392179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.392745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.394888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:28:13.397745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:28:13.507751 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87b474f7-475b-46a1-9a44-7347442e7921 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394100 Oct 28 19:28:13.514995 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2167/4327] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:28:13.540674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-39c76563-ad75-419a-bb3d-b3504a09737e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:13.541591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-39c76563-ad75-419a-bb3d-b3504a09737e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:13.798053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-39c76563-ad75-419a-bb3d-b3504a09737e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:13.829701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-39c76563-ad75-419a-bb3d-b3504a09737e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1228 microversion: 2.1 time: 0.306842 Oct 28 19:28:13.848519 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2168/4328] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:13 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1228 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:13.859484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:13.864470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:13.888820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.889452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.890448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.890754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.891176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.891513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.915764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:13.937402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5905cee6-191b-4ab0-9d46-1d3f7db0ae44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1511 microversion: 2.1 time: 0.554939 Oct 28 19:28:13.940333 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2161/4329] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:13 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1511 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:13.968882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.969751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.970634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.971379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lazy-loading 'fault' on Instance uuid aa6e3768-cf94-48fd-9ef7-07d88da0da4b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:28:14.044189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:14.053606 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c3d92e7b-b3b7-4901-b44e-14616e5702b3 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1297 microversion: 2.1 time: 0.203324 Oct 28 19:28:14.056341 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2169/4330] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:13 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1297 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:14.164377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:14.166637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:14.188692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:14.190296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:14.191204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:14.193990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:14.195273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:14.196238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:14.854016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:14.854832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:14.876596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:14.878975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:14.879708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:14.882634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:14.884637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:14.885593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.252561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:15.266864 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4085b459-eed9-4efb-b208-bf8f41edd0fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1232 microversion: 2.1 time: 0.412682 Oct 28 19:28:15.280431 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2170/4331] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:14 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1232 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:15.281256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:15.288967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:15.289166 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0673aebf-8f5a-45e6-9eff-6756d79e8045 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 1.128662 Oct 28 19:28:15.290725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:15.299810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2162/4332] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:14 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:15.312645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.313144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.313583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.314296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.314777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.315197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.319132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:15.328744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:15.346546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.350239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.350809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.352483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.361437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.362041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.490033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.500323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.500926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.501781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lazy-loading 'fault' on Instance uuid aa6e3768-cf94-48fd-9ef7-07d88da0da4b {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:28:15.696103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea87a8ceb604f0aa3baa5453a3bd434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb5a1d5abd4b3a88ff15a95746b717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:15.705077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81755c6f-4bc9-44e7-a11f-e3858da18893 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 200 len: 1297 microversion: 2.1 time: 0.403004 Oct 28 19:28:15.706142 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2163/4333] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:15 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 1297 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:16.296737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:16.298009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:16.311891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.312678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.313312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.318285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.318954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.319530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.659251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:16.679988 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7aee9eb9-1f57-4436-823e-8b62ad70bc60 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1511 microversion: 2.1 time: 1.398256 Oct 28 19:28:16.687230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:16.722160 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f908ff5c-2916-4c39-a367-01dc55787560 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1286 microversion: 2.1 time: 0.432326 Oct 28 19:28:16.725009 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2171/4334] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:15 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1511 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:16.731482 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2164/4335] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:16 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1286 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:16.753280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:16.753932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:16.771752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:16.773651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: aa6e3768-cf94-48fd-9ef7-07d88da0da4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:16.796487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.797266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.797929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.805158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.806016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.807045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.807904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.808581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.815695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.816964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.817729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.818388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.925259 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b could not be found. Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b HTTP/1.1 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b could not be found. Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aa6e3768-cf94-48fd-9ef7-07d88da0da4b'} Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b could not be found. Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b could not be found. Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.950441 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b could not be found. Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance aa6e3768-cf94-48fd-9ef7-07d88da0da4b could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59fdf7c5-eb3d-4b73-8606-a34461783212 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b" status: 404 len: 111 microversion: 2.1 time: 0.213935 Oct 28 19:28:16.955127 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2165/4336] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:16 2022] GET /compute/v2.1/servers/aa6e3768-cf94-48fd-9ef7-07d88da0da4b => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:17.038301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.057176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:17.081882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.082869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.084504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.086078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.087857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.095547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.134315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b HTTP/1.1 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9c152010-7b9e-4d32-87e4-8ebc92783c4b'} Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:17.140983 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.144848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.146628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.147279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a054e80a-11e6-4e55-b590-29c09755a3d0 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 404 len: 111 microversion: 2.1 time: 0.129292 Oct 28 19:28:17.148100 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2166/4337] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:17 2022] DELETE /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:17.161486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.162105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 9c152010-7b9e-4d32-87e4-8ebc92783c4b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:17.189425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.190434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.197418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.199811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.200673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.202635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.252171 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b HTTP/1.1 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9c152010-7b9e-4d32-87e4-8ebc92783c4b'} Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.253710 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 9c152010-7b9e-4d32-87e4-8ebc92783c4b could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-affb5952-2a6e-4787-b568-ea4f4e5031a6 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b" status: 404 len: 111 microversion: 2.1 time: 0.098071 Oct 28 19:28:17.259130 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2167/4338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:17 2022] GET /compute/v2.1/servers/9c152010-7b9e-4d32-87e4-8ebc92783c4b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:17.272980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b491c41-b5e7-46c1-b33f-36f04995709b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76ab5ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.315051 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9b491c41-b5e7-46c1-b33f-36f04995709b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Image not found. Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b491c41-b5e7-46c1-b33f-36f04995709b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa HTTP/1.1 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'cb860721-af74-4244-9bf5-3e26f27f18fa'} Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cb860721-af74-4244-9bf5-3e26f27f18fa to delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb860721-af74-4244-9bf5-3e26f27f18fa could not be found. Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.317476 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b491c41-b5e7-46c1-b33f-36f04995709b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b491c41-b5e7-46c1-b33f-36f04995709b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa" status: 404 len: 62 microversion: 2.1 time: 0.051086 Oct 28 19:28:17.321329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2168/4339] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:17 2022] DELETE /compute/v2.1/images/cb860721-af74-4244-9bf5-3e26f27f18fa => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:17.333705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.334440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:17.373233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.373972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.374623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.375740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.376380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.377063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.448457 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 HTTP/1.1 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '707bc10a-d5db-41f4-b4d2-63e819b35c40'} Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:17.451480 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.456048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75f5e694-9de6-4d55-9f29-4b7f0f0f4b42 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 404 len: 111 microversion: 2.1 time: 0.127904 Oct 28 19:28:17.466222 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2169/4340] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:17 2022] DELETE /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:17.483337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.484289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 707bc10a-d5db-41f4-b4d2-63e819b35c40] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:17.512615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.513843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.514025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.515174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.515881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.519948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.562084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 HTTP/1.1 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '707bc10a-d5db-41f4-b4d2-63e819b35c40'} Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.563649 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.567874 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.567874 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.567874 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.567874 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.567874 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. Oct 28 19:28:17.567874 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.570384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 707bc10a-d5db-41f4-b4d2-63e819b35c40 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.571501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7dc1a36-f18a-4f29-89f7-53cdc401644c tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40" status: 404 len: 111 microversion: 2.1 time: 0.103890 Oct 28 19:28:17.575499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:17.583639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2170/4341] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:17 2022] GET /compute/v2.1/servers/707bc10a-d5db-41f4-b4d2-63e819b35c40 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:17.585465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-edc7cdf8-441b-46e0-ac76-c04813a81369 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.859052 Oct 28 19:28:17.592168 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2172/4342] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:16 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:17.597244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccf890a6-a6b3-4609-8140-18f05e6745f1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d76cfbd30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.661440 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ccf890a6-a6b3-4609-8140-18f05e6745f1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Image not found. Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccf890a6-a6b3-4609-8140-18f05e6745f1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba HTTP/1.1 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e45c6d9a-e055-4c4a-b97f-e215264c01ba'} Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e45c6d9a-e055-4c4a-b97f-e215264c01ba to delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e45c6d9a-e055-4c4a-b97f-e215264c01ba could not be found. Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.665063 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:28:17.669482 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.673903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccf890a6-a6b3-4609-8140-18f05e6745f1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.675377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ccf890a6-a6b3-4609-8140-18f05e6745f1 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba" status: 404 len: 62 microversion: 2.1 time: 0.081930 Oct 28 19:28:17.676176 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2173/4343] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:17 2022] DELETE /compute/v2.1/images/e45c6d9a-e055-4c4a-b97f-e215264c01ba => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:17.690187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.691068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:17.712321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.714673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.715611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.716786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.719089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.721401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.757275 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 HTTP/1.1 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '86ee9cd8-4486-48e8-b0db-5070b46158a7'} Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:17.762220 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:17.769268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:17.772397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-effc5155-9e8d-4dd6-8609-0846821932b7 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 404 len: 111 microversion: 2.1 time: 0.087096 Oct 28 19:28:17.775855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2174/4344] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:17 2022] DELETE /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:28:17.786908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:17.788177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:17.812795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.813772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.816629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.818062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.818797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.819490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.895985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:17.899883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:17.900761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:17.902341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lazy-loading 'fault' on Instance uuid 4e536842-38fb-4b72-9bbe-f32123e53811 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:28:18.124136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-02de655c-5e05-4dab-9862-62e78e156cc2 req-2be27cec-1552-4a17-9b43-dfaab11a823e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e536842-38fb-4b72-9bbe-f32123e53811", "name": "network-vif-deleted", "tag": "747a8d0f-8f13-48e2-8568-bd7a0b92f2b3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:18.164411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-02de655c-5e05-4dab-9862-62e78e156cc2 req-2be27cec-1552-4a17-9b43-dfaab11a823e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.171353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-02de655c-5e05-4dab-9862-62e78e156cc2 req-2be27cec-1552-4a17-9b43-dfaab11a823e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.175244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-02de655c-5e05-4dab-9862-62e78e156cc2 req-2be27cec-1552-4a17-9b43-dfaab11a823e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.244296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:18.258367 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-02de655c-5e05-4dab-9862-62e78e156cc2 req-2be27cec-1552-4a17-9b43-dfaab11a823e service nova] Creating event network-vif-deleted:747a8d0f-8f13-48e2-8568-bd7a0b92f2b3 for instance 4e536842-38fb-4b72-9bbe-f32123e53811 on n-h1-862769-3 Oct 28 19:28:18.261165 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78cbe065-b4cf-4611-82b3-1646da8e98b6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 200 len: 1307 microversion: 2.1 time: 0.482358 Oct 28 19:28:18.265327 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2175/4345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:17 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 1307 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:18.271689 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-02de655c-5e05-4dab-9862-62e78e156cc2 req-2be27cec-1552-4a17-9b43-dfaab11a823e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.683846 Oct 28 19:28:18.274305 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2171/4346] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:18.286830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:18.287921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:18.292029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 86ee9cd8-4486-48e8-b0db-5070b46158a7] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:18.301858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:18.332074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.334651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.335201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.339158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.339326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.343830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.344712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.345204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.345500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.346478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.349523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.353741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.428952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 HTTP/1.1 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '86ee9cd8-4486-48e8-b0db-5070b46158a7'} Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.434806 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.441689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:18.441689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:18.441689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:18.441689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:18.441689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. Oct 28 19:28:18.441689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.455297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 86ee9cd8-4486-48e8-b0db-5070b46158a7 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:18.459860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6df5b568-8526-494a-9616-ae070716ee61 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7" status: 404 len: 111 microversion: 2.1 time: 0.180796 Oct 28 19:28:18.464940 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2172/4347] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:18 2022] GET /compute/v2.1/servers/86ee9cd8-4486-48e8-b0db-5070b46158a7 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:18.481983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b6bdc01-84b3-496c-9244-6ff8be3fd6fd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d769cdb80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:18.585329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2b6bdc01-84b3-496c-9244-6ff8be3fd6fd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Image not found. Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b6bdc01-84b3-496c-9244-6ff8be3fd6fd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 HTTP/1.1 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: exception: Image not found. Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2ebad2d2-27db-4d16-a040-ba39f8836d62'} Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ebad2d2-27db-4d16-a040-ba39f8836d62 to delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ebad2d2-27db-4d16-a040-ba39f8836d62 could not be found. Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.588025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:28:18.593047 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.597507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b6bdc01-84b3-496c-9244-6ff8be3fd6fd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Image not found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:18.599646 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2b6bdc01-84b3-496c-9244-6ff8be3fd6fd tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62" status: 404 len: 62 microversion: 2.1 time: 0.131452 Oct 28 19:28:18.600464 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2173/4348] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:18 2022] DELETE /compute/v2.1/images/2ebad2d2-27db-4d16-a040-ba39f8836d62 => generated 62 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:18.618474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:18.621121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:18.643152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.646012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.648433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.649501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.651536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.656412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.696946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 HTTP/1.1 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5d2b6e84-8310-4924-b1f6-fd2e29466257'} Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:18.704851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:18.709332 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:18.711400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:18.716769 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e957405-03a9-4e25-83c2-272506ed7c4b tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 404 len: 111 microversion: 2.1 time: 0.109398 Oct 28 19:28:18.717967 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2174/4349] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:18 2022] DELETE /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:18.727812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:18.734888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:18.754757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.758386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.758872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:18.760268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:18.763488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:18.764007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.164078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:19.200082 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3351a8c-9835-40af-a755-741ee7f461f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1328 microversion: 2.1 time: 0.926567 Oct 28 19:28:19.201411 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2176/4350] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:18 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1328 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:19.218769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.220309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: 5d2b6e84-8310-4924-b1f6-fd2e29466257] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:19.254587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.266527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.268872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.272467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.275334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.276350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.321617 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 HTTP/1.1 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '5d2b6e84-8310-4924-b1f6-fd2e29466257'} Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.323237 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.327187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance 5d2b6e84-8310-4924-b1f6-fd2e29466257 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:19.328033 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-925a6a66-02cc-4ab6-bb0e-d065b6d60d30 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257" status: 404 len: 111 microversion: 2.1 time: 0.124650 Oct 28 19:28:19.333976 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2177/4351] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:19 2022] GET /compute/v2.1/servers/5d2b6e84-8310-4924-b1f6-fd2e29466257 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:19.339196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.346712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:19.362796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.365666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.366303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.367224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.369697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.371680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.410528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 HTTP/1.1 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '4e536842-38fb-4b72-9bbe-f32123e53811'} Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.451139 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:28:19.458402 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.465469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:19.476758 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8f66134-692c-4d65-adec-09b5dc552d3c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 404 len: 111 microversion: 2.1 time: 0.135345 Oct 28 19:28:19.484750 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2178/4352] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:19 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:19.510073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-492ca98e-ad79-4694-8a50-55b7d514aa2e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '.version_select at 0x7f1d773acdc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.559005 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-492ca98e-ad79-4694-8a50-55b7d514aa2e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Image not found. Oct 28 19:28:19.561431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-492ca98e-ad79-4694-8a50-55b7d514aa2e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 HTTP/1.1 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1b1f7233-4edb-4aa6-9a14-c8cf8705b905'} Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b1f7233-4edb-4aa6-9a14-c8cf8705b905 to delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b1f7233-4edb-4aa6-9a14-c8cf8705b905 could not be found. Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.562212 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-492ca98e-ad79-4694-8a50-55b7d514aa2e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-492ca98e-ad79-4694-8a50-55b7d514aa2e tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905" status: 404 len: 62 microversion: 2.1 time: 0.077260 Oct 28 19:28:19.576609 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2179/4353] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:19 2022] DELETE /compute/v2.1/images/1b1f7233-4edb-4aa6-9a14-c8cf8705b905 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:19.582068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.582068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:19.599752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e3b0f2f-93a7-41a7-bba0-3cc90b6ae242 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.880083 Oct 28 19:28:19.601149 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2175/4354] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:18 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:19.609794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.611065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:19.619795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.620067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.620898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.624311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.626590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.628829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.643223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.648990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.651472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.655895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.659208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.662644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.756867 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df HTTP/1.1 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a50e570b-bb24-4bfa-9833-94f0f24d31df'} Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:19.767855 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.779573 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.788154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:19.790141 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8985a6bc-0a62-4d61-a611-500bbfc48c66 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 404 len: 111 microversion: 2.1 time: 0.187187 Oct 28 19:28:19.796779 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2176/4355] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:19 2022] DELETE /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:19.810722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.812503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] [instance: a50e570b-bb24-4bfa-9833-94f0f24d31df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:19.835762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.836393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.838397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.860748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:19.861356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:19.861801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:19.933694 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] HTTP exception thrown: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Request method failure captured: Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df HTTP/1.1 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCwTX8D6WHJvP7RwiAs6Aru14AY8aClqLnPcGD4hGLkiDAx6S2Je1eoeNSJhhrXP-oYCnvHuKvIPySiBmdoo0GfGsZFKxTJzyQmnxtOjb8bP2Ju6SNU6_Hzymlga_N4cNNHpDxDXbIyuFqRxBJ4-8099pyZv9HzNszkAOgY2orDv71E Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebb5a1d5abd4b3a88ff15a95746b717", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebb5a1d5abd4b3a88ff15a95746b717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 3ebb5a1d5abd4b3a88ff15a95746b717 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ImagesTestJSON-1524469335 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6ea87a8ceb604f0aa3baa5453a3bd434 Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ImagesTestJSON-1524469335-project Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a50e570b-bb24-4bfa-9833-94f0f24d31df'} Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.935523 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:19.939671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] Returning 404 to user: Instance a50e570b-bb24-4bfa-9833-94f0f24d31df could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:19.941565 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fd8af7c-8301-4c68-9421-63e78574a971 tempest-ImagesTestJSON-1524469335 tempest-ImagesTestJSON-1524469335-project] 10.222.0.44 "GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df" status: 404 len: 111 microversion: 2.1 time: 0.140306 Oct 28 19:28:19.947291 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2177/4356] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:19 2022] GET /compute/v2.1/servers/a50e570b-bb24-4bfa-9833-94f0f24d31df => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:20.572877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:20.592274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1417006907", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:20.603899 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c2e4abd5-fb78-4bde-8236-0763893d0858 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.031759 Oct 28 19:28:20.618589 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2180/4357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:19 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:20.632891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:20.633532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:20.660302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:20.660848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:20.665572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:20.671359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:20.673603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:20.674212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:20.703382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:28:20.703977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:28:20.704569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:28:20.705089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:28:20.706036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:28:20.717709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:20.718609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:20.720773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:20.721968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:20.723307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:20.723973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:20.738432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:20.750048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Getting quotas for project a6968336b75749e1a7925e66353025a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:20.757621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Getting quotas for user b8ebe31561844623a8e0bd6fbd3b041b and project a6968336b75749e1a7925e66353025a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:20.775504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:28:20.779153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:28:20.855169 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6df064af-08b8-49fe-b29b-7d624b05b677 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.657550 Oct 28 19:28:20.856633 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2178/4358] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 19:28:20.862809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:20.864015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:20.873198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:20.874133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:20.874996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:20.876948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:20.877723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:20.878469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:20.902032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:21.865529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:21.875914 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ea0be21-55f9-42b6-a326-3ce190a933df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 1.017964 Oct 28 19:28:21.881655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2179/4359] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:20 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:22.038924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:22.066921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8159a21e-2999-4a8e-a2fc-dcf067061110 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1328 microversion: 2.1 time: 1.459824 Oct 28 19:28:22.068023 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2181/4360] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:20 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1328 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:22.083362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:22.084388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:22.095907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.105171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bfc19207-050a-43bb-9b7e-8f1ee6ec71cd req-05cc341a-b9f0-4d51-aa04-ddfa7f64ddb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df05a481-9877-4266-ac22-e91a42b6c06f", "tag": "cefdc901-3f20-49fa-8964-738a7f7fde70"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:22.118224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.118784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:22.119624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.122439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.125286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:22.139494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bfc19207-050a-43bb-9b7e-8f1ee6ec71cd req-05cc341a-b9f0-4d51-aa04-ddfa7f64ddb6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.141228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bfc19207-050a-43bb-9b7e-8f1ee6ec71cd req-05cc341a-b9f0-4d51-aa04-ddfa7f64ddb6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.148158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bfc19207-050a-43bb-9b7e-8f1ee6ec71cd req-05cc341a-b9f0-4d51-aa04-ddfa7f64ddb6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:22.184028 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bfc19207-050a-43bb-9b7e-8f1ee6ec71cd req-05cc341a-b9f0-4d51-aa04-ddfa7f64ddb6 service nova] Creating event network-changed:cefdc901-3f20-49fa-8964-738a7f7fde70 for instance df05a481-9877-4266-ac22-e91a42b6c06f on n-h2-862769-3 Oct 28 19:28:22.211397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bfc19207-050a-43bb-9b7e-8f1ee6ec71cd req-05cc341a-b9f0-4d51-aa04-ddfa7f64ddb6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327400 Oct 28 19:28:22.226851 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2180/4361] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:22.249303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7aad11e-ae14-4dfc-9268-127b91921604 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7aad11e-ae14-4dfc-9268-127b91921604 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 163 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": 12345, "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 12345 Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:22.263636 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 19:28:22.268564 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:22.270203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7aad11e-ae14-4dfc-9268-127b91921604 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:22.271257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7aad11e-ae14-4dfc-9268-127b91921604 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.042717 Oct 28 19:28:22.273041 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2181/4362] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:22 2022] POST /compute/v2.1/servers => generated 127 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:22.280203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:22.286665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:22.310407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.310944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.311383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:22.312096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.312550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.312979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:22.405540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:22.420194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:22.422169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:22.423395 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2d52e10-14b2-4125-8b5c-755027194c33 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1274 microversion: 2.54 time: 0.352238 Oct 28 19:28:22.433153 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2182/4363] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:22 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:22.910290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:22.911328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:22.924021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.928728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.929184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:22.932873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:22.933483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:22.933923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:23.272273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:23.598897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:23.610926 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bac68d25-b21c-4a2c-b894-c980c4523508 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.332260 Oct 28 19:28:23.624940 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2182/4364] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:22 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:23.630801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:23.631762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:23.650435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:23.653218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:23.659560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:23.671758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:23.672604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:23.674452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:23.803045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:23.837582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:23.851576 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f04c549f-ea6c-4ec8-9746-c1982ee2dcc4 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.948643 Oct 28 19:28:23.856050 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2183/4365] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:22 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:23.868647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:23.869564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:23.888999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:23.890214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:23.890856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:23.892173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:23.892872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:23.893893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:24.055866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:24.072801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:24.074674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:24.080054 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee8daeab-5f6b-451d-aa02-65ef3ef5727e tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1336 microversion: 2.54 time: 0.221165 Oct 28 19:28:24.096926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2184/4366] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:23 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1336 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:24.111397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:24.112351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:24.120146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:24.120937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:24.121672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:24.123106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:24.123832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:24.124459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:24.400558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:24.418781 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e456a4e-b85e-483c-952c-847dd39add86 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1328 microversion: 2.1 time: 0.792147 Oct 28 19:28:24.419940 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2183/4367] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:23 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1328 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:24.588531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:24.601438 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba3634bd-4419-4fc5-988e-e078dfbe5a62 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.503056 Oct 28 19:28:24.602174 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2185/4368] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:24 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:24.880131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:24.882031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:24.900133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:24.909079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:24.910633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:24.912878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:24.913781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:24.915190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:25.116263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:25.116885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:25.128664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:25.141111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:25.141791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:25.145558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:25.149284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:25.153102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:25.376330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:25.389201 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea2ebc62-b42a-4727-87b3-52301289abf8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.512904 Oct 28 19:28:25.421433 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2184/4369] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:24 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:25.448205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:25.449222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:25.459924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:25.465791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:25.466843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:25.469078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:25.471443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:25.474135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:25.475046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:25.503422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:25.513825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:25.529807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:25.531181 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0c24cff-36ee-4fb5-aff7-b65a7ff5de08 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1336 microversion: 2.54 time: 0.418835 Oct 28 19:28:25.531781 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2186/4370] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:25 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1336 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:26.420323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:26.423898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:26.450404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:26.451269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:26.453213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:26.459356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:26.460172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:26.468585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:26.537297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:26.550718 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d94f5ee4-867b-402b-a349-c7e4bc57f33b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1328 microversion: 2.1 time: 1.108789 Oct 28 19:28:26.570481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2185/4371] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:25 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1328 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:26.587186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:26.596207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:26.620642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:26.625901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:26.627824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:26.629058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:26.637594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:26.639715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:27.014165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:27.023657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:27.025212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:27.026510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29477c8d-0957-4743-af6f-d7613d9395d4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1357 microversion: 2.54 time: 0.454412 Oct 28 19:28:27.047640 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2186/4372] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:26 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1357 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:27.077158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca67bb1d-19c9-44f9-9328-9ad1bc624236 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Action: 'create', calling method: .version_select at 0x7f1d769f5940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1259329686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzE9aH7w+OIDlPnihDZmRy49mJsKtteQUTZycx5zVArDCvWxe/2XWZf3vyhD8PUycuKKiiS/7RDOG2ijJdZc8nnf8bExxF1e3sEdCu6aEa5zVuNe9Fog4RYKkecGiifg=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:27.141568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ca67bb1d-19c9-44f9-9328-9ad1bc624236 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Getting quotas for project a6968336b75749e1a7925e66353025a9. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:27.182360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ca67bb1d-19c9-44f9-9328-9ad1bc624236 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Getting quotas for user b8ebe31561844623a8e0bd6fbd3b041b and project a6968336b75749e1a7925e66353025a9. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:27.286727 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca67bb1d-19c9-44f9-9328-9ad1bc624236 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.213826 Oct 28 19:28:27.287877 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2187/4373] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:28:27 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:28:27.304062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1259329686", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:27.307076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:27.332399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:27.332902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:27.333343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:27.334052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:27.334505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:27.351158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:27.460988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:27.476281 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b38649fe-2e46-42b7-9d3a-0d97c783b39c tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 1.056562 Oct 28 19:28:27.480124 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2187/4374] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:26 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:27.575669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:27.576694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:27.589661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:27.593110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:27.597739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:27.598788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:27.599453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:27.600070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:27.657205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:28:27.658900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:28:27.659405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:28:27.667455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:28:27.668573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:28:27.945024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:27.968695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:27.970337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:27.971974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:27.975259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:27.978479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:27.979252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:28.054169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:28.063228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61ccf5c7-b820-4701-8d8d-ac854e93771f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1328 microversion: 2.1 time: 0.492768 Oct 28 19:28:28.064863 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ccfaca12-ebe5-4aa8-b279-e0c0a25a46ed tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "POST /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc/action" status: 202 len: 1140 microversion: 2.54 time: 0.764811 Oct 28 19:28:28.079324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2188/4375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:27 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1328 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:28.081561 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2188/4376] 10.222.0.44 () {62 vars in 1320 bytes} [Fri Oct 28 19:28:27 2022] POST /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc/action => generated 1140 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 19:28:28.093406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:28.095814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:28.107261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:28.124113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:28.124964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:28.125943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:28.126616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:28.127294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:28.238073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:28.249948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:28.257062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:28.260641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8925f915-8620-4bb0-b2ca-df137a42e9f6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.171644 Oct 28 19:28:28.264411 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2189/4377] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:28 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:28.333896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35205f11-a651-40cf-88ef-96697b5e00bc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-847696366", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5a45b775-89ad-4028-bd2d-23d0bb950008", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:28.501457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:28.510376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:28.531027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:28.534840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:28.539297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:28.540452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:28.543388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:28.544766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:28.553880 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-35205f11-a651-40cf-88ef-96697b5e00bc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Block Device 5a45b775-89ad-4028-bd2d-23d0bb950008 is not bootable. Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35205f11-a651-40cf-88ef-96697b5e00bc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 357 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-847696366", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5a45b775-89ad-4028-bd2d-23d0bb950008", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: exception: Block Device 5a45b775-89ad-4028-bd2d-23d0bb950008 is not bootable. Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-847696366', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5a45b775-89ad-4028-bd2d-23d0bb950008'}], 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5a45b775-89ad-4028-bd2d-23d0bb950008 is not bootable. Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:28.564848 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5a45b775-89ad-4028-bd2d-23d0bb950008 is not bootable. Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5a45b775-89ad-4028-bd2d-23d0bb950008 is not bootable. Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35205f11-a651-40cf-88ef-96697b5e00bc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Block Device 5a45b775-89ad-4028-bd2d-23d0bb950008 is not bootable. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35205f11-a651-40cf-88ef-96697b5e00bc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.239791 Oct 28 19:28:28.570025 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2189/4378] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:28.601096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:28.605008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:28.653856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:28.654394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:28.654914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:28.655680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:28.656169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:28.656647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:29.288586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:29.308245 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8b2722c-5d19-484b-80ea-d66cda88a21e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 0.810507 Oct 28 19:28:29.308904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2190/4379] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:28 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:29.380666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:29.390741 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-28cbd18a-6c0f-48e9-a252-e1252db0698d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.816401 Oct 28 19:28:29.391919 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2190/4380] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:28 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:29.397805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:29.412068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:29.444608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:29.444608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:29.444608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:29.444608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:29.444608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:29.474872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:29.993738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8e9bc91d-8252-4289-856b-0950174e10ce req-6bbf74e2-4c5a-46bf-95d6-9d40fc529678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df05a481-9877-4266-ac22-e91a42b6c06f", "name": "network-vif-plugged", "status": "completed", "tag": "cefdc901-3f20-49fa-8964-738a7f7fde70"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:30.011220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e9bc91d-8252-4289-856b-0950174e10ce req-6bbf74e2-4c5a-46bf-95d6-9d40fc529678 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.012558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e9bc91d-8252-4289-856b-0950174e10ce req-6bbf74e2-4c5a-46bf-95d6-9d40fc529678 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:30.013326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e9bc91d-8252-4289-856b-0950174e10ce req-6bbf74e2-4c5a-46bf-95d6-9d40fc529678 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:30.032479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8e9bc91d-8252-4289-856b-0950174e10ce req-6bbf74e2-4c5a-46bf-95d6-9d40fc529678 service nova] Creating event network-vif-plugged:cefdc901-3f20-49fa-8964-738a7f7fde70 for instance df05a481-9877-4266-ac22-e91a42b6c06f on n-h2-862769-3 Oct 28 19:28:30.040119 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8e9bc91d-8252-4289-856b-0950174e10ce req-6bbf74e2-4c5a-46bf-95d6-9d40fc529678 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.729759 Oct 28 19:28:30.040943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2191/4381] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:30.049291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:30.050250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:30.060110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.060908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:30.061820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:30.062862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.063491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:30.072989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:30.259753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:30.282481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:30.293176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:30.295018 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4df76e81-04d0-48d9-8fcd-3568f507ad5f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.252530 Oct 28 19:28:30.311788 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2192/4382] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:30 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:30.349062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:30.358866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:30.387535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.389013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:30.389656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:30.392613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.393266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:30.396882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:30.736363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:30.927894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:30.942639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f75e447-89f5-4f43-98a6-01f690518167 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1328 microversion: 2.1 time: 1.549211 Oct 28 19:28:30.945902 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2191/4383] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:29 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1328 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:30.969169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:30.975248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:30.990045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.991197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:30.992285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:30.997208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:30.998177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:31.001164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:31.365736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:31.378566 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a1cf1ba-bbe1-4676-86a9-392d96c744b4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.064893 Oct 28 19:28:31.382288 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2193/4384] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:30 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:31.395358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:31.397809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:31.421041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:31.422541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:31.424029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:31.426614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:31.427363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:31.428032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:32.253370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:32.263915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:32.268060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:32.271068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8df8f84c-1674-444b-a7a1-6be53facd590 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.887105 Oct 28 19:28:32.271723 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2194/4385] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:31 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:32.291024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:32.291966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:32.306807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:32.307308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:32.307744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:32.308455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:32.308978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:32.309402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:32.609979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:32.626482 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb3b8517-1090-43b8-8c60-1aff9d488b31 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1505 microversion: 2.1 time: 1.676470 Oct 28 19:28:32.627668 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2192/4386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:30 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1505 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:32.946547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:32.961418 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07adf76d-4a72-4a51-bc4c-2ec117372ff6 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1510 microversion: 2.1 time: 0.685103 Oct 28 19:28:32.962618 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2195/4387] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:32 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1510 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:32.989078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:32.989807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:33.020810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.021422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.021888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.022811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.032848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.033308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.299898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:33.300769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:33.315144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.316266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.316721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.317463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.317934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.318351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.493559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:33.549615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:33.559515 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-da0fcd24-8093-45ac-9c32-7186119be3d1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1510 microversion: 2.1 time: 0.574348 Oct 28 19:28:33.577132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:33.577409 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2193/4388] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:32 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:33.583703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:33.584541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:33.585201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:33.587497 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d56e3a67-cf56-4724-96e8-feb204aa0826 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.291875 Oct 28 19:28:33.591887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.592664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.593318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.594262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.595017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.595659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.599981 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2196/4389] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:33 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:33.643148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:28:33.659408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:33.660574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:33.675171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.679560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.680265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.681238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.681925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.682596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.870445 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9f877c04-e031-4545-9aa6-0cef6c2f0e1b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 204 len: 0 microversion: 2.1 time: 0.288729 Oct 28 19:28:33.872752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2194/4390] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:33 2022] DELETE /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:33.886292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:33.887340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:33.901231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.903163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.906073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.908537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.911105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.914238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:34.284458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:34.292669 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a093ddf-a449-42bb-b80a-a67e0af6d3ab tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1502 microversion: 2.1 time: 0.637021 Oct 28 19:28:34.301814 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2197/4391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:33 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1502 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:34.425705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:34.428540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:34.445253 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e821fea-58c5-47f3-8e56-ed9063ab172a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1516 microversion: 2.1 time: 0.567793 Oct 28 19:28:34.445890 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2195/4392] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:33 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1516 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:34.512240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a22e078d-f78c-4cfb-97bc-66494e2a5575 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1119700895", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d275f742-67cf-44be-b2bb-1596dfea8f48", "destination_type": "local"}, {"source_type": "volume", "uuid": "14401fde-5bd6-4b72-aff3-92b6d57a3917", "destination_type": "invalid"}], "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a22e078d-f78c-4cfb-97bc-66494e2a5575 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 495 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1119700895", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d275f742-67cf-44be-b2bb-1596dfea8f48", "destination_type": "local"}, {"source_type": "volume", "uuid": "14401fde-5bd6-4b72-aff3-92b6d57a3917", "destination_type": "invalid"}], "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1119700895', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '14401fde-5bd6-4b72-aff3-92b6d57a3917', 'destination_type': 'invalid'}], 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:34.522436 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a22e078d-f78c-4cfb-97bc-66494e2a5575 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:34.526991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a22e078d-f78c-4cfb-97bc-66494e2a5575 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017276 Oct 28 19:28:34.534282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:34.534940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:34.544955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2198/4393] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:34 2022] POST /compute/v2.1/servers => generated 155 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:34.548840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:34.549349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:34.549789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:34.550508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:34.550992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:34.551430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:34.618745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:34.618745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:34.637709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:34.638274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:34.638654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:34.639407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:34.639868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:34.640295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:34.879071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:34.883749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:34.894786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:34.896680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:34.898188 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65ad0096-1091-4cb7-b9a6-3a52ec4e5640 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.285181 Oct 28 19:28:34.899515 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2199/4394] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:34 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:35.081286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:35.096093 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-642f4199-8f5a-4ed5-9af9-8a71c745bbc6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.566554 Oct 28 19:28:35.097693 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2196/4395] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:34 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:35.124584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:35.125211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:35.137781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.138338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.138807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.139537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.140002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.140431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.336524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:35.337160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:35.348417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.348914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.349349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.350064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.353512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.356770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.435170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:35.452847 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8a259281-3207-416b-a4c9-8105846c9386 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.329908 Oct 28 19:28:35.462719 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2200/4396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:35 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:35.483373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:35.484197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:35.494596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.495118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.498796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.501904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.504667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.505948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.710878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:35.733207 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3023f167-b0a6-45d6-a519-49e137edc0a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1502 microversion: 2.1 time: 0.396860 Oct 28 19:28:35.733742 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2197/4397] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:35 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:35.796861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-54df702c-f67d-4df6-9012-274c00f35048 req-1ce05bf4-6000-43a0-8309-886cfdfff426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce09057f-2c6a-44bb-b4ce-944ed126a6fb", "name": "network-vif-unplugged", "status": "completed", "tag": "c302d473-43be-46f4-88db-c8a7067c7497"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:35.825418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54df702c-f67d-4df6-9012-274c00f35048 req-1ce05bf4-6000-43a0-8309-886cfdfff426 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.827640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54df702c-f67d-4df6-9012-274c00f35048 req-1ce05bf4-6000-43a0-8309-886cfdfff426 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.827640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54df702c-f67d-4df6-9012-274c00f35048 req-1ce05bf4-6000-43a0-8309-886cfdfff426 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.862205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-54df702c-f67d-4df6-9012-274c00f35048 req-1ce05bf4-6000-43a0-8309-886cfdfff426 service nova] Creating event network-vif-unplugged:c302d473-43be-46f4-88db-c8a7067c7497 for instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb on n-h2-862769-3 Oct 28 19:28:35.872121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:35.877096 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-54df702c-f67d-4df6-9012-274c00f35048 req-1ce05bf4-6000-43a0-8309-886cfdfff426 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084409 Oct 28 19:28:35.877727 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2198/4398] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:28:35.883177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb633daf-8e6e-4345-9584-37eda290b2c4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1804187058", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:35.885939 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7884a022-6865-4f93-b61d-6b687e23cbf4 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1516 microversion: 2.1 time: 0.412538 Oct 28 19:28:35.887568 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2201/4399] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:35 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb633daf-8e6e-4345-9584-37eda290b2c4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 492 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1804187058", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1804187058', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.900006 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 19:28:35.908562 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:35.912569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb633daf-8e6e-4345-9584-37eda290b2c4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:35.914101 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb633daf-8e6e-4345-9584-37eda290b2c4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.034902 Oct 28 19:28:35.915950 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2199/4400] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:35 2022] POST /compute/v2.1/servers => generated 624 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:35.925646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:35.926656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:35.938946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.941012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.942143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.944875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.946077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.946908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:35.948526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.949144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:35.969413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.970015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.970702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.971638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.973930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.974637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.142143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:36.152919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:36.154802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:36.156430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-efe07bc8-ba88-4cf9-ac7a-e6d8c387b35c tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.223507 Oct 28 19:28:36.157813 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2200/4401] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:35 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:36.294533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:36.321845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d059e71-46a8-47f3-98cf-2585263e2030 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.401150 Oct 28 19:28:36.325122 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2202/4402] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:35 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:36.348616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:36.349606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:36.358763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.360027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.360684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.361964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.363229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.364014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.614035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:36.659333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf8f8cbf-bb21-4ec2-b5f6-0b2f377e7bc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.303609 Oct 28 19:28:36.661117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2201/4403] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:36 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:36.760754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:36.762661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:36.776545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.780334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.782999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.783930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.785572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.786925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.822160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-443f2fcb-5443-4203-9d79-b71fcd774060 req-55dce147-840d-4717-bb1a-9ab4b29713ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df05a481-9877-4266-ac22-e91a42b6c06f", "name": "network-vif-deleted", "tag": "cefdc901-3f20-49fa-8964-738a7f7fde70"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:36.862761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-443f2fcb-5443-4203-9d79-b71fcd774060 req-55dce147-840d-4717-bb1a-9ab4b29713ad service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.869041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-443f2fcb-5443-4203-9d79-b71fcd774060 req-55dce147-840d-4717-bb1a-9ab4b29713ad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.874636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-443f2fcb-5443-4203-9d79-b71fcd774060 req-55dce147-840d-4717-bb1a-9ab4b29713ad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.923581 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-443f2fcb-5443-4203-9d79-b71fcd774060 req-55dce147-840d-4717-bb1a-9ab4b29713ad service nova] Creating event network-vif-deleted:cefdc901-3f20-49fa-8964-738a7f7fde70 for instance df05a481-9877-4266-ac22-e91a42b6c06f on n-h2-862769-3 Oct 28 19:28:36.943408 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-443f2fcb-5443-4203-9d79-b71fcd774060 req-55dce147-840d-4717-bb1a-9ab4b29713ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127800 Oct 28 19:28:36.947144 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2202/4404] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 28 19:28:36.962451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:36.965305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:36.987545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.988449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.989742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.993452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.995206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.995881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.082171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.083309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.083936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.094395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lazy-loading 'fault' on Instance uuid df05a481-9877-4266-ac22-e91a42b6c06f {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:28:37.207229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.227640 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81b926b6-9e39-43d8-b89e-471f3e1b5a64 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 200 len: 1318 microversion: 2.1 time: 0.277416 Oct 28 19:28:37.228993 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2203/4405] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:36 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:37.257903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54532fe0-19f6-472f-9431-fc465fbdb9fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:37.258930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54532fe0-19f6-472f-9431-fc465fbdb9fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 416 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.265995 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54532fe0-19f6-472f-9431-fc465fbdb9fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54532fe0-19f6-472f-9431-fc465fbdb9fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.019983 Oct 28 19:28:37.269250 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2204/4406] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:37 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:37.271303 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77f7096f-7e52-418a-9f50-3ab1a05ea649 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1502 microversion: 2.1 time: 0.514177 Oct 28 19:28:37.272555 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2203/4407] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:36 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1502 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:37.274062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:37.274754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:37.276839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=10 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:37.277818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:37.278546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:37.286053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.286716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.287408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.288232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.288762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.289450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.299358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.300345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.300993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.302169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.303086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.303749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.460258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.479111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.483502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.486958 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1a0ae84-970f-4750-adbc-85fd094be3f8 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.217462 Oct 28 19:28:37.489867 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2205/4408] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:37 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:37.529244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.542627 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-438ed3d2-1f6c-4ac1-a00e-f8cae35f5d0a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.268891 Oct 28 19:28:37.543373 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2204/4409] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:37 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:37.567610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:37.569660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:37.591552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.594398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.596707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.597998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.600201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.602357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.834590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.847618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f3b4508e-2b31-499e-bff9-ec8bccf7daed tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.284396 Oct 28 19:28:37.849545 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2206/4410] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:37 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:38.150459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7db73768-d42b-4546-936d-f9b666bb3e20 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1333178697", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": -1, "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:38.167891 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-7db73768-d42b-4546-936d-f9b666bb3e20 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Flavor -1 could not be found. Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7db73768-d42b-4546-936d-f9b666bb3e20 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 206 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1333178697", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": -1, "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: exception: Flavor -1 could not be found. Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1333178697', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': -1, 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:38.170463 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7db73768-d42b-4546-936d-f9b666bb3e20 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:38.175178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7db73768-d42b-4546-936d-f9b666bb3e20 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.027677 Oct 28 19:28:38.182226 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2205/4411] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:38 2022] POST /compute/v2.1/servers => generated 73 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:28:38.183748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.184453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:38.192485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.195898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.196365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.199722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.202992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.204284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.261301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.264203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:38.273150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.273637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.274075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.275541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.281415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.283264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.306569 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f HTTP/1.1 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'df05a481-9877-4266-ac22-e91a42b6c06f'} Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.308319 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:38.312939 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f13c5dd-5da7-4358-900d-687f05084248 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 404 len: 111 microversion: 2.1 time: 0.059002 Oct 28 19:28:38.313843 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2206/4412] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:38 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:28:38.318836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.319708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:38.326895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.327678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.328317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.329388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.330111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.330759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.623801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:38.633354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a95ea761-89e6-461b-af76-5b9f05fc9218 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 200 len: 1445 microversion: 2.1 time: 0.318398 Oct 28 19:28:38.640892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:38.645857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2207/4413] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:38 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 1445 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:38.653042 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18fc04e8-1c6b-4d0b-a2cf-57343db7fc91 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.474308 Oct 28 19:28:38.655292 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2207/4414] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:38 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:38.659908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.671406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93410af7-0235-4f75-aa93-95595ff20c9e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '.version_select at 0x7f1d7696cd30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.675766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:38.689937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:38.691962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.697047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.697722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.698655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.699357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.700177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.720332 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-93410af7-0235-4f75-aa93-95595ff20c9e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-key-928124342" status: 202 len: 0 microversion: 2.1 time: 0.068604 Oct 28 19:28:38.721612 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2208/4415] 10.222.0.44 () {58 vars in 1206 bytes} [Fri Oct 28 19:28:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-928124342 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:28:38.742896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.743626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:38.773889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.777219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.777735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.778492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.782407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.782911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.856786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:38.869785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:38.874175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:38.875559 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-32f484d4-9ab9-420b-9d9c-fbd8ddf19d02 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.219255 Oct 28 19:28:38.878046 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2208/4416] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:38 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:39.433147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:39.441587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-104858501", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:39.442141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ece4a85d-245a-47f7-b388-125e513037bf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.719270 Oct 28 19:28:39.442983 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2209/4417] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:38 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:39.448219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:39.449056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:39.457693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:39.458441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:39.459125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:39.460020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:39.460666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:39.461280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:39.579032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:28:39.872426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:39.880787 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2126bd92-f9c2-452b-a3d2-50aca250782c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.436454 Oct 28 19:28:39.912152 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2210/4418] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:39 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:39.927053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-797753639", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:40.021899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:28:40.168039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:28:40.184490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:28:40.185273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:28:40.186453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:28:40.187018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:28:40.201462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:40.203250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:40.204299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:40.205543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:40.208523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:40.209196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:40.253695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Getting quotas for project d36609a3ce9f441ba031b1d384fca5b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:40.261358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Getting quotas for user bddb9f9bc0d345f39ae73192f4433f63 and project d36609a3ce9f441ba031b1d384fca5b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:40.280386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:28:40.283196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:28:40.353465 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-672cf3c8-6273-4de9-8f3e-6441051f7abc tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473706 Oct 28 19:28:40.354904 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2209/4419] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:28:40.361030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:40.362123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:40.371184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:40.372037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:40.372767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:40.373726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:40.374573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:40.375305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.107311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:41.118387 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a306560b-ece1-44c2-bc64-c10b91a329a5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.762140 Oct 28 19:28:41.119026 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2210/4420] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:40 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:41.137061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:41.140062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:41.160666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.162389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.164648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.167685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.168580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.169365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.375904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:41.396180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:41.397742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:41.404966 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73ab6651-26f3-4e96-8ad9-a787ebe83ea4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.279001 Oct 28 19:28:41.413847 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2211/4421] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:41 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:41.433930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c95b834-8fd6-4299-81c6-0d108056fbd7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739601827", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c95b834-8fd6-4299-81c6-0d108056fbd7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 173 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739601827", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1739601827', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi -1 Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:41.440724 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 19:28:41.445787 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:41.447786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c95b834-8fd6-4299-81c6-0d108056fbd7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:41.448860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c95b834-8fd6-4299-81c6-0d108056fbd7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.033792 Oct 28 19:28:41.449999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2212/4422] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:41.458179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:41.459173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:41.468192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.469014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.469628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.470499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.471133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.471710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.632082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:28:41.633032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:41.633641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:28:41.635279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:28:41.637167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:28:41.637745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:28:41.652254 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14eae8f2-5086-4f41-bea3-4bef97ddcbee tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1212 microversion: 2.1 time: 0.201022 Oct 28 19:28:41.655328 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2213/4423] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:41 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:41.659213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.659900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.660512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.661406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.662016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.662616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.672181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:41.672883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:41.681743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.682226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.685712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.687831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.691240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.691864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.731900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:41.745236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:41.777672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:28:41.785950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:28:41.853783 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b159723c-dac2-426f-8c9f-54690d0f8cad tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.932818 Oct 28 19:28:41.854645 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2211/4424] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:28:41.860824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:41.861993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:41.870641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.871219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.871809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.872727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.873325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.874117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.093835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.107038 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5781f9c0-3086-414b-ac99-487d7c6750f5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.450433 Oct 28 19:28:42.112528 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2214/4425] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:41 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:42.130010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73611e92-3f00-43f2-9bba-f78cbf04d086 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:42.133481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73611e92-3f00-43f2-9bba-f78cbf04d086 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:42.262930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73611e92-3f00-43f2-9bba-f78cbf04d086 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.273878 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73611e92-3f00-43f2-9bba-f78cbf04d086 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1208 microversion: 2.1 time: 0.159865 Oct 28 19:28:42.278532 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2215/4426] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:42 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:42.287228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:42.291616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:42.304472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.305840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.309227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.310112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.313808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.314445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.315955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.364756 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37757dcd-3511-4492-a67d-af640e74300c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.487880 Oct 28 19:28:42.367325 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2212/4427] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:41 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:42.396373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:42.397095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:42.403995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.404855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.405957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.406952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.407835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.408448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.719857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.731430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.732907 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1a15ee9-989e-48b1-8441-eb9515d6fbbb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.340558 Oct 28 19:28:42.733994 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2213/4428] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:42 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:42.745525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:42.746549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:42.757316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.758170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.758878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.766108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65d99574-1d8c-481d-adb5-d5f28e8bf46e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.485361 Oct 28 19:28:42.767709 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2216/4429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:42 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:42.768512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.770178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.770848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.774873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:42.775733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:42.798307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.800524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.805111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.805997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.806477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.806932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.909682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.921946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.927051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:42.931657 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5dd7d50e-f9b6-41db-b610-eb39a4712a81 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.196346 Oct 28 19:28:42.936325 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2214/4430] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:42 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:42.948078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fb016ca5-ef96-432b-97dc-7aa596845de6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:42.965366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb016ca5-ef96-432b-97dc-7aa596845de6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.966140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb016ca5-ef96-432b-97dc-7aa596845de6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.966802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb016ca5-ef96-432b-97dc-7aa596845de6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.993749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:43.010752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1008f0d1-6cc2-440d-9e25-81f5cfe0c561 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1274 microversion: 2.1 time: 0.241178 Oct 28 19:28:43.012725 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2217/4431] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:42 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:43.034993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb016ca5-ef96-432b-97dc-7aa596845de6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Going to try to stop instance {{(pid=120628) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:28:43.075328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7902459e-6041-4c4e-a06c-fc3bacbbf7f8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1706559557", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:43.082609 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-7902459e-6041-4c4e-a06c-fc3bacbbf7f8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7902459e-6041-4c4e-a06c-fc3bacbbf7f8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 216 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1706559557", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1706559557', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:43.087307 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:43.091266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7902459e-6041-4c4e-a06c-fc3bacbbf7f8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:43.091798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7902459e-6041-4c4e-a06c-fc3bacbbf7f8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023231 Oct 28 19:28:43.093639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2218/4432] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:43 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:43.104333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:43.105196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:43.110210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:43.116875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.117160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fb016ca5-ef96-432b-97dc-7aa596845de6 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.179322 Oct 28 19:28:43.117959 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2215/4433] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:42 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:28:43.126998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:43.130630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.131903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:43.135612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.137561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.141043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.144201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.149020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.149523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.149962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.150679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.151337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.152037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.175047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:43.450844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:43.454410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:43.464795 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09f045af-8f03-4f8a-a175-e0b7a0836455 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.365926 Oct 28 19:28:43.465569 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2219/4434] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:43 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:43.467134 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bc26169-099a-4587-8608-b9571acb61c0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.344290 Oct 28 19:28:43.480121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:43.483126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:43.483293 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2216/4435] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:43 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:43.495826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.496490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:43.497533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.498049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.498929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.500598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.502374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.508105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:43.516416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.519334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.520532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.523697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.524317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.524895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.619672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:43.647109 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-243c2fd8-4350-4565-b97d-a413331ed4bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1260 microversion: 2.1 time: 0.179267 Oct 28 19:28:43.650763 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2220/4436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:43 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:43.802376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:43.810719 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c436e89-1589-463d-9afa-9ed391fbeb45 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.318097 Oct 28 19:28:43.817888 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2217/4437] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:43 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:43.987589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:43.989114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:44.004473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.004976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.007156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.008622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.009362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.010172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.037586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:44.038746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:44.045506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.046001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.046435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.063176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.063761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.064202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.121991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.134007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.138499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.142237 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92b90072-8308-4ac8-8517-6ab90e79a5c6 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.166917 Oct 28 19:28:44.142878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2221/4438] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:43 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:44.156216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e63d193-903a-4083-8129-eed45b5f9952 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-499653319", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-key-1507886030", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:44.227089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.238821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:44.256069 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d312b30-21a1-4da9-b2a3-d15fab02a6e8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1274 microversion: 2.1 time: 0.222430 Oct 28 19:28:44.273991 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2218/4439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:44 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:44.280600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3e63d193-903a-4083-8129-eed45b5f9952 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] validate_networks() for [('36d96f74-08a9-41e6-b957-eb52f0325134', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:28:44.494578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:44.495478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:44.508586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.511306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.512084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.512895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.513423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.513910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.685286 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3e63d193-903a-4083-8129-eed45b5f9952 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Invalid key_name provided. Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e63d193-903a-4083-8129-eed45b5f9952 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 246 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-499653319", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-key-1507886030", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid key_name provided. Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-499653319', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'key_name': 'tempest-key-1507886030', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1507886030 not found for user 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:44.693686 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 28 19:28:44.697861 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:44.701335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e63d193-903a-4083-8129-eed45b5f9952 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid key_name provided. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:44.702591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e63d193-903a-4083-8129-eed45b5f9952 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.558776 Oct 28 19:28:44.703652 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2222/4440] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:44 2022] POST /compute/v2.1/servers => generated 70 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:28:44.708923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:44.715933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:44.727756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.733550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.734836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.735775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.736551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.737033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.782601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.799319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea971081-6717-430f-a253-ca65dd33c8a0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.308496 Oct 28 19:28:44.812245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2219/4441] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:44 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:44.823480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:44.824414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:44.829894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.835516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.837850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.838409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.839248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.839847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.840350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.863328 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69290cf8-99e9-4b7d-8280-177dc53e735f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1266 microversion: 2.1 time: 0.156689 Oct 28 19:28:44.867186 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2223/4442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:44 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:45.029156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.039371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f325f770-34f9-494e-89fc-c88c4655472f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.220337 Oct 28 19:28:45.040544 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2220/4443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:44 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:45.064961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.074041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:45.082157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.082768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.083516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.084567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.085093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.085509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.173292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.174310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:45.181953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.182718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.183714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.184692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.185732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.186352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.287298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.301367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.302890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.304112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d3bb0c8-c1a4-40bf-9928-44849a53669f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.136360 Oct 28 19:28:45.314736 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2221/4444] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:45.318973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.321889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:45.332749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.333430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.334107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.335007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.335623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.336362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.346925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.357609 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8bbd8c4-86f7-4738-be53-07149bec1187 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.296650 Oct 28 19:28:45.359992 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2224/4445] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:45.421372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.431962 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1cd2a52-c5b3-435d-b033-1a11891d2f8a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1274 microversion: 2.1 time: 0.119002 Oct 28 19:28:45.432740 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2222/4446] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:45.541377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f419ba1-6704-405d-9305-02921bec3420 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-779481309", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:45.695745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.security_group_api [None req-1f419ba1-6704-405d-9305-02921bec3420 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Neutron security group does_not_exist not found {{(pid=120629) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 28 19:28:45.697006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1f419ba1-6704-405d-9305-02921bec3420 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f419ba1-6704-405d-9305-02921bec3420 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 257 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-779481309", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-779481309', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 28 19:28:45.708245 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 28 19:28:45.712763 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:45.719409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f419ba1-6704-405d-9305-02921bec3420 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:45.720093 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f419ba1-6704-405d-9305-02921bec3420 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.182323 Oct 28 19:28:45.721297 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2225/4447] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:45 2022] POST /compute/v2.1/servers => generated 106 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:45.730644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.731718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:45.740157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.741117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.741756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.742889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.743564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.744735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.834638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.835642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:45.859517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.860433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.862340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.865444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.866141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.867378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.137771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:46.146634 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c8d01445-7d45-4507-9a98-610f36f1a346 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.420957 Oct 28 19:28:46.151883 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2223/4448] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:46.173214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:46.175171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:46.200783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.201284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.204251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.205051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.205585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.206018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.451737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:46.481256 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ab13e41b-86e5-4d2f-bdb5-e76b2ee8e6b0 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.656373 Oct 28 19:28:46.482107 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2226/4449] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:46.500658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:46.501276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:46.523555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.526193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.526640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.528584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.533893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.534387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.888199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:46.905733 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de117965-ff33-40f5-a97a-c10d5b9696cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.747698 Oct 28 19:28:46.906381 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2224/4450] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:46 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:46.911256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:46.924269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:46.925280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:46.927737 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e26d734-3a3c-47d6-affa-4d0bbac2332b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.443393 Oct 28 19:28:46.928654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2227/4451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:46 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:46.941964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:46.943587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:46.957523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.957905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.958353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.959027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.959190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.959519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.961128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.962305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.964526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:46.965749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:46.967123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:46.968334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.046626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.056603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.058547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.067399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8b0029d4-6820-403c-b36a-b023ad40dbb4 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.153963 Oct 28 19:28:47.068001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2225/4452] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:46 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:47.092379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c95ea1d-2127-4aa1-bce0-7d47c5b8b9c8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:47.093174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c95ea1d-2127-4aa1-bce0-7d47c5b8b9c8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: e4458d1e-06b7-49d0-b3e3-5b273a46aad0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:47.113760 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-5c95ea1d-2127-4aa1-bce0-7d47c5b8b9c8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance e4458d1e-06b7-49d0-b3e3-5b273a46aad0 could not be found. Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c95ea1d-2127-4aa1-bce0-7d47c5b8b9c8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/e4458d1e-06b7-49d0-b3e3-5b273a46aad0 HTTP/1.1 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e4458d1e-06b7-49d0-b3e3-5b273a46aad0 could not be found. Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e4458d1e-06b7-49d0-b3e3-5b273a46aad0'} Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4458d1e-06b7-49d0-b3e3-5b273a46aad0 could not be found. Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4458d1e-06b7-49d0-b3e3-5b273a46aad0 could not be found. Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.117271 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4458d1e-06b7-49d0-b3e3-5b273a46aad0 could not be found. Oct 28 19:28:47.122081 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.124859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c95ea1d-2127-4aa1-bce0-7d47c5b8b9c8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance e4458d1e-06b7-49d0-b3e3-5b273a46aad0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:47.128146 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c95ea1d-2127-4aa1-bce0-7d47c5b8b9c8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e4458d1e-06b7-49d0-b3e3-5b273a46aad0" status: 404 len: 111 microversion: 2.1 time: 0.041832 Oct 28 19:28:47.131036 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2226/4453] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:47 2022] DELETE /compute/v2.1/servers/e4458d1e-06b7-49d0-b3e3-5b273a46aad0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:47.137832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:47.140558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:47.161954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.166139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.168698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.171373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.174729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.175403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.236123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.247731 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-beb5cfc4-0502-42bf-8315-b5fae36921c4 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.315883 Oct 28 19:28:47.248593 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2228/4454] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:46 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:47.408270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.417957 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c19775a2-013c-426d-b60e-f01974d13152 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.284361 Oct 28 19:28:47.420654 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2227/4455] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:47 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:47.461196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:47.465323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:47.478234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.479983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.480583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.481303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.481864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.482292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.512669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:47.513327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:47.527966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.529281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.530934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.531675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.547036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.547485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.854915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.863114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9fe0e047-84fb-4583-be60-d3e7f6219f67 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.357189 Oct 28 19:28:47.867408 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2228/4456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:47 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:47.893142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:47.901371 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7b0e271-e763-40b8-8ca9-6225c3d3e422 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.454923 Oct 28 19:28:47.903761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2229/4457] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:47 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:47.951872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:47.952816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:47.953473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4aaa65bf-690d-4f7a-9a90-52b16dbc9fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:47.954172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4aaa65bf-690d-4f7a-9a90-52b16dbc9fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:28:47.955420 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4aaa65bf-690d-4f7a-9a90-52b16dbc9fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4aaa65bf-690d-4f7a-9a90-52b16dbc9fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9223372036854775808 could not be found. Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9223372036854775808'} Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:47.961325 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:47.970721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:47.970721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:47.970721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:47.970721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 28 19:28:47.970721 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:47.974859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4aaa65bf-690d-4f7a-9a90-52b16dbc9fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:47.982037 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4aaa65bf-690d-4f7a-9a90-52b16dbc9fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.057773 Oct 28 19:28:47.999221 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2229/4458] 10.222.0.44 () {58 vars in 1188 bytes} [Fri Oct 28 19:28:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:48.013102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.014019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.014722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.017634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.020101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.020870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.022622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:48.023603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:48.047833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.048747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.049386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.050301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.051048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.051768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.339290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:48.359083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:48.363684 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec261ce4-9886-41ab-9748-eae25bbd191f tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.420253 Oct 28 19:28:48.367867 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2230/4459] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:47 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:48.383551 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c48837b-383b-4f8b-840c-46a2cf423443 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.381464 Oct 28 19:28:48.393095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-be9cdba3-8a08-436a-9130-efeccd19b9d1 req-a8fedd10-f91d-48bf-b7f5-453da0bfd0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:48.393566 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2230/4460] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:48 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:48.402052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:48.403010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:48.410263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.411013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.411610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.412507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.412970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.413399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.433284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-be9cdba3-8a08-436a-9130-efeccd19b9d1 req-a8fedd10-f91d-48bf-b7f5-453da0bfd0fa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.434371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-be9cdba3-8a08-436a-9130-efeccd19b9d1 req-a8fedd10-f91d-48bf-b7f5-453da0bfd0fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.436081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-be9cdba3-8a08-436a-9130-efeccd19b9d1 req-a8fedd10-f91d-48bf-b7f5-453da0bfd0fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.503251 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-be9cdba3-8a08-436a-9130-efeccd19b9d1 req-a8fedd10-f91d-48bf-b7f5-453da0bfd0fa service nova] Creating event network-changed:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:28:48.545497 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-be9cdba3-8a08-436a-9130-efeccd19b9d1 req-a8fedd10-f91d-48bf-b7f5-453da0bfd0fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175416 Oct 28 19:28:48.558824 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2231/4461] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:48.571172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:48.576042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:48.590955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.595514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.596562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.597699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.599876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.600660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.602329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:48.626457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:48.628421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:48.632181 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9bb0e324-1d86-4a25-8c4d-1c3cd80c26a1 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.234410 Oct 28 19:28:48.642682 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2231/4462] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:48 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:48.648777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:48.649583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:48.662142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.669538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.670335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.671436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.672048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.672618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.869604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:48.880203 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d806038-840f-403e-babe-ddb0a92c9614 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.319837 Oct 28 19:28:48.883897 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2232/4463] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:48 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:48.890633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:48.896281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:48.910230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.914883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.915407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:48.917323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:48.920742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:48.921808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.094230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:49.106131 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7ca069ee-f772-4619-bbfb-58fd79423e01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.461868 Oct 28 19:28:49.107152 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2232/4464] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:48 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:49.131672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-add28dd9-e893-4570-b106-b9bfe60a4b08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:49.132160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-add28dd9-e893-4570-b106-b9bfe60a4b08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Failed to fetch instance by id -1 {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 19:28:49.133032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-add28dd9-e893-4570-b106-b9bfe60a4b08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance -1 could not be found. Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-add28dd9-e893-4570-b106-b9bfe60a4b08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance -1 could not be found. Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '-1'} Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:49.134560 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:49.143758 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:49.143758 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:49.143758 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 28 19:28:49.143758 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.143758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-add28dd9-e893-4570-b106-b9bfe60a4b08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:49.143758 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-add28dd9-e893-4570-b106-b9bfe60a4b08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014215 Oct 28 19:28:49.147001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2233/4465] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:28:49 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:28:49.147953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:49.152853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:49.153490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:49.159638 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0a7b1799-f5a1-4e35-99f7-95b7cd8925a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.272872 Oct 28 19:28:49.161569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.163268 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2233/4466] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:48 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:49.173716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.174226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.175035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.175517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.175941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.376653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:49.388466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:49.388947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:49.389620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d23a3ae1-2392-4510-be15-eb9fe5ff11f0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.241136 Oct 28 19:28:49.391076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2234/4467] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:49 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:49.402166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.402735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.403166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.404108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.404709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.405269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.417372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:49.418564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:49.426462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.427296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.427929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.428836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.429870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.431709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.812451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:49.827558 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-720dd640-4406-452e-9041-a66df716da62 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.442990 Oct 28 19:28:49.828505 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2234/4468] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:49 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:49.845473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:49.853420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:49.854266 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4bc3bcf3-387a-41d7-93b3-fe629aced372 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.443548 Oct 28 19:28:49.854765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:49.862117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.862839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.863656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.863861 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2235/4469] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:49 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:49.866140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.866805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.867476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.882592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a3bff72-7f6e-4fc8-9707-6eb55bd3f76b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:49.883391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a3bff72-7f6e-4fc8-9707-6eb55bd3f76b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 977a1cd4-e177-454b-92c4-9140224e2737] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:49.892169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2a3bff72-7f6e-4fc8-9707-6eb55bd3f76b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 977a1cd4-e177-454b-92c4-9140224e2737 could not be found. Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a3bff72-7f6e-4fc8-9707-6eb55bd3f76b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/977a1cd4-e177-454b-92c4-9140224e2737/action HTTP/1.1 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 19 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: {"forceDelete": {}} Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 977a1cd4-e177-454b-92c4-9140224e2737 could not be found. Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '977a1cd4-e177-454b-92c4-9140224e2737', 'body': {'forceDelete': {}}} Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977a1cd4-e177-454b-92c4-9140224e2737 could not be found. Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977a1cd4-e177-454b-92c4-9140224e2737 could not be found. Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:49.903926 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:49.909277 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:49.909277 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:49.909277 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977a1cd4-e177-454b-92c4-9140224e2737 could not be found. Oct 28 19:28:49.909277 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:28:49.912553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a3bff72-7f6e-4fc8-9707-6eb55bd3f76b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 977a1cd4-e177-454b-92c4-9140224e2737 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:49.913662 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a3bff72-7f6e-4fc8-9707-6eb55bd3f76b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/977a1cd4-e177-454b-92c4-9140224e2737/action" status: 404 len: 111 microversion: 2.1 time: 0.035327 Oct 28 19:28:49.914714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2236/4470] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:49 2022] POST /compute/v2.1/servers/977a1cd4-e177-454b-92c4-9140224e2737/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:28:49.927187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:49.928827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:49.946259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.947502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.948700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.957053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:49.958118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:49.959280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:49.989667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.002315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.007014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.009010 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f88b0f18-38cc-4185-9f1f-39c899268a84 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.163342 Oct 28 19:28:50.012832 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2235/4471] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:49 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:50.032208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:50.033142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:50.041089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.042387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.042536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.043494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.044338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.044822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.238932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:50.263520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.274742 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82812b3f-8204-46e5-8058-cd966134a335 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.358717 Oct 28 19:28:50.276145 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2237/4472] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:49 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:50.281247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:50.282163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:50.289223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.289992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.290823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.291739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.292495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.293440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.486459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.506592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e51a8654-d456-4fce-9030-92401be2e16f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.490884 Oct 28 19:28:50.519202 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2236/4473] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:50 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:50.537135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:50.540097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:50.548678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.549561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.550183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.551102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.551804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.554143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.830097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.843045 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5dcbd08e-0965-4caa-8d61-d2c99e24a0bc tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.565210 Oct 28 19:28:50.843888 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2238/4474] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:50 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:50.849340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7030b042-3bf8-483d-8b9f-fc73e4b91d2e req-b13e5648-6196-46e9-9027-6517aa5424c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab5d632-c743-409f-a244-4a0ce5e1a550", "tag": "120c1614-2f19-4c29-b626-34215687c796"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:50.867790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7030b042-3bf8-483d-8b9f-fc73e4b91d2e req-b13e5648-6196-46e9-9027-6517aa5424c9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.868709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7030b042-3bf8-483d-8b9f-fc73e4b91d2e req-b13e5648-6196-46e9-9027-6517aa5424c9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.870373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7030b042-3bf8-483d-8b9f-fc73e4b91d2e req-b13e5648-6196-46e9-9027-6517aa5424c9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.885840 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7030b042-3bf8-483d-8b9f-fc73e4b91d2e req-b13e5648-6196-46e9-9027-6517aa5424c9 service nova] Creating event network-changed:120c1614-2f19-4c29-b626-34215687c796 for instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 on n-h2-862769-3 Oct 28 19:28:50.894058 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7030b042-3bf8-483d-8b9f-fc73e4b91d2e req-b13e5648-6196-46e9-9027-6517aa5424c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048682 Oct 28 19:28:50.895540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2239/4475] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:50.903484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:50.904886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:50.915924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.917273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.917273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.918260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:50.918765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:50.919517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:50.925855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:50.978942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:50.990914 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54b29e53-c500-4cc3-8254-0ad5b4a5b688 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.456804 Oct 28 19:28:50.992525 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2237/4476] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:50 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:51.017535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-110c9eb9-da7f-4d1c-92be-5f9ab23c7352 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:51.021850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-110c9eb9-da7f-4d1c-92be-5f9ab23c7352 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 8e0f5ec7-7746-4add-bb77-609fc3b37f1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.041626 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-110c9eb9-da7f-4d1c-92be-5f9ab23c7352 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 8e0f5ec7-7746-4add-bb77-609fc3b37f1f could not be found. Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-110c9eb9-da7f-4d1c-92be-5f9ab23c7352 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/8e0f5ec7-7746-4add-bb77-609fc3b37f1f/action HTTP/1.1 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 39 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: {"os-getConsoleOutput": {"length": 10}} Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 8e0f5ec7-7746-4add-bb77-609fc3b37f1f could not be found. Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8e0f5ec7-7746-4add-bb77-609fc3b37f1f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0f5ec7-7746-4add-bb77-609fc3b37f1f could not be found. Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0f5ec7-7746-4add-bb77-609fc3b37f1f could not be found. Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.057289 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0f5ec7-7746-4add-bb77-609fc3b37f1f could not be found. Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.062253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-110c9eb9-da7f-4d1c-92be-5f9ab23c7352 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 8e0f5ec7-7746-4add-bb77-609fc3b37f1f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:51.062933 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-110c9eb9-da7f-4d1c-92be-5f9ab23c7352 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/8e0f5ec7-7746-4add-bb77-609fc3b37f1f/action" status: 404 len: 111 microversion: 2.1 time: 0.049011 Oct 28 19:28:51.067544 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2238/4477] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:51 2022] POST /compute/v2.1/servers/8e0f5ec7-7746-4add-bb77-609fc3b37f1f/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:28:51.081129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.083739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.097061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.097862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.099182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.100405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.101232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.102007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.119536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.130537 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb22d450-4d87-49ad-8a03-fd2c80341da5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.233259 Oct 28 19:28:51.142938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:51.146524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2240/4478] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:50 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:51.154660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.155347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.169323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.172872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.173394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.175055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.175541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.176120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.251518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.276806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.279855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.282067 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4057a690-29e3-4c8c-825b-9e8b65386157 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.216356 Oct 28 19:28:51.283406 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2239/4479] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:51.324211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.325146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.336332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.337282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.338174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.339877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.341551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.342831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.382950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.401428 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4822fa3-99d1-4b36-b47c-367f9537c02e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.256585 Oct 28 19:28:51.402055 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2241/4480] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:51.429347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.430225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.437725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.438461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.439127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.440089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.440764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.441333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.590830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.604202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6742dd91-623b-4006-90a4-d2963b337994 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.282501 Oct 28 19:28:51.605270 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2240/4481] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:51.688126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:51.767344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:51.773375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:51.785688 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4c4127c8-bfc3-476d-af50-4585c545e35b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.360323 Oct 28 19:28:51.787613 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2242/4482] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:51.814832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3beeec40-0ed2-4ab9-bb9d-67f444f9ad18 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.815641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3beeec40-0ed2-4ab9-bb9d-67f444f9ad18 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 872ca454-42f3-4ada-91c8-192143cb3a6d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.821690 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3beeec40-0ed2-4ab9-bb9d-67f444f9ad18 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 872ca454-42f3-4ada-91c8-192143cb3a6d could not be found. Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3beeec40-0ed2-4ab9-bb9d-67f444f9ad18 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/872ca454-42f3-4ada-91c8-192143cb3a6d HTTP/1.1 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 872ca454-42f3-4ada-91c8-192143cb3a6d could not be found. Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '872ca454-42f3-4ada-91c8-192143cb3a6d'} Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872ca454-42f3-4ada-91c8-192143cb3a6d could not be found. Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872ca454-42f3-4ada-91c8-192143cb3a6d could not be found. Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:51.823489 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:51.828273 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:51.828273 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:51.828273 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:51.828273 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872ca454-42f3-4ada-91c8-192143cb3a6d could not be found. Oct 28 19:28:51.828273 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:51.829860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3beeec40-0ed2-4ab9-bb9d-67f444f9ad18 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 872ca454-42f3-4ada-91c8-192143cb3a6d could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:51.831291 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3beeec40-0ed2-4ab9-bb9d-67f444f9ad18 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/872ca454-42f3-4ada-91c8-192143cb3a6d" status: 404 len: 111 microversion: 2.1 time: 0.021238 Oct 28 19:28:51.832449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2241/4483] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/872ca454-42f3-4ada-91c8-192143cb3a6d => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:51.841542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.842756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.853402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.854076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.854709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.855620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.856235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.856807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.867836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:51.868654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:51.897183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.897734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.898353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:51.899336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:51.899952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:51.900673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.177414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.190184 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1986a06-c162-4291-9353-72bb7ace941a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.352898 Oct 28 19:28:52.193770 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2243/4484] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:52.205075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:52.205932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:52.222282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.225225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.227318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.230073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.230857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.231687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.234278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.246606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3add43fb-de5f-440d-8e13-428072a866a2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.382927 Oct 28 19:28:52.247318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2242/4485] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:51 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:52.253093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:52.254418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:52.262999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.263767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.264407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.265260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.266150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.266770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.291812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:52.557023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.566441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f8ecd4d-d9ed-46d1-a1b9-ef18e4736fe9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.317762 Oct 28 19:28:52.569245 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2243/4486] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:52 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:52.579595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:52.579595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:52.593545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.596131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.596695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.601484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.602379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.603139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.658618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.671530 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8c5e299-a21e-4a70-8319-8b8e522d8470 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.475974 Oct 28 19:28:52.672682 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2244/4487] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:52 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:52.678115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:52.679103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:52.687780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.688623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.689223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.690553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.692230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.693128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.783994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.795141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.797478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:52.800880 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d139942c-ef1b-4065-95ba-1f46c255b60f tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.230578 Oct 28 19:28:52.810908 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2244/4488] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:52 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:52.842230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6eb0c2b-3056-460b-815c-47f66e99d6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1111173734", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6eb0c2b-3056-460b-815c-47f66e99d6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 238 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1111173734", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1111173734', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.855520 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6eb0c2b-3056-460b-815c-47f66e99d6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:52.860290 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6eb0c2b-3056-460b-815c-47f66e99d6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023370 Oct 28 19:28:52.862271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2245/4489] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:52.871797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:52.872555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:52.882032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.883406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.884196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:52.885310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:52.886318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:52.887137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.033218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.047668 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95587814-1535-41eb-9b24-71d181a62ef3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.373591 Oct 28 19:28:53.050705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2245/4490] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:52 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:53.145185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.154973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b2cbb3c-9208-4bd4-b1a1-dd457cb21427 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.288788 Oct 28 19:28:53.159213 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2246/4491] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:52 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:53.202375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:53.204182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:53.232989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.233527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.234003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.234800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.235336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.235919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.275529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:53.276198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:53.285727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.286482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.289228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.291587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.291930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.292366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.530236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.539062 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-563c39df-8a9a-4d4d-8d92-2aba66b27f44 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.358132 Oct 28 19:28:53.552793 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2246/4492] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:53 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:53.561867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.574973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f74f7674-34b4-4be3-9ae9-79ff9a1c701d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1677 microversion: 2.1 time: 0.300570 Oct 28 19:28:53.576040 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2247/4493] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:53 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1677 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:53.733410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:53.734024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:53.747991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.749407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.749844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.750562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.751045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.752493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.825484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afbc8da5-6e57-4ced-a598-eeef62f0ba8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-597621520", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afbc8da5-6e57-4ced-a598-eeef62f0ba8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 234 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-597621520", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-597621520', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.829826 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afbc8da5-6e57-4ced-a598-eeef62f0ba8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:53.835672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-afbc8da5-6e57-4ced-a598-eeef62f0ba8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010252 Oct 28 19:28:53.838104 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2248/4494] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:53 2022] POST /compute/v2.1/servers => generated 133 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:28:53.842189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:53.842910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:53.851094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.851626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.852058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.852835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:53.853387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:53.853810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:53.972301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.986232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.989274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:53.994045 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb5cb89f-7449-4395-887f-46218bceaf95 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.156753 Oct 28 19:28:53.998261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2249/4495] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:53 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:54.009366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:54.009990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:54.017634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.018311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.026248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.028602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.029101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.029535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.123641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:54.142507 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25d51a0c-5a7b-4997-8209-17be778e44d5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.408849 Oct 28 19:28:54.143223 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2247/4496] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:53 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:54.206653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:54.209943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:54.228742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.229248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.236355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.237029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.238317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.238977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.424508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:54.434098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17055711-1a1b-4da0-83ad-8bf9700067e9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.433617 Oct 28 19:28:54.434098 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2250/4497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:53 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:54.444536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-39b95959-7b64-4f47-8466-c2f2f4ac8b08 req-969e3382-ae2c-4009-a8cb-42e9bc014060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "name": "network-vif-plugged", "status": "completed", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:54.465167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39b95959-7b64-4f47-8466-c2f2f4ac8b08 req-969e3382-ae2c-4009-a8cb-42e9bc014060 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.466243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39b95959-7b64-4f47-8466-c2f2f4ac8b08 req-969e3382-ae2c-4009-a8cb-42e9bc014060 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.466896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39b95959-7b64-4f47-8466-c2f2f4ac8b08 req-969e3382-ae2c-4009-a8cb-42e9bc014060 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.493997 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-39b95959-7b64-4f47-8466-c2f2f4ac8b08 req-969e3382-ae2c-4009-a8cb-42e9bc014060 service nova] Creating event network-vif-plugged:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:28:54.505747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-39b95959-7b64-4f47-8466-c2f2f4ac8b08 req-969e3382-ae2c-4009-a8cb-42e9bc014060 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070362 Oct 28 19:28:54.506364 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2251/4498] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:54.512028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:54.528140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:54.528549 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-19f01d78-7a08-4fe3-bddc-2db1f232c8a7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.350826 Oct 28 19:28:54.528861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:54.529517 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2248/4499] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:54 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:54.543844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.545072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.545666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.546794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.547268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.548079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.599571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:54.600193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:54.613482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.614279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.614744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.615475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.617977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.618930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.813824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:54.824659 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-feb0a9f4-e2af-403f-a070-5a3c9828cda5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.315505 Oct 28 19:28:54.825556 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2252/4500] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:54 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:54.847156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04642fb9-0dfe-4c94-8cf0-ce523efcb6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:54.847953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04642fb9-0dfe-4c94-8cf0-ce523efcb6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 65b2a518-8d94-4896-9bf1-d2790249c03f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:54.854285 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-04642fb9-0dfe-4c94-8cf0-ce523efcb6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 65b2a518-8d94-4896-9bf1-d2790249c03f could not be found. Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04642fb9-0dfe-4c94-8cf0-ce523efcb6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/65b2a518-8d94-4896-9bf1-d2790249c03f/action HTTP/1.1 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 13 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: {"pause": {}} Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 65b2a518-8d94-4896-9bf1-d2790249c03f could not be found. Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '65b2a518-8d94-4896-9bf1-d2790249c03f', 'body': {'pause': {}}} Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b2a518-8d94-4896-9bf1-d2790249c03f could not be found. Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b2a518-8d94-4896-9bf1-d2790249c03f could not be found. Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:54.863276 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:54.867906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:54.867906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:54.867906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b2a518-8d94-4896-9bf1-d2790249c03f could not be found. Oct 28 19:28:54.867906 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:54.869147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04642fb9-0dfe-4c94-8cf0-ce523efcb6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 65b2a518-8d94-4896-9bf1-d2790249c03f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:54.870474 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04642fb9-0dfe-4c94-8cf0-ce523efcb6fe tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/65b2a518-8d94-4896-9bf1-d2790249c03f/action" status: 404 len: 111 microversion: 2.1 time: 0.027178 Oct 28 19:28:54.872124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:54.875137 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2253/4501] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:54 2022] POST /compute/v2.1/servers/65b2a518-8d94-4896-9bf1-d2790249c03f/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:28:54.883268 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02b74c46-c2fb-49ae-ab6a-875b9e540a8d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1654 microversion: 2.1 time: 0.288223 Oct 28 19:28:54.883921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:54.884752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:54.890730 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2249/4502] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:54 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1654 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:54.898888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.900202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.901700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.903006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.905329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.905864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:54.910524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e44d7c38-3e39-4f1d-adc2-8bddcbcb23fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:54.929613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e44d7c38-3e39-4f1d-adc2-8bddcbcb23fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:54.930119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e44d7c38-3e39-4f1d-adc2-8bddcbcb23fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:54.930561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e44d7c38-3e39-4f1d-adc2-8bddcbcb23fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.001178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e44d7c38-3e39-4f1d-adc2-8bddcbcb23fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Going to try to start instance {{(pid=120628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:28:55.075513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.085193 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9d4a0dc7-3fcf-4124-a7ab-f02ac94a5212 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.207763 Oct 28 19:28:55.086308 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2254/4503] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:54 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:55.092122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:55.092910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:55.096144 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e44d7c38-3e39-4f1d-adc2-8bddcbcb23fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.189767 Oct 28 19:28:55.097334 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2250/4504] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:54 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:28:55.099674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.100195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.100783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.101729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.102320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.102941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.121397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:55.122567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:55.134926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.136101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.136692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.137751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.138374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.139001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.202434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.229000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.237692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.240709 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68df8837-194f-452e-b77c-79065cf5155d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1409 microversion: 2.54 time: 0.151807 Oct 28 19:28:55.243096 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2255/4505] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:55 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:55.254293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:55.258246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:55.274004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.276064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.276529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.293426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.294356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.294824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.407801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.417662 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a9d65e9-7ee8-43a6-bb18-03be333455a8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1663 microversion: 2.1 time: 0.316207 Oct 28 19:28:55.427102 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2251/4506] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:55 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1663 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:55.437230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:55.440389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:55.452701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:55.458033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.459537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.460129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.464964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.465650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.466408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.768833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.780942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff99c184-f84d-47e3-bd55-066c7df18afb tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.535428 Oct 28 19:28:55.781728 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2256/4507] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:55 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:55.789146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:55.800012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:55.816706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.818631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.821163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.822357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.823739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.824836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.887880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:55.896579 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd151490-82d2-4ef0-b36e-922b440f780a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.468049 Oct 28 19:28:55.912543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2252/4508] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:55 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:55.921559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:55.923346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:55.939574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.940356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.941025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:55.941905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:55.945725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:55.946381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.063500 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc41dd78-3c93-4cf8-b965-f03bfd95e0ca tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.147146 Oct 28 19:28:56.064765 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2253/4509] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:55 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:28:56.079177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:56.080338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:56.089260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.090114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.091214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.091487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.092298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.092946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.138058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:56.160193 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d32860bc-3213-46ff-a5cd-4f52ff30ef66 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1316 microversion: 2.1 time: 0.366983 Oct 28 19:28:56.161765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2257/4510] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:55 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:56.275529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:56.276412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:56.285422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.286125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.286726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.287565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.288177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.288588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.420251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:56.430122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:56.432563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:56.434089 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5b95525-0537-4a99-babb-530b891596de tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1415 microversion: 2.54 time: 0.164455 Oct 28 19:28:56.435288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2258/4511] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:56 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1415 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:28:56.454364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:56.455995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:56.456765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:56.458815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:56.465498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.466361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.466864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.467998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.469685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.469815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2eaa7a58-7342-464c-8f7a-86cc6d72e9d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1511 microversion: 2.1 time: 0.400861 Oct 28 19:28:56.470398 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2254/4512] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:56 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:56.470819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.551967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c8ea8152-41c1-45b8-bca0-3a2ee3bcee5e req-adf504f9-71ba-4541-86da-0d76e4750001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab5d632-c743-409f-a244-4a0ce5e1a550", "name": "network-vif-plugged", "status": "completed", "tag": "120c1614-2f19-4c29-b626-34215687c796"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:56.569255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c8ea8152-41c1-45b8-bca0-3a2ee3bcee5e req-adf504f9-71ba-4541-86da-0d76e4750001 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.570455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c8ea8152-41c1-45b8-bca0-3a2ee3bcee5e req-adf504f9-71ba-4541-86da-0d76e4750001 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.571143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c8ea8152-41c1-45b8-bca0-3a2ee3bcee5e req-adf504f9-71ba-4541-86da-0d76e4750001 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.588173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c8ea8152-41c1-45b8-bca0-3a2ee3bcee5e req-adf504f9-71ba-4541-86da-0d76e4750001 service nova] Creating event network-vif-plugged:120c1614-2f19-4c29-b626-34215687c796 for instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 on n-h2-862769-3 Oct 28 19:28:56.597281 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c8ea8152-41c1-45b8-bca0-3a2ee3bcee5e req-adf504f9-71ba-4541-86da-0d76e4750001 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048573 Oct 28 19:28:56.598531 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2255/4513] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:56.805142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:56.836491 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4aa77e7-395c-4aed-beb3-6e94b0a78279 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1663 microversion: 2.1 time: 0.384751 Oct 28 19:28:56.837756 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2259/4514] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:56 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1663 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:56.929710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:56.930756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:56.942304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.943700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.944686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:56.945697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:56.946352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:56.948553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:57.173965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:57.183928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:57.184539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:57.190888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ffffe93-2359-455c-a6b1-db71406a0c76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1308 microversion: 2.1 time: 0.267986 Oct 28 19:28:57.192197 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2256/4515] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:56 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:57.233194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:57.234206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:57.234820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:57.239917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:57.240791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:57.240911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:57.463235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:57.464245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:57.490128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:57.490635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:57.491103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:57.491819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:57.492277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:57.492707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:57.608875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:57.611686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:57.619183 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fd8feb2-9c50-4e3f-bc7b-4607696f8fe7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1466 microversion: 2.1 time: 0.439492 Oct 28 19:28:57.643172 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2260/4516] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:57 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1466 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:57.654605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:57.655622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:57.662315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:57.662967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:57.663472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:57.664387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:57.664907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:57.665414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.210108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:58.237315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:58.239912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:58.243714 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3db9eb7f-067a-46b5-ab43-dbf65ea02d27 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1415 microversion: 2.54 time: 0.782642 Oct 28 19:28:58.245098 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2257/4517] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:57 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1415 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:58.251609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-865719720", "metadata": {"image_type": "test"}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:58.256086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:58.265054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.266095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.266806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.268732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.269527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.270461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.397514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Getting quotas for project d36609a3ce9f441ba031b1d384fca5b8. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:58.404679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Getting quotas for user bddb9f9bc0d345f39ae73192f4433f63 and project d36609a3ce9f441ba031b1d384fca5b8. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:58.475531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:58.487758 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-036b65f0-2a12-4819-a433-4c78f1eaed8b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1491 microversion: 2.1 time: 0.843196 Oct 28 19:28:58.488623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2261/4518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:57 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1491 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:58.520926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:58.520926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:58.520926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.520926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.521361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.522008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.529068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.529517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.689726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69cca637-ec9d-4c80-8cd9-422ed14b2c1c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "POST /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39/action" status: 202 len: 0 microversion: 2.1 time: 0.442990 Oct 28 19:28:58.702838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2258/4519] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:58 2022] POST /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:28:58.710491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:58.716424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:58.743616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.744505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.748793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.770099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.773687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.788397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.877278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:58.889877 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b1104af-9106-4a80-bf02-098de2f4773d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1663 microversion: 2.1 time: 0.387598 Oct 28 19:28:58.892481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2262/4520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:58 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1663 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:58.912046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:58.912984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:58.924049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.925599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.926867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:58.929780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:58.932026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:58.934406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.008334 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'pause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state paused Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 13 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: {"pause": {}} Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: exception: Cannot 'pause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state paused Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'pause': {}}} Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state paused. Cannot pause while the instance is in this state. Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state paused Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:59.009870 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:59.014110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:59.014110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:59.014110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:59.014110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state paused Oct 28 19:28:59.014110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:28:59.016949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'pause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state paused {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:59.017824 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35f5c16c-da4b-4423-9f3d-10b513c1aa0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 143 microversion: 2.1 time: 0.122587 Oct 28 19:28:59.021226 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2263/4521] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:58 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 143 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:28:59.029707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c03db57-ab98-43f2-b9f4-f16ab3b81ffa tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768e3e50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:59.102902 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c03db57-ab98-43f2-b9f4-f16ab3b81ffa tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.079476 Oct 28 19:28:59.103836 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2264/4522] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:28:59 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:59.125146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:59.125686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:59.145614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.146115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.146558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.147258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.147705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.148119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.154601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:59.164448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-920d329e-5b26-4079-bd76-f567103a01f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1489 microversion: 2.1 time: 0.460167 Oct 28 19:28:59.165276 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2259/4523] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:58 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1489 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:59.258451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2b58980-3e6b-461d-926e-55e8836992c9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.140297 Oct 28 19:28:59.258838 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2265/4524] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:59 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:28:59.266366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:59.268182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:59.284516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:59.285017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:59.287692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.288200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.288633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.291491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.293157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.293633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.308426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.308952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.309393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.310082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.310847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.311460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.385028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:59.394459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:59.398564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:59.408315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82f8be10-d4c2-4870-acd5-a16569bb9a91 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1400 microversion: 2.54 time: 0.129363 Oct 28 19:28:59.422722 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2266/4525] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:28:59 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1400 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:28:59.422722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-797753639", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:59.507180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:28:59.647490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:59.660754 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de853c99-46cc-49c8-b2e4-61e23a1711f2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1498 microversion: 2.1 time: 0.398616 Oct 28 19:28:59.667720 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2260/4526] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:59 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:59.679807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-367898da-151e-4297-95a1-1d92cc3a1d44 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '.version_select at 0x7f1d773d9790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:59.720304 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-367898da-151e-4297-95a1-1d92cc3a1d44 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1259329686" status: 204 len: 0 microversion: 2.54 time: 0.050876 Oct 28 19:28:59.738275 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2261/4527] 10.222.0.44 () {60 vars in 1319 bytes} [Fri Oct 28 19:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1259329686 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:28:59.761844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:59.765036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:59.774453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.780790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.781537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.782474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.783213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.784594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.851235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:28:59.951223 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11b20cec-bc72-4584-9d3f-78e18c01a56a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 204 len: 0 microversion: 2.54 time: 0.199308 Oct 28 19:28:59.952034 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2262/4528] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:28:59 2022] DELETE /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:28:59.963263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:59.964292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:28:59.972037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.973491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.974722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:59.975638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:59.976844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:59.977811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.326405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:00.339099 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b569ff4-76da-4969-9d49-9d0293c840bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.380908 Oct 28 19:29:00.340672 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2263/4529] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:59 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:00.346407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:00.347256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:00.354528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.355444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.356299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.357155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.358739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.360024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.424759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:29:00.425254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:29:00.425840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:29:00.426310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:29:00.426842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:29:00.437186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.438011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.438716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.440182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.440997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.442421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.472580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:29:00.481601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:29:00.486392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:00.504474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:00.507977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:29:00.517044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:00.518767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:29:00.530130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:00.531323 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ed1956e-2711-4d47-89e3-c1d925b95562 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1406 microversion: 2.54 time: 0.189508 Oct 28 19:29:00.531897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2264/4530] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:29:00 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:29:00.561794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f070dfb0-1420-4548-9935-fe6d49c2c9cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d773ace50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:00.614583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f070dfb0-1420-4548-9935-fe6d49c2c9cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.070887 Oct 28 19:29:00.616314 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2265/4531] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:00 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:00.622116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:00.623107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:00.629943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.630853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.631670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.632477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.633000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.633495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.668858 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa910968-66f8-4662-afa4-1a75c8d4c638 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258376 Oct 28 19:29:00.676258 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2267/4532] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:29:00.682114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2f6721c-3aee-4ba0-86e4-a6489806caf0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:00.683085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2f6721c-3aee-4ba0-86e4-a6489806caf0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:00.798143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2f6721c-3aee-4ba0-86e4-a6489806caf0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:00.807952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2f6721c-3aee-4ba0-86e4-a6489806caf0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1208 microversion: 2.1 time: 0.128507 Oct 28 19:29:00.808803 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2268/4533] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:00 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:00.832483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:00.835003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:00.849888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.850280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.853280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:00.854683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:00.855054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:00.857414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.015554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.025305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d251bf60-68ac-45c8-8719-108aa4229bc5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.407687 Oct 28 19:29:01.028162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2266/4534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:00 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:01.061154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:01.061913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:01.080956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.082306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.084130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.087050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.087794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.088622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.289756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.301644 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db754802-499d-4522-bcd3-4258542f45c5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.483832 Oct 28 19:29:01.303215 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2269/4535] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:00 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:01.327743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:01.328842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:01.344132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.344964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.345550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.347118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.347806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.348540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.457804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.471714 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0923d2e6-86eb-4e64-b93c-5d901c0fab9f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.417951 Oct 28 19:29:01.473199 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2267/4536] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:01 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:01.499972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:01.500592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:01.517174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.517720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.518206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.518976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.519460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.519997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.688995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.703116 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2b92ff5-2523-4170-b702-98fc4e0ea639 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.380612 Oct 28 19:29:01.704198 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2270/4537] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:01 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:01.718838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:01.719850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:01.726764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.727222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.727661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.728372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:01.733259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:01.740205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:01.970825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.990952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.994166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:01.997441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-493e2cc1-f4e8-40ed-9678-b76cff7cdf5d tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1406 microversion: 2.54 time: 0.292255 Oct 28 19:29:01.999164 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2271/4538] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:29:01 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:29:02.014400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b0ca544-3516-46b8-9158-18796cb8443c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7697c0d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:02.102108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:02.120899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b0ca544-3516-46b8-9158-18796cb8443c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.119395 Oct 28 19:29:02.123065 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2272/4539] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:02 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:02.143737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:02.152715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:02.169272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.170169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.172364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.174924 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dfd5fd72-4f5d-49f2-98d2-4c27c443f109 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.676464 Oct 28 19:29:02.175252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.176295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.178286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.181247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2268/4540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:01 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:02.206517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:02.206517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:02.220044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.220587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.222220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.224196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.226241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.226709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.240212 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811/action HTTP/1.1 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 28 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: {"reboot": {"type": "SOFT"}} Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4e536842-38fb-4b72-9bbe-f32123e53811', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:02.246633 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a31ba09-85d2-4a61-9f17-e43ef8e33842 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811/action" status: 404 len: 111 microversion: 2.1 time: 0.122771 Oct 28 19:29:02.251830 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2273/4541] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:02 2022] POST /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811/action => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:02.259532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:02.260142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:02.280136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.280930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.282961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.285023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.285682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.287338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.440318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:02.456449 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30a9513d-cf52-43c2-8772-082729dba707 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1260 microversion: 2.1 time: 0.271421 Oct 28 19:29:02.459341 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2269/4542] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:02 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:02.488807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:02.492186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:02.510296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.511108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.512083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.513091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:02.516165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:02.517733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:02.585854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:03.377254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:03.391314 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f745d57-6fcf-4d4e-aaca-f3020f408e69 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 1.141363 Oct 28 19:29:03.392588 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2274/4543] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:02 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:03.409012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:03.421665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:03.432012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:03.432742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:03.433401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:03.434278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:03.434922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:03.435676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:03.485217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:03.486060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:03.486651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:03.487476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lazy-loading 'fault' on Instance uuid 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:03.713844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:03.727161 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b0bdb77-d706-4881-addc-a864609ff6c1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.265687 Oct 28 19:29:03.727827 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2270/4544] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:02 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:03.738799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc79093c-18f4-4e15-aec2-d7cdf4cbd594 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d77392dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:03.743103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:03.761661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:03.776248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b8ebe31561844623a8e0bd6fbd3b041b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6968336b75749e1a7925e66353025a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:03.781227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f1735aca-f457-47c3-90dd-d636a75e8295 tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 200 len: 1411 microversion: 2.54 time: 0.387380 Oct 28 19:29:03.795756 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2275/4545] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:29:03 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 1411 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:29:03.817892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:03.819717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:03.842308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:03.846364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:03.846872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:03.847620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:03.848249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:03.849526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:03.882291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc79093c-18f4-4e15-aec2-d7cdf4cbd594 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.153319 Oct 28 19:29:03.890584 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2271/4546] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:03 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:03.917714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lazy-loading 'flavor' on Instance uuid f1b86398-b5dd-4e34-a35d-ee6081efa9c5 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:03.985006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:03.986026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:03.998273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:03.998560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.000336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.001299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:04.001918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.002534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.112607 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4076687-7cae-4170-b81c-1f23563346bb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.315100 Oct 28 19:29:04.113360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2276/4547] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:03 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:29:04.127488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:04.128233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:04.136652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:04.148456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:04.149262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.149892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.151058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:04.151702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.152423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.160414 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-288a11bf-a8a1-4fe0-a5f3-0b0fcd55520b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1266 microversion: 2.1 time: 0.230701 Oct 28 19:29:04.163349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2272/4548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:03 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:04.182110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:04.187106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:04.202408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:04.204498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.205205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.206124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:04.211210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.212283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.774599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:04.784745 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9f387194-dee3-4774-a8c5-54698b6c1dd3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.667511 Oct 28 19:29:04.785329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2277/4549] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:04 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:04.811793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-64223f6d-dff6-473a-9556-2201a53e8053 req-54da29f8-f4ec-4412-9f33-03ac0a8be7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "name": "network-vif-plugged", "status": "completed", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:04.869930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64223f6d-dff6-473a-9556-2201a53e8053 req-54da29f8-f4ec-4412-9f33-03ac0a8be7c6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:04.870832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64223f6d-dff6-473a-9556-2201a53e8053 req-54da29f8-f4ec-4412-9f33-03ac0a8be7c6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:04.871437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64223f6d-dff6-473a-9556-2201a53e8053 req-54da29f8-f4ec-4412-9f33-03ac0a8be7c6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:04.915877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:04.923134 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-64223f6d-dff6-473a-9556-2201a53e8053 req-54da29f8-f4ec-4412-9f33-03ac0a8be7c6 service nova] Creating event network-vif-plugged:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:29:04.928612 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9db494fe-a4df-48b0-9cef-6fe66e3ac683 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1675 microversion: 2.1 time: 0.760536 Oct 28 19:29:04.928950 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2273/4550] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:04 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1675 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:04.945222 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-64223f6d-dff6-473a-9556-2201a53e8053 req-54da29f8-f4ec-4412-9f33-03ac0a8be7c6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152396 Oct 28 19:29:04.948037 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2278/4551] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:04.959477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4d9ddef-be0d-4343-84e7-ab2ddb4c0bf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:04.969356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4d9ddef-be0d-4343-84e7-ab2ddb4c0bf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 7e614cf3-539f-49cf-9747-5f8ddb509387] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:04.974537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:04.979366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] [instance: 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:04.995720 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f4d9ddef-be0d-4343-84e7-ab2ddb4c0bf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 7e614cf3-539f-49cf-9747-5f8ddb509387 could not be found. Oct 28 19:29:05.004559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4d9ddef-be0d-4343-84e7-ab2ddb4c0bf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7e614cf3-539f-49cf-9747-5f8ddb509387/action HTTP/1.1 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 28 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: {"reboot": {"type": "SOFT"}} Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7e614cf3-539f-49cf-9747-5f8ddb509387 could not be found. Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7e614cf3-539f-49cf-9747-5f8ddb509387', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e614cf3-539f-49cf-9747-5f8ddb509387 could not be found. Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e614cf3-539f-49cf-9747-5f8ddb509387 could not be found. Oct 28 19:29:05.007311 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e614cf3-539f-49cf-9747-5f8ddb509387 could not be found. Oct 28 19:29:05.011848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.014218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:05.015290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4d9ddef-be0d-4343-84e7-ab2ddb4c0bf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 7e614cf3-539f-49cf-9747-5f8ddb509387 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:05.016918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:05.018053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4d9ddef-be0d-4343-84e7-ab2ddb4c0bf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/7e614cf3-539f-49cf-9747-5f8ddb509387/action" status: 404 len: 111 microversion: 2.1 time: 0.080386 Oct 28 19:29:05.020346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:05.022088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2274/4552] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:04 2022] POST /compute/v2.1/servers/7e614cf3-539f-49cf-9747-5f8ddb509387/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:05.023748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:05.027171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:05.045405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b585e6df-dc68-4172-9638-c5b667cf4de7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d777d6940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:05.081695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] HTTP exception thrown: Instance 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc could not be found. Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Request method failure captured: Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc HTTP/1.1 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC1TsyKZmapEUSJV8Y58HiLw88pdytyA7W-0WSn3tyVgXzIVnhebIUPlIKfgwohaf0Y3NNzts_cTQED5p7h_UECXCSTRy5gXrxzv6Mq1pE6cOJH9GZ3QxdLJg1gAELDE38JSN1LVlrw-4vFOeYV8aPBG0xqhs8yAWlRV74wmYkHy3_o Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.54 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: a6968336b75749e1a7925e66353025a9 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerShowV254Test-922729534 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a6968336b75749e1a7925e66353025a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a6968336b75749e1a7925e66353025a9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a6968336b75749e1a7925e66353025a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a6968336b75749e1a7925e66353025a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerShowV254Test-922729534 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: a6968336b75749e1a7925e66353025a9 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerShowV254Test-922729534 Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerShowV254Test-922729534-project Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: b8ebe31561844623a8e0bd6fbd3b041b Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerShowV254Test-922729534-project Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc could not be found. Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7ea8554d-2d54-41f5-a8d7-3c46904e4ccc'} Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc could not be found. Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc could not be found. Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:05.107618 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc could not be found. Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] Returning 404 to user: Instance 7ea8554d-2d54-41f5-a8d7-3c46904e4ccc could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:05.111946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7eddbf4-1fe7-4f27-9fe8-46a93077182a tempest-ServerShowV254Test-922729534 tempest-ServerShowV254Test-922729534-project] 10.222.0.44 "GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc" status: 404 len: 111 microversion: 2.54 time: 0.152767 Oct 28 19:29:05.127598 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2279/4553] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:29:04 2022] GET /compute/v2.1/servers/7ea8554d-2d54-41f5-a8d7-3c46904e4ccc => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:29:05.135416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b585e6df-dc68-4172-9638-c5b667cf4de7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.110291 Oct 28 19:29:05.141733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:05.145117 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2275/4554] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:05 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:05.160166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:05.196921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:05.197801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:05.198628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:05.200574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:05.201301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:05.201424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:05.208105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:05.208725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:05.229723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:05.255485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:05.256555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:05.258597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:05.260634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:05.262958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:05.323954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:06.660881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:06.680673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec417d58-5e40-4be5-b2e1-8d0b0b67a3d4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.554640 Oct 28 19:29:06.701779 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2280/4555] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:05 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:06.704110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:06.710788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:06.740893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:06.749218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:06.751676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:06.752726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:06.753720 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ca62872-e420-4db2-b5a9-1f93bdbeb397 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 1.568135 Oct 28 19:29:06.754993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:06.757788 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2276/4556] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:05 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:06.759710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:06.762778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c4d919f-5d37-49b3-9336-13946e1cef71 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d774e8d30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:06.763286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:06.885946 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c4d919f-5d37-49b3-9336-13946e1cef71 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.126891 Oct 28 19:29:06.894606 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2277/4557] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:06 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:06.899950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:06.912343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:06.940647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:06.941545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:06.942217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:06.943310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:06.943976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:06.944634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.373592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:07.389556 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a22c423e-daf5-421a-a765-5a261ae89818 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.493428 Oct 28 19:29:07.395049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2278/4558] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:06 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:07.424339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:07.428600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:07.453650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.458782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.460359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.467312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.468232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.469493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.499842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:07.504616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811/action HTTP/1.1 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 65 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '4e536842-38fb-4b72-9bbe-f32123e53811', 'body': {'rebuild': {'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48'}}} Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 19:29:07.511691 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:29:07.515734 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:07.516892 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71f46144-1add-4671-ac43-c680b8f5aefa tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1658 microversion: 2.1 time: 0.829123 Oct 28 19:29:07.519693 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2281/4559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:06 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1658 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:07.535118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:07.546841 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c60d3753-e5a1-4f54-91ea-f8ff6cc8acc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811/action" status: 404 len: 111 microversion: 2.1 time: 0.129166 Oct 28 19:29:07.548224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2279/4560] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:07 2022] POST /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811/action => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:29:07.556373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:07.557127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:07.557799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:07.560771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:07.586644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.587165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.591346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.592536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.593253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.593485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.593758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.594463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.599087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.603018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.604335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.606243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.766879 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d71772f3-2b88-407d-8417-e1613ab53eac tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.222995 Oct 28 19:29:07.767899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2282/4561] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:07 2022] POST /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:29:07.778456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:07.779264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:07.803563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.809304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.810112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:07.811014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:07.824650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:07.825179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:08.527109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:08.551225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-66082f60-9619-42e9-8efc-a86c30223f0d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.992890 Oct 28 19:29:08.566532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2280/4562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:07 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:08.584450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:08.589630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:08.605533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:08.612421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:08.613143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:08.614197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:08.614844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:08.615461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:08.709847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:08.729787 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-327f010f-75d0-4ebc-b76f-e52bff1e3a26 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1664 microversion: 2.1 time: 0.948486 Oct 28 19:29:08.730932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2283/4563] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:07 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1664 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:08.737981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4455f2d-c55d-49df-99eb-46ec346415fd tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d769bbdc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:08.840907 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4455f2d-c55d-49df-99eb-46ec346415fd tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.108702 Oct 28 19:29:08.842227 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2284/4564] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:08 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:08.865096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:08.866120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:08.875226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:08.876590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:08.877234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:08.878341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:08.879407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:08.898250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:09.101787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:09.124551 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fb1cfe42-2a37-482c-a36f-e8fe1364409a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 0.554995 Oct 28 19:29:09.138743 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2281/4565] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:08 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:09.492646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a4e69d49-9bb6-4162-ad34-f8013bfc1f39 req-aed2d178-d4b2-4290-8033-38940de40eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adff317-707a-4a36-93a1-291582680c8a", "tag": "88efe451-1fc4-4857-b9b4-7cf210cabca1"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:09.517451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a4e69d49-9bb6-4162-ad34-f8013bfc1f39 req-aed2d178-d4b2-4290-8033-38940de40eaf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:09.519850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a4e69d49-9bb6-4162-ad34-f8013bfc1f39 req-aed2d178-d4b2-4290-8033-38940de40eaf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:09.534799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a4e69d49-9bb6-4162-ad34-f8013bfc1f39 req-aed2d178-d4b2-4290-8033-38940de40eaf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:09.575100 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a4e69d49-9bb6-4162-ad34-f8013bfc1f39 req-aed2d178-d4b2-4290-8033-38940de40eaf service nova] Creating event network-changed:88efe451-1fc4-4857-b9b4-7cf210cabca1 for instance 7adff317-707a-4a36-93a1-291582680c8a on n-h1-862769-3 Oct 28 19:29:09.594039 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a4e69d49-9bb6-4162-ad34-f8013bfc1f39 req-aed2d178-d4b2-4290-8033-38940de40eaf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109559 Oct 28 19:29:09.602596 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2282/4566] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:09.755880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:09.756843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:09.757550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:09.764881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9fd12d80-e707-4aea-9c5f-bd6c87e3f573 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.921352 Oct 28 19:29:09.765477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2285/4567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:08 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:09.780338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:09.780338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:09.780338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:09.780338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:09.780338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:09.780338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:09.793216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52346f88-ef54-444d-9708-81def23e3f7d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:09.806268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-52346f88-ef54-444d-9708-81def23e3f7d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 8dedfb8f-66e5-4076-a03f-66c814b9b935] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:09.832078 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-52346f88-ef54-444d-9708-81def23e3f7d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 8dedfb8f-66e5-4076-a03f-66c814b9b935 could not be found. Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52346f88-ef54-444d-9708-81def23e3f7d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/8dedfb8f-66e5-4076-a03f-66c814b9b935/action HTTP/1.1 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 65 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 8dedfb8f-66e5-4076-a03f-66c814b9b935 could not be found. Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8dedfb8f-66e5-4076-a03f-66c814b9b935', 'body': {'rebuild': {'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48'}}} Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dedfb8f-66e5-4076-a03f-66c814b9b935 could not be found. Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 19:29:09.833794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dedfb8f-66e5-4076-a03f-66c814b9b935 could not be found. Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dedfb8f-66e5-4076-a03f-66c814b9b935 could not be found. Oct 28 19:29:09.839391 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:09.859535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52346f88-ef54-444d-9708-81def23e3f7d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 8dedfb8f-66e5-4076-a03f-66c814b9b935 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:09.861173 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-52346f88-ef54-444d-9708-81def23e3f7d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/8dedfb8f-66e5-4076-a03f-66c814b9b935/action" status: 404 len: 111 microversion: 2.1 time: 0.075842 Oct 28 19:29:09.864533 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2286/4568] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:09 2022] POST /compute/v2.1/servers/8dedfb8f-66e5-4076-a03f-66c814b9b935/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:09.884746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94cbbd9f-18e4-4750-8389-8e011e8f7f6d tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d769eb8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:10.318000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:10.339437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-deca5257-5f69-4202-8395-d7f9231cbb3a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1664 microversion: 2.1 time: 0.587265 Oct 28 19:29:10.354779 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2283/4569] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:09 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1664 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:10.369855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:10.373153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:10.402462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:10.407277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:10.408383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:10.414309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:10.415582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:10.416453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:10.458138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:10.702628 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94cbbd9f-18e4-4750-8389-8e011e8f7f6d tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.835234 Oct 28 19:29:10.703303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2287/4570] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:09 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:10.716307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:10.716937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:10.732373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:10.732876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:10.733314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:10.734025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:10.734480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:10.734930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:10.802866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:11.142551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:11.169373 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.802452 Oct 28 19:29:11.178837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:11.188378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2284/4571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:10 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:11.191861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:11.195342 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b307b57-598a-4c55-8167-4f1fa572657a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005579 Oct 28 19:29:11.203894 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8bae323-8617-48af-b5ed-05d92c5ae064 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 0.493904 Oct 28 19:29:11.203894 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2288/4572] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:10 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:11.204687 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2285/4573] 10.222.0.44 () {56 vars in 886 bytes} [Fri Oct 28 19:29:11 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 19:29:11.229193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:11.250302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:11.271245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:11.283218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:11.283799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:11.284671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:11.285139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:11.286913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:11.374031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:11.386419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:11.411034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:11.415101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:11.415857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:11.416832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:11.417724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:11.418369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:12.802389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:12.814028 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0b6ad65-35c7-4105-b945-b055905b18d9 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.598343 Oct 28 19:29:12.815363 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2289/4574] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:11 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:12.822005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a5a79f3-587b-4524-9109-f62c394fc3a5 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7697c3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:12.836518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:12.852800 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebafd836-bc99-4ad3-a1bf-a1dd80d6d2d2 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 1.482570 Oct 28 19:29:12.857838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2286/4575] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:11 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:12.864878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:12.870744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:12.910603 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a5a79f3-587b-4524-9109-f62c394fc3a5 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.093364 Oct 28 19:29:12.913264 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2290/4576] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:12 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:12.927343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:12.928184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:12.929977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:12.931770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:12.934255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:12.934942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:12.947695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-84cb62ca-e1ce-4a8f-a8c5-ff276fd29ae0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:12.947695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-84cb62ca-e1ce-4a8f-a8c5-ff276fd29ae0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: abd84603-a1d5-4d05-b109-eaacfa09b140] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:12.977219 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-84cb62ca-e1ce-4a8f-a8c5-ff276fd29ae0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance abd84603-a1d5-4d05-b109-eaacfa09b140 could not be found. Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-84cb62ca-e1ce-4a8f-a8c5-ff276fd29ae0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/abd84603-a1d5-4d05-b109-eaacfa09b140/action HTTP/1.1 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 15 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: {"restore": {}} Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance abd84603-a1d5-4d05-b109-eaacfa09b140 could not be found. Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'abd84603-a1d5-4d05-b109-eaacfa09b140', 'body': {'restore': {}}} Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd84603-a1d5-4d05-b109-eaacfa09b140 could not be found. Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd84603-a1d5-4d05-b109-eaacfa09b140 could not be found. Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:12.979007 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:12.986596 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:12.986596 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:12.986596 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd84603-a1d5-4d05-b109-eaacfa09b140 could not be found. Oct 28 19:29:12.986596 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:12.986596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-84cb62ca-e1ce-4a8f-a8c5-ff276fd29ae0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance abd84603-a1d5-4d05-b109-eaacfa09b140 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:12.986596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-84cb62ca-e1ce-4a8f-a8c5-ff276fd29ae0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/abd84603-a1d5-4d05-b109-eaacfa09b140/action" status: 404 len: 111 microversion: 2.1 time: 0.061635 Oct 28 19:29:12.991941 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2291/4577] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:12 2022] POST /compute/v2.1/servers/abd84603-a1d5-4d05-b109-eaacfa09b140/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:13.008384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:13.009015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:13.027050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:13.027579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:13.028050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:13.028811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:13.029278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:13.029693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:13.405170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:13.414093 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fde06ad1-65fd-4720-8471-fdedc2059f76 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 0.554868 Oct 28 19:29:13.414985 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2287/4578] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:12 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:13.420374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:13.428054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:13.437272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:13.444475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:13.445800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:13.448814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:13.452551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:13.453313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:13.770033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:13.779787 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a412c5e4-899a-496d-9065-0807505f7721 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1667 microversion: 2.1 time: 0.781675 Oct 28 19:29:13.779787 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2292/4579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:12 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1667 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:13.809392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:13.810082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:13.816421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:13.817472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:13.817923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:13.818713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:13.819185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:13.819605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:13.856870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:13.865098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Working on deleting snapshot 93d59bdf-bf29-409d-995d-b30accc4020a from shelved instance... Oct 28 19:29:14.013939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:14.028517 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dadc4286-44eb-4f79-92f4-7cab389991a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.609221 Oct 28 19:29:14.032174 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2288/4580] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:13 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:14.043223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a8a9be0f-2764-4665-af72-97ea8234411a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768bcb80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:15.737401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Doing local delete in cell c3d72f5c-12c5-4ca8-b006-0eb4a596a968(cell1) {{(pid=120629) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 19:29:15.738362 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a8a9be0f-2764-4665-af72-97ea8234411a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 1.704869 Oct 28 19:29:15.739718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:15.740639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:15.741380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:15.742122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 19:29:15.747033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] deallocate_for_instance() {{(pid=120629) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 19:29:15.747498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2289/4581] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:14 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:15.759844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:15.760476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:15.774567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:15.775160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:15.775538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:15.784593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:15.784593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:15.784593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:16.813280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:16.826975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-76dd4703-1c8e-4b78-8348-601a0136ea63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.078016 Oct 28 19:29:16.828373 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2290/4582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:15 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:16.867980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:16.872203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:16.900141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:16.902119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:16.905255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:16.906425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:16.908221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:16.910311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:16.976488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Updating instance_info_cache with network_info: [] {{(pid=120629) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 19:29:17.361334 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 204 len: 0 microversion: 2.1 time: 3.557757 Oct 28 19:29:17.361947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2293/4583] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:13 2022] DELETE /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 0 bytes in 3559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:29:17.363133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:17.364877 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ab33a85-535b-4b3c-ad6c-9a6084dbe6fb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001318 Oct 28 19:29:17.367019 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2294/4584] 10.222.0.44 () {56 vars in 886 bytes} [Fri Oct 28 19:29:17 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 19:29:17.379942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-74158df7-2fa1-43fb-b98c-543ec018851f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768fc160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:17.493248 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-74158df7-2fa1-43fb-b98c-543ec018851f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.116042 Oct 28 19:29:17.494056 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2295/4585] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:17 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:17.532948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:17.533677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:17.560918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.564382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.569103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.570507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.571552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.572411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.644779 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'restore' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 15 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: {"restore": {}} Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: exception: Cannot 'restore' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'restore': {}}} Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state active. Cannot restore while the instance is in this state. Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:17.652532 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:17.659529 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:17.659529 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:17.659529 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:17.659529 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:17.659529 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.661849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'restore' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:17.663073 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8f46578-cba9-4b63-b49a-ef16474bea3a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 145 microversion: 2.1 time: 0.167931 Oct 28 19:29:17.666823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2296/4586] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:17 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 145 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:29:17.676564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-59e28587-15e5-47ad-aa11-a605b8c9a031 req-9cafd10d-3104-4ccc-86cb-3f4346b8434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce09057f-2c6a-44bb-b4ce-944ed126a6fb", "name": "network-vif-deleted", "tag": "c302d473-43be-46f4-88db-c8a7067c7497"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:17.700184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-59e28587-15e5-47ad-aa11-a605b8c9a031 req-9cafd10d-3104-4ccc-86cb-3f4346b8434e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.706164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-59e28587-15e5-47ad-aa11-a605b8c9a031 req-9cafd10d-3104-4ccc-86cb-3f4346b8434e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.706837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-59e28587-15e5-47ad-aa11-a605b8c9a031 req-9cafd10d-3104-4ccc-86cb-3f4346b8434e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.718040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:17.735092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.compute.server_external_events [req-59e28587-15e5-47ad-aa11-a605b8c9a031 req-9cafd10d-3104-4ccc-86cb-3f4346b8434e service nova] Unable to find a host for instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb. Dropping event network-vif-deleted {{(pid=120629) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:29:17.739180 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-59e28587-15e5-47ad-aa11-a605b8c9a031 req-9cafd10d-3104-4ccc-86cb-3f4346b8434e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.070705 Oct 28 19:29:17.740612 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2297/4587] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 19:29:17.745987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:17.747075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ce09057f-2c6a-44bb-b4ce-944ed126a6fb] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:17.755593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.756495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.757197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.758840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.759552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.760202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.783084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] HTTP exception thrown: Instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb could not be found. Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Request method failure captured: Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb HTTP/1.1 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXCtsmXkcOQXSFh5nt1nO8UxrF7f7mjLMsVatMRciI8JqEXW-Uzz5Gl5-RQIq4jqirdqf98HC3-6v6VlOSzISvYXWbEyILCE39CwcF9AIGIAWKMjJmVLeaiVnQII2bfu3nLNcGAsq9XJeHjqNZMziDbCEcrhjeIvhuVbMLgVXC2j43YQ Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/488f01035c694382b597fcadb399bccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_488f01035c694382b597fcadb399bccc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 42f0003698694056b69b98933c84cd8a Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb could not be found. Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ce09057f-2c6a-44bb-b4ce-944ed126a6fb'} Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb could not be found. Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb could not be found. Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:17.785186 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb could not be found. Oct 28 19:29:17.789689 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:17.792747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Returning 404 to user: Instance ce09057f-2c6a-44bb-b4ce-944ed126a6fb could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:17.794451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb" status: 404 len: 111 microversion: 2.1 time: 0.052072 Oct 28 19:29:17.796352 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2298/4588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:17 2022] GET /compute/v2.1/servers/ce09057f-2c6a-44bb-b4ce-944ed126a6fb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:17.797843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:17.799225 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76fc6078-86e2-4ccb-ba31-15d50e4d408d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001669 Oct 28 19:29:17.801413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:17.806906 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2299/4589] 10.222.0.44 () {54 vars in 1035 bytes} [Fri Oct 28 19:29:17 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 28 19:29:17.817797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8b38493-c00b-4521-a3ac-49f692cf44bf tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 0.988001 Oct 28 19:29:17.826109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:17.827977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:17.835970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.836800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.837483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.839082 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2291/4590] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:16 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:17.839694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.840985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.841662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.849062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:17.849582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:17.875694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.876219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.884341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.886139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:17.888516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:17.892300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:17.983627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:18.144680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:18.204454 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "DELETE /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 204 len: 0 microversion: 2.1 time: 0.363909 Oct 28 19:29:18.212524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2292/4591] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:17 2022] DELETE /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:29:18.215099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:18.247788 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b625af54-825e-4fd3-8954-4f649e8f3201 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.033243 Oct 28 19:29:18.253426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2293/4592] 10.222.0.44 () {54 vars in 1041 bytes} [Fri Oct 28 19:29:18 2022] GET /compute/v2.1/ => generated 388 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:18.265732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:18.267590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:18.283563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.288244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.289156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:18.292584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.295446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.296885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:18.478816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:18.492575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1465 microversion: 2.1 time: 0.236598 Oct 28 19:29:18.493190 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2294/4593] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:18 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1465 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:18.515647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:18.518795 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-325a54fa-f45c-4362-8fbc-b1445331fd6a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003432 Oct 28 19:29:18.526355 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2295/4594] 10.222.0.44 () {56 vars in 886 bytes} [Fri Oct 28 19:29:18 2022] GET /compute/ => generated 377 bytes in 32 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 19:29:18.549572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8dd295f6-5dcf-4d14-9751-5b5f8770fbab tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d774a8b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:18.638345 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8dd295f6-5dcf-4d14-9751-5b5f8770fbab tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.110018 Oct 28 19:29:18.648836 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2296/4595] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:18 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:18.677214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-280ee69f-edc9-4fe6-b724-2d9535ae5f6a req-e4525580-2917-4807-8ed7-ed6981eb84d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adff317-707a-4a36-93a1-291582680c8a", "name": "network-vif-plugged", "status": "completed", "tag": "88efe451-1fc4-4857-b9b4-7cf210cabca1"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:18.700271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:18.706392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-280ee69f-edc9-4fe6-b724-2d9535ae5f6a req-e4525580-2917-4807-8ed7-ed6981eb84d8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.707834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-280ee69f-edc9-4fe6-b724-2d9535ae5f6a req-e4525580-2917-4807-8ed7-ed6981eb84d8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.708636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-280ee69f-edc9-4fe6-b724-2d9535ae5f6a req-e4525580-2917-4807-8ed7-ed6981eb84d8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:18.710534 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2742a506-690f-4ab6-8f9e-a1a6f4fde260 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.902591 Oct 28 19:29:18.721319 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2300/4596] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:17 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:18.734879 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-280ee69f-edc9-4fe6-b724-2d9535ae5f6a req-e4525580-2917-4807-8ed7-ed6981eb84d8 service nova] Creating event network-vif-plugged:88efe451-1fc4-4857-b9b4-7cf210cabca1 for instance 7adff317-707a-4a36-93a1-291582680c8a on n-h1-862769-3 Oct 28 19:29:18.745116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-280ee69f-edc9-4fe6-b724-2d9535ae5f6a req-e4525580-2917-4807-8ed7-ed6981eb84d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071000 Oct 28 19:29:18.746527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:18.748664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2297/4597] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:18.750481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:18.765924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.771382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.772926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:18.773870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.776260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.776969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:18.842589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:18.843533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:18.858720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.859220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.859820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:18.874244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:18.874990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:18.875435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:19.716909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:19.729135 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0d8af5e-1711-4ae6-99f0-f1714089b11e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 0.891345 Oct 28 19:29:19.762820 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2298/4598] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:18 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:19.787001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:19.787897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:19.802349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:19.803324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:19.804027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:19.805030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:19.805750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:19.806424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:19.809683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:19.830430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-932dd761-7782-4d59-b31d-4cc75a397337 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.087826 Oct 28 19:29:19.832304 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2301/4599] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:18 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:19.840367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8bf615ce-7167-4d3b-830b-a414c7ecdf75 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768da700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:20.024352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:20.030299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8bf615ce-7167-4d3b-830b-a414c7ecdf75 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.196695 Oct 28 19:29:20.033188 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2302/4600] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:19 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:20.036957 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3357c56a-375d-4640-a9a0-e00486b95c76 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1465 microversion: 2.1 time: 0.261517 Oct 28 19:29:20.041845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e63177e3-8c96-4b34-bff4-7289d5765c0f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:20.043171 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2299/4601] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:19 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1465 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:20.044336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e63177e3-8c96-4b34-bff4-7289d5765c0f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 96bebdef-bf4b-4ace-beed-eb2b0ab5262f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:20.057846 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e63177e3-8c96-4b34-bff4-7289d5765c0f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 96bebdef-bf4b-4ace-beed-eb2b0ab5262f could not be found. Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e63177e3-8c96-4b34-bff4-7289d5765c0f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/96bebdef-bf4b-4ace-beed-eb2b0ab5262f/action HTTP/1.1 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 14 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: {"resume": {}} Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 96bebdef-bf4b-4ace-beed-eb2b0ab5262f could not be found. Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '96bebdef-bf4b-4ace-beed-eb2b0ab5262f', 'body': {'resume': {}}} Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bebdef-bf4b-4ace-beed-eb2b0ab5262f could not be found. Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bebdef-bf4b-4ace-beed-eb2b0ab5262f could not be found. Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:20.074898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:20.080176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:20.080176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:20.080176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bebdef-bf4b-4ace-beed-eb2b0ab5262f could not be found. Oct 28 19:29:20.080176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.080176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e63177e3-8c96-4b34-bff4-7289d5765c0f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 96bebdef-bf4b-4ace-beed-eb2b0ab5262f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:20.080176 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e63177e3-8c96-4b34-bff4-7289d5765c0f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/96bebdef-bf4b-4ace-beed-eb2b0ab5262f/action" status: 404 len: 111 microversion: 2.1 time: 0.043952 Oct 28 19:29:20.083997 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2303/4602] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:20 2022] POST /compute/v2.1/servers/96bebdef-bf4b-4ace-beed-eb2b0ab5262f/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:20.092887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:20.093500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:20.095514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:20.103963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.104786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.105452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.106389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.107104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.107724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.486353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:20.502683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e0b5c24-bfbc-42dd-9884-8ffa372c6c31 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.414134 Oct 28 19:29:20.504145 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2300/4603] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:20 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:20.527868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:20.528749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:20.535930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.536599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.537626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.538491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.540336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.540922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.712762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:20.722037 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88dd28b2-fee8-4740-b281-4e82c4b68be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.198515 Oct 28 19:29:20.736221 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2304/4604] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:20 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:20.749103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:20.749923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:20.798537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.800937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.802379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.805621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:20.806179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.807462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.807803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:20.810490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.835708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.840076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.841364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.843535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.846975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.847655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.877180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'resume' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 14 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: {"resume": {}} Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'resume' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'resume': {}}} Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state active. Cannot resume while the instance is in this state. Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:20.879085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:29:20.883282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:20.891290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'resume' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:20.892472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36ad47a2-ecbb-4fdb-97fc-88d2bec1acb1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 144 microversion: 2.1 time: 0.148985 Oct 28 19:29:20.893276 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2301/4605] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:20 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 144 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:29:20.902741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:20.903777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:20.923151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.924179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.924852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:20.925959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:20.926630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:20.927309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:21.163367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:21.184725 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4f8d103e-8ac7-452c-b562-0c0e6e0dbb30 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1308 microversion: 2.1 time: 0.428117 Oct 28 19:29:21.202659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:21.203184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2305/4606] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:20 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:21.208059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53a47869-4880-47c0-afd7-9b2b8c735b87 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768beee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:21.213690 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-018f41ee-676c-4963-9e55-723593ca56ec tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.314880 Oct 28 19:29:21.226716 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2302/4607] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:20 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:21.226716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:21.226716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:21.265701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:21.266310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:21.266895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:21.267733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:21.269353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:21.269896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:21.309968 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53a47869-4880-47c0-afd7-9b2b8c735b87 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.105606 Oct 28 19:29:21.310749 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2306/4608] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:21 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:21.317800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:21.318522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:21.333530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:21.338250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:21.338861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:21.340036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:21.340615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:21.341206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:21.523335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:21.539063 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43d87114-4792-4fa9-b465-6954b9bc8f51 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 200 len: 1465 microversion: 2.1 time: 0.321922 Oct 28 19:29:21.539970 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2303/4609] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:21 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 1465 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:21.678003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:21.690065 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8ca9ca0-e14a-427a-bd07-68221e5a7c5a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.378281 Oct 28 19:29:21.691549 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2307/4610] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:21 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:21.927429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba57862a-72af-43f6-afde-f955949384b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba57862a-72af-43f6-afde-f955949384b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 160 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "36d96f74-08a9-41e6-b957-eb52f0325134"}]}} Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd275f742-67cf-44be-b2bb-1596dfea8f48', 'flavorRef': '452', 'networks': [{'uuid': '36d96f74-08a9-41e6-b957-eb52f0325134'}]}}} Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '' Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:29:21.940536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:29:21.948173 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:21.953968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba57862a-72af-43f6-afde-f955949384b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:21.961921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba57862a-72af-43f6-afde-f955949384b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.033372 Oct 28 19:29:21.962797 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2304/4611] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:29:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:29:21.978008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:21.979475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:21.983688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fa852a3a-50c1-4a92-b713-8d4c08e1850c req-b7da7a1d-32a0-465b-9864-fb1c97b371b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42007865-5ba7-4202-9c7a-af9eb42578f5", "name": "network-vif-deleted", "tag": "df8f3b4d-df8f-455b-9582-7c7a5acae42f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:22.007726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:22.008489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:22.010181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fa852a3a-50c1-4a92-b713-8d4c08e1850c req-b7da7a1d-32a0-465b-9864-fb1c97b371b6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:22.015175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:22.016356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:22.017430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fa852a3a-50c1-4a92-b713-8d4c08e1850c req-b7da7a1d-32a0-465b-9864-fb1c97b371b6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:22.019781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fa852a3a-50c1-4a92-b713-8d4c08e1850c req-b7da7a1d-32a0-465b-9864-fb1c97b371b6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:22.028275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:22.029049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:22.053047 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fa852a3a-50c1-4a92-b713-8d4c08e1850c req-b7da7a1d-32a0-465b-9864-fb1c97b371b6 service nova] Creating event network-vif-deleted:df8f3b4d-df8f-455b-9582-7c7a5acae42f for instance 42007865-5ba7-4202-9c7a-af9eb42578f5 on n-h1-862769-3 Oct 28 19:29:22.076085 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fa852a3a-50c1-4a92-b713-8d4c08e1850c req-b7da7a1d-32a0-465b-9864-fb1c97b371b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094509 Oct 28 19:29:22.077357 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2305/4612] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:29:22.218641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:22.220216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:22.259040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:22.262140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:22.263580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:22.265771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:22.266882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:22.268350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:22.909302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:22.942660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:22.958634 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-003c997b-3c39-484d-86a3-80a4fe53df1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.990416 Oct 28 19:29:22.959303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2308/4613] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:21 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:22.962486 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-129659b5-c60f-4309-b001-1c84a43b4c3e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1490 microversion: 2.1 time: 0.752227 Oct 28 19:29:22.963447 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2306/4614] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:22 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1490 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:22.984357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-992eb525-2bff-419d-a8e5-c25d02faf96d tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768da8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:22.993674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:22.999535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: 42007865-5ba7-4202-9c7a-af9eb42578f5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:23.028639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.050375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.052651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.053532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.054025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.054463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.096190 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-992eb525-2bff-419d-a8e5-c25d02faf96d tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.133876 Oct 28 19:29:23.097511 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2309/4615] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:22 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:23.103011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:23.104109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:23.121547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.122532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.123264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.125898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.126794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.128161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.132462 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] HTTP exception thrown: Instance 42007865-5ba7-4202-9c7a-af9eb42578f5 could not be found. Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Request method failure captured: Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 HTTP/1.1 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtsmXkcOQXSFh5nt1nO8UxrF7f7mjLMsVatMRciI8JqEXW-Uzz5Gl5-RQIq4jqirdqf98HC3-6v6VlOSzISvYXWbEyILCE39CwcF9AIGIAWKMjJmVLeaiVnQII2bfu3nLNcGAsq9XJeHjqNZMziDbCEcrhjeIvhuVbMLgVXC2j43YQ Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/488f01035c694382b597fcadb399bccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_488f01035c694382b597fcadb399bccc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 42f0003698694056b69b98933c84cd8a Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 42007865-5ba7-4202-9c7a-af9eb42578f5 could not be found. Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '42007865-5ba7-4202-9c7a-af9eb42578f5'} Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42007865-5ba7-4202-9c7a-af9eb42578f5 could not be found. Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42007865-5ba7-4202-9c7a-af9eb42578f5 could not be found. Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:23.193022 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42007865-5ba7-4202-9c7a-af9eb42578f5 could not be found. Oct 28 19:29:23.197816 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.199908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Returning 404 to user: Instance 42007865-5ba7-4202-9c7a-af9eb42578f5 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:23.202371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85e3766d-4038-48f1-a8f4-8a57bdd731cf tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5" status: 404 len: 111 microversion: 2.1 time: 0.237366 Oct 28 19:29:23.209185 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2307/4616] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:22 2022] GET /compute/v2.1/servers/42007865-5ba7-4202-9c7a-af9eb42578f5 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:23.233425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:23.234142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:23.241014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.241520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.242033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.243463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.244104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.244481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.661692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:23.679548 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d74128f0-6661-40e8-a10b-de3d4c2c46d2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.575601 Oct 28 19:29:23.680225 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2310/4617] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:23 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:23.691369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:23.692026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:23.704763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.705270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.705704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.706450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.711603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.711603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.720679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:23.736940 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a47a4a50-00b3-4b31-a4ba-d2ab47b5272c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1489 microversion: 2.1 time: 0.526073 Oct 28 19:29:23.756966 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2308/4618] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:23 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1489 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:23.773665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d711d7e2-3387-4c2f-a715-752c6222fa0e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:23.776070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d711d7e2-3387-4c2f-a715-752c6222fa0e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 7c409725-8c08-4ecb-be04-e30056e83e1c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:23.792552 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-d711d7e2-3387-4c2f-a715-752c6222fa0e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 7c409725-8c08-4ecb-be04-e30056e83e1c could not be found. Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d711d7e2-3387-4c2f-a715-752c6222fa0e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7c409725-8c08-4ecb-be04-e30056e83e1c/action HTTP/1.1 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 14 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: {"shelve": {}} Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7c409725-8c08-4ecb-be04-e30056e83e1c could not be found. Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7c409725-8c08-4ecb-be04-e30056e83e1c', 'body': {'shelve': {}}} Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c409725-8c08-4ecb-be04-e30056e83e1c could not be found. Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c409725-8c08-4ecb-be04-e30056e83e1c could not be found. Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:23.799775 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c409725-8c08-4ecb-be04-e30056e83e1c could not be found. Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d711d7e2-3387-4c2f-a715-752c6222fa0e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 7c409725-8c08-4ecb-be04-e30056e83e1c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d711d7e2-3387-4c2f-a715-752c6222fa0e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/7c409725-8c08-4ecb-be04-e30056e83e1c/action" status: 404 len: 111 microversion: 2.1 time: 0.042757 Oct 28 19:29:23.804355 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2309/4619] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:23 2022] POST /compute/v2.1/servers/7c409725-8c08-4ecb-be04-e30056e83e1c/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:23.814091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:23.819308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:23.820285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:23.842532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.847889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.849205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.850731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:23.851500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:23.852108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:23.989756 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0360537-2b92-4540-90f6-1bd43008d402 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 204 len: 0 microversion: 2.1 time: 0.308146 Oct 28 19:29:23.996287 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2311/4620] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:23 2022] DELETE /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:29:24.007702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:24.008405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:24.026347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.031557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.032251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.033282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.033892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.035975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.294606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:24.306181 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e73a8eb5-906c-49f1-8cc4-93328bf96f0e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1490 microversion: 2.1 time: 0.498211 Oct 28 19:29:24.331155 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2310/4621] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:23 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1490 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:24.338301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:24.339485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:24.346048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.346985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.347658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.348614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.349288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.349945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.490461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:24.502480 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5aa74f1f-6701-410e-bf0d-28586acc39b2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.504776 Oct 28 19:29:24.504752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2312/4622] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:23 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:24.515916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d0e994b7-101e-4642-9349-51cf530c2f5c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768da5e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:24.602724 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d0e994b7-101e-4642-9349-51cf530c2f5c tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.096019 Oct 28 19:29:24.603763 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2313/4623] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:24 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:24.609325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:24.610133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:24.625229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.629785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.634908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.636231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.638273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.639060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.693125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:24.709447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf2f752a-c3f7-45a7-91e0-081924922b81 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1506 microversion: 2.1 time: 0.375515 Oct 28 19:29:24.715955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:24.730367 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2311/4624] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:24 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:24.738099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:24.741841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:24.753743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.754070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.754477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.755244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.755733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.756183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.863924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:24.900995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b09a8d59-55b8-48c3-a99e-8e9fb63b4fac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 204 len: 0 microversion: 2.1 time: 0.294662 Oct 28 19:29:24.903641 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2314/4625] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:24 2022] DELETE /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:29:24.917342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:24.918607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:24.939854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.940543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.941241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:24.941991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:24.942443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:24.942974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:26.163166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:26.176061 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c475149-af24-4d87-87bd-297c4c45ac4a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.444053 Oct 28 19:29:26.178107 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2312/4626] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:24 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:26.236989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f3d57a23-2c00-4010-b33b-723064ca8448 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d77499b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:26.299836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:26.313996 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92c832b1-2ce9-4c7e-b721-85e9a77fa5f5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1496 microversion: 2.1 time: 1.404980 Oct 28 19:29:26.317692 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2315/4627] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:24 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1496 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:26.325026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:26.351880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:26.370816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:26.371418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:26.372675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:26.373694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:26.374175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:26.376292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:26.389511 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f3d57a23-2c00-4010-b33b-723064ca8448 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.195483 Oct 28 19:29:26.390217 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2313/4628] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:26 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:26.410423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:26.412110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:26.425199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:26.425935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:26.426557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:26.427526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:26.435175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:26.435929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:26.537336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lazy-loading 'flavor' on Instance uuid 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:26.968028 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-03ec2904-d21b-4ad3-9a9f-2e710b54ca17 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.575695 Oct 28 19:29:26.972186 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2314/4629] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:26 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:29:26.999142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:26.999877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:27.018612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:27.019155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:27.019593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:27.020323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:27.020785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:27.021212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:27.062001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:27.084508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50021f05-c30b-4905-8685-ccb601ade65d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1506 microversion: 2.1 time: 0.763723 Oct 28 19:29:27.105796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2316/4630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:26 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:27.337571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:27.338257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:27.348910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:27.349404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:27.349836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:27.350560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:27.361616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:27.362108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:27.911352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:27.926806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:27.935185 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12d2469a-ba3c-4474-a054-6504e2b828e3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.950755 Oct 28 19:29:27.938938 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2315/4631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:26 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:27.951542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e52d4f8b-7afa-40ea-b273-67fcf9a0f757 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7693a1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:28.073138 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e52d4f8b-7afa-40ea-b273-67fcf9a0f757 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.132782 Oct 28 19:29:28.073999 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2316/4632] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:27 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:28.133877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:28.139075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:28.157825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:28.167489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:28.168532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:28.174178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:28.175151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:28.175898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:28.292311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:28.295827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:28.317176 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f78e06c-bfe6-457a-8d3e-1f671c160116 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1496 microversion: 2.1 time: 0.983480 Oct 28 19:29:28.326761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2317/4633] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:27 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1496 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:28.921934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:28.941705 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dad96ae2-ceb1-48ac-86e6-0f6c8bccc6df tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1506 microversion: 2.1 time: 0.812062 Oct 28 19:29:28.943198 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2317/4634] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:28 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:28.967454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:28.968897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:28.983512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:28.988015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:28.988927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:28.990021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:28.996483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:28.997531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:29.092073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53213e70-6c9e-4940-8dd1-34760878dc99 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d77392dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:29.180870 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53213e70-6c9e-4940-8dd1-34760878dc99 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1421 microversion: 2.1 time: 0.094827 Oct 28 19:29:29.181606 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2318/4635] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:29 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:29.364963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:29.365742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:29.390862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:29.394407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:29.396002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:29.399533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:29.400325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:29.402127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.058973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:30.072573 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4819ca1c-a657-44c5-a804-9628926773e6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 1.110060 Oct 28 19:29:30.073925 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2318/4636] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:28 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:30.092025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-cd9ffdb8-f2c9-4e65-adee-96e631b58abf req-342f0c44-11c8-4c34-a7af-f9cc0167d766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7fe9c2-a313-40dc-97e2-f41286b1216b", "name": "network-vif-deleted", "tag": "543ab562-9b7c-4aef-bdbc-8f11573789c8"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:30.124670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cd9ffdb8-f2c9-4e65-adee-96e631b58abf req-342f0c44-11c8-4c34-a7af-f9cc0167d766 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:30.129143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cd9ffdb8-f2c9-4e65-adee-96e631b58abf req-342f0c44-11c8-4c34-a7af-f9cc0167d766 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:30.129965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cd9ffdb8-f2c9-4e65-adee-96e631b58abf req-342f0c44-11c8-4c34-a7af-f9cc0167d766 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.166277 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-cd9ffdb8-f2c9-4e65-adee-96e631b58abf req-342f0c44-11c8-4c34-a7af-f9cc0167d766 service nova] Creating event network-vif-deleted:543ab562-9b7c-4aef-bdbc-8f11573789c8 for instance ef7fe9c2-a313-40dc-97e2-f41286b1216b on n-h2-862769-3 Oct 28 19:29:30.183777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-cd9ffdb8-f2c9-4e65-adee-96e631b58abf req-342f0c44-11c8-4c34-a7af-f9cc0167d766 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101771 Oct 28 19:29:30.184989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2319/4637] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:30.198431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:30.200947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:30.228404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:30.248600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:30.249295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.250551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:30.251619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:30.252473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.305586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:30.317761 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79e867fa-6d77-42ef-a433-ca3eab67b3aa tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1496 microversion: 2.1 time: 0.966069 Oct 28 19:29:30.318421 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2319/4638] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:29 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1496 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:30.328866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b97d4a05-246b-4403-a085-f58df25dc6cd tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d774d2700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:30.426959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:30.429174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:30.429811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.434492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lazy-loading 'fault' on Instance uuid ef7fe9c2-a313-40dc-97e2-f41286b1216b {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:30.434939 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b97d4a05-246b-4403-a085-f58df25dc6cd tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1430 microversion: 2.1 time: 0.115128 Oct 28 19:29:30.435553 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2320/4639] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:30 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1430 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:30.466819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2765c3bc-40ca-46e3-a23d-0c70a5ecf609 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7783e1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:30.570896 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2765c3bc-40ca-46e3-a23d-0c70a5ecf609 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 200 len: 1430 microversion: 2.1 time: 0.121783 Oct 28 19:29:30.574259 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2321/4640] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:30 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 1430 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:30.585933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:30.586757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:30.616144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:30.616884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:30.617532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.618419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:30.619177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:30.619763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:30.746165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:30.757822 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41ba0ee9-c152-40d7-8b20-939f17fa8edb tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 200 len: 1304 microversion: 2.1 time: 0.569525 Oct 28 19:29:30.779344 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2320/4641] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:30 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 1304 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:31.076823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:31.090509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-192cfbe7-857a-4d6a-a5ee-67b2d60e68cb tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1479 microversion: 2.1 time: 0.508409 Oct 28 19:29:31.094250 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2322/4642] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:30 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1479 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:31.146407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:31.147853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:31.218684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.219396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.219866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.230234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.231215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.232000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.348762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:31.349337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:31.362207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.362719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.363175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.363917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.364354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.392918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.516348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.517089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.517752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.518447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lazy-loading 'fault' on Instance uuid 7adff317-707a-4a36-93a1-291582680c8a {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:31.749987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:31.764351 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e495dde1-c527-4747-9fa0-f42b71079e18 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 200 len: 1298 microversion: 2.1 time: 0.423337 Oct 28 19:29:31.765403 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2323/4643] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:31 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 1298 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:31.785848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:31.786982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ef7fe9c2-a313-40dc-97e2-f41286b1216b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:31.800522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.803390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.804251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.808563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.809413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.810113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.842683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] HTTP exception thrown: Instance ef7fe9c2-a313-40dc-97e2-f41286b1216b could not be found. Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Request method failure captured: Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b HTTP/1.1 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtsmXkcOQXSFh5nt1nO8UxrF7f7mjLMsVatMRciI8JqEXW-Uzz5Gl5-RQIq4jqirdqf98HC3-6v6VlOSzISvYXWbEyILCE39CwcF9AIGIAWKMjJmVLeaiVnQII2bfu3nLNcGAsq9XJeHjqNZMziDbCEcrhjeIvhuVbMLgVXC2j43YQ Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/488f01035c694382b597fcadb399bccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_488f01035c694382b597fcadb399bccc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 42f0003698694056b69b98933c84cd8a Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance ef7fe9c2-a313-40dc-97e2-f41286b1216b could not be found. Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'ef7fe9c2-a313-40dc-97e2-f41286b1216b'} Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7fe9c2-a313-40dc-97e2-f41286b1216b could not be found. Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7fe9c2-a313-40dc-97e2-f41286b1216b could not be found. Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:31.844999 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7fe9c2-a313-40dc-97e2-f41286b1216b could not be found. Oct 28 19:29:31.849075 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:31.861595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Returning 404 to user: Instance ef7fe9c2-a313-40dc-97e2-f41286b1216b could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:31.863434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14455e30-1521-4cb8-82e6-acbf5e0f9855 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b" status: 404 len: 111 microversion: 2.1 time: 0.081669 Oct 28 19:29:31.864340 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2324/4644] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:31 2022] GET /compute/v2.1/servers/ef7fe9c2-a313-40dc-97e2-f41286b1216b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:29:31.874256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:31.874954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:31.882150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.883152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.883881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.884894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:31.885636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:31.886362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:31.928444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:32.096578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78da9d62-52d8-419c-a051-a254d485ff3d tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 204 len: 0 microversion: 2.1 time: 0.226159 Oct 28 19:29:32.107459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:32.112706 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2325/4645] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:31 2022] DELETE /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:29:32.130811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a97238a-5dce-4ad0-807d-c8f627651e1c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 1.035310 Oct 28 19:29:32.134212 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2321/4646] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:31 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:32.140644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.144323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:32.162525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.179065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.179585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.181426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.181911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.182347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.236915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.237584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:32.262159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.263067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.267826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.268967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.271286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.271911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.716531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:32.725765 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44ea685f-9952-4b2a-87a2-228b165a873a tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1495 microversion: 2.1 time: 0.608563 Oct 28 19:29:32.726356 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2326/4647] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:32 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1495 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:32.741295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:32.750184 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d9a7898f-0c51-47ad-8da4-ef520b0b8fb7 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1466 microversion: 2.1 time: 0.517755 Oct 28 19:29:32.751189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2322/4648] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:32 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1466 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:32.774796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f471599-0160-424b-b402-b6047c7c04b2 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d773929d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.801473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.802833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:32.818269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.819117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.819712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.821101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.822735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.823535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.859649 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:29:32.861037 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f471599-0160-424b-b402-b6047c7c04b2 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/d275f742-67cf-44be-b2bb-1596dfea8f48" status: 200 len: 784 microversion: 2.1 time: 0.090741 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a HTTP/1.1 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7adff317-707a-4a36-93a1-291582680c8a'} Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:32.861579 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73f4a92c-5f89-49ad-a00a-f6c873df5f1a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 404 len: 111 microversion: 2.1 time: 0.076453 Oct 28 19:29:32.872092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2323/4649] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:32 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:32.883411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3758721a-6e9f-49b8-99ae-c25f8d462d41 req-d3ade701-a190-4cde-8f4d-fc12002fecf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adff317-707a-4a36-93a1-291582680c8a", "name": "network-vif-deleted", "tag": "88efe451-1fc4-4857-b9b4-7cf210cabca1"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:32.883694 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2327/4650] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:32 2022] GET /compute/v2.1/images/d275f742-67cf-44be-b2bb-1596dfea8f48 => generated 784 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:32.891285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.892151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:32.898397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3758721a-6e9f-49b8-99ae-c25f8d462d41 req-d3ade701-a190-4cde-8f4d-fc12002fecf3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.899243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3758721a-6e9f-49b8-99ae-c25f8d462d41 req-d3ade701-a190-4cde-8f4d-fc12002fecf3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.899849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3758721a-6e9f-49b8-99ae-c25f8d462d41 req-d3ade701-a190-4cde-8f4d-fc12002fecf3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.902361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.903226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.903743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.905729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:32.906308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:32.906838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:32.919589 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3758721a-6e9f-49b8-99ae-c25f8d462d41 req-d3ade701-a190-4cde-8f4d-fc12002fecf3 service nova] Creating event network-vif-deleted:88efe451-1fc4-4857-b9b4-7cf210cabca1 for instance 7adff317-707a-4a36-93a1-291582680c8a on n-h1-862769-3 Oct 28 19:29:32.926227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3758721a-6e9f-49b8-99ae-c25f8d462d41 req-d3ade701-a190-4cde-8f4d-fc12002fecf3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059474 Oct 28 19:29:32.927428 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2324/4651] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:32.934012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-639e5cb8-da5f-43a1-ae2e-4627db49fbd8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.943540 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-639e5cb8-da5f-43a1-ae2e-4627db49fbd8 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014673 Oct 28 19:29:32.945478 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2325/4652] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:29:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:32.960556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fff5513c-71e5-4e1e-981e-2550cc3988ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7682a820>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:32.975109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:33.112258 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5f6345e-e38e-4499-a486-6ebedacc979d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 204 len: 0 microversion: 2.1 time: 0.225400 Oct 28 19:29:33.113339 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2328/4653] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:32 2022] DELETE /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:29:33.127749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:33.129218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:33.137343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:33.138092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:33.138848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:33.139807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:33.140471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:33.141106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:33.834033 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fff5513c-71e5-4e1e-981e-2550cc3988ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "DELETE /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 204 len: 0 microversion: 2.1 time: 0.878069 Oct 28 19:29:33.835662 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2326/4654] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:32 2022] DELETE /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:29:33.845933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:33.847039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:33.868469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:33.869161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:33.871518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:33.874817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:33.878050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:33.878730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:34.061212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:34.076158 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-551c46f0-79ce-44c9-9c8a-bfb20e7a5254 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1495 microversion: 2.1 time: 0.952735 Oct 28 19:29:34.077055 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2329/4655] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:33 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1495 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:34.100594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:34.108034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:34.125300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:34.130111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:34.130793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:34.131721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:34.132353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:34.132945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:34.356072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:34.367302 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cdc0d57e-511c-4e40-b54d-5d73fdbbbcf5 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 200 len: 1453 microversion: 2.1 time: 0.273663 Oct 28 19:29:34.380070 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2330/4656] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:34 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 1453 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:34.393336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43726412-4882-4ff9-b37e-c797f333dece tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d76960af0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:34.423510 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-43726412-4882-4ff9-b37e-c797f333dece tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] HTTP exception thrown: Image not found. Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43726412-4882-4ff9-b37e-c797f333dece tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Request method failure captured: Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 HTTP/1.1 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC1mNZonAJCvkGwa8sykyUgAJrBSe3WEHyYZo9AwgN9GJyPGzRKiZmsn7CiDln8nIZzMppUCfqL3D7af8I3Pzh_Ey8PkATafG60HpurQpBxb0slHhhzj-fUGXXy9OxkkGTtUAEHQl55G0SaKPUwOjJDFJkEfjm-zJbdDaTjo2f7nfuc Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d36609a3ce9f441ba031b1d384fca5b8 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d36609a3ce9f441ba031b1d384fca5b8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d36609a3ce9f441ba031b1d384fca5b8 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerTestJSON-370091223-project Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: bddb9f9bc0d345f39ae73192f4433f63 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerTestJSON-370091223-project Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '770d3ff2-08cc-4c44-a04f-0077df46f5b5'} Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 770d3ff2-08cc-4c44-a04f-0077df46f5b5 Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:29:34.427519 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 770d3ff2-08cc-4c44-a04f-0077df46f5b5 could not be found. Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:29:34.432298 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:34.437128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43726412-4882-4ff9-b37e-c797f333dece tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:34.438189 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43726412-4882-4ff9-b37e-c797f333dece tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 404 len: 62 microversion: 2.1 time: 0.050944 Oct 28 19:29:34.444618 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2331/4657] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:34 2022] GET /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:29:34.450442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2665cde9-5f64-4971-bb06-ef926eedcafa req-840d46bd-4e13-47f3-aaa3-a96f2a74158f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "name": "network-vif-unplugged", "status": "completed", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:34.467739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2665cde9-5f64-4971-bb06-ef926eedcafa req-840d46bd-4e13-47f3-aaa3-a96f2a74158f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:34.468598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2665cde9-5f64-4971-bb06-ef926eedcafa req-840d46bd-4e13-47f3-aaa3-a96f2a74158f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:34.469525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2665cde9-5f64-4971-bb06-ef926eedcafa req-840d46bd-4e13-47f3-aaa3-a96f2a74158f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:34.480232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:34.485286 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2665cde9-5f64-4971-bb06-ef926eedcafa req-840d46bd-4e13-47f3-aaa3-a96f2a74158f service nova] Creating event network-vif-unplugged:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:29:34.489484 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2093180e-636e-4437-8d87-f307a7095d9c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.648632 Oct 28 19:29:34.492091 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2665cde9-5f64-4971-bb06-ef926eedcafa req-840d46bd-4e13-47f3-aaa3-a96f2a74158f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045806 Oct 28 19:29:34.493139 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2332/4658] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:34.508403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1181724258"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:34.508691 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2327/4659] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:33 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:34.512586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:34.523176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:34.524107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:34.524806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:34.525680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:34.526433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:34.527640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:34.862530 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78194827-360a-445a-95ee-db2ea3c7694e tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "POST /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39/action" status: 202 len: 0 microversion: 2.1 time: 0.367753 Oct 28 19:29:34.863567 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2333/4660] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:29:34 2022] POST /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:29:34.877211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4447d4fe-d696-4394-ba87-71c005495d26 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7686ce50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:34.971394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4447d4fe-d696-4394-ba87-71c005495d26 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.100701 Oct 28 19:29:34.972111 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2328/4661] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:34 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:35.064291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-53ec900d-fe23-440c-9ced-edb7fbdaa385 req-301b86e9-832f-4979-bdd4-8fb8b472df94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1aa922-be6c-4f4b-bd29-40d3b87ad14b", "name": "network-vif-deleted", "tag": "5f8d1a12-1d86-48c9-b972-32472c57e16c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:35.092949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-53ec900d-fe23-440c-9ced-edb7fbdaa385 req-301b86e9-832f-4979-bdd4-8fb8b472df94 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.093471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-53ec900d-fe23-440c-9ced-edb7fbdaa385 req-301b86e9-832f-4979-bdd4-8fb8b472df94 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.093922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-53ec900d-fe23-440c-9ced-edb7fbdaa385 req-301b86e9-832f-4979-bdd4-8fb8b472df94 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.105778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:35.106413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:35.121781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.122296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.122764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.123495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.123952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.124383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.153677 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-53ec900d-fe23-440c-9ced-edb7fbdaa385 req-301b86e9-832f-4979-bdd4-8fb8b472df94 service nova] Creating event network-vif-deleted:5f8d1a12-1d86-48c9-b972-32472c57e16c for instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b on n-h1-862769-3 Oct 28 19:29:35.172396 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-53ec900d-fe23-440c-9ced-edb7fbdaa385 req-301b86e9-832f-4979-bdd4-8fb8b472df94 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113822 Oct 28 19:29:35.176281 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2334/4662] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:35.397550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:35.398495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: ae1aa922-be6c-4f4b-bd29-40d3b87ad14b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:35.413813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.415444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.416619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.417756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.419867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.420497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.455160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] HTTP exception thrown: Instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b could not be found. Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Request method failure captured: Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b HTTP/1.1 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtsmXkcOQXSFh5nt1nO8UxrF7f7mjLMsVatMRciI8JqEXW-Uzz5Gl5-RQIq4jqirdqf98HC3-6v6VlOSzISvYXWbEyILCE39CwcF9AIGIAWKMjJmVLeaiVnQII2bfu3nLNcGAsq9XJeHjqNZMziDbCEcrhjeIvhuVbMLgVXC2j43YQ Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/488f01035c694382b597fcadb399bccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_488f01035c694382b597fcadb399bccc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 42f0003698694056b69b98933c84cd8a Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b could not be found. Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'ae1aa922-be6c-4f4b-bd29-40d3b87ad14b'} Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b could not be found. Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b could not be found. Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:35.457189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b could not be found. Oct 28 19:29:35.462111 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:35.464637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Returning 404 to user: Instance ae1aa922-be6c-4f4b-bd29-40d3b87ad14b could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:35.465747 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0426b003-a919-419a-a34b-f20c0a0c7eb1 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b" status: 404 len: 111 microversion: 2.1 time: 0.074147 Oct 28 19:29:35.466944 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2335/4663] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:35 2022] GET /compute/v2.1/servers/ae1aa922-be6c-4f4b-bd29-40d3b87ad14b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:29:35.478683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:35.480041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:35.487303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.488259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.488938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.490354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.491071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.491842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.499348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:35.555361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:29:35.693184 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8eefb016-37a1-4adf-bb15-6318ce8623f8 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 204 len: 0 microversion: 2.1 time: 0.221853 Oct 28 19:29:35.697556 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2336/4664] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:29:35 2022] DELETE /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:29:35.704481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:35.705443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:35.717266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.719694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.720287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.722596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.723241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.724935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.736649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:35.746934 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-557f1f94-fecc-4a64-8671-9d7a2636be01 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1495 microversion: 2.1 time: 0.646109 Oct 28 19:29:35.751806 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2329/4665] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:35 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1495 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:35.757072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:35.768763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:35.779711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.782493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.788799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:35.789836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:35.790473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:35.791137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:36.216360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:36.232303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0326ca91-4307-4359-a2c0-1c4e89abc15e tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1673 microversion: 2.1 time: 0.479134 Oct 28 19:29:36.233145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2330/4666] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:35 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1673 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:36.241519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4a6850a-09ca-48a8-a069-219c3fdbe1f6 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7684d670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:36.272512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:36.283856 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6dbe9e5-6221-4906-8b8a-eab61de222a8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.584096 Oct 28 19:29:36.284464 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2337/4667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:35 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:36.336186 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4a6850a-09ca-48a8-a069-219c3fdbe1f6 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.091396 Oct 28 19:29:36.339770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2331/4668] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:36 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:36.778191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:36.781209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:36.797181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:36.798343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:36.801641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:36.804894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:36.805446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:36.805894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:36.910235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:36.911027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:36.911627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:36.912247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lazy-loading 'fault' on Instance uuid 1ab5d632-c743-409f-a244-4a0ce5e1a550 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:37.083736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:37.099526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f41e2538-0ac4-4f8a-8b68-154358c4a486 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 200 len: 1298 microversion: 2.1 time: 0.327262 Oct 28 19:29:37.100127 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2338/4669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:36 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 1298 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:37.259471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:37.260732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:37.279207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:37.280406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:37.280856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:37.281620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:37.282083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:37.282512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:37.309903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:37.310527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:37.322649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:37.323107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:37.323713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:37.336925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:37.339339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:37.340823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:37.695774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:37.705160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a84a2815-fba2-4886-ad86-82621d7d627a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.399520 Oct 28 19:29:37.720236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2339/4670] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:37 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:37.720236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc34f52e-ae13-4d0d-b7a9-18a4b3036594 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d76cfbaf0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:37.789453 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc34f52e-ae13-4d0d-b7a9-18a4b3036594 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.077003 Oct 28 19:29:37.790158 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2340/4671] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:37 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:37.808805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2d0fd76b-fcf3-425b-bf94-a2629e0c083e req-bc2731b8-d41b-47d9-8cd5-a82199e96150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab5d632-c743-409f-a244-4a0ce5e1a550", "name": "network-vif-deleted", "tag": "120c1614-2f19-4c29-b626-34215687c796"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:37.835131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2d0fd76b-fcf3-425b-bf94-a2629e0c083e req-bc2731b8-d41b-47d9-8cd5-a82199e96150 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:37.837716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2d0fd76b-fcf3-425b-bf94-a2629e0c083e req-bc2731b8-d41b-47d9-8cd5-a82199e96150 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:37.838309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2d0fd76b-fcf3-425b-bf94-a2629e0c083e req-bc2731b8-d41b-47d9-8cd5-a82199e96150 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:37.870373 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd76b-fcf3-425b-bf94-a2629e0c083e req-bc2731b8-d41b-47d9-8cd5-a82199e96150 service nova] Creating event network-vif-deleted:120c1614-2f19-4c29-b626-34215687c796 for instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 on n-h2-862769-3 Oct 28 19:29:37.883053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2d0fd76b-fcf3-425b-bf94-a2629e0c083e req-bc2731b8-d41b-47d9-8cd5-a82199e96150 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082907 Oct 28 19:29:37.884610 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2341/4672] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:37.970082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:37.989256 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ccb0c6b7-a24a-4e8b-9d17-e4a5421abfa9 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1673 microversion: 2.1 time: 0.732908 Oct 28 19:29:37.990569 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2332/4673] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:37 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1673 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:38.139200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:38.147020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:38.178342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:38.179656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:38.187283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:38.189144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:38.192104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:38.192806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:38.243642 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 HTTP/1.1 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1ab5d632-c743-409f-a244-4a0ce5e1a550'} Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:38.245845 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:38.250604 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:38.250604 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:38.250604 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:38.250604 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:38.250604 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:29:38.250604 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:38.252452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:38.253865 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ab71636f-769c-4594-8a2a-62b23497d880 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 404 len: 111 microversion: 2.1 time: 0.130444 Oct 28 19:29:38.254961 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2342/4674] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:38 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:38.518675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1545181693", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:38.622984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:29:38.739595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:38.742055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:38.751897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:38.756021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:38.757586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:38.758506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:38.759237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:38.759820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:39.367282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:39.386441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b85a26d-3d83-45c3-8635-54233f23e024 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.647370 Oct 28 19:29:39.388007 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2343/4675] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:38 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:39.401058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a30e2f9-880c-48df-a6c0-d40cdbe2d868 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d773929d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:39.520007 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a30e2f9-880c-48df-a6c0-d40cdbe2d868 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.128562 Oct 28 19:29:39.521015 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2344/4676] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:39 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:39.532990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:39.543800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:39.602532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:39.603134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:39.603863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:39.605582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:39.606127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:39.606640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:40.038801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:29:40.039298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:29:40.039678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:29:40.040089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:29:40.041332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:29:40.064987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:40.068044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:40.068980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:40.069923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:40.070524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:40.091301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:40.092881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:40.103975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37386067-f710-4000-bd4a-ef8495e418de tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1673 microversion: 2.1 time: 0.578412 Oct 28 19:29:40.105478 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2345/4677] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:39 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1673 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:40.144734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:29:40.158785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:29:40.218672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:29:40.234999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:29:40.350519 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-96d0d313-3c7f-4e28-b465-3dd8ec21cd8b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835874 Oct 28 19:29:40.354603 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2333/4678] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:29:40.365239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ecf8216-b03c-4d4b-9f69-db0a2d9a41f2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:40.365866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ecf8216-b03c-4d4b-9f69-db0a2d9a41f2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:40.414352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:40.415110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:40.425352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:40.428403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:40.430804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:40.431745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:40.433662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:40.434394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:40.545474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ecf8216-b03c-4d4b-9f69-db0a2d9a41f2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:40.553349 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ecf8216-b03c-4d4b-9f69-db0a2d9a41f2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1209 microversion: 2.1 time: 0.191857 Oct 28 19:29:40.557955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2346/4679] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:40 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1209 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:40.576614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-639f8e3a-b796-4e6d-acbb-e626239282f3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d773ace50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:40.704407 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-639f8e3a-b796-4e6d-acbb-e626239282f3 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.142190 Oct 28 19:29:40.704865 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2347/4680] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:40 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:40.797452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:40.819046 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bbc2286f-6c36-473c-a04d-941522007983 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.409710 Oct 28 19:29:40.844772 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2334/4681] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:40 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:41.130847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:41.132140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:41.154935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:41.155708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:41.156304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:41.157187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:41.159618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:41.160274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:41.376980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:41.386586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c3508f6a-a046-4cfb-af6f-a122575bcecd tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1673 microversion: 2.1 time: 0.259633 Oct 28 19:29:41.393263 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2348/4682] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:41 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:41.586272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:41.589557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:41.599672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:41.600375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:41.602436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:41.604498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:41.605790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:41.610243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:41.695488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:41.716016 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a6a0c111-a5a1-4e3f-a9d9-085f3f4b8203 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1205 microversion: 2.1 time: 0.139327 Oct 28 19:29:41.721408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c271f89f-b531-4459-824a-03ae2e5a5556 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7c44a1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:41.731617 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2335/4683] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:41 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1205 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:41.816172 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c271f89f-b531-4459-824a-03ae2e5a5556 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.099319 Oct 28 19:29:41.820435 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2349/4684] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:41 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:41.861771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:41.864295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:41.883098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:41.883687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:41.884134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:41.892033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:41.895803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:41.896761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:42.424313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:42.426954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:42.445186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:42.454453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:42.456010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:42.457991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:42.460145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:42.463328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:42.464061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:43.269882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:43.288687 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-625daa3f-0603-41c5-90f9-f837e79f593f tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1606 microversion: 2.1 time: 0.872176 Oct 28 19:29:43.290821 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2350/4685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:42 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1606 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:29:43.299321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:43.299940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:43.319421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:43.319936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:43.320378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:43.321103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:43.321561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:43.321992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:44.199755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:44.215811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d556e03e-ee36-489d-a36e-0a43d7cd3a85 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 2.359899 Oct 28 19:29:44.219826 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2336/4686] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:41 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:44.240245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3959fb7e-a373-4935-b3ef-6471f4180801 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d7684de50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:44.316574 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3959fb7e-a373-4935-b3ef-6471f4180801 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.095192 Oct 28 19:29:44.318018 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2337/4687] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:44 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:44.326671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f91486a0-be16-4d03-897a-d7ffa9c5d05c req-25204bd6-cd7d-4434-99e6-5e256c602df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "name": "network-vif-plugged", "status": "completed", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:44.345449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f91486a0-be16-4d03-897a-d7ffa9c5d05c req-25204bd6-cd7d-4434-99e6-5e256c602df4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:44.346204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f91486a0-be16-4d03-897a-d7ffa9c5d05c req-25204bd6-cd7d-4434-99e6-5e256c602df4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:44.346987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f91486a0-be16-4d03-897a-d7ffa9c5d05c req-25204bd6-cd7d-4434-99e6-5e256c602df4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:44.348130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:44.371760 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f81e2b83-c38d-4a8c-88d0-122ceacbe238 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1267 microversion: 2.1 time: 1.079592 Oct 28 19:29:44.372950 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2351/4688] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:43 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1267 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:44.386295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f91486a0-be16-4d03-897a-d7ffa9c5d05c req-25204bd6-cd7d-4434-99e6-5e256c602df4 service nova] Creating event network-vif-plugged:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:29:44.399410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f91486a0-be16-4d03-897a-d7ffa9c5d05c req-25204bd6-cd7d-4434-99e6-5e256c602df4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079097 Oct 28 19:29:44.401484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2338/4689] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:44.411820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bcda10c5-3f74-48e4-a3b1-7e507ba2c0fd req-38f08374-5331-415c-bb78-a0d75afbc0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b86398-b5dd-4e34-a35d-ee6081efa9c5", "name": "network-vif-deleted", "tag": "c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:44.430369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bcda10c5-3f74-48e4-a3b1-7e507ba2c0fd req-38f08374-5331-415c-bb78-a0d75afbc0f8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:44.432452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bcda10c5-3f74-48e4-a3b1-7e507ba2c0fd req-38f08374-5331-415c-bb78-a0d75afbc0f8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:44.433720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bcda10c5-3f74-48e4-a3b1-7e507ba2c0fd req-38f08374-5331-415c-bb78-a0d75afbc0f8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:44.459000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bcda10c5-3f74-48e4-a3b1-7e507ba2c0fd req-38f08374-5331-415c-bb78-a0d75afbc0f8 service nova] Creating event network-vif-deleted:c5e7fb04-f96b-4a7c-b460-8f6ecddd42cb for instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 on n-h1-862769-3 Oct 28 19:29:44.466184 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bcda10c5-3f74-48e4-a3b1-7e507ba2c0fd req-38f08374-5331-415c-bb78-a0d75afbc0f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059600 Oct 28 19:29:44.467303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2339/4690] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:44.477544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:44.478710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:44.487583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:44.488478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:44.490041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:44.491313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:44.492216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:44.492907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:44.582606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:44.585645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:44.587599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:44.589045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lazy-loading 'fault' on Instance uuid f1b86398-b5dd-4e34-a35d-ee6081efa9c5 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:29:44.660460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c70e683e-b88f-4396-a1b8-328ffd6bbfa2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'create', calling method: .version_select at 0x7f1d774d2940>, body: {"keypair": {"name": "tempest-keypair-720764812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkIa6h8lGUsubkBfkw8/cVn2SDcFoxC6ekJJWT5iN4poPnmIzNbdqeYVc6naJHVItFxBvbFyvbw8LSwP4u8PdiNLnC3JrEOTW/qL6S33SbacvY6r7H/q45dyBjus3GORg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:44.707508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c70e683e-b88f-4396-a1b8-328ffd6bbfa2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for project 95f88e4c7194409a91baeb78e099e93f. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:29:44.720933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c70e683e-b88f-4396-a1b8-328ffd6bbfa2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for user dea27583bf5144a5aeed6ec0c3c20ca4 and project 95f88e4c7194409a91baeb78e099e93f. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:29:44.775136 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c70e683e-b88f-4396-a1b8-328ffd6bbfa2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.400875 Oct 28 19:29:44.783195 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2352/4691] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:29:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 409 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 19:29:45.242791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:45.243781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:45.257476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:45.263334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:45.267270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:45.271372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:45.272607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:45.275491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:45.733867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f0003698694056b69b98933c84cd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f01035c694382b597fcadb399bccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:45.747178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aff7a6aa-6866-45a7-96ba-e9e3c496c371 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 200 len: 1327 microversion: 2.1 time: 1.277201 Oct 28 19:29:45.766702 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2340/4692] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:44 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 1327 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:45.780367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52a79b45-3d71-42a8-8487-c22b3ed287ec tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768305e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:45.921904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:45.951160 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-52a79b45-3d71-42a8-8487-c22b3ed287ec tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1427 microversion: 2.1 time: 0.181715 Oct 28 19:29:45.952269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2341/4693] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:45 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:45.959171 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69dd2d16-c862-4485-ab3b-2a12627b0387 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 0.717070 Oct 28 19:29:45.975866 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2353/4694] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:45 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:45.976868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:45.977507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:45.986203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:45.987488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:45.988117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:45.989001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:45.989636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:45.990215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:46.223161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:46.236332 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-145cbc56-afa4-4d69-88d0-905ce5e484e9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1267 microversion: 2.1 time: 0.280070 Oct 28 19:29:46.239863 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2342/4695] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:45 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:46.773554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:46.774754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] [instance: f1b86398-b5dd-4e34-a35d-ee6081efa9c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:46.801222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:46.801772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:46.806154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:46.806972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:46.811007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:46.811496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:46.885256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] HTTP exception thrown: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 could not be found. Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Request method failure captured: Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 HTTP/1.1 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXCtsmXkcOQXSFh5nt1nO8UxrF7f7mjLMsVatMRciI8JqEXW-Uzz5Gl5-RQIq4jqirdqf98HC3-6v6VlOSzISvYXWbEyILCE39CwcF9AIGIAWKMjJmVLeaiVnQII2bfu3nLNcGAsq9XJeHjqNZMziDbCEcrhjeIvhuVbMLgVXC2j43YQ Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/488f01035c694382b597fcadb399bccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_488f01035c694382b597fcadb399bccc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/488f01035c694382b597fcadb399bccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 488f01035c694382b597fcadb399bccc Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-232803518 Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 42f0003698694056b69b98933c84cd8a Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-232803518-project Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 could not be found. Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'f1b86398-b5dd-4e34-a35d-ee6081efa9c5'} Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 could not be found. Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 could not be found. Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:29:46.924017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 could not be found. Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Returning 404 to user: Instance f1b86398-b5dd-4e34-a35d-ee6081efa9c5 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2e427222-25dd-42ac-85c4-1d101453d0a7 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5" status: 404 len: 111 microversion: 2.1 time: 0.159249 Oct 28 19:29:46.929518 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2354/4696] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:46 2022] GET /compute/v2.1/servers/f1b86398-b5dd-4e34-a35d-ee6081efa9c5 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:29:46.940379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb9c47d3-d0ae-4250-a14b-c6d08a7e9318 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] Calling method '.version_select at 0x7f1d76830c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:46.967563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1e065c1-616c-42ac-973d-af5c2ab535f6 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d77d378b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:46.996514 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb9c47d3-d0ae-4250-a14b-c6d08a7e9318 tempest-ServerActionsTestJSON-232803518 tempest-ServerActionsTestJSON-232803518-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-236544143" status: 202 len: 0 microversion: 2.1 time: 0.062172 Oct 28 19:29:46.997682 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2343/4697] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-236544143 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:29:47.004572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:47.021412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:47.042342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:47.043218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:47.043817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:47.053755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:47.054522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:47.055172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:47.573216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:47.575859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:47.589311 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d42cc4f-a1df-4fc5-ba1c-05105c140044 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 0.586496 Oct 28 19:29:47.594029 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2344/4698] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:46 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:47.620371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:47.623300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:47.652594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:47.655392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:47.656118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:47.657104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:47.661623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:47.662445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:49.001383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:49.020270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a712b803-8bf6-48f7-9b60-a54e6f28c525 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1309 microversion: 2.1 time: 1.419236 Oct 28 19:29:49.024557 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2345/4699] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:47 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1309 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:49.057661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:49.067600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:49.082616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:49.085733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:49.091771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:49.093739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:49.100565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:49.101045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:50.202803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:50.205335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:51.117862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:51.132165 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d50f66cb-d477-4daa-91df-cbcd518ddc72 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 2.097909 Oct 28 19:29:51.151655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2346/4700] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:49 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:51.167369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:51.170925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:51.193227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:51.194647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:51.195949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:51.199651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:51.201112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:51.201746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:52.217041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:52.228336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-693d1e9e-d5e6-4f11-9089-68f53b6699b3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1309 microversion: 2.1 time: 1.074048 Oct 28 19:29:52.237497 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2347/4701] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:51 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1309 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:52.247812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-97c9c6f5-832d-44e1-9a4d-caafbb3c5910 req-0d76861d-073e-4ccb-bafd-8eefa863708e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "name": "network-vif-plugged", "status": "completed", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:52.290598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-97c9c6f5-832d-44e1-9a4d-caafbb3c5910 req-0d76861d-073e-4ccb-bafd-8eefa863708e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:52.292148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-97c9c6f5-832d-44e1-9a4d-caafbb3c5910 req-0d76861d-073e-4ccb-bafd-8eefa863708e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:52.294523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-97c9c6f5-832d-44e1-9a4d-caafbb3c5910 req-0d76861d-073e-4ccb-bafd-8eefa863708e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:52.326569 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-97c9c6f5-832d-44e1-9a4d-caafbb3c5910 req-0d76861d-073e-4ccb-bafd-8eefa863708e service nova] Creating event network-vif-plugged:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:29:52.345547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-97c9c6f5-832d-44e1-9a4d-caafbb3c5910 req-0d76861d-073e-4ccb-bafd-8eefa863708e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106328 Oct 28 19:29:52.346490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2348/4702] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:52.357012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:52.358924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:52.378087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:52.383585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:52.385088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:52.388243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:52.388749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:52.389182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:53.486409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:53.504880 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91d8d2bf-6322-4579-8756-a790b398702e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 1.157065 Oct 28 19:29:53.544740 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2349/4703] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:52 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:53.596189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:53.597877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:53.618300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:53.619401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:53.621157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:53.625051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:53.625701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:53.626827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:54.586509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:54.597977 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54907900-beaa-4d91-b2f0-e1e4b487fc28 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1309 microversion: 2.1 time: 1.051734 Oct 28 19:29:54.607413 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2350/4704] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:53 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1309 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:54.618818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:54.622348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:54.637479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:54.639373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:54.640003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:54.643607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:54.644313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:54.644992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:54.744600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:55.794676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:55.819413 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d6aa960-8f4d-4f61-8cf7-58a15fe0900a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 1.209947 Oct 28 19:29:55.845278 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2351/4705] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:54 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:55.892450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e3da3185-ddd7-4f17-b8db-629900c64e38 req-8d6eda2f-d3b5-49a7-9acc-3a45cc17e72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fc04d8-35a3-4705-9fe4-24fc4995015b", "tag": "1edde99f-9f55-43c1-b4dd-7b66c599f958"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:55.909517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:55.980137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e3da3185-ddd7-4f17-b8db-629900c64e38 req-8d6eda2f-d3b5-49a7-9acc-3a45cc17e72d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:55.980661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e3da3185-ddd7-4f17-b8db-629900c64e38 req-8d6eda2f-d3b5-49a7-9acc-3a45cc17e72d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:55.981103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e3da3185-ddd7-4f17-b8db-629900c64e38 req-8d6eda2f-d3b5-49a7-9acc-3a45cc17e72d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:56.026898 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e3da3185-ddd7-4f17-b8db-629900c64e38 req-8d6eda2f-d3b5-49a7-9acc-3a45cc17e72d service nova] Creating event network-changed:1edde99f-9f55-43c1-b4dd-7b66c599f958 for instance 28fc04d8-35a3-4705-9fe4-24fc4995015b on n-h1-862769-3 Oct 28 19:29:56.039673 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e3da3185-ddd7-4f17-b8db-629900c64e38 req-8d6eda2f-d3b5-49a7-9acc-3a45cc17e72d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189707 Oct 28 19:29:56.040583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2352/4706] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:29:56.053606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:29:56.054639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:29:56.074267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:56.075091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:56.075729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:56.076634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:29:56.077969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:29:56.079225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:29:56.526384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:29:56.538092 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9ac9c21-abc0-4a68-9fc6-0713400092a2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1309 microversion: 2.1 time: 0.494054 Oct 28 19:29:56.539835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2353/4707] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:29:56 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1309 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:29:56.546445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1141197113", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "968c50da-8ea0-4519-84fb-2b5bd5402d5f"}], "security_groups": [{"name": "tempest-securitygroup--1310135687"}], "key_name": "tempest-keypair-720764812", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:29:56.794882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:29:56.834738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:04.215027 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1e065c1-616c-42ac-973d-af5c2ab535f6 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1436 microversion: 2.1 time: 17.251580 Oct 28 19:30:04.223200 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2355/4708] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:29:46 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1436 bytes in 17256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:04.252211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:04.255989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:04.278585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:04.280584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:04.284512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:04.287720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:04.288239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:04.288734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:04.588642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] validate_networks() for [('968c50da-8ea0-4519-84fb-2b5bd5402d5f', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:30:05.540801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:05.565241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb8955a3-7299-455d-b2e8-5c797583a19a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 1.345776 Oct 28 19:30:05.565802 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2356/4709] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:04 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:05.591954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:05.593284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:05.609457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:05.610898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:05.613530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:05.615361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:05.618730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:05.619623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:06.537687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=47 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:06.569261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:06.712887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:06.742785 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-89f1dd6b-ddbc-48d2-990d-3a6bc8515bce tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1309 microversion: 2.1 time: 1.165279 Oct 28 19:30:06.743783 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2357/4710] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:05 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1309 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:06.748881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c17249d0-0640-4c2f-9cef-812afeefc4bb req-4d47bbfd-bb0b-4e34-832c-3c1d8d607dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fc04d8-35a3-4705-9fe4-24fc4995015b", "name": "network-vif-plugged", "status": "completed", "tag": "1edde99f-9f55-43c1-b4dd-7b66c599f958"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:06.770202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c17249d0-0640-4c2f-9cef-812afeefc4bb req-4d47bbfd-bb0b-4e34-832c-3c1d8d607dac service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:06.770968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c17249d0-0640-4c2f-9cef-812afeefc4bb req-4d47bbfd-bb0b-4e34-832c-3c1d8d607dac service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:06.771573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c17249d0-0640-4c2f-9cef-812afeefc4bb req-4d47bbfd-bb0b-4e34-832c-3c1d8d607dac service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:06.815183 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c17249d0-0640-4c2f-9cef-812afeefc4bb req-4d47bbfd-bb0b-4e34-832c-3c1d8d607dac service nova] Creating event network-vif-plugged:1edde99f-9f55-43c1-b4dd-7b66c599f958 for instance 28fc04d8-35a3-4705-9fe4-24fc4995015b on n-h1-862769-3 Oct 28 19:30:06.830055 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c17249d0-0640-4c2f-9cef-812afeefc4bb req-4d47bbfd-bb0b-4e34-832c-3c1d8d607dac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084700 Oct 28 19:30:06.830784 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2358/4711] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:06.847094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e6dae16-e0fe-466e-9898-917d7bbc5fe9 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d77c464c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:07.000615 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e6dae16-e0fe-466e-9898-917d7bbc5fe9 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 200 len: 1436 microversion: 2.1 time: 0.165156 Oct 28 19:30:07.002340 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2359/4712] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:06 2022] GET /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 1436 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:07.023800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:07.026414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:07.044376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:07.045127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:07.048714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:07.049672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:07.050508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:07.055024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.034887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:30:08.034887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:30:08.035800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:30:08.035800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:30:08.035800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:30:08.065257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:08.065777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:08.066354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.067049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:08.077444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:08.079238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.139281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for project 95f88e4c7194409a91baeb78e099e93f. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:30:08.155257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for user dea27583bf5144a5aeed6ec0c3c20ca4 and project 95f88e4c7194409a91baeb78e099e93f. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:30:08.181888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:30:08.187814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:08.193915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:30:08.196779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d715494-c0d6-43e2-a6e4-901805c6834b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 1.191315 Oct 28 19:30:08.220829 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2360/4713] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:07 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:08.228048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:08.229284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:08.237528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:08.238491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:08.240538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.241587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:08.243234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:08.245103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.347746 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af564b58-1dd1-432c-8096-c979fd81a65e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 11.805953 Oct 28 19:30:08.348439 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2354/4714] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:29:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 11808 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:30:08.376767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:08.377398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:08.409230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:08.409731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:08.410171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.410927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:08.411384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:08.411804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:08.832376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:08.851715 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-518fc465-bb4f-4800-b148-064ab5e866ea tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1466 microversion: 2.1 time: 0.628360 Oct 28 19:30:08.861793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:08.872321 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e916b36-d0b4-4b01-92d5-93fc5bd079a5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1309 microversion: 2.1 time: 0.522764 Oct 28 19:30:08.873543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2361/4715] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:08 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1466 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:08.878542 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2355/4716] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:08 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:08.881834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06caec69-44ac-4925-ba6c-1bde11f86c33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:08.887776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-06caec69-44ac-4925-ba6c-1bde11f86c33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:08.897365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5eb2d76d-1d05-422f-83c0-46b53657928f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d768810d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:09.033247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06caec69-44ac-4925-ba6c-1bde11f86c33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:09.045389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06caec69-44ac-4925-ba6c-1bde11f86c33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:09.047110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06caec69-44ac-4925-ba6c-1bde11f86c33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:09.052799 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06caec69-44ac-4925-ba6c-1bde11f86c33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1281 microversion: 2.20 time: 0.177705 Oct 28 19:30:09.055304 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2362/4717] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:08 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:09.060816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-49419af5-f894-4bc0-a031-877848748560 req-46b40799-76d1-4596-93f2-ae36d4eb08a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "name": "network-vif-unplugged", "status": "completed", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:09.137408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-49419af5-f894-4bc0-a031-877848748560 req-46b40799-76d1-4596-93f2-ae36d4eb08a9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:09.138897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-49419af5-f894-4bc0-a031-877848748560 req-46b40799-76d1-4596-93f2-ae36d4eb08a9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:09.140106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-49419af5-f894-4bc0-a031-877848748560 req-46b40799-76d1-4596-93f2-ae36d4eb08a9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:09.165017 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-49419af5-f894-4bc0-a031-877848748560 req-46b40799-76d1-4596-93f2-ae36d4eb08a9 service nova] Creating event network-vif-unplugged:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:30:09.178287 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-49419af5-f894-4bc0-a031-877848748560 req-46b40799-76d1-4596-93f2-ae36d4eb08a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118735 Oct 28 19:30:09.180330 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2363/4718] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:09.224475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:09.229449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:09.245436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:09.248634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:09.250829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:09.253382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:09.255579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:09.258131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:09.810757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:09.836920 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09460065-34c5-41e9-a1f8-d0ca2c16f522 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 0.614720 Oct 28 19:30:09.840100 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2364/4719] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:09 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:09.908231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:09.909305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:09.939591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:09.944278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:09.944872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:09.946101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:09.953950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:09.955054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:10.690921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:10.700192 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1226b9aa-2c1d-4d03-84aa-da0afa33982c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1490 microversion: 2.1 time: 0.796818 Oct 28 19:30:10.701796 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2365/4720] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:09 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1490 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:10.721303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:10.729146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:10.757720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:10.762823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:10.763713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:10.764914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:10.765841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:10.766499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:10.875913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:10.896728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:10.898829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:10.903401 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dda32583-5aa4-4323-b713-b9bd8e976ce3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1333 microversion: 2.20 time: 0.194276 Oct 28 19:30:10.904340 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2366/4721] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:10 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1333 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:10.924330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:10.934445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:10.942329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:10.943830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:10.944514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:10.945806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:10.946483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:10.947310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:11.047312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-81728712-453c-4fb4-a5ec-97416eff3b4a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "PUT /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1085 microversion: 2.1 time: 0.140217 Oct 28 19:30:11.048311 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2367/4722] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:30:10 2022] PUT /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1085 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:11.054031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:11.055196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:11.062486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:11.063402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:11.064291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:11.065245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:11.065922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:11.066567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:11.484574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:11.498201 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-511bfb9d-d06f-4321-a0ba-4e492536a4e4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 0.448274 Oct 28 19:30:11.516265 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2368/4723] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:11 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:11.585653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:11.591468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:11.634601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:11.635855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:11.639736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:11.643844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:11.647566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:11.649734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:11.970821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5eb2d76d-1d05-422f-83c0-46b53657928f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "DELETE /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604" status: 204 len: 0 microversion: 2.1 time: 3.075295 Oct 28 19:30:11.970821 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2356/4724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:08 2022] DELETE /compute/v2.1/images/869ba8fd-3b8e-497d-84c6-01aa6bc96604 => generated 0 bytes in 3077 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:30:11.980995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:11.981599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:12.013605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:12.014160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:12.014604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:12.028844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:12.029088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:12.040187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:12.343519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:12.387627 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48069910-63fc-4de9-8266-d64a139f7380 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1511 microversion: 2.1 time: 0.857049 Oct 28 19:30:12.418607 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2369/4725] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:11 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1511 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:12.440586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5bb87f66-301a-4b97-bfdf-c5c0fccc813f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '.version_select at 0x7f1d774200d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:12.456445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:12.469662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:12.482062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:12.485846 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7950b83c-08df-4d24-833a-462babbbea77 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1339 microversion: 2.20 time: 0.516120 Oct 28 19:30:12.486445 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2357/4726] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:11 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1339 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:12.503531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:12.504574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:12.546824 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-5bb87f66-301a-4b97-bfdf-c5c0fccc813f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] HTTP exception thrown: Image not found. Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5bb87f66-301a-4b97-bfdf-c5c0fccc813f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Request method failure captured: Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 HTTP/1.1 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC1mNZonAJCvkGwa8sykyUgAJrBSe3WEHyYZo9AwgN9GJyPGzRKiZmsn7CiDln8nIZzMppUCfqL3D7af8I3Pzh_Ey8PkATafG60HpurQpBxb0slHhhzj-fUGXXy9OxkkGTtUAEHQl55G0SaKPUwOjJDFJkEfjm-zJbdDaTjo2f7nfuc Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d36609a3ce9f441ba031b1d384fca5b8 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d36609a3ce9f441ba031b1d384fca5b8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d36609a3ce9f441ba031b1d384fca5b8 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerTestJSON-370091223-project Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: bddb9f9bc0d345f39ae73192f4433f63 Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerTestJSON-370091223-project Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '770d3ff2-08cc-4c44-a04f-0077df46f5b5'} Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 770d3ff2-08cc-4c44-a04f-0077df46f5b5 to delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 770d3ff2-08cc-4c44-a04f-0077df46f5b5 could not be found. Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.548995 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:30:12.553968 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:12.555531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:12.555531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:12.555531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:12.555531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:12.555531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:12.555531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:12.556890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5bb87f66-301a-4b97-bfdf-c5c0fccc813f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:30:12.557897 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5bb87f66-301a-4b97-bfdf-c5c0fccc813f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "DELETE /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5" status: 404 len: 62 microversion: 2.1 time: 0.137817 Oct 28 19:30:12.558942 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2370/4727] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:12 2022] DELETE /compute/v2.1/images/770d3ff2-08cc-4c44-a04f-0077df46f5b5 => generated 62 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:30:12.567643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:12.570157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:12.592226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:12.593000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:12.593615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:12.594495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:12.595126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:12.595906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.394064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:13.412088 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-834460ee-6b2d-4804-bb3f-d6e85072d225 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1528 microversion: 2.1 time: 0.851739 Oct 28 19:30:13.412962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2371/4728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:12 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1528 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:13.423103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:13.423620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:13.436492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.437210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.437878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.438784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.439561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.440150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.469964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:30:13.593437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b3047ad-4dfa-419d-b855-e9ddc6d59c5f tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 204 len: 0 microversion: 2.1 time: 0.177056 Oct 28 19:30:13.594865 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2372/4729] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:30:13 2022] DELETE /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:30:13.602463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:13.603551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:13.608718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:13.611009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.611550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.611982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.612685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.613136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.613554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.618573 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99697fbc-2f53-4251-b424-fde2a3a0c2ba tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1511 microversion: 2.1 time: 1.130665 Oct 28 19:30:13.625157 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2358/4730] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:12 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1511 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:13.634142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:13.636107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:13.657522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.658384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.659070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.660160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.660940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.662403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.870676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:13.888103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:13.893313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:13.894962 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4a5ff88a-4c93-45a3-9f57-cbec37837d5e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1339 microversion: 2.20 time: 0.298570 Oct 28 19:30:13.909703 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2373/4731] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:13 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1339 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:13.918208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:13.919547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:13.930660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.931740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.932651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.933947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:13.935212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:13.935931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:13.965133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:13.977404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:30:14.157398 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da213bd8-3482-4951-bca3-5b4c4c0748eb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 204 len: 0 microversion: 2.1 time: 0.239952 Oct 28 19:30:14.161885 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2374/4732] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:30:13 2022] DELETE /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:30:14.177484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:14.178981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:14.187034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:14.187765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:14.188403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:14.189284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:14.189909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:14.190500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:14.375753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:14.401431 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-523a5c28-f313-42c2-a676-d96b7934050a tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1472 microversion: 2.1 time: 0.771484 Oct 28 19:30:14.402148 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2359/4733] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:13 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1472 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:14.441510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:14.442979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:14.452466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:14.453587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:14.455176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:14.456453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:14.457032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:14.458403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:15.039749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:15.048862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f69f640-a304-4d75-97c6-f053862a0c6d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1517 microversion: 2.1 time: 0.879012 Oct 28 19:30:15.055551 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2375/4734] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:14 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1517 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:15.067944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:15.068954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:15.079746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:15.080515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:15.081310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:15.082236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:15.083967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:15.085485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:15.150116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:15.161568 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81a249d1-812e-4cc1-b689-af7fa4d42ec6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1510 microversion: 2.1 time: 0.725441 Oct 28 19:30:15.174855 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2360/4735] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:14 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1510 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:15.427243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:15.428339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:15.436444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:15.437524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:15.438125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:15.439092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:15.439730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:15.440321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:15.497471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:15.506663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:15.508801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:15.510210 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13f73322-c84f-48de-b1e6-45f44a21f2a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.453267 Oct 28 19:30:15.511359 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2376/4736] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:15 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:15.941630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:15.952564 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0c5144e-501e-44d1-9616-215388b99f67 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1472 microversion: 2.1 time: 0.530610 Oct 28 19:30:15.953174 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2361/4737] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:15 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:16.085893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:16.086881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:16.097617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.099648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.100816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.102105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.102950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.103732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.189012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:16.189625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:16.198430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.199333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.199956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.200875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.202315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.202991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.646128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:16.665299 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5d6916cd-9e4f-4fdb-8eb3-e1479e64f414 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1517 microversion: 2.1 time: 0.576929 Oct 28 19:30:16.666482 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2377/4738] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:16 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1517 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:16.678764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:16.679562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:16.704706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.705554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.706211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.707393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.708058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.708687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.811025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:16.821513 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bfaf6fb0-e74c-444b-85b2-3eb0735c97b3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1510 microversion: 2.1 time: 0.636961 Oct 28 19:30:16.834319 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2362/4739] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:16 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1510 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:16.977188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:16.977988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:16.993493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.994339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.995005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:16.995891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:16.996506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:16.997086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:17.046761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:17.063135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:17.065151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:17.066777 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25c4895b-b864-49d9-b45a-e4be2c84aeb2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.396164 Oct 28 19:30:17.067468 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2378/4740] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:16 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:17.244506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:17.255325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3902f785-cb95-4a0b-a8d6-4c64024a9e3b tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1472 microversion: 2.1 time: 0.282505 Oct 28 19:30:17.256544 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2363/4741] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:16 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:17.456710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8464afdd-3143-490e-bc72-a3b8d1119c64 req-3a928c85-67d6-4d48-a370-af99bceebce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "name": "network-vif-unplugged", "status": "completed", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:17.513203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8464afdd-3143-490e-bc72-a3b8d1119c64 req-3a928c85-67d6-4d48-a370-af99bceebce4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:17.513711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8464afdd-3143-490e-bc72-a3b8d1119c64 req-3a928c85-67d6-4d48-a370-af99bceebce4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:17.514148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8464afdd-3143-490e-bc72-a3b8d1119c64 req-3a928c85-67d6-4d48-a370-af99bceebce4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:17.529732 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8464afdd-3143-490e-bc72-a3b8d1119c64 req-3a928c85-67d6-4d48-a370-af99bceebce4 service nova] Creating event network-vif-unplugged:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:30:17.537864 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8464afdd-3143-490e-bc72-a3b8d1119c64 req-3a928c85-67d6-4d48-a370-af99bceebce4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093721 Oct 28 19:30:17.540908 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2379/4742] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:17.709090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:17.709664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:17.750341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:17.751241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:17.751900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:17.752995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:17.755913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:17.756627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:17.860717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:17.861724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:17.873407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:17.874368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:17.875086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:17.875973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:17.876579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:17.877148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:17.949195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:17.962120 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6115c513-3b02-4c0a-84d4-d110da8ac3ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1475 microversion: 2.1 time: 0.269857 Oct 28 19:30:17.963713 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2364/4743] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:17 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1475 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:18.100397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:18.101054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:18.112442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:18.113998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.123392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:18.124341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:18.125299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.125946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:18.126570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:18.175362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:18.459599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:18.471279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a24d1c7d-3525-4271-9ce3-0f5806a86872 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1510 microversion: 2.1 time: 0.614197 Oct 28 19:30:18.480085 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2380/4744] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:17 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:18.485860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a17be39a-99c1-43e2-b7db-19875e1a8d09 req-b6a9fa5e-7175-43a6-8c41-34e5d18ac2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3962f285-7196-4170-92a3-782c084e5a39", "name": "network-vif-deleted", "tag": "1fcb4443-6ad0-450c-897e-95060962aba5"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:18.535719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a17be39a-99c1-43e2-b7db-19875e1a8d09 req-b6a9fa5e-7175-43a6-8c41-34e5d18ac2f0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.541727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a17be39a-99c1-43e2-b7db-19875e1a8d09 req-b6a9fa5e-7175-43a6-8c41-34e5d18ac2f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:18.542452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a17be39a-99c1-43e2-b7db-19875e1a8d09 req-b6a9fa5e-7175-43a6-8c41-34e5d18ac2f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:18.574397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a17be39a-99c1-43e2-b7db-19875e1a8d09 req-b6a9fa5e-7175-43a6-8c41-34e5d18ac2f0 service nova] Creating event network-vif-deleted:1fcb4443-6ad0-450c-897e-95060962aba5 for instance 3962f285-7196-4170-92a3-782c084e5a39 on n-h2-862769-3 Oct 28 19:30:18.601975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a17be39a-99c1-43e2-b7db-19875e1a8d09 req-b6a9fa5e-7175-43a6-8c41-34e5d18ac2f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120040 Oct 28 19:30:18.602996 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2381/4745] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:18.614793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:18.619717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:18.621274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:18.624541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:18.626057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:18.632376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.633104 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f48ee7ea-d6d9-4498-ac60-107c95486887 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.536319 Oct 28 19:30:18.634291 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2365/4746] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:18 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:30:18.637032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:18.639873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:18.640708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.641190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:18.641632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:18.702085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.703083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:18.703776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:18.704479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lazy-loading 'fault' on Instance uuid 3962f285-7196-4170-92a3-782c084e5a39 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:30:18.825949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddb9f9bc0d345f39ae73192f4433f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36609a3ce9f441ba031b1d384fca5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:18.836127 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-290840bc-7108-4f07-b660-1bc3defcebef tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 200 len: 1306 microversion: 2.1 time: 0.231801 Oct 28 19:30:18.839485 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2382/4747] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:18 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 1306 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:18.985537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:18.986162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:18.998474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:18.999480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.000640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.003042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.004853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.006018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.115233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.115858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.116310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.116951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lazy-loading 'fault' on Instance uuid 28fc04d8-35a3-4705-9fe4-24fc4995015b {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:30:19.164161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:19.176610 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40658c55-a257-424d-a226-54523ccefce2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 200 len: 1320 microversion: 2.1 time: 0.194943 Oct 28 19:30:19.177729 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2366/4748] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:18 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:19.511741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:19.513366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:19.532026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:19.537387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.539714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.544488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.545838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.551038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.551850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.659557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:19.667898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:19.691823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.698970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.700095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.701275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.702052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.702479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.936547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:19.940448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:19.951690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:19.955257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:19.956701 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f501ec95-20e8-48e2-b82d-c84c2b089eea tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.301123 Oct 28 19:30:19.958289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-174165ed-64f0-4ce0-969e-63290624dcf3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1513 microversion: 2.1 time: 0.449731 Oct 28 19:30:19.964203 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2383/4749] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:19 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:19.969641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:19.973787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] [instance: 3962f285-7196-4170-92a3-782c084e5a39] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:19.977825 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2367/4750] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:19 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:30:19.988822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.991010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:19.992106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:19.997515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:19.998548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.000727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.002785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:20.003691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:20.015243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.016481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.017154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.018114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.018764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.019518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.060892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] HTTP exception thrown: Instance 3962f285-7196-4170-92a3-782c084e5a39 could not be found. Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Request method failure captured: Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 HTTP/1.1 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC1mNZonAJCvkGwa8sykyUgAJrBSe3WEHyYZo9AwgN9GJyPGzRKiZmsn7CiDln8nIZzMppUCfqL3D7af8I3Pzh_Ey8PkATafG60HpurQpBxb0slHhhzj-fUGXXy9OxkkGTtUAEHQl55G0SaKPUwOjJDFJkEfjm-zJbdDaTjo2f7nfuc Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: d36609a3ce9f441ba031b1d384fca5b8 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d36609a3ce9f441ba031b1d384fca5b8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d36609a3ce9f441ba031b1d384fca5b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: d36609a3ce9f441ba031b1d384fca5b8 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-370091223 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ImagesOneServerTestJSON-370091223-project Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: bddb9f9bc0d345f39ae73192f4433f63 Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ImagesOneServerTestJSON-370091223-project Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 3962f285-7196-4170-92a3-782c084e5a39 could not be found. Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '3962f285-7196-4170-92a3-782c084e5a39'} Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3962f285-7196-4170-92a3-782c084e5a39 could not be found. Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3962f285-7196-4170-92a3-782c084e5a39 could not be found. Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:20.066279 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3962f285-7196-4170-92a3-782c084e5a39 could not be found. Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] Returning 404 to user: Instance 3962f285-7196-4170-92a3-782c084e5a39 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58395f6b-86c6-49ef-804e-2f623e1e6521 tempest-ImagesOneServerTestJSON-370091223 tempest-ImagesOneServerTestJSON-370091223-project] 10.222.0.44 "GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39" status: 404 len: 111 microversion: 2.1 time: 0.103585 Oct 28 19:30:20.072532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2384/4751] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:19 2022] GET /compute/v2.1/servers/3962f285-7196-4170-92a3-782c084e5a39 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:30:20.214513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:20.217179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:20.234381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.234915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.243352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.245354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.247676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.249008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.300060 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b HTTP/1.1 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '28fc04d8-35a3-4705-9fe4-24fc4995015b'} Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.306135 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.312305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:20.312305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:20.312305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:30:20.312305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:30:20.312305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:30:20.312305 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.314056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:30:20.315625 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5172913f-3cf1-4a8a-a7f4-3a5b97c020f1 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 404 len: 111 microversion: 2.1 time: 0.115379 Oct 28 19:30:20.318396 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2385/4752] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:20 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:30:20.429129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:20.443015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4b4c4b6f-3352-46ab-9b58-b593000bf6bf tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1453 microversion: 2.1 time: 0.453883 Oct 28 19:30:20.444854 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2368/4753] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:19 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1453 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:20.508779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:20.509331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:20.519583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.521582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.523533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.524454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.525113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.529971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.598147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1171474229", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1c457a82-03d7-4a12-ad63-62e256e152ca"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:20.605748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lazy-loading 'flavor' on Instance uuid 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:30:20.638546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'shelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state shelved_offloaded Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 14 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: {"shelve": {}} Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'shelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state shelved_offloaded Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'shelve': {}}} Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:30:20.648214 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state shelved_offloaded Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state shelved_offloaded Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'shelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state shelved_offloaded {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de8165bd-6393-4129-aa17-b36bdaae98b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 155 microversion: 2.1 time: 0.145076 Oct 28 19:30:20.652955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2386/4754] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:30:20 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 155 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:30:20.659696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:20.660299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:20.667748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.669388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.669826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.670546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:20.671147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:20.671569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:20.710523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] validate_networks() for [('1c457a82-03d7-4a12-ad63-62e256e152ca', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:30:21.094192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120628) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:30:21.281851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-34a07449-2194-461d-bdbd-3f6710fdeb63 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.626822 Oct 28 19:30:21.289043 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2387/4755] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:30:20 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:30:21.306081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fc04d8-35a3-4705-9fe4-24fc4995015b", "name": "network-vif-deleted", "tag": "1edde99f-9f55-43c1-b4dd-7b66c599f958"}, {"name": "network-changed", "server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:21.331820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:21.337493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:21.339832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:21.384212 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] Creating event network-vif-deleted:1edde99f-9f55-43c1-b4dd-7b66c599f958 for instance 28fc04d8-35a3-4705-9fe4-24fc4995015b on n-h1-862769-3 Oct 28 19:30:21.436890 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] Creating event network-changed:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h2-862769-3 Oct 28 19:30:21.476363 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7bbd7b14-ec08-4323-8f79-4cec9ffa2b58 req-cc1d5d6c-c7fe-4a36-9fc3-740c3de135ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.185499 Oct 28 19:30:21.484260 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2388/4756] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:21.498025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:21.511634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:21.534222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:21.537084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:21.539077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:21.542139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:21.544829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:21.545709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:22.128645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:22.140393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:22.147905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:22.149369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b898b1c7-b736-4da0-a7ee-a40cb1fa372a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.663732 Oct 28 19:30:22.150273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2389/4757] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:21 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:22.159816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:22.160446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:22.180794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:22.181300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:22.181789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:22.182522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:22.183011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:22.183436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:22.341185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:30:22.341807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:30:22.342055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:30:22.342453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:30:22.342889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:30:22.361717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:22.362208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:22.362634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:22.363471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:22.363911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:22.364322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:22.446223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:30:22.458253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Getting quotas for user 6fbf3cffd85842d2b730d0d6615899fe and project 25bf27a16a6148cca843ffd36a54684c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:30:22.510682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:22.515883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:30:22.518402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:30:22.521011 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7677f2c9-f342-454a-a655-88eb1700ab4c tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1461 microversion: 2.1 time: 0.369199 Oct 28 19:30:22.521633 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2390/4758] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:22 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1461 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:22.589511 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ee2236e-aa28-4d9b-94e5-93b0459f5308 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984511 Oct 28 19:30:22.589511 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2369/4759] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:30:22.613664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5aa199fa-d04b-4225-b8bf-109e6732c5f9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:22.615272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5aa199fa-d04b-4225-b8bf-109e6732c5f9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:22.755445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5aa199fa-d04b-4225-b8bf-109e6732c5f9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:22.763683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5aa199fa-d04b-4225-b8bf-109e6732c5f9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1209 microversion: 2.1 time: 0.166039 Oct 28 19:30:22.787882 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2391/4760] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:22 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1209 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:23.178867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:23.180276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:23.188784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:23.189547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:23.190231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:23.191325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:23.193004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:23.193262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:23.481854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:23.494616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:23.508669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:23.509934 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba0d5408-0d1d-4d91-a60f-f3b05af86478 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.339216 Oct 28 19:30:23.522796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2370/4761] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:23 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:23.549633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:23.556241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:23.567733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:23.569851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:23.570625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:23.572441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:23.573624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:23.574277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:23.701060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:23.797243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:23.798055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:23.811161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:23.811828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:23.819326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:23.820267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:23.820859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:23.821424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:24.002301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:24.012199 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f05a051-e878-42d6-a3b0-4cf16f298760 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1461 microversion: 2.1 time: 0.468178 Oct 28 19:30:24.016623 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2392/4762] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:23 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1461 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:24.367931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:24.384554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ba1e579-8537-439c-87ef-4ed22db95ed2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1205 microversion: 2.1 time: 0.592660 Oct 28 19:30:24.395275 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2371/4763] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:23 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1205 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:24.539750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:24.540605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:24.550654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:24.551444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:24.552167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:24.553154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:24.554495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:24.555190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:25.044903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:25.045591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:25.061593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:25.062170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:25.063291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:25.063896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:25.069853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:25.070740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:25.074177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:25.080015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:25.081953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:25.086368 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e7d0b293-0018-497e-8a7f-706b0f5f92f7 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.551826 Oct 28 19:30:25.091970 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2393/4764] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:24 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:25.143557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:25.412835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:25.413886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:25.432117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:25.433732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:25.434525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:25.436251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:25.437018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:25.438462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:25.705337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:25.723540 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87d7cef2-03d3-4d8b-9fc0-09e76604765e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1267 microversion: 2.1 time: 0.316577 Oct 28 19:30:25.741020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2394/4765] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:25 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:25.867039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:25.878316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-259fc8a4-7a75-42e5-a3f2-24ad8e49c247 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1461 microversion: 2.1 time: 0.841027 Oct 28 19:30:25.895241 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2372/4766] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:25 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1461 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:26.119596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:26.120277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:26.142471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:26.144936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:26.145724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:26.150557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:26.151386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:26.152790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:26.641781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2bca2c52-e527-4ec0-b9f1-b6c88efe2d32 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7691adc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:26.734267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2bca2c52-e527-4ec0-b9f1-b6c88efe2d32 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/12463ae8-0d6d-4877-bd5c-d54c9a7765f1" status: 200 len: 662 microversion: 2.1 time: 0.088724 Oct 28 19:30:26.734267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2373/4767] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:26 2022] GET /compute/v2.1/images/12463ae8-0d6d-4877-bd5c-d54c9a7765f1 => generated 662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:26.741305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-30046f9d-c0e9-44f6-b051-60a71412725d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d769e3dc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:26.819345 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-30046f9d-c0e9-44f6-b051-60a71412725d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/12463ae8-0d6d-4877-bd5c-d54c9a7765f1" status: 200 len: 662 microversion: 2.1 time: 0.082905 Oct 28 19:30:26.820307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2374/4768] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:26 2022] GET /compute/v2.1/images/12463ae8-0d6d-4877-bd5c-d54c9a7765f1 => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:30:26.832610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:26.835424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:26.848701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:26.851319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:26.851979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:26.856114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:26.856840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:26.857569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:27.568578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:27.579599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae8f4184-0af3-4699-b330-84febaa246ef tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1267 microversion: 2.1 time: 0.758157 Oct 28 19:30:27.583462 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2375/4769] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:26 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1267 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:27.591541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:27.597543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:27.623542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:27.624115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:27.624561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:27.625378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:27.625840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:27.626272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:27.907914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:27.919705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:27.923916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:27.933601 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ade59897-4b94-46e1-a4d9-0fdbb689909c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 1.819824 Oct 28 19:30:27.934545 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2395/4770] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:26 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:27.943324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7b4e6e5e-41d7-4101-be1f-200e299efe4a req-45f32419-b02b-4014-b911-043202f59174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "name": "network-vif-plugged", "status": "completed", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:27.969826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:27.973762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:27.978925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7b4e6e5e-41d7-4101-be1f-200e299efe4a req-45f32419-b02b-4014-b911-043202f59174 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:27.982300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7b4e6e5e-41d7-4101-be1f-200e299efe4a req-45f32419-b02b-4014-b911-043202f59174 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:27.984356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7b4e6e5e-41d7-4101-be1f-200e299efe4a req-45f32419-b02b-4014-b911-043202f59174 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:27.986604 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1821b6f0-a0b8-4d18-acbe-aa05dfc5cfc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.401666 Oct 28 19:30:27.989325 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2376/4771] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:27 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:28.004653 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7b4e6e5e-41d7-4101-be1f-200e299efe4a req-45f32419-b02b-4014-b911-043202f59174 service nova] Creating event network-vif-plugged:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h2-862769-3 Oct 28 19:30:28.014294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7b4e6e5e-41d7-4101-be1f-200e299efe4a req-45f32419-b02b-4014-b911-043202f59174 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078253 Oct 28 19:30:28.015478 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2396/4772] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:28.429011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f6e06c1-4132-4a84-8f1f-57fc358c92e2 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d769e3d30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:28.502128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f6e06c1-4132-4a84-8f1f-57fc358c92e2 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/abc80c94-41dc-47ee-9f0d-2affab790949" status: 200 len: 662 microversion: 2.1 time: 0.081471 Oct 28 19:30:28.503890 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2377/4773] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:28 2022] GET /compute/v2.1/images/abc80c94-41dc-47ee-9f0d-2affab790949 => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:28.520227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65128fd9-28e7-4bf2-b14a-fc6cbe29da28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d768bc670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:28.605896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:28.606522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:28.607595 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65128fd9-28e7-4bf2-b14a-fc6cbe29da28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/abc80c94-41dc-47ee-9f0d-2affab790949" status: 200 len: 662 microversion: 2.1 time: 0.093896 Oct 28 19:30:28.608432 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2397/4774] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:28 2022] GET /compute/v2.1/images/abc80c94-41dc-47ee-9f0d-2affab790949 => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:28.639428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:28.640302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:28.640999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:28.642118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:28.642801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:28.643409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:28.969226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:28.970867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:28.979967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:28.982652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:28.983537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:28.984553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:28.985302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:28.985988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:29.138011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:29.172122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c1a2f495-cfd9-46c2-bc3b-a648e58e6583 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 0.570189 Oct 28 19:30:29.183421 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2378/4775] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:28 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:29.209486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:29.213561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:29.247423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:29.248104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:29.248658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:29.256980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:29.257810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:29.258457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:29.669936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:29.686819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:29.690988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:29.692607 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d916dcf-271b-4835-91a9-c2da435eb7a0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 0.733532 Oct 28 19:30:29.695902 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2398/4776] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:28 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:30:29.876634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:29.890123 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1df72890-95e3-4d4e-935d-e4b8751f12d7 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.704957 Oct 28 19:30:29.893486 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2379/4777] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:29 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:30.202258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:30.202992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:30.218848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:30.219810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:30.220411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:30.223395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:30.226346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:30.229335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:30.729164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:30.731598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:30.755700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:30.765524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:30.766302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:30.767351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:30.770295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:30.771975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:31.863510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:31.892096 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e8769e4-a6ee-402b-9646-4282a11e0983 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 1.690061 Oct 28 19:30:31.894223 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2399/4778] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:30 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:31.916373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:31.920167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:31.949140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:31.958625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:31.961058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:31.961962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:31.965172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:31.978751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:32.117048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:32.130597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:32.133224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:32.137895 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7a23036b-d4da-493b-b1f8-2233ecfc3583 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1407 microversion: 2.20 time: 1.417850 Oct 28 19:30:32.153579 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2380/4779] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:30 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1407 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:32.761970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:32.882591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71eb56d1-7c97-4862-8137-ec7f5b1fa65c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d769e3280>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:32.892416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:32.895919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:32.989354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71eb56d1-7c97-4862-8137-ec7f5b1fa65c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/85c18ef6-9268-4dc4-b490-7ba729032416" status: 200 len: 661 microversion: 2.1 time: 0.110108 Oct 28 19:30:32.990360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2381/4780] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:32 2022] GET /compute/v2.1/images/85c18ef6-9268-4dc4-b490-7ba729032416 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:33.006176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:33.007156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:33.036670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:33.038807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:33.044353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:33.045883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:33.046613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:33.049125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:33.537870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:33.577769 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b513c49-f301-4136-aadb-1a6d53501524 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 1.682096 Oct 28 19:30:33.585060 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2400/4781] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:31 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:33.595434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60843573-9a99-4823-9e02-fa9320976436 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77efcd30>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:33.688120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:33.707372 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a5d466b0-6aac-4759-ad7b-fe4ff1b9804a tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 0.709237 Oct 28 19:30:33.708927 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2382/4782] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:32 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:33.725863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:33.735759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:33.741688 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-60843573-9a99-4823-9e02-fa9320976436 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/85c18ef6-9268-4dc4-b490-7ba729032416" status: 200 len: 661 microversion: 2.1 time: 0.155548 Oct 28 19:30:33.742294 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2401/4783] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:30:33 2022] GET /compute/v2.1/images/85c18ef6-9268-4dc4-b490-7ba729032416 => generated 661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:33.761896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:33.762933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:33.764695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:33.765810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:33.770450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:33.772075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:33.909912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-348329631", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:34.048474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:30:35.869783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:35.908139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:35.912992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:35.917191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a50eff72-df2c-47cf-bda2-95c676d938a1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1598 microversion: 2.20 time: 2.206660 Oct 28 19:30:35.921972 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2383/4784] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:30:33 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1598 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:30:35.938186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a9ff2036-428a-44ec-81eb-bafac238f810 req-26f7e38c-ea57-4954-a8b6-1d337de73be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613ca4b5-f78b-4cc9-be67-409151150964", "tag": "68e9f9f7-da9e-4b30-b20f-b12aae818418"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:35.984046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a9ff2036-428a-44ec-81eb-bafac238f810 req-26f7e38c-ea57-4954-a8b6-1d337de73be3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:35.984569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a9ff2036-428a-44ec-81eb-bafac238f810 req-26f7e38c-ea57-4954-a8b6-1d337de73be3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:35.985010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a9ff2036-428a-44ec-81eb-bafac238f810 req-26f7e38c-ea57-4954-a8b6-1d337de73be3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:36.029084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a9ff2036-428a-44ec-81eb-bafac238f810 req-26f7e38c-ea57-4954-a8b6-1d337de73be3 service nova] Creating event network-changed:68e9f9f7-da9e-4b30-b20f-b12aae818418 for instance 613ca4b5-f78b-4cc9-be67-409151150964 on n-h1-862769-3 Oct 28 19:30:36.045645 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a9ff2036-428a-44ec-81eb-bafac238f810 req-26f7e38c-ea57-4954-a8b6-1d337de73be3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120355 Oct 28 19:30:36.056419 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2384/4785] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:36.086167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:36.087608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:36.108509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:36.109013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:36.128692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:30:36.129236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:30:36.129566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:30:36.129972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:30:36.130376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:30:36.137013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:36.143827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:36.153895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:36.157037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:36.184185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:36.185318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:36.185572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:36.189950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:36.197880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:36.198874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:36.300140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Getting quotas for project c6197c092ced4555b66f6d086a17628c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:30:36.311389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Getting quotas for user 36699f62b10a4e0f98942f73d3df0e71 and project c6197c092ced4555b66f6d086a17628c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:30:36.392939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:30:36.401195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:30:36.558008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4697cd1e-d2d7-4127-bb6f-be1b36c717c0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.652910 Oct 28 19:30:36.561167 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2402/4786] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:30:36.600616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:36.625175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:36.709335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:36.716868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:36.717520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:36.726867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:36.727382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:36.727830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:37.448075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:37.499394 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38df03a4-ec28-4335-b9cf-d73e44f31083 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 0.924994 Oct 28 19:30:37.499394 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2403/4787] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:36 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:37.514197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:37.516593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:37.532075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:37.536007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:37.536775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:37.537950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:37.538643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:37.541254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:37.594422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:37.628499 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3ef18bd-de8a-442c-b485-0fa63876ca2e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 1.563635 Oct 28 19:30:37.638383 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2385/4788] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:36 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:37.659292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1928391234", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:37.678278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:37.785855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:30:38.050270 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15fae20c-20b1-4686-beb2-d3f92ac0561c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.552784 Oct 28 19:30:38.060026 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2404/4789] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:30:37 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-interface => generated 284 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:30:38.517330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:38.519214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:38.538081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:38.538893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:38.539634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:38.540573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:38.541239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:38.541871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:40.082184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:40.097470 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-640b0946-52cd-41ff-867a-97edacb40847 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 1.578978 Oct 28 19:30:40.099331 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2405/4790] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:38 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:40.114621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:40.115678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:40.129399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:40.133613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:40.136474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:40.143355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:40.144270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:40.144966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:40.278660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:30:40.280268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:30:40.280678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:30:40.281092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:30:40.281716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:30:40.341547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:40.345954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:40.351454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:40.352302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:40.352833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:40.353324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:40.466453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Getting quotas for project c6197c092ced4555b66f6d086a17628c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:30:40.496363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Getting quotas for user 36699f62b10a4e0f98942f73d3df0e71 and project c6197c092ced4555b66f6d086a17628c. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:30:40.555475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:30:40.575790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:30:40.736181 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5abaff6-8689-4edc-b79f-e25b9b767ccf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.096089 Oct 28 19:30:40.737393 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2386/4791] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:30:40.749776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c20f33d-a477-4093-b34d-56e64ef05512 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:40.751071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c20f33d-a477-4093-b34d-56e64ef05512 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:40.763908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:40.814339 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2e9716f-b821-42ad-8853-faa52a021d6e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.713532 Oct 28 19:30:40.819790 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2406/4792] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:40 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:40.856568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c20f33d-a477-4093-b34d-56e64ef05512 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:40.873037 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c20f33d-a477-4093-b34d-56e64ef05512 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1218 microversion: 2.1 time: 0.128103 Oct 28 19:30:40.889163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2387/4793] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:40 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:41.123317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:41.124533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:41.141024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:41.141557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:41.141965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:41.142680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:41.143161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:41.158654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:41.843095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:41.844371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:41.871028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:41.878605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:41.883141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:41.899415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:41.899415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:41.899415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:43.634522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:43.646778 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa4e2c26-d4c2-4875-8096-bb7e47f66382 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 1.807191 Oct 28 19:30:43.651269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2388/4794] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:41 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:43.663378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:43.664832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:43.715492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:43.716305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:43.716976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:43.718131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:43.720064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:43.721651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:43.771857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:43.797512 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-055af602-bd66-4e84-aa3b-b62055968200 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 2.679209 Oct 28 19:30:43.831147 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2407/4795] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:41 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 2713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:44.328670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:44.345093 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b2ddec7-5f5c-4c0a-9e6e-08c2efdf3d47 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1270 microversion: 2.1 time: 0.688090 Oct 28 19:30:44.346020 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2389/4796] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:43 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1270 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:44.353667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-662139612", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "3bf034a9-8bb4-42fa-8158-434a2bf2fdcf"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:44.364995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dfa2d138-37c9-477b-9524-ca91737f59b5 req-6f3a3242-31ce-4d42-88c2-993954cd89cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613ca4b5-f78b-4cc9-be67-409151150964", "name": "network-vif-plugged", "status": "completed", "tag": "68e9f9f7-da9e-4b30-b20f-b12aae818418"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:44.412960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dfa2d138-37c9-477b-9524-ca91737f59b5 req-6f3a3242-31ce-4d42-88c2-993954cd89cc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:44.413550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dfa2d138-37c9-477b-9524-ca91737f59b5 req-6f3a3242-31ce-4d42-88c2-993954cd89cc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:44.414424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dfa2d138-37c9-477b-9524-ca91737f59b5 req-6f3a3242-31ce-4d42-88c2-993954cd89cc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:44.475085 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dfa2d138-37c9-477b-9524-ca91737f59b5 req-6f3a3242-31ce-4d42-88c2-993954cd89cc service nova] Creating event network-vif-plugged:68e9f9f7-da9e-4b30-b20f-b12aae818418 for instance 613ca4b5-f78b-4cc9-be67-409151150964 on n-h1-862769-3 Oct 28 19:30:44.487949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] validate_networks() for [('3bf034a9-8bb4-42fa-8158-434a2bf2fdcf', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:30:44.497380 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dfa2d138-37c9-477b-9524-ca91737f59b5 req-6f3a3242-31ce-4d42-88c2-993954cd89cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148491 Oct 28 19:30:44.517337 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2390/4797] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:44.683332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:44.684039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:44.705806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:44.706979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:44.707617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:44.708357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:44.708817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:44.709241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:46.218331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:46.368078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:46.386805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:46.404939 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d015c448-684f-40ee-a2f4-e1d3b01eddc0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 1.727555 Oct 28 19:30:46.429499 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2391/4798] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:44 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:46.440177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:46.443683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:46.460266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:46.461119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:46.463439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:46.464367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:46.465939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:46.470992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.141384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:48.162451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54992e97-bdbd-4e26-bf5a-ebb071de3070 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 1.731191 Oct 28 19:30:48.196023 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2392/4799] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:46 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:48.206730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:30:48.207230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:30:48.207700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:30:48.208106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:30:48.208505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:30:48.215726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:48.218044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:48.242065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.242594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.243121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.243962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.246163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.248449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.248960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.250496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.250710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.251033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.251453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.256939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.332720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Getting quotas for project 850f2f326084434bb6c1784276fed3d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:30:48.360127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Getting quotas for user a9244fcd848c4c6cac8b3b16c47f4384 and project 850f2f326084434bb6c1784276fed3d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:30:48.405409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:30:48.424724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:30:48.605024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:48.617475 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d34093d-5b13-49a7-9ea0-eb1fc2d5cb5f tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.783278 Oct 28 19:30:48.618111 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62231d90-7ac1-4848-9bd2-2e6ca95b7809 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1276 microversion: 2.1 time: 0.417600 Oct 28 19:30:48.624664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2408/4800] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:30:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:30:48.627623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2393/4801] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:48 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1276 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:48.641081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-194d3158-1766-4637-bd9b-d644e434b6de req-b397151c-67a8-4dc3-9ddb-5833805a2971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:48.656507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:48.658779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:48.669779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-194d3158-1766-4637-bd9b-d644e434b6de req-b397151c-67a8-4dc3-9ddb-5833805a2971 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.674934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-194d3158-1766-4637-bd9b-d644e434b6de req-b397151c-67a8-4dc3-9ddb-5833805a2971 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.675724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.675980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-194d3158-1766-4637-bd9b-d644e434b6de req-b397151c-67a8-4dc3-9ddb-5833805a2971 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.676225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.676657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.677379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.677833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.678252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.708312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-194d3158-1766-4637-bd9b-d644e434b6de req-b397151c-67a8-4dc3-9ddb-5833805a2971 service nova] Creating event network-changed:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h2-862769-3 Oct 28 19:30:48.722287 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-194d3158-1766-4637-bd9b-d644e434b6de req-b397151c-67a8-4dc3-9ddb-5833805a2971 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092999 Oct 28 19:30:48.734367 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2394/4802] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:48.752972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bab646d1-4bbe-44b0-96d8-7ed1a0d1a875 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:48.756423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bab646d1-4bbe-44b0-96d8-7ed1a0d1a875 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:49.100106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bab646d1-4bbe-44b0-96d8-7ed1a0d1a875 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:49.107999 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bab646d1-4bbe-44b0-96d8-7ed1a0d1a875 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1215 microversion: 2.1 time: 0.368861 Oct 28 19:30:49.118332 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2395/4803] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:48 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1215 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:49.191737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:49.193878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:49.206309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:49.209030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:49.212247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:49.214258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:49.215187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:49.216806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:49.454046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:49.465753 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b777e8c7-427c-404a-b464-a7f09309aa01 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.846434 Oct 28 19:30:49.475129 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2409/4804] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:48 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:49.653204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:49.654361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:49.678118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:49.681462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:49.689014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:49.690802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:49.693008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:49.694349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.120214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:50.161238 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-181c2bd5-003a-4659-8b3c-640eeb464f28 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1276 microversion: 2.1 time: 0.510635 Oct 28 19:30:50.164933 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2410/4805] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:49 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1276 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:50.207997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:50.210337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:50.230661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:50.233151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.236473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.238084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.241881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.243657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.245139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.252189 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48a125f5-6098-465a-95ad-9e0295da9e13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1491 microversion: 2.1 time: 1.064139 Oct 28 19:30:50.266632 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2396/4806] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:49 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1491 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:50.281182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1154422050"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:50.293212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:50.314592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.320199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.323502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.344505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.345384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.348386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.408679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:50.506068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:50.520584 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f724052d-a6ed-442f-89d9-abcfaf758a58 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "PUT /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1076 microversion: 2.1 time: 0.244032 Oct 28 19:30:50.537114 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2397/4807] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:30:50 2022] PUT /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1076 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:50.544190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:50.545027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:50.551738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.552522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.553137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.554086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.554735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.555330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.586813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:50.652597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe6883f2-a260-4815-b120-51b0f21828a8 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1267 microversion: 2.1 time: 0.482169 Oct 28 19:30:50.664285 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2411/4808] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:50 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1267 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:50.684371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:50.685488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:50.700311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.701328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.702278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.703393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:50.704107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:50.704757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.122529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:51.134865 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b7fb7b9-ec7f-4319-82fc-02a80dbefbc3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.596415 Oct 28 19:30:51.136074 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2398/4809] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:50 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:51.191397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:51.194964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:51.212218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:51.212713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:51.213144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.213863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:51.214315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:51.214746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.375653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:51.384803 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb5a6b21-8faf-4c84-80c4-3c499f3f3efe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1502 microversion: 2.1 time: 0.716267 Oct 28 19:30:51.390032 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2412/4810] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:50 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1502 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:51.421196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:51.422403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:51.435015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:51.435966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:51.438798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.439955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:51.443786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:51.444520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.479227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:52.058080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:52.071669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-730f512a-efda-4f64-a0c6-a72535ac05ec tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1318 microversion: 2.1 time: 0.888026 Oct 28 19:30:52.077361 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2399/4811] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:51 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:52.089203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:52.090140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:52.109323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.110099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.113011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.114114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.115416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.117640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.216592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:52.233032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b833a27-62cb-42c8-92f1-f43009c569df tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1502 microversion: 2.1 time: 0.816229 Oct 28 19:30:52.234349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2413/4812] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:51 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1502 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:52.245436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:52.247442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:52.265194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.265979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.267742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.268686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.269857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:52.270583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.272088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.278961 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe6f493b-4aa1-40f1-821c-587fb8df30f5 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1273 microversion: 2.1 time: 0.200155 Oct 28 19:30:52.298717 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2400/4813] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:52 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:52.303294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-87000a25-babf-48e7-87a2-42cc5af072b5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:52.313215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87000a25-babf-48e7-87a2-42cc5af072b5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.313717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87000a25-babf-48e7-87a2-42cc5af072b5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.314156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87000a25-babf-48e7-87a2-42cc5af072b5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.366940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-87000a25-babf-48e7-87a2-42cc5af072b5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Going to try to stop instance {{(pid=120629) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:30:52.445312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-87000a25-babf-48e7-87a2-42cc5af072b5 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "POST /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964/action" status: 202 len: 0 microversion: 2.1 time: 0.156057 Oct 28 19:30:52.449105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2401/4814] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:30:52 2022] POST /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:30:52.456671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:52.457400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:52.476363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.477027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.477540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.478326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.478860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.479530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.425653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:53.442095 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21beefcd-bc8f-45d8-bb4f-513be91cb2b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 1.206346 Oct 28 19:30:53.442726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2414/4815] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:52 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:53.458872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:53.459779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:53.467870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:53.468632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:53.469237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.470169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:53.470863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:53.471455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.520097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:53.536161 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9223f0ce-2592-4216-a31b-d9e86d135c81 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 1.083785 Oct 28 19:30:53.537847 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2402/4816] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:52 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:53.560260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:53.561928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:53.568464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:53.569197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:53.570564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.571801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:53.572437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:53.574760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.775013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:53.783138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f9071b2-6efa-43d1-902c-673d8e74de6e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1273 microversion: 2.1 time: 0.243963 Oct 28 19:30:53.784419 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2403/4817] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:53 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:53.967425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:53.994917 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e84c204c-3b6d-4e4a-af3c-b47c639be7aa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1318 microversion: 2.1 time: 0.550982 Oct 28 19:30:53.998941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2415/4818] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:53 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:54.385999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-77dedca8-1425-4d47-83d9-80865e231410 req-f20e800d-544c-4f2d-aec1-b5f7ef3c524e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10edd313-26a6-40c7-87c9-2804f0f53589", "tag": "cc84a956-8415-4ff0-bb48-04d2f3b8c36e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:54.410812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77dedca8-1425-4d47-83d9-80865e231410 req-f20e800d-544c-4f2d-aec1-b5f7ef3c524e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.412771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77dedca8-1425-4d47-83d9-80865e231410 req-f20e800d-544c-4f2d-aec1-b5f7ef3c524e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.413362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-77dedca8-1425-4d47-83d9-80865e231410 req-f20e800d-544c-4f2d-aec1-b5f7ef3c524e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:54.433690 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-77dedca8-1425-4d47-83d9-80865e231410 req-f20e800d-544c-4f2d-aec1-b5f7ef3c524e service nova] Creating event network-changed:cc84a956-8415-4ff0-bb48-04d2f3b8c36e for instance 10edd313-26a6-40c7-87c9-2804f0f53589 on n-h2-862769-3 Oct 28 19:30:54.456989 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-77dedca8-1425-4d47-83d9-80865e231410 req-f20e800d-544c-4f2d-aec1-b5f7ef3c524e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081742 Oct 28 19:30:54.458282 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2404/4819] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:54.467965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:54.469348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:54.480675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.481417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.482173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:54.483670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.485453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.486757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:54.567403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:54.568891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:54.577984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.578492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.578950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:54.579665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.580169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.580591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.204992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:55.216053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1f3d58b8-751e-4086-8391-5bbbd2c1a5c2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.752425 Oct 28 19:30:55.225202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:55.236717 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24743572-08dc-4e45-9cfd-2635874af945 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.678493 Oct 28 19:30:55.237320 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2405/4820] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:54 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:55.254054 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2416/4821] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:54 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:55.264285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-cacbed61-f3d9-4371-a68a-53491a268882 req-634fe6b2-9c1c-41bf-a30f-0cb47b55e44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:55.264757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:55.265587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:55.285076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.285900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.286711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.290816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cacbed61-f3d9-4371-a68a-53491a268882 req-634fe6b2-9c1c-41bf-a30f-0cb47b55e44c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.291149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.291774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.292037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cacbed61-f3d9-4371-a68a-53491a268882 req-634fe6b2-9c1c-41bf-a30f-0cb47b55e44c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.292482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.292809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cacbed61-f3d9-4371-a68a-53491a268882 req-634fe6b2-9c1c-41bf-a30f-0cb47b55e44c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.323574 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-cacbed61-f3d9-4371-a68a-53491a268882 req-634fe6b2-9c1c-41bf-a30f-0cb47b55e44c service nova] Creating event network-changed:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:30:55.346388 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-cacbed61-f3d9-4371-a68a-53491a268882 req-634fe6b2-9c1c-41bf-a30f-0cb47b55e44c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098075 Oct 28 19:30:55.349242 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2406/4822] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:55.369764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:55.371102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:55.381035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.381816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.383067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.384146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.384784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.385368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:56.254937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:56.270446 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54b2370a-339f-4ac5-8b93-3ab87994743d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 1.014099 Oct 28 19:30:56.274518 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2417/4823] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:55 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:56.285484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4a64b1bc-4fd6-4b67-9949-f5a257a38ff6 req-fe219f99-bd6c-406f-8987-96beb7dc8465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "name": "network-vif-plugged", "status": "completed", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:56.309589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4a64b1bc-4fd6-4b67-9949-f5a257a38ff6 req-fe219f99-bd6c-406f-8987-96beb7dc8465 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:56.312085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4a64b1bc-4fd6-4b67-9949-f5a257a38ff6 req-fe219f99-bd6c-406f-8987-96beb7dc8465 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:56.312795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4a64b1bc-4fd6-4b67-9949-f5a257a38ff6 req-fe219f99-bd6c-406f-8987-96beb7dc8465 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:56.332383 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4a64b1bc-4fd6-4b67-9949-f5a257a38ff6 req-fe219f99-bd6c-406f-8987-96beb7dc8465 service nova] Creating event network-vif-plugged:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:30:56.342815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4a64b1bc-4fd6-4b67-9949-f5a257a38ff6 req-fe219f99-bd6c-406f-8987-96beb7dc8465 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066398 Oct 28 19:30:56.361364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2418/4824] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:56.372323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:56.374626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:56.377827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:56.398785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:56.399324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1bef244-e82f-4168-b8b7-5d28a5052db7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1318 microversion: 2.1 time: 1.038581 Oct 28 19:30:56.399897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:56.400305 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2407/4825] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:55 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1318 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:56.401099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:56.402078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:56.403444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:56.404066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:56.405995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:56.406737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:56.423656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:56.424653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:56.424990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:56.425939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:56.426491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:56.427106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.035497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:57.039195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:57.056653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-45e0c413-360d-4ce0-a3a1-99a57a30a798 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 0.654507 Oct 28 19:30:57.057520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1544d80c-128e-4c92-87eb-dc88de339382 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.692294 Oct 28 19:30:57.072607 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2408/4826] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:56 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:57.073220 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2419/4827] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:56 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:57.301400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:57.302583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:57.310087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:57.311014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:57.311668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.312850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:57.313861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:57.314594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.427203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:57.427966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:57.457478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:57.457993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:57.458400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.459188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:57.459657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:57.460080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.791326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:57.807608 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c42c245-6ce5-4869-abba-47c83c72488d tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 0.509650 Oct 28 19:30:57.811302 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2409/4828] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:57 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:57.873147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:57.891577 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf005ed2-26ba-42f2-89c2-0811517016a1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1318 microversion: 2.1 time: 0.473366 Oct 28 19:30:57.892185 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2420/4829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:57 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:58.084884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:58.085988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:58.095090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:58.095970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:58.096139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:58.096726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:58.096880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:58.097727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:58.098555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:58.099190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:58.103644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:58.104140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:58.104575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:58.105285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:58.105741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:58.106160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:58.297635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:58.389498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:58.974169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:58.988901 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a9cf5bbd-813b-43cc-b540-7fe9166f789d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.895630 Oct 28 19:30:59.013838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2421/4830] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:58 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:59.021727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:59.022355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:59.028398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:59.031255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:59.032120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:59.032730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:59.033751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:59.035180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:59.035783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:59.102036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:59.104732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=10 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:59.120408 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a6aa267d-68ea-4abb-82be-fd65f1e3e69b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1519 microversion: 2.1 time: 1.039654 Oct 28 19:30:59.124175 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2410/4831] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:58 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1519 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:59.140881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:59.141927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:30:59.157379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:59.158780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:59.159517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:59.161544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:59.162366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:59.163686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:59.966070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:59.983381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d6577a8-31e2-4408-b34d-71dcbd582fa2 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 0.965898 Oct 28 19:30:59.999297 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2422/4832] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:59 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:00.004325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-92ee2fa8-0778-4d4f-a65d-268d6a4e0e2f req-559d6d82-a405-4708-ae6a-54e48fa96d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbde432-ed73-4ea5-ba2a-8412de3a31ee", "tag": "94d5e034-6bc9-4311-b7fe-976ed8ed466d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:00.015219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-92ee2fa8-0778-4d4f-a65d-268d6a4e0e2f req-559d6d82-a405-4708-ae6a-54e48fa96d33 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.015709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-92ee2fa8-0778-4d4f-a65d-268d6a4e0e2f req-559d6d82-a405-4708-ae6a-54e48fa96d33 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.016145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-92ee2fa8-0778-4d4f-a65d-268d6a4e0e2f req-559d6d82-a405-4708-ae6a-54e48fa96d33 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.047741 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-92ee2fa8-0778-4d4f-a65d-268d6a4e0e2f req-559d6d82-a405-4708-ae6a-54e48fa96d33 service nova] Creating event network-changed:94d5e034-6bc9-4311-b7fe-976ed8ed466d for instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee on n-h1-862769-3 Oct 28 19:31:00.054119 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-92ee2fa8-0778-4d4f-a65d-268d6a4e0e2f req-559d6d82-a405-4708-ae6a-54e48fa96d33 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053385 Oct 28 19:31:00.057559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2423/4833] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:00.069933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:00.070644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:00.097813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.100754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.101395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.107000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.107559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.108010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.156529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:00.178572 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed4d6de1-674e-427c-92b7-1a6dd650a21d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1318 microversion: 2.1 time: 1.047045 Oct 28 19:31:00.180259 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2411/4834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:59 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1318 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:00.186961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:00.194168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:00.207895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.210945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.211615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.212613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.213599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.214548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.960678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:00.970536 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b5e4428-f7ba-4956-86c5-4103bbce18f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.909387 Oct 28 19:31:00.973500 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2424/4835] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:00 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:00.979162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4afbfd3c-de9c-4cd5-a26d-7553b8fc3422 req-4ba10c31-cfe7-4926-b47f-4a68feda5f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edd313-26a6-40c7-87c9-2804f0f53589", "name": "network-vif-plugged", "status": "completed", "tag": "cc84a956-8415-4ff0-bb48-04d2f3b8c36e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:00.991126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4afbfd3c-de9c-4cd5-a26d-7553b8fc3422 req-4ba10c31-cfe7-4926-b47f-4a68feda5f94 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.992356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4afbfd3c-de9c-4cd5-a26d-7553b8fc3422 req-4ba10c31-cfe7-4926-b47f-4a68feda5f94 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.993372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4afbfd3c-de9c-4cd5-a26d-7553b8fc3422 req-4ba10c31-cfe7-4926-b47f-4a68feda5f94 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.017779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4afbfd3c-de9c-4cd5-a26d-7553b8fc3422 req-4ba10c31-cfe7-4926-b47f-4a68feda5f94 service nova] Creating event network-vif-plugged:cc84a956-8415-4ff0-bb48-04d2f3b8c36e for instance 10edd313-26a6-40c7-87c9-2804f0f53589 on n-h2-862769-3 Oct 28 19:31:01.028245 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4afbfd3c-de9c-4cd5-a26d-7553b8fc3422 req-4ba10c31-cfe7-4926-b47f-4a68feda5f94 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052310 Oct 28 19:31:01.030066 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2425/4836] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:01.045996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:01.051777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:01.072193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.073024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.073479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.074217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.074677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.075408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.106371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:01.125450 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91a0907d-b7e3-412c-8e1f-51028422c9a1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.943637 Oct 28 19:31:01.126338 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2412/4837] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:00 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:01.149109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:01.150106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:01.165622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.167406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.168071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.169361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.170181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.171147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.615458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:01.633160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9523cd73-eaf4-4a18-ac5b-13c259044e5c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 0.601644 Oct 28 19:31:01.633917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2426/4838] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:01 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:01.640001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:01.640891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:01.649771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.651170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.651818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.652759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.653546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.654169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.685114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:01.696606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6dcbcc48-78fd-4346-8737-a61777e093d5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.551824 Oct 28 19:31:01.697517 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2413/4839] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:01 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:01.731957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:01.733269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:01.742542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.743571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.744126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.744848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.745381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.745803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.751568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:01.978820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:01.994517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:02.006559 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c06ca7de-6251-451f-8646-db23bbd3adc1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.279079 Oct 28 19:31:02.009970 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c23ba46-324d-4065-9d94-a901ecdc1d78 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1318 microversion: 2.1 time: 0.374461 Oct 28 19:31:02.022818 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2427/4840] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:01 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:02.022818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:02.022818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:02.027738 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2414/4841] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:01 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:02.034367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55a9e424-6a4f-4144-822b-1fd46858090f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:02.040826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-55a9e424-6a4f-4144-822b-1fd46858090f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 4fd3a3b2-891f-468d-801a-8280abd581d2 has no mapping to a cell. Oct 28 19:31:02.041438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.042054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.042602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55a9e424-6a4f-4144-822b-1fd46858090f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/4fd3a3b2-891f-468d-801a-8280abd581d2/action HTTP/1.1 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 15 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: {"os-stop": {}} Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4fd3a3b2-891f-468d-801a-8280abd581d2 has no mapping to a cell. Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4fd3a3b2-891f-468d-801a-8280abd581d2', 'body': {'os-stop': {}}} Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 4fd3a3b2-891f-468d-801a-8280abd581d2 has no mapping to a cell. Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:02.047671 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd3a3b2-891f-468d-801a-8280abd581d2 has no mapping to a cell. Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd3a3b2-891f-468d-801a-8280abd581d2 has no mapping to a cell. Oct 28 19:31:02.053704 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:02.054466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.054466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.054466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.056906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55a9e424-6a4f-4144-822b-1fd46858090f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 4fd3a3b2-891f-468d-801a-8280abd581d2 has no mapping to a cell. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:02.058453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55a9e424-6a4f-4144-822b-1fd46858090f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/4fd3a3b2-891f-468d-801a-8280abd581d2/action" status: 404 len: 117 microversion: 2.1 time: 0.028734 Oct 28 19:31:02.081459 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2415/4842] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:02 2022] POST /compute/v2.1/servers/4fd3a3b2-891f-468d-801a-8280abd581d2/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:02.096236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:02.097373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:02.108392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.109588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.110431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.111451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.112088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.114314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.461304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:02.470929 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-565ba377-13df-4ff4-8a99-bf8388286ca2 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.457795 Oct 28 19:31:02.475568 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2428/4843] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:02 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:02.539098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:02.549686 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-546d220e-a2ca-4a26-816f-13db8d15b49e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.461739 Oct 28 19:31:02.581980 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2416/4844] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:02 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:02.587376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:02.590802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:02.605032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.606594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.613550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.614599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.615273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.615868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.663349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:02.663974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:02.674066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.674772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.675342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.676359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:02.677001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:02.689979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.364228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:03.375913 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-009f87bb-cf56-4e57-a476-8dbee42dc67c tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 0.717337 Oct 28 19:31:03.377535 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2417/4845] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:02 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:03.387861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:03.393309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:03.405954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.406451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.412419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.413375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.414061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.414223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:03.414713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.424943 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59a4bbeb-1b55-4d55-971a-587f80342e03 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.842225 Oct 28 19:31:03.438714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2429/4846] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:02 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:03.438714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-106259d5-e066-48c6-9156-caa5acdceee3 req-c2ad0ab5-d203-40cf-8bbe-9a4fb74c921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "name": "network-vif-plugged", "status": "completed", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:03.464304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-106259d5-e066-48c6-9156-caa5acdceee3 req-c2ad0ab5-d203-40cf-8bbe-9a4fb74c921c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.468155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-106259d5-e066-48c6-9156-caa5acdceee3 req-c2ad0ab5-d203-40cf-8bbe-9a4fb74c921c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.468824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-106259d5-e066-48c6-9156-caa5acdceee3 req-c2ad0ab5-d203-40cf-8bbe-9a4fb74c921c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.501458 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-106259d5-e066-48c6-9156-caa5acdceee3 req-c2ad0ab5-d203-40cf-8bbe-9a4fb74c921c service nova] Creating event network-vif-plugged:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:31:03.513937 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-106259d5-e066-48c6-9156-caa5acdceee3 req-c2ad0ab5-d203-40cf-8bbe-9a4fb74c921c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082924 Oct 28 19:31:03.514900 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2430/4847] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:03.528415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eafb8046-3b69-42f9-8969-e2a052e12f64 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:03.535252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eafb8046-3b69-42f9-8969-e2a052e12f64 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: e4db36f1-7cd1-4e93-8c94-6904a1517752] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:03.547770 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-eafb8046-3b69-42f9-8969-e2a052e12f64 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance e4db36f1-7cd1-4e93-8c94-6904a1517752 could not be found. Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eafb8046-3b69-42f9-8969-e2a052e12f64 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/e4db36f1-7cd1-4e93-8c94-6904a1517752/action HTTP/1.1 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 15 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: {"suspend": {}} Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e4db36f1-7cd1-4e93-8c94-6904a1517752 could not be found. Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e4db36f1-7cd1-4e93-8c94-6904a1517752', 'body': {'suspend': {}}} Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4db36f1-7cd1-4e93-8c94-6904a1517752 could not be found. Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4db36f1-7cd1-4e93-8c94-6904a1517752 could not be found. Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:03.549390 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:03.553603 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:03.553603 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:03.553603 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4db36f1-7cd1-4e93-8c94-6904a1517752 could not be found. Oct 28 19:31:03.553603 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:03.553603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eafb8046-3b69-42f9-8969-e2a052e12f64 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance e4db36f1-7cd1-4e93-8c94-6904a1517752 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:03.555786 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eafb8046-3b69-42f9-8969-e2a052e12f64 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/e4db36f1-7cd1-4e93-8c94-6904a1517752/action" status: 404 len: 111 microversion: 2.1 time: 0.029641 Oct 28 19:31:03.556464 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2431/4848] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:03 2022] POST /compute/v2.1/servers/e4db36f1-7cd1-4e93-8c94-6904a1517752/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:03.582592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:03.584781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:03.629205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.634263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.634951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.638384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.639085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.649914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:04.621337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:04.636649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ba3ea73-7834-4888-a95d-9d86d9791a5d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 1.077692 Oct 28 19:31:04.637312 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2432/4849] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:03 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:04.642652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:04.643604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:04.668084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:04.668588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:04.669339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:04.670067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:04.670526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:04.674222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:04.681829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:04.689515 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f4bfc6a-0262-4283-8aa3-ef54effd65cb tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1468 microversion: 2.1 time: 1.310840 Oct 28 19:31:04.690109 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2418/4850] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:03 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1468 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:04.700709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:04.703590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:04.719146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:04.719945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:04.720549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:04.721644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:04.727666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:04.729005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.102639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:05.106821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:05.112863 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-befec0aa-85ad-4f98-8a9c-249ff6ca207f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.474483 Oct 28 19:31:05.113928 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2433/4851] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:04 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:05.119424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:05.120435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:05.122617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:05.127549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.128278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.128895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.129795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.130419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.131084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.145286 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c79245b7-cd4c-41e6-bb7f-d7cdfa4c9ed3 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 0.449045 Oct 28 19:31:05.165329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2419/4852] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:04 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:05.170751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:05.171249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:05.177851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.178632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.179268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.180163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.180835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.181528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.233863 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c34fd54-6079-450d-a95b-b5bdd1450012 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/ips" status: 200 len: 150 microversion: 2.20 time: 0.067285 Oct 28 19:31:05.235510 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2420/4853] 10.222.0.44 () {60 vars in 1289 bytes} [Fri Oct 28 19:31:05 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:31:05.250568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:05.251498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:05.262399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.263234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.264759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.265786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.267742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.269025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.625128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:05.635520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-64efeb99-d09f-4c5f-9782-660d0f0c0d33 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1317 microversion: 2.1 time: 0.519880 Oct 28 19:31:05.636060 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2434/4854] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:05 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:05.651487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-59b9fe61-18b7-4e59-8b93-25c400013ed8 req-383016d9-fe44-4c79-a10f-fc0078555422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbde432-ed73-4ea5-ba2a-8412de3a31ee", "name": "network-vif-plugged", "status": "completed", "tag": "94d5e034-6bc9-4311-b7fe-976ed8ed466d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:05.667568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:05.670778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59b9fe61-18b7-4e59-8b93-25c400013ed8 req-383016d9-fe44-4c79-a10f-fc0078555422 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.671264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59b9fe61-18b7-4e59-8b93-25c400013ed8 req-383016d9-fe44-4c79-a10f-fc0078555422 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.671901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59b9fe61-18b7-4e59-8b93-25c400013ed8 req-383016d9-fe44-4c79-a10f-fc0078555422 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.681438 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11988202-8bf1-44b2-b229-76d2558fc4b8 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.435808 Oct 28 19:31:05.682271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2421/4855] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:05 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:05.696784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:05.697985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:05.712465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.714295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.715281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.718891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.719556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.720175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.747203 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-59b9fe61-18b7-4e59-8b93-25c400013ed8 req-383016d9-fe44-4c79-a10f-fc0078555422 service nova] Creating event network-vif-plugged:94d5e034-6bc9-4311-b7fe-976ed8ed466d for instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee on n-h1-862769-3 Oct 28 19:31:05.763006 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-59b9fe61-18b7-4e59-8b93-25c400013ed8 req-383016d9-fe44-4c79-a10f-fc0078555422 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124493 Oct 28 19:31:05.799699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2435/4856] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:05.838532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:05.839860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:05.849752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.850563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.851357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.852387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.853096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.853677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.892029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lazy-loading 'flavor' on Instance uuid 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:31:06.041452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d274d086-68b4-4466-9858-2b7407ff7e27 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.236948 Oct 28 19:31:06.045921 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2436/4857] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:05 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:31:06.053370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:06.054147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:06.067171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.068016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.068678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.069616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.070907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.071577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.097991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:06.118596 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b2b9e12-f504-4379-9b37-54928ad79029 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.434936 Oct 28 19:31:06.121775 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2422/4858] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:05 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:06.173289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:06.174796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:06.189620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.192961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.199850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.203371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.203886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.205888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.463719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:06.473507 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f6ff3f7-8d02-4e52-94b4-f40490e236ff tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1514 microversion: 2.1 time: 0.426087 Oct 28 19:31:06.481958 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2437/4859] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:06 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1514 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:06.666823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:06.670768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:06.692777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:06.693722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.694559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.701047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.706897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.707701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.708365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.708592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66b34d17-3daa-4ff9-ab4f-4695fa34b3fb tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1315 microversion: 2.1 time: 0.539669 Oct 28 19:31:06.709222 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2423/4860] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:06 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:06.946172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:06.959241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01463435-3df6-423f-abf1-c00c1b08c0fd tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1466 microversion: 2.1 time: 0.303810 Oct 28 19:31:06.960323 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2438/4861] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:06 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:06.982380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-54461878"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:06.985093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:06.992290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.993297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.994081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.995007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:06.995660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:06.996243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.148517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:07.149240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:07.155725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.156215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.156905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.157776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.158405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.159104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.434329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ecc463f-3781-4762-9b04-72a59676b072 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "POST /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260/action" status: 202 len: 0 microversion: 2.1 time: 0.456064 Oct 28 19:31:07.435639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2424/4862] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:06 2022] POST /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:31:07.450522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f29d69d5-1414-4639-813d-a2511d869048 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7691af70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:07.455560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:07.487480 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0cbc3c5f-67ef-497f-b567-7a7f733329d9 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.345576 Oct 28 19:31:07.488113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2439/4863] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:07 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:07.507689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:07.508493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:07.516778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.517624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.518158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.519093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.519681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.520311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.537977 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f29d69d5-1414-4639-813d-a2511d869048 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.093587 Oct 28 19:31:07.538681 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2425/4864] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:07 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:07.732878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:07.746293 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2837f863-7c2e-4f1b-a53b-37efa0771c33 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1497 microversion: 2.1 time: 0.252447 Oct 28 19:31:07.750261 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2440/4865] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:07 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:07.764442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:07.764442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:07.764442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:07.769021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.773985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.774819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.775907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.776601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.777293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.788154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:07.788754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:07.802943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.804383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.805106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.806316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.807192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.807794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.852628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lazy-loading 'flavor' on Instance uuid 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:31:07.868470 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'suspend' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state suspended Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 15 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: {"suspend": {}} Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: exception: Cannot 'suspend' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state suspended Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'suspend': {}}} Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state suspended. Cannot suspend while the instance is in this state. Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 28 19:31:07.871413 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state suspended Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state suspended Oct 28 19:31:07.878430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:07.885002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'suspend' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state suspended {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:07.887054 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23d94b27-3ff0-461f-8eea-acf75d0f4f67 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 148 microversion: 2.1 time: 0.106074 Oct 28 19:31:07.892302 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2441/4866] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:07 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 148 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:31:07.900533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:07.901326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:07.911521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.912483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.913367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.914540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.915792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.916231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.044122 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-485eaa94-d842-4e58-8a47-2cb026893be5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.150124 Oct 28 19:31:08.045319 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2442/4867] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:07 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:31:08.057693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.057965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.065429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.066410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.067341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.068364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.069044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.069729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.090987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:08.103873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b795eb3c-d443-4f14-a7e8-4129166b731a tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1502 microversion: 2.1 time: 0.372009 Oct 28 19:31:08.120279 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2426/4868] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:07 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:08.135559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.139512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.152161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.155000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.155532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.161319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.161905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.162455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.239833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2afda5e7-af21-4c8a-9e6a-1738da32fc76 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.111405 Oct 28 19:31:08.250586 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2427/4869] 10.222.0.44 () {58 vars in 1296 bytes} [Fri Oct 28 19:31:08 2022] DELETE /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee/os-server-password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:31:08.256817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.257461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.269835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.271177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.271942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.274571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.274571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.276515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.311812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2cffb52e-8d58-4610-b827-b4934bfa220e tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.059634 Oct 28 19:31:08.317246 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2428/4870] 10.222.0.44 () {58 vars in 1293 bytes} [Fri Oct 28 19:31:08 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee/os-server-password => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:31:08.328110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.328885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.342352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.346630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.346630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.346630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.346630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.346630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.395548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:31:08.446940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:08.511088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc262b04-3efc-4bce-bd34-ac2e0e6a6456 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 204 len: 0 microversion: 2.1 time: 0.191555 Oct 28 19:31:08.512976 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2429/4871] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:08 2022] DELETE /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:31:08.522205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:08.522205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.527996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.528490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.528926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.530212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.530212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.530492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.561397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lazy-loading 'flavor' on Instance uuid 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:31:08.622185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:08.632257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88412178-489d-43d3-bc43-4c8d3ed0f516 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1503 microversion: 2.1 time: 0.580277 Oct 28 19:31:08.637945 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2443/4872] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:08 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1503 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:08.654636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.655434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.667591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.668594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.669713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.671505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.672227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.672941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.885479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c2f31c5-8e1b-4c87-90f5-a852e61f7903 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/action" status: 202 len: 0 microversion: 2.20 time: 0.370892 Oct 28 19:31:08.886265 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2430/4873] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:31:08 2022] POST /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:31:08.908593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.910001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:08.939285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.940073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.941397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.942603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.943684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.944440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:09.378715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:09.399892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df530a20-4e5a-477a-b871-81cab0936b13 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.760626 Oct 28 19:31:09.411283 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2444/4874] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:08 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:09.416537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e689aaac-b649-45e8-829d-da5c7f121208 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77df54c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:09.506305 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e689aaac-b649-45e8-829d-da5c7f121208 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.085143 Oct 28 19:31:09.507015 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2445/4875] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:09 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:09.520294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:09.520923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:09.528558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:09.529272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:09.529907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:09.530838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:09.531468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:09.532087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:09.548171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:09.557456 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dca24aeb-e5b1-4b3d-95f4-a8f0007b7350 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1508 microversion: 2.1 time: 0.669899 Oct 28 19:31:09.558057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2431/4876] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:08 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:09.660163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:09.660848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:09.686771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:09.693736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:09.694390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:09.695403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:09.696058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:09.696664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:10.119225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:10.137450 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dbbea8bb-b960-4890-a3bb-acbfacb6f643 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1503 microversion: 2.1 time: 0.481975 Oct 28 19:31:10.144678 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2432/4877] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:09 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1503 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:10.185758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:10.198630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:10.200126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:10.201385 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b1cb3d9-89a9-41cd-a164-acac5bb8d78c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.685492 Oct 28 19:31:10.224730 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2446/4878] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:09 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:10.439209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:10.440084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:10.474169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:10.475120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:10.478809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:10.482918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:10.484752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:10.485510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:10.522878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6fba363a-3fb4-4d9c-9a87-298b52ef1dd9 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77905790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:10.587416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6fba363a-3fb4-4d9c-9a87-298b52ef1dd9 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.068528 Oct 28 19:31:10.591523 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2447/4879] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:10 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:10.607334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:10.610241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:10.618952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:10.619794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:10.620703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:10.621894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:10.622772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:10.623429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:11.254422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:11.322810 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04af56e0-9c5b-4ce3-9c79-4ab457f4c25d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.884032 Oct 28 19:31:11.353214 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2433/4880] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:10 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:11.364533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:11.368057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:11.374531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:11.381325 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e9ce9a50-c9e4-4042-aa43-ee0c5c2d5e69 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1508 microversion: 2.1 time: 0.776920 Oct 28 19:31:11.382979 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2448/4881] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:10 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1508 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:11.392869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:11.393377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:11.393816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:11.395351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:11.397261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:11.397403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:11.400621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:11.407083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:11.418120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:11.418759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:11.419510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:11.420244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:11.420694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:11.421113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.318603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.338165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.343757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.345469 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5bb13df4-e607-48e2-8d1d-6013cce0c4d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.959528 Oct 28 19:31:12.346139 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2449/4882] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:11 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:12.363372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-785d61a8-25b8-4826-976a-e70322fcfc90 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779fb820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:12.435095 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-785d61a8-25b8-4826-976a-e70322fcfc90 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.087728 Oct 28 19:31:12.440470 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2450/4883] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:12 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:12.454338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-981c6668-549e-49c1-b198-c2295e4a6bef req-5287e4ea-1b6e-4540-b8c6-b1b73fb8b09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "name": "network-vif-plugged", "status": "completed", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:12.481742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-981c6668-549e-49c1-b198-c2295e4a6bef req-5287e4ea-1b6e-4540-b8c6-b1b73fb8b09f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.482242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-981c6668-549e-49c1-b198-c2295e4a6bef req-5287e4ea-1b6e-4540-b8c6-b1b73fb8b09f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.484372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-981c6668-549e-49c1-b198-c2295e4a6bef req-5287e4ea-1b6e-4540-b8c6-b1b73fb8b09f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.511922 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-981c6668-549e-49c1-b198-c2295e4a6bef req-5287e4ea-1b6e-4540-b8c6-b1b73fb8b09f service nova] Creating event network-vif-plugged:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:31:12.522867 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-981c6668-549e-49c1-b198-c2295e4a6bef req-5287e4ea-1b6e-4540-b8c6-b1b73fb8b09f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077142 Oct 28 19:31:12.523757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2451/4884] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:12.535664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.554591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae025e8d-e5af-4487-a9a3-dfa9738688b0 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1503 microversion: 2.1 time: 1.199713 Oct 28 19:31:12.574175 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2434/4885] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:11 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1503 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:12.580319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:12.581915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:12.602212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:12.602859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:12.616977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.621196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.623699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.626964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.630973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.632283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.633996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.637380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.642049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.645760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.649547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.651882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.654625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:12.771103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.771480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.774239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.775043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lazy-loading 'fault' on Instance uuid 6fbde432-ed73-4ea5-ba2a-8412de3a31ee {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:31:12.971377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9244fcd848c4c6cac8b3b16c47f4384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850f2f326084434bb6c1784276fed3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.983515 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fc316bc-36f3-446a-ae41-2e0fc1b9dd65 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 200 len: 1305 microversion: 2.1 time: 0.402626 Oct 28 19:31:12.994303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2435/4886] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:12 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 1305 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:13.000873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-75fd2313-2917-454d-a74c-206000170d98 req-bd559c28-c41a-4445-a0f1-f8afa1e82238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbde432-ed73-4ea5-ba2a-8412de3a31ee", "name": "network-vif-deleted", "tag": "94d5e034-6bc9-4311-b7fe-976ed8ed466d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:13.018950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-75fd2313-2917-454d-a74c-206000170d98 req-bd559c28-c41a-4445-a0f1-f8afa1e82238 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.019414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-75fd2313-2917-454d-a74c-206000170d98 req-bd559c28-c41a-4445-a0f1-f8afa1e82238 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.020066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-75fd2313-2917-454d-a74c-206000170d98 req-bd559c28-c41a-4445-a0f1-f8afa1e82238 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.096600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-75fd2313-2917-454d-a74c-206000170d98 req-bd559c28-c41a-4445-a0f1-f8afa1e82238 service nova] Creating event network-vif-deleted:94d5e034-6bc9-4311-b7fe-976ed8ed466d for instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee on n-h1-862769-3 Oct 28 19:31:13.103955 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-75fd2313-2917-454d-a74c-206000170d98 req-bd559c28-c41a-4445-a0f1-f8afa1e82238 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106645 Oct 28 19:31:13.105329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2436/4887] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:13.385802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:13.389094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:13.402151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.404744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.409942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.411403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.412160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.412843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.451465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:13.461331 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a13bc84e-f8fc-4b73-8313-efc50fc52287 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.935917 Oct 28 19:31:13.468895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2452/4888] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:12 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:13.488559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4cc53407-aa25-4f4b-87d7-fc6fdb1bec90 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77df54c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:13.576842 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4cc53407-aa25-4f4b-87d7-fc6fdb1bec90 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.104544 Oct 28 19:31:13.584803 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2453/4889] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:13 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:13.602445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:13.607414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:13.643440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.647059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.647721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.648630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.651305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.652054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.984903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:13.999988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:14.008860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:14.010459 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e997159c-d416-4ace-a0d7-1979d7448b01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.632313 Oct 28 19:31:14.012065 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2437/4890] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:13 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:14.026140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:14.029361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] [instance: 6fbde432-ed73-4ea5-ba2a-8412de3a31ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:14.044384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.049408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.049943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.050889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.051435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.054784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.099089 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] HTTP exception thrown: Instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee could not be found. Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Request method failure captured: Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee HTTP/1.1 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC3hfLreADSb5mjJvwp5uLCcEk10nsC2M2beVDLv5oIIg4y2490IJzI4WzifX8G_ejRDoLab0s0tf_uuuOzjFyZZG68iKX6MTweq64AZoqbxPlv7zpkW7E2lEI1ZvPnW_48UUUfsEc5pqPi60ALYfEuvIvtgjVfsKYYonRwjY99CFiY Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 850f2f326084434bb6c1784276fed3d2 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerPasswordTestJSON-926628035 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/850f2f326084434bb6c1784276fed3d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_850f2f326084434bb6c1784276fed3d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/850f2f326084434bb6c1784276fed3d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/850f2f326084434bb6c1784276fed3d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerPasswordTestJSON-926628035 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 850f2f326084434bb6c1784276fed3d2 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerPasswordTestJSON-926628035 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerPasswordTestJSON-926628035-project Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: a9244fcd848c4c6cac8b3b16c47f4384 Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerPasswordTestJSON-926628035-project Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee could not be found. Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '6fbde432-ed73-4ea5-ba2a-8412de3a31ee'} Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee could not be found. Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee could not be found. Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:14.101411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee could not be found. Oct 28 19:31:14.107496 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:14.109621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] Returning 404 to user: Instance 6fbde432-ed73-4ea5-ba2a-8412de3a31ee could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:14.110602 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e49accf-6f72-4e81-8386-1e42fdd15550 tempest-ServerPasswordTestJSON-926628035 tempest-ServerPasswordTestJSON-926628035-project] 10.222.0.44 "GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee" status: 404 len: 111 microversion: 2.1 time: 0.096557 Oct 28 19:31:14.111221 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2438/4891] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:14 2022] GET /compute/v2.1/servers/6fbde432-ed73-4ea5-ba2a-8412de3a31ee => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:14.216115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:14.232253 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9173fc2d-fb70-406e-b614-f5b253565f30 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.646810 Oct 28 19:31:14.233065 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2454/4892] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:13 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:14.264883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:14.265629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:14.280737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.283340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.284744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.290936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.294898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.295629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.497531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:14.500127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:14.508263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.508859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.509876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.510795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.511428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.512228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.062191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:15.087667 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48d9006f-abc8-44f0-8df9-6be32df98221 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.827369 Oct 28 19:31:15.088267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2439/4893] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:14 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:15.102665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e106ff6-8386-4827-8674-779d3b8869ff tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d768fc3a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:15.191682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2e106ff6-8386-4827-8674-779d3b8869ff tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.101589 Oct 28 19:31:15.192197 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2440/4894] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:15 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:15.206069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:15.207432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:15.236302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:15.236811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:15.237253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.237979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:15.238439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:15.238894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.554458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:15.567917 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4c2f9428-2a56-4dd4-af6c-6ff29f503aee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 1.078860 Oct 28 19:31:15.568520 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2455/4895] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:14 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:15.573535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9745e382-9fe0-468c-bb79-3551b70ebbc5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:15.579416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9745e382-9fe0-468c-bb79-3551b70ebbc5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:15.597275 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9745e382-9fe0-468c-bb79-3551b70ebbc5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5 could not be found. Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9745e382-9fe0-468c-bb79-3551b70ebbc5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/6befd5f2-99e4-4e6c-9c53-3fe31f6943c5/action HTTP/1.1 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 15 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: {"unpause": {}} Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5 could not be found. Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '6befd5f2-99e4-4e6c-9c53-3fe31f6943c5', 'body': {'unpause': {}}} Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5 could not be found. Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5 could not be found. Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:15.599895 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:15.605196 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:15.605196 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:15.605196 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5 could not be found. Oct 28 19:31:15.605196 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:15.606569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9745e382-9fe0-468c-bb79-3551b70ebbc5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 6befd5f2-99e4-4e6c-9c53-3fe31f6943c5 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:15.609813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9745e382-9fe0-468c-bb79-3551b70ebbc5 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/6befd5f2-99e4-4e6c-9c53-3fe31f6943c5/action" status: 404 len: 111 microversion: 2.1 time: 0.037996 Oct 28 19:31:15.611141 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2456/4896] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:15 2022] POST /compute/v2.1/servers/6befd5f2-99e4-4e6c-9c53-3fe31f6943c5/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:15.623264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:15.626955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:15.639299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:15.643140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:15.645989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.646969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:15.647591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:15.649518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.977956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:15.992643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:16.005216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:16.010003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8c5527c-e0b8-4600-8c14-64a2f15cfe57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.813532 Oct 28 19:31:16.011455 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2441/4897] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:15 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:16.206859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1b2c984f-c145-4a86-ab10-24fc1db44f8d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d769e3af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:16.271440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b2c984f-c145-4a86-ab10-24fc1db44f8d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.068415 Oct 28 19:31:16.272029 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2442/4898] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:16 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:16.275211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:16.283972 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3fefa41f-e6cf-4671-a224-537629c8fdd1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.667979 Oct 28 19:31:16.288830 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2457/4899] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:15 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:16.320325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:16.321009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:16.341800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.342302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.342757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.343473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.343931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.344352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.597342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:16.598778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:16.618342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.619172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.619817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.620746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.621404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.622825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.691790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:16.710427 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7da40304-237c-4753-886f-e722a8533937 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.396175 Oct 28 19:31:16.718589 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2443/4900] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:16 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:16.742227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:16.743251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:16.757249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.758199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.759144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.760113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.763550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.764333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.847259 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'unpause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 15 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: {"unpause": {}} Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: exception: Cannot 'unpause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'unpause': {}}} Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state active. Cannot unpause while the instance is in this state. Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:16.849176 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:16.854304 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:16.854304 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:16.854304 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:16.854304 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:16.854304 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:16.855687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'unpause' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:16.869806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-218f6a13-42b0-452e-8965-9518563453db tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 145 microversion: 2.1 time: 0.131650 Oct 28 19:31:16.877939 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2444/4901] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:16 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 145 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 19:31:16.883185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:16.888619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:16.903488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.904253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.907076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:16.908004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:16.908650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:16.911418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:17.536992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:17.560073 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebe54888-be24-4ceb-b930-857684f0cf84 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.954427 Oct 28 19:31:17.561497 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2458/4902] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:16 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:17.566630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:17.567535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:17.584520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:17.585323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:17.586574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:17.587584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:17.588244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:17.588877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:17.680178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:17.697662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4dd99e7-d64f-4834-8afa-9363476e056d tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.818285 Oct 28 19:31:17.722727 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2445/4903] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:16 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:17.726460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fcfa37c-c9d0-439b-a22c-c9f89ba78b9e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ab7940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:17.810920 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0fcfa37c-c9d0-439b-a22c-c9f89ba78b9e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.091122 Oct 28 19:31:17.811819 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2446/4904] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:17 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:17.823730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:17.824353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:17.860877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:17.861402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:17.861826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:17.862682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:17.863020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:17.865973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:18.837687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:18.855369 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-962e2c5d-a967-487b-b92b-83900f50e4cc tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.040264 Oct 28 19:31:18.856002 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2447/4905] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:17 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:18.864602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:18.874744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:18.882511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:18.883356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:18.883989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:18.885720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:18.886359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:18.887005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:18.892138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:18.896132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:18.908698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:18.924705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:18.926169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8593397d-a1ae-426e-8b7c-d7b9bbc880af tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 1.363508 Oct 28 19:31:18.926914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2459/4906] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:17 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:18.931702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37291903-5037-42ad-9642-a6bb8afd03e4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76d2b040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:19.009893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37291903-5037-42ad-9642-a6bb8afd03e4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.081767 Oct 28 19:31:19.011230 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2460/4907] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:18 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:19.029029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20ccf2e1-ccc8-4566-ad4a-a6c192b89526 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:19.029820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-20ccf2e1-ccc8-4566-ad4a-a6c192b89526 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: b8fa8352-06e7-444b-bd39-a41c3d3e4f30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:19.036762 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-20ccf2e1-ccc8-4566-ad4a-a6c192b89526 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance b8fa8352-06e7-444b-bd39-a41c3d3e4f30 could not be found. Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20ccf2e1-ccc8-4566-ad4a-a6c192b89526 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/b8fa8352-06e7-444b-bd39-a41c3d3e4f30/action HTTP/1.1 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 18 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: {"unshelve": null} Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance b8fa8352-06e7-444b-bd39-a41c3d3e4f30 could not be found. Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'b8fa8352-06e7-444b-bd39-a41c3d3e4f30', 'body': {'unshelve': None}} Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fa8352-06e7-444b-bd39-a41c3d3e4f30 could not be found. Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fa8352-06e7-444b-bd39-a41c3d3e4f30 could not be found. Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:19.038493 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fa8352-06e7-444b-bd39-a41c3d3e4f30 could not be found. Oct 28 19:31:19.044432 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:19.046594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20ccf2e1-ccc8-4566-ad4a-a6c192b89526 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance b8fa8352-06e7-444b-bd39-a41c3d3e4f30 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:19.052459 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20ccf2e1-ccc8-4566-ad4a-a6c192b89526 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/b8fa8352-06e7-444b-bd39-a41c3d3e4f30/action" status: 404 len: 111 microversion: 2.1 time: 0.040221 Oct 28 19:31:19.053034 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2461/4908] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:19 2022] POST /compute/v2.1/servers/b8fa8352-06e7-444b-bd39-a41c3d3e4f30/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:19.061729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:19.062343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:19.070119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:19.071181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:19.071620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:19.072334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:19.072840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:19.073262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:19.955489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:19.965670 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3ab1092-56ff-41f9-b6a3-83e0086ca540 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 1.108597 Oct 28 19:31:19.971501 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2448/4909] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:18 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:19.984706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:19.987622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:20.019365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.021277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.027298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.028273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.029066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.029655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.181592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:20.191637 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca843906-bb22-4e25-ad31-e1420ab511a3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 1.134039 Oct 28 19:31:20.220927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2462/4910] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:19 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:20.226269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e4a315c9-5f16-4b13-92b4-8eb96502917e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d778873a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:20.311173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e4a315c9-5f16-4b13-92b4-8eb96502917e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.088678 Oct 28 19:31:20.312293 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2463/4911] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:20 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:20.323803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:20.324858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:20.341584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.342106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.342846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.343584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.344038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.344458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.850553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:20.861679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:20.863151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:20.864356 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8fabddbb-acd5-4025-83e4-911a4722443f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.889776 Oct 28 19:31:20.875128 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2449/4912] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:19 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:20.879894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:20.894813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7bc3a95-09b0-4de5-b994-309a0d963d08 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.581340 Oct 28 19:31:20.896121 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2464/4913] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:20 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:20.920728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:20.921659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:20.936180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.937073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.943298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.944602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.945597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.949398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.999665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:21.000546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:21.015111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.015911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.016531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.018340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.020882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.022223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.044176 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Cannot 'unshelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action HTTP/1.1 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 18 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: {"unshelve": null} Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: exception: Cannot 'unshelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'unshelve': None}} Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b in vm_state active. Cannot unshelve while the instance is in this state. Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 19:31:21.047203 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active Oct 28 19:31:21.052241 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:21.055257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 409 to user: Cannot 'unshelve' instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b while it is in vm_state active {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:21.056828 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17b54963-b2ac-4d88-ba1e-68f2777fa73e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action" status: 409 len: 146 microversion: 2.1 time: 0.140502 Oct 28 19:31:21.063869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2450/4914] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:20 2022] POST /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b/action => generated 146 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:31:21.082806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:21.086130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:21.108169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.111373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.111851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.114469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.115000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.115431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.841202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:21.862069 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a140f71a-c0ea-429d-90c4-9b29d717fd8a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.788252 Oct 28 19:31:21.863222 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2451/4915] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:21 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:21.868189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f6f17d0a-41c0-4e80-b560-9c627be70f09 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b660d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:21.898742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:21.909635 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b3aaeea-6a51-430e-a6d1-3eafa4492d51 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1512 microversion: 2.1 time: 0.919814 Oct 28 19:31:21.913219 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2465/4916] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:20 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1512 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:21.927108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:21.930781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:21.955857 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f6f17d0a-41c0-4e80-b560-9c627be70f09 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.091348 Oct 28 19:31:21.964449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2452/4917] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:21 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:21.964703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.964703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.964703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.964703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.964703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.964703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.972825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:21.981168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:22.009285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.009863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.011689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.018024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.018773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.019332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.493657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:22.503817 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ecb5e6e1-3fb9-47f3-b332-8ba54cd7448b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.588770 Oct 28 19:31:22.512063 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2466/4918] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:21 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:22.542042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af9fae20-40c3-4251-b910-3c6be235f974 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-182524573_updated"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:22.547669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af9fae20-40c3-4251-b910-3c6be235f974 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 267d1752-38cc-4394-985e-2649a80b2e44] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:22.564579 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-af9fae20-40c3-4251-b910-3c6be235f974 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 267d1752-38cc-4394-985e-2649a80b2e44 could not be found. Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af9fae20-40c3-4251-b910-3c6be235f974 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/servers/267d1752-38cc-4394-985e-2649a80b2e44 HTTP/1.1 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 80 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-182524573_updated"}} Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 267d1752-38cc-4394-985e-2649a80b2e44 could not be found. Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '267d1752-38cc-4394-985e-2649a80b2e44', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-182524573_updated'}}} Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d1752-38cc-4394-985e-2649a80b2e44 could not be found. Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 19:31:22.566497 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d1752-38cc-4394-985e-2649a80b2e44 could not be found. Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d1752-38cc-4394-985e-2649a80b2e44 could not be found. Oct 28 19:31:22.571882 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:22.579267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af9fae20-40c3-4251-b910-3c6be235f974 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 267d1752-38cc-4394-985e-2649a80b2e44 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:22.580791 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af9fae20-40c3-4251-b910-3c6be235f974 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "PUT /compute/v2.1/servers/267d1752-38cc-4394-985e-2649a80b2e44" status: 404 len: 111 microversion: 2.1 time: 0.050682 Oct 28 19:31:22.581909 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2467/4919] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:31:22 2022] PUT /compute/v2.1/servers/267d1752-38cc-4394-985e-2649a80b2e44 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:22.590220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:22.591499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:22.614617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.615500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.616229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.617127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.617756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.618338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.837874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:22.863235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:22.866382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:22.868723 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db4b8198-a464-4aee-b61a-84d517583ae1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.910454 Oct 28 19:31:22.869602 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2453/4920] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:21 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:22.938926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:22.939807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:22.955118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.964551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.965253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.967226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.976897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.977699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.405870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:23.415685 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-47ff5918-6b86-4553-bec4-107cd9f313b1 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.829511 Oct 28 19:31:23.420155 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2468/4921] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:22 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:23.426093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-08c08221-8edf-424f-b9e3-765e487ece8b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779fba60>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:23.513082 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-08c08221-8edf-424f-b9e3-765e487ece8b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.091688 Oct 28 19:31:23.514006 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2469/4922] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:23 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:23.526776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:23.531381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:23.560971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.561780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.562582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.566905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.570769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.571611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.649006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:23.658505 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af3e1e0e-2425-4abe-935d-fa0c13a4aebb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1489 microversion: 2.1 time: 0.724813 Oct 28 19:31:23.665842 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2454/4923] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:22 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1489 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:23.697106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-755387156"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:23.704763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:23.721240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.722025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.723550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.724854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.727290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.727903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.852534 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-036612c1-1eb6-47a0-921e-db4a5944efd8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "PUT /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1061 microversion: 2.1 time: 0.160321 Oct 28 19:31:23.868464 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2455/4924] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:31:23 2022] PUT /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1061 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:23.873877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:23.874915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:23.883397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.884162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.884851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.885796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.886484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.887142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.915146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:23.933528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e588127e-9756-447c-b16d-317e45aebda6 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.413455 Oct 28 19:31:23.934222 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2470/4925] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:23 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:23.951258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:23.973937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:24.001573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:24.002125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:24.002555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.014097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:24.018937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:24.020946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.419432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:24.443524 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e824685-87d6-4bef-bc67-d8c7a8bf2907 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1488 microversion: 2.1 time: 0.572040 Oct 28 19:31:24.444542 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2456/4926] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:23 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1488 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:24.463345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ecd30ab-c137-4e29-a684-3373c31f0e1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ecd30ab-c137-4e29-a684-3373c31f0e1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: request: PUT /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b HTTP/1.1 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 280 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.486454 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 19:31:24.492463 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:24.496295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ecd30ab-c137-4e29-a684-3373c31f0e1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:24.497384 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9ecd30ab-c137-4e29-a684-3373c31f0e1b tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "PUT /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 400 len: 619 microversion: 2.1 time: 0.050835 Oct 28 19:31:24.499502 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2457/4927] 10.222.0.44 () {60 vars in 1257 bytes} [Fri Oct 28 19:31:24 2022] PUT /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 619 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:31:24.519564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:24.520635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:24.564008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:24.567269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:24.570402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.572090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:24.573540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:24.575880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.650559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:24.669902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:24.671634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:24.673046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ff97383-ad8d-4e4e-aae8-2440d9ccc98a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 0.730314 Oct 28 19:31:24.675121 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2471/4928] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:23 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:24.690009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:24.695794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:24.714302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:24.723778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:24.724509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.725447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:24.726065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:24.726664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.935062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:24.944770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3011a94-1b52-4d37-a2ab-0083c95008ac tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1488 microversion: 2.1 time: 0.442921 Oct 28 19:31:24.962752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2458/4929] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:24 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1488 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:24.962752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b3e46b62-426f-4b8c-a19f-940333cd453a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b66ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.043628 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b3e46b62-426f-4b8c-a19f-940333cd453a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.094303 Oct 28 19:31:25.045591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2459/4930] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:24 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:25.059104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.060722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:25.077840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.079633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.081620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.082578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.085671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.086564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.093573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:25.102372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a222edbe-3283-4d84-bb89-f59290516a1e tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.425946 Oct 28 19:31:25.108635 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2472/4931] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:24 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:25.131119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:31:25.139938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.140876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:25.153617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.154332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.155018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.159514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.160168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.160764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.334802 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6ef64fbc-2c39-42db-a53a-5dc00ec9dc4d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 204 len: 0 microversion: 2.1 time: 0.286702 Oct 28 19:31:25.335512 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2460/4932] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:25 2022] DELETE /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:31:25.347245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.381817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:25.403244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.403778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.417848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.421887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.422390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.427381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.487841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:25.498894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4ce49af-5eeb-4fa3-ac92-458e17174664 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.362486 Oct 28 19:31:25.500030 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2473/4933] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:25 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:25.529477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c933792-1067-41be-93da-584306ffbd15 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c933792-1067-41be-93da-584306ffbd15 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b HTTP/1.1 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 24 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": ""}} Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b', 'body': {'server': {'name': ''}}} Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '' Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:31:25.536197 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:31:25.541862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:25.545063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c933792-1067-41be-93da-584306ffbd15 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:25.546611 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c933792-1067-41be-93da-584306ffbd15 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "PUT /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 400 len: 108 microversion: 2.1 time: 0.026134 Oct 28 19:31:25.550641 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2474/4934] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:31:25 2022] PUT /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:31:25.556335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.557325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:25.570987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.583441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.584284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.585205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.585854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.586806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.889496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:25.897989 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d718ab90-6500-4a5e-8eed-bf0a4754cf60 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1494 microversion: 2.1 time: 0.555301 Oct 28 19:31:25.898616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2461/4935] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:25 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1494 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:25.914336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.915066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:25.935020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.936437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.937022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.937817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.939181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.943393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:25.947834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.959196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f9446eb4-a124-4bf6-a1ca-a8f38fb867a2 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1506 microversion: 2.1 time: 0.405592 Oct 28 19:31:25.959886 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2475/4936] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:25 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:26.063651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2ac8b7c-1e6c-4c2a-bcaa-f3f3dc21001e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77d63e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:26.183550 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f2ac8b7c-1e6c-4c2a-bcaa-f3f3dc21001e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.124991 Oct 28 19:31:26.184159 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2476/4937] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:26 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:26.339118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:26.360085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:26.367791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:26.369485 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-19c10a80-a576-4835-852b-87642eb6ac28 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1743 microversion: 2.20 time: 0.469910 Oct 28 19:31:26.370274 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2462/4938] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:25 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1743 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:26.926323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:26.927315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:26.952383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:26.963163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:26.966295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:26.968525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:26.970656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:26.974000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:27.202371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db06c4f9-81f0-4eae-abd7-5997a1e42c8e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76a09b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:27.657600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db06c4f9-81f0-4eae-abd7-5997a1e42c8e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1453 microversion: 2.1 time: 0.458649 Oct 28 19:31:27.670804 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2463/4939] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:27 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1453 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:27.676184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:27.678977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:27.699381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:27.700852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:27.701507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:27.702470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:27.703182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:27.703836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:27.755946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:27.760012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:27.765464 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-306a859b-6257-427c-a503-837d861e7f35 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1494 microversion: 2.1 time: 0.844524 Oct 28 19:31:27.781631 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2477/4940] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:26 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1494 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:28.424949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b2f1a48a-070f-461f-83c4-63ae4a68c7f5 req-af127717-c876-455f-af06-a6443017e745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "name": "network-vif-plugged", "status": "completed", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:28.459856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b2f1a48a-070f-461f-83c4-63ae4a68c7f5 req-af127717-c876-455f-af06-a6443017e745 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:28.464943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b2f1a48a-070f-461f-83c4-63ae4a68c7f5 req-af127717-c876-455f-af06-a6443017e745 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:28.465675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b2f1a48a-070f-461f-83c4-63ae4a68c7f5 req-af127717-c876-455f-af06-a6443017e745 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:28.539010 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b2f1a48a-070f-461f-83c4-63ae4a68c7f5 req-af127717-c876-455f-af06-a6443017e745 service nova] Creating event network-vif-plugged:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h2-862769-3 Oct 28 19:31:28.563192 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b2f1a48a-070f-461f-83c4-63ae4a68c7f5 req-af127717-c876-455f-af06-a6443017e745 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142186 Oct 28 19:31:28.567106 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2478/4941] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:28.674353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab2549c6-f947-420c-a66b-5d3779308855 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d777c9dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:29.718356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:29.756705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:29.763967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:29.765555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a31808d2-6ee3-4fd1-96ee-2c29c0190cc9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 2.093061 Oct 28 19:31:29.766090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2464/4942] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:27 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:29.793696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:29.794647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:29.835703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:29.836436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:29.836882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:29.837604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:29.838061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:29.838477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:29.994298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:30.004934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:30.005652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:30.006286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lazy-loading 'fault' on Instance uuid 613ca4b5-f78b-4cc9-be67-409151150964 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:31:31.275434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:31.287568 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a899e704-ed12-42ff-bd95-653ed333e78e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 200 len: 1309 microversion: 2.1 time: 1.519098 Oct 28 19:31:31.288600 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2465/4943] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:29 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 1309 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:31.326265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a1e4a752-7597-4813-8bfa-bf9db86454dc req-9f284ac0-2e3d-4479-8842-7b0120c1d634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613ca4b5-f78b-4cc9-be67-409151150964", "name": "network-vif-deleted", "tag": "68e9f9f7-da9e-4b30-b20f-b12aae818418"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:31.386217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a1e4a752-7597-4813-8bfa-bf9db86454dc req-9f284ac0-2e3d-4479-8842-7b0120c1d634 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:31.388740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a1e4a752-7597-4813-8bfa-bf9db86454dc req-9f284ac0-2e3d-4479-8842-7b0120c1d634 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:31.392185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a1e4a752-7597-4813-8bfa-bf9db86454dc req-9f284ac0-2e3d-4479-8842-7b0120c1d634 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:31.441132 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a1e4a752-7597-4813-8bfa-bf9db86454dc req-9f284ac0-2e3d-4479-8842-7b0120c1d634 service nova] Creating event network-vif-deleted:68e9f9f7-da9e-4b30-b20f-b12aae818418 for instance 613ca4b5-f78b-4cc9-be67-409151150964 on n-h1-862769-3 Oct 28 19:31:31.462870 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a1e4a752-7597-4813-8bfa-bf9db86454dc req-9f284ac0-2e3d-4479-8842-7b0120c1d634 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145847 Oct 28 19:31:31.464216 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2466/4944] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:31.485179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:31.488674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:31.525585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:31.529220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:31.531658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:31.535524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:31.541476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:31.542255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:31.566160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:32.389450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:32.415309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:32.420582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:32.429606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6ed6b079-547d-485f-bc60-0e662ae9253a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 0.963885 Oct 28 19:31:32.456333 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2467/4945] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:31 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:32.465935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:32.466872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:32.476982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.477773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.478458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.479448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.480232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.480904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.520250 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 HTTP/1.1 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '613ca4b5-f78b-4cc9-be67-409151150964'} Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.521854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.526723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.526723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.526723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:32.526723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:32.526723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.526723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.547739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:32.549794 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10898501-178c-4452-9fe7-4bb3ec6f40ca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 404 len: 111 microversion: 2.1 time: 0.090472 Oct 28 19:31:32.550608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2468/4946] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:32 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:32.574073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:32.575012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:32.616280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.617016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.618645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.623161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.624000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.629247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.683211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 HTTP/1.1 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '613ca4b5-f78b-4cc9-be67-409151150964'} Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:32.690818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.695955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.704775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:32.706315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ce6c442-76c3-436e-84e0-e4d61a9be31e tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 404 len: 111 microversion: 2.1 time: 0.145948 Oct 28 19:31:32.709948 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2469/4947] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:32 2022] DELETE /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:32.725124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:32.730498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 613ca4b5-f78b-4cc9-be67-409151150964] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:32.743648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.750066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.751755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.752779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.753650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.755392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.815768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 HTTP/1.1 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '613ca4b5-f78b-4cc9-be67-409151150964'} Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.817436 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 613ca4b5-f78b-4cc9-be67-409151150964 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:32.824064 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0510cbd3-9d2b-41ad-a544-2432aea15733 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964" status: 404 len: 111 microversion: 2.1 time: 0.104009 Oct 28 19:31:32.826799 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2470/4948] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:32 2022] GET /compute/v2.1/servers/613ca4b5-f78b-4cc9-be67-409151150964 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:32.835230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:32.835748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:32.863692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.864186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.866927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.869179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.872683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.873171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.932448 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b HTTP/1.1 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '28fc04d8-35a3-4705-9fe4-24fc4995015b'} Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:32.938721 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:32.944292 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:32.958947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:32.962226 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2dee6fb4-798a-414f-83c6-9f4acbee7d1c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 404 len: 111 microversion: 2.1 time: 0.131267 Oct 28 19:31:32.962999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2471/4949] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:32 2022] DELETE /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:32.989297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:32.990021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 28fc04d8-35a3-4705-9fe4-24fc4995015b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:33.037931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.038433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.039960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.040923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.041141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.046889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.104391 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b HTTP/1.1 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '28fc04d8-35a3-4705-9fe4-24fc4995015b'} Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.113069 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.118583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 28fc04d8-35a3-4705-9fe4-24fc4995015b could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:33.123661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d544337-3470-4886-bbd8-a2d04e82d2c8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b" status: 404 len: 111 microversion: 2.1 time: 0.150708 Oct 28 19:31:33.141538 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2472/4950] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:32 2022] GET /compute/v2.1/servers/28fc04d8-35a3-4705-9fe4-24fc4995015b => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:33.164725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:33.167369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:33.200451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.201512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.202177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.206558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.207309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.208166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.435734 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a HTTP/1.1 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7adff317-707a-4a36-93a1-291582680c8a'} Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:33.437261 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:33.442580 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5d1a8590-42d1-4761-83c5-259edcc6d669 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 404 len: 111 microversion: 2.1 time: 0.294595 Oct 28 19:31:33.461468 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2473/4951] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:33 2022] DELETE /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 111 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:33.475000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:33.481952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:33.500774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.504818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.513944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.513944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.513944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.514849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.183556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:34.212818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:34.214425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:34.236391 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6acafd4b-017d-415d-b17a-d5a7848e4217 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 0.773300 Oct 28 19:31:34.240584 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2474/4952] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:33 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:34.261505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.261773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 7adff317-707a-4a36-93a1-291582680c8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:34.298979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:34.305110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.317869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.318228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.319028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.321631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.322108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.407486 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a HTTP/1.1 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7adff317-707a-4a36-93a1-291582680c8a'} Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.409114 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.414862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 7adff317-707a-4a36-93a1-291582680c8a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:34.420098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-659ca478-6fc5-4e5b-9073-e70a001f9cca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a" status: 404 len: 111 microversion: 2.1 time: 0.177204 Oct 28 19:31:34.423763 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2475/4953] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:34 2022] GET /compute/v2.1/servers/7adff317-707a-4a36-93a1-291582680c8a => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:34.436269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.437715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:34.455926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.458383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.461370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.462880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.468544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.469249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.494035 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 HTTP/1.1 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1ab5d632-c743-409f-a244-4a0ce5e1a550'} Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:34.504958 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.511110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.517353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:34.518738 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53ebec00-2ab2-40b3-8b9b-2ef9804e4c0b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 404 len: 111 microversion: 2.1 time: 0.090648 Oct 28 19:31:34.521088 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2476/4954] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:34 2022] DELETE /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:34.532426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.538020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 1ab5d632-c743-409f-a244-4a0ce5e1a550] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:34.568887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.575535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.580521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.581745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.583312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.591084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.651329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 HTTP/1.1 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '1ab5d632-c743-409f-a244-4a0ce5e1a550'} Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.659908 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 1ab5d632-c743-409f-a244-4a0ce5e1a550 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:34.665002 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-de584aa6-2443-4d00-9c00-27549e1cc70d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550" status: 404 len: 111 microversion: 2.1 time: 0.138913 Oct 28 19:31:34.673700 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2477/4955] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:34 2022] GET /compute/v2.1/servers/1ab5d632-c743-409f-a244-4a0ce5e1a550 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:34.698435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.700507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:34.715386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.718846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.720340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.724580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.725272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.725934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.758807 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f HTTP/1.1 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'df05a481-9877-4266-ac22-e91a42b6c06f'} Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:34.765218 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.770838 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.775483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:34.777537 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b74033ce-3f57-4959-a86b-a811828558d0 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 404 len: 111 microversion: 2.1 time: 0.100950 Oct 28 19:31:34.781321 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2478/4956] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:34 2022] DELETE /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:34.792725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.795481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: df05a481-9877-4266-ac22-e91a42b6c06f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:34.818684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.824944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.826565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.827632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.828300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.828958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.866024 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f HTTP/1.1 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'df05a481-9877-4266-ac22-e91a42b6c06f'} Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.874795 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.880567 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.880567 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.880567 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:34.880567 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:34.880567 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. Oct 28 19:31:34.880567 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.882149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance df05a481-9877-4266-ac22-e91a42b6c06f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:34.883411 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-425063c7-c055-4c54-9a3f-83f30bf2267d tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f" status: 404 len: 111 microversion: 2.1 time: 0.097959 Oct 28 19:31:34.884270 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2479/4957] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:34 2022] GET /compute/v2.1/servers/df05a481-9877-4266-ac22-e91a42b6c06f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:31:34.895641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.896528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:34.912707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.915135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.917743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.921313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.923400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.924063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.978650 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 HTTP/1.1 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd3084f05-651a-4b79-9773-d0f9a63e0677'} Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:34.990955 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:34.997682 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:34.999749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:35.000824 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-532fce55-9a7e-420d-bf57-5be1fae92da3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 404 len: 111 microversion: 2.1 time: 0.112234 Oct 28 19:31:35.002014 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2480/4958] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:34 2022] DELETE /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:35.019089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:35.021224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d3084f05-651a-4b79-9773-d0f9a63e0677] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:35.038967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:35.039746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:35.041955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:35.043056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:35.048718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:35.050010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:35.106784 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 HTTP/1.1 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd3084f05-651a-4b79-9773-d0f9a63e0677'} Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.109894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.115236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:35.115236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:35.115236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:35.115236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:35.115236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. Oct 28 19:31:35.115236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.122926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance d3084f05-651a-4b79-9773-d0f9a63e0677 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:35.129708 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0bebb952-5dec-4ec9-ae6e-e13a41bafb4b tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677" status: 404 len: 111 microversion: 2.1 time: 0.123532 Oct 28 19:31:35.130619 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2481/4959] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:35 2022] GET /compute/v2.1/servers/d3084f05-651a-4b79-9773-d0f9a63e0677 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:31:35.156829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88c38c1d-11a2-48d7-8082-decdd96a69f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:35.158057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88c38c1d-11a2-48d7-8082-decdd96a69f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 45e80111-ba2a-4f61-83be-fac8bc4a9436] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:35.181061 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-88c38c1d-11a2-48d7-8082-decdd96a69f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88c38c1d-11a2-48d7-8082-decdd96a69f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 HTTP/1.1 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '45e80111-ba2a-4f61-83be-fac8bc4a9436'} Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:35.191213 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.196145 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.201129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88c38c1d-11a2-48d7-8082-decdd96a69f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:35.202574 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88c38c1d-11a2-48d7-8082-decdd96a69f8 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436" status: 404 len: 111 microversion: 2.1 time: 0.067629 Oct 28 19:31:35.208006 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2482/4960] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:35 2022] DELETE /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:35.231762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89ebb43d-876c-4365-b71d-6b009b332cee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:35.236369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89ebb43d-876c-4365-b71d-6b009b332cee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: 45e80111-ba2a-4f61-83be-fac8bc4a9436] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:35.261606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-89ebb43d-876c-4365-b71d-6b009b332cee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89ebb43d-876c-4365-b71d-6b009b332cee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 HTTP/1.1 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '45e80111-ba2a-4f61-83be-fac8bc4a9436'} Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:35.268113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:35.273046 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:35.273046 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:35.273046 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. Oct 28 19:31:35.273046 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:35.279146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89ebb43d-876c-4365-b71d-6b009b332cee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance 45e80111-ba2a-4f61-83be-fac8bc4a9436 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:35.282630 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89ebb43d-876c-4365-b71d-6b009b332cee tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436" status: 404 len: 111 microversion: 2.1 time: 0.070580 Oct 28 19:31:35.284200 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2483/4961] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:35 2022] GET /compute/v2.1/servers/45e80111-ba2a-4f61-83be-fac8bc4a9436 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:35.296817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:35.300851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:35.319880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:35.321563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:35.332816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:35.334071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:35.337217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:35.338013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:36.135528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:36.156025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:36.161962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:36.167868 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-521f611d-e786-4b5e-ac1e-5557238030dc tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 0.878715 Oct 28 19:31:36.170396 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2484/4962] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:35 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:36.184330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:36.188198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:36.203067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:36.203932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:36.204578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:36.205608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:36.207479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:36.209233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:36.277635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:31:36.583763 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db4b438c-a7f3-4ae3-b7da-504df9f3335c tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 204 len: 0 microversion: 2.1 time: 0.410341 Oct 28 19:31:36.589723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2485/4963] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:36 2022] DELETE /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:31:36.609556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:36.611156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:36.664230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:36.665272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:36.666302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:36.687848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:36.690913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:36.693002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:37.531781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:37.544540 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98d42207-761f-4bd0-9345-6feff44ffbca tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1479 microversion: 2.1 time: 0.949711 Oct 28 19:31:37.545499 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2486/4964] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:36 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1479 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:37.572212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:37.573389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:37.594387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:37.615388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:37.618000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:37.619245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:37.626194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:37.627058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:38.453593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=95 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:38.561465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:38.748322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:38.764721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:38.768152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:38.772614 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6fbceac-b437-48f4-bad7-3ad39818c10d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 1.226034 Oct 28 19:31:38.779903 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2487/4965] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:37 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:38.785610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:38.787668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:38.817130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:38.817634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:38.818139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:38.818957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:38.819261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:38.819682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:39.611776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:39.624877 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-06bd4bf2-dd6b-4ef3-8e9d-b29e65a85cfe tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1479 microversion: 2.1 time: 0.841305 Oct 28 19:31:39.625509 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2488/4966] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:38 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1479 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:39.839173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:39.839173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:39.839173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:39.839173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:39.839173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:39.842808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:39.843223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:39.843745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:40.435996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:40.455948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:40.459310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:40.461798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7a131c1d-b8c6-4bfa-af54-c8826019ee01 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 0.657771 Oct 28 19:31:40.467072 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2489/4967] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:39 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:40.474939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:40.488860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:40.512425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:40.517428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:40.518370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:40.521135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:40.521834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:40.527256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:40.556458 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 HTTP/1.1 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4e536842-38fb-4b72-9bbe-f32123e53811'} Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:40.561177 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.566851 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.569942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:40.572793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f70eb05-8f26-4f99-ab99-489f45482dcd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 404 len: 111 microversion: 2.1 time: 0.101762 Oct 28 19:31:40.576147 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2490/4968] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:40 2022] DELETE /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:40.587225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:40.592202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 4e536842-38fb-4b72-9bbe-f32123e53811] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:40.606216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:40.610742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:40.611469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:40.612978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:40.613605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:40.619384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:40.651303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 HTTP/1.1 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4e536842-38fb-4b72-9bbe-f32123e53811'} Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:40.654566 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. Oct 28 19:31:40.660590 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:31:40.662908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 4e536842-38fb-4b72-9bbe-f32123e53811 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:40.665735 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-344214c6-c406-4d93-bdc2-9ad2a5d398dd tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811" status: 404 len: 111 microversion: 2.1 time: 0.084606 Oct 28 19:31:40.676439 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2491/4969] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:40 2022] GET /compute/v2.1/servers/4e536842-38fb-4b72-9bbe-f32123e53811 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:40.688111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:40.689191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:40.704773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:40.705806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:40.712777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:40.714094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:40.714840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:40.715571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:41.470731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:41.485748 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4e15114-cfde-4d60-8f50-1844988ac5c3 tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1479 microversion: 2.1 time: 0.806351 Oct 28 19:31:41.489072 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2492/4970] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:40 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1479 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:41.522199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:41.525358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:41.541739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:41.542350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:41.545704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:41.546547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:41.547185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:41.547667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:41.658021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:31:41.698100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:41.840642 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ab2549c6-f947-420c-a66b-5d3779308855 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1462 microversion: 2.1 time: 13.170373 Oct 28 19:31:41.851973 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2479/4971] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:28 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1462 bytes in 13182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:41.852489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f9f33801-5fcd-4653-82f9-f85956cc124a tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "DELETE /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 204 len: 0 microversion: 2.1 time: 0.340243 Oct 28 19:31:41.857430 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2493/4972] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:31:41 2022] DELETE /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:31:41.864848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:41.865809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:41.873791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:41.874466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:41.875174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:41.876082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:41.876700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:41.877283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:41.883861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-058032dd-b6bc-4051-a1c6-d340a10ae377 req-154c7512-8168-46a7-ac6b-e285e7cb7de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d482530a-34f7-48c7-83d8-490a6ef992a9", "name": "network-vif-unplugged", "status": "completed", "tag": "c99ea8af-90af-4b9e-b581-5b4aebab1949"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:41.954414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-058032dd-b6bc-4051-a1c6-d340a10ae377 req-154c7512-8168-46a7-ac6b-e285e7cb7de8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:41.961815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-058032dd-b6bc-4051-a1c6-d340a10ae377 req-154c7512-8168-46a7-ac6b-e285e7cb7de8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:41.962589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-058032dd-b6bc-4051-a1c6-d340a10ae377 req-154c7512-8168-46a7-ac6b-e285e7cb7de8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:42.035008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-058032dd-b6bc-4051-a1c6-d340a10ae377 req-154c7512-8168-46a7-ac6b-e285e7cb7de8 service nova] Creating event network-vif-unplugged:c99ea8af-90af-4b9e-b581-5b4aebab1949 for instance d482530a-34f7-48c7-83d8-490a6ef992a9 on n-h2-862769-3 Oct 28 19:31:42.044137 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-058032dd-b6bc-4051-a1c6-d340a10ae377 req-154c7512-8168-46a7-ac6b-e285e7cb7de8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.185633 Oct 28 19:31:42.053185 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2480/4973] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:42.063715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-210e4333-a814-4a0d-b02d-c9e627a613b7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d777cb700>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:42.188427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-210e4333-a814-4a0d-b02d-c9e627a613b7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 200 len: 1462 microversion: 2.1 time: 0.133674 Oct 28 19:31:42.189019 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2481/4974] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:42 2022] GET /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:42.213615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:42.214383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:42.232912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:42.233685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:42.234311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:42.235246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:42.235871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:42.236657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:42.311051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:42.325735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:42.328282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:42.351256 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d954f8a-477e-4bb6-8a3e-8aee2bf32432 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 0.489018 Oct 28 19:31:42.355090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2494/4975] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:41 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:42.375680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:42.378719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:42.405493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:42.406472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:42.407397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:42.408385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:42.409199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:42.409883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:42.900779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:42.933692 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d5fbcaae-b1a5-4664-b78d-ff40208729f4 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 0.738655 Oct 28 19:31:42.934344 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2482/4976] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:42 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:42.952623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:42.953263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:42.991029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:42.991798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:42.992621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:42.994593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:42.997090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:43.001714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:43.080159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:43.100618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-08425c24-06e2-481a-89ab-32d319665376 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1479 microversion: 2.1 time: 0.741041 Oct 28 19:31:43.103304 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2495/4977] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:42 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1479 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:43.133470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c9a3b119-e43b-4ced-964a-7fd701be9116 req-e010ac95-b719-40a2-9968-e000ad0fd27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d482530a-34f7-48c7-83d8-490a6ef992a9", "name": "network-vif-deleted", "tag": "c99ea8af-90af-4b9e-b581-5b4aebab1949"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:43.169262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c9a3b119-e43b-4ced-964a-7fd701be9116 req-e010ac95-b719-40a2-9968-e000ad0fd27a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:43.170221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c9a3b119-e43b-4ced-964a-7fd701be9116 req-e010ac95-b719-40a2-9968-e000ad0fd27a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:43.170855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c9a3b119-e43b-4ced-964a-7fd701be9116 req-e010ac95-b719-40a2-9968-e000ad0fd27a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:43.227430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c9a3b119-e43b-4ced-964a-7fd701be9116 req-e010ac95-b719-40a2-9968-e000ad0fd27a service nova] Creating event network-vif-deleted:c99ea8af-90af-4b9e-b581-5b4aebab1949 for instance d482530a-34f7-48c7-83d8-490a6ef992a9 on n-h2-862769-3 Oct 28 19:31:43.236592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c9a3b119-e43b-4ced-964a-7fd701be9116 req-e010ac95-b719-40a2-9968-e000ad0fd27a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127777 Oct 28 19:31:43.239047 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2496/4978] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:43.383659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:43.384369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:43.398467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:43.399262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:43.399978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:43.406102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:43.407045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:43.407739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:43.833452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fbf3cffd85842d2b730d0d6615899fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bf27a16a6148cca843ffd36a54684c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:43.841755 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84a37c23-873d-49ca-9ef0-c8b1561db8fb tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 200 len: 1277 microversion: 2.1 time: 0.903251 Oct 28 19:31:43.848675 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2483/4979] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:42 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 1277 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:43.964341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:43.965787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:43.975050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:43.975562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:43.976008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:43.976761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:43.977223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:43.977651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:44.686022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:44.697196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:44.705509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:44.708177 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c5727cad-f711-4867-b641-1a9643041bae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 1.328815 Oct 28 19:31:44.711983 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2497/4980] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:43 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:31:44.720525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:44.739674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:44.746851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:44.747602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:44.748207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:44.749158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:44.749810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:44.756185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:45.691545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:45.702722 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01d07168-3481-4237-b598-6a2c4f950161 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 1.746435 Oct 28 19:31:45.728352 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2484/4981] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:43 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:45.739901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:45.759335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] [instance: d482530a-34f7-48c7-83d8-490a6ef992a9] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:45.809293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:45.809797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:45.810230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:45.811034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:45.811480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:45.811939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:45.898893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] HTTP exception thrown: Instance d482530a-34f7-48c7-83d8-490a6ef992a9 could not be found. Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Request method failure captured: Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 HTTP/1.1 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0Oq_ypcdX8_6EBuoqyqbxlONlf6Z20jIAiGvSdbYDeYW78YDTPaFHBZq1kztiykfCgzjnrLBoNL0IN-FExjYL-oKY-FUlzIIQURdPupwfdBV975vF0X73QAl2Ei7xwWXwxuEgyR3sv7lKX25hcqu7pBVAm7nzO6ywpZeASROQqvds Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_25bf27a16a6148cca843ffd36a54684c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/25bf27a16a6148cca843ffd36a54684c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersTestJSON-814476170 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 25bf27a16a6148cca843ffd36a54684c Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersTestJSON-814476170 Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersTestJSON-814476170-project Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 6fbf3cffd85842d2b730d0d6615899fe Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersTestJSON-814476170-project Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d482530a-34f7-48c7-83d8-490a6ef992a9 could not be found. Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd482530a-34f7-48c7-83d8-490a6ef992a9'} Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d482530a-34f7-48c7-83d8-490a6ef992a9 could not be found. Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d482530a-34f7-48c7-83d8-490a6ef992a9 could not be found. Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:45.901761 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:45.907421 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:45.907421 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:45.907421 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:45.907421 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:45.907421 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d482530a-34f7-48c7-83d8-490a6ef992a9 could not be found. Oct 28 19:31:45.907421 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:45.908899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] Returning 404 to user: Instance d482530a-34f7-48c7-83d8-490a6ef992a9 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:45.909985 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f1bc106-c440-4113-986c-012b050c90cc tempest-ServersTestJSON-814476170 tempest-ServersTestJSON-814476170-project] 10.222.0.44 "GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9" status: 404 len: 111 microversion: 2.1 time: 0.180224 Oct 28 19:31:45.911084 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2485/4982] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:45 2022] GET /compute/v2.1/servers/d482530a-34f7-48c7-83d8-490a6ef992a9 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:45.922017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:45.922889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:45.931027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:45.931782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:45.932383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:45.933253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:45.933871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:45.934668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:46.106343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:46.106343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22d5932b-00fd-42a8-ad70-98e1d32d9e84 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1466 microversion: 2.1 time: 1.376492 Oct 28 19:31:46.122277 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2498/4983] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:44 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1466 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:46.155237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e18d009f-59f6-40bd-8fc6-e0b08ac104e9 req-068d6ed6-7343-43e6-bdb9-eae1445606bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "name": "network-vif-unplugged", "status": "completed", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:46.196447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e18d009f-59f6-40bd-8fc6-e0b08ac104e9 req-068d6ed6-7343-43e6-bdb9-eae1445606bb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:46.198247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e18d009f-59f6-40bd-8fc6-e0b08ac104e9 req-068d6ed6-7343-43e6-bdb9-eae1445606bb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:46.199378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e18d009f-59f6-40bd-8fc6-e0b08ac104e9 req-068d6ed6-7343-43e6-bdb9-eae1445606bb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:46.254227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e18d009f-59f6-40bd-8fc6-e0b08ac104e9 req-068d6ed6-7343-43e6-bdb9-eae1445606bb service nova] Creating event network-vif-unplugged:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:31:46.268131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e18d009f-59f6-40bd-8fc6-e0b08ac104e9 req-068d6ed6-7343-43e6-bdb9-eae1445606bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141549 Oct 28 19:31:46.271457 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2499/4984] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:46.285408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1812584377"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:46.300400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:46.314831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:46.319788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:46.320412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:46.322391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:46.324561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:46.325123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:46.792397 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb825543-05c5-4028-851d-b483bfab4864 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "POST /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589/action" status: 202 len: 0 microversion: 2.1 time: 0.517114 Oct 28 19:31:46.819770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2500/4985] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:46 2022] POST /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:31:46.842450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:46.848698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:46.881879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:46.883813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:46.884631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:46.890044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:46.890928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:46.892724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:48.504489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:48.517612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:48.525540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:48.527110 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd2b1354-0622-476e-bad9-eac1f0b2bff6 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 2.614466 Oct 28 19:31:48.528684 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2486/4986] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:45 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 2616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:31:48.540949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8dd747ad-3b36-4385-913a-ce4e1b85d18a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779fbf70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:48.616564 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8dd747ad-3b36-4385-913a-ce4e1b85d18a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.086475 Oct 28 19:31:48.618986 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2487/4987] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:48 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:48.635404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3f0559f6-bc34-4c65-999a-6080f8f69634 req-15b3a21b-69fd-4aaf-8304-114a5736f677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "name": "network-vif-unplugged", "status": "completed", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:48.657942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3f0559f6-bc34-4c65-999a-6080f8f69634 req-15b3a21b-69fd-4aaf-8304-114a5736f677 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:48.659450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3f0559f6-bc34-4c65-999a-6080f8f69634 req-15b3a21b-69fd-4aaf-8304-114a5736f677 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:48.661976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3f0559f6-bc34-4c65-999a-6080f8f69634 req-15b3a21b-69fd-4aaf-8304-114a5736f677 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:48.702514 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3f0559f6-bc34-4c65-999a-6080f8f69634 req-15b3a21b-69fd-4aaf-8304-114a5736f677 service nova] Creating event network-vif-unplugged:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:31:48.714021 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3f0559f6-bc34-4c65-999a-6080f8f69634 req-15b3a21b-69fd-4aaf-8304-114a5736f677 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093409 Oct 28 19:31:48.715463 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2488/4988] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:48.942493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:48.959575 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5d9a876-d7f2-4c72-b3a2-5a8babee658f tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1512 microversion: 2.1 time: 2.131890 Oct 28 19:31:48.960656 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2501/4989] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:46 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1512 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:49.380685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f693147f-9362-456f-a731-ffc107880f86 req-d65c2297-87e8-4c8b-9f6e-37002616ce1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497bbf72-ab02-4a63-8d2b-5ed4521fdc7b", "name": "network-vif-deleted", "tag": "ee9648d9-9ea3-49c4-a345-2001be803f13"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:49.437107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f693147f-9362-456f-a731-ffc107880f86 req-d65c2297-87e8-4c8b-9f6e-37002616ce1c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:49.437629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f693147f-9362-456f-a731-ffc107880f86 req-d65c2297-87e8-4c8b-9f6e-37002616ce1c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:49.438087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f693147f-9362-456f-a731-ffc107880f86 req-d65c2297-87e8-4c8b-9f6e-37002616ce1c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:49.537904 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f693147f-9362-456f-a731-ffc107880f86 req-d65c2297-87e8-4c8b-9f6e-37002616ce1c service nova] Creating event network-vif-deleted:ee9648d9-9ea3-49c4-a345-2001be803f13 for instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b on n-h1-862769-3 Oct 28 19:31:49.558068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:49.559446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:49.573069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:49.577048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:49.580467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:49.585008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f693147f-9362-456f-a731-ffc107880f86 req-d65c2297-87e8-4c8b-9f6e-37002616ce1c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208409 Oct 28 19:31:49.595427 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2489/4990] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:49.599421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:49.600033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:49.600450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:49.634937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11c1bda9-e698-4f9b-8145-9d1af71afd23 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77392c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:49.737499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11c1bda9-e698-4f9b-8145-9d1af71afd23 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.106278 Oct 28 19:31:49.741682 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2490/4991] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:49 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:49.987832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:49.989069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:49.999362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:50.002641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:50.007548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:50.013297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:50.013938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:50.014391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:50.207393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:50.211467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:50.211948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:50.212420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lazy-loading 'fault' on Instance uuid 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:31:51.089448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:51.109709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:51.116033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:51.122364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f3674ce-054b-473d-bf81-3c8ca5c1ee69 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 1.568493 Oct 28 19:31:51.123324 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2502/4992] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:49 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:31:51.130674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c84311fd-9c06-4389-aac4-eac2a6162f2e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76bb73a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:51.194195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44942f0796ee463b954bb0032470e8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f863f63a99324431a4e9d92e311d2567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:51.201942 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05b71582-0874-4c1e-bd82-a5bedf3810c3 tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 200 len: 1307 microversion: 2.1 time: 1.218866 Oct 28 19:31:51.231194 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2491/4993] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:49 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 1307 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:52.155114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:52.155641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:52.186634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:52.187293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:52.187743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:52.188512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:52.188994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:52.189427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:53.799324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:53.808935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:53.817653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:53.820040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ecaaceec-6c67-406b-9aad-3f4976f4fabf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 1.669730 Oct 28 19:31:53.820899 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2492/4994] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:52 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:31:53.828698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:53.844185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] [instance: 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:53.858281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:53.864425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:53.867274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:53.874341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:53.875240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:53.883614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:53.939921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] HTTP exception thrown: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b could not be found. Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Request method failure captured: Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b HTTP/1.1 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC0ctHtv1YWNI5ifUHBhNeX2oNJ6X7h1hE6lkamth41TED0jnQaRnfZEIsw-re5k3keYTqKmNNbqSn9kZe52vxKzhThAUdFW4eoXklD488DDku8F1QX1WnZ-n9TmaU1LlrGTKKwg13EKSW9fk9Te4TLvKKeqY3kou0TsMaDDTAkRAXY Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f863f63a99324431a4e9d92e311d2567", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f863f63a99324431a4e9d92e311d2567"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f863f63a99324431a4e9d92e311d2567 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-42159625 Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 44942f0796ee463b954bb0032470e8fb Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-42159625-project Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b could not be found. Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '497bbf72-ab02-4a63-8d2b-5ed4521fdc7b'} Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b could not be found. Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b could not be found. Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:31:53.941741 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b could not be found. Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] Returning 404 to user: Instance 497bbf72-ab02-4a63-8d2b-5ed4521fdc7b could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:31:53.946517 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7976e4c-edf4-4023-a08c-e36b3a0479ad tempest-ServersNegativeTestJSON-42159625 tempest-ServersNegativeTestJSON-42159625-project] 10.222.0.44 "GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b" status: 404 len: 111 microversion: 2.1 time: 0.121139 Oct 28 19:31:53.952714 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2493/4995] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:53 2022] GET /compute/v2.1/servers/497bbf72-ab02-4a63-8d2b-5ed4521fdc7b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:31:53.963157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2730be21-7db3-42f8-b8fc-f71f79854255 req-a96057d8-d125-4903-99a6-c325aea8d66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edd313-26a6-40c7-87c9-2804f0f53589", "name": "network-vif-plugged", "status": "completed", "tag": "cc84a956-8415-4ff0-bb48-04d2f3b8c36e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:53.997904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2730be21-7db3-42f8-b8fc-f71f79854255 req-a96057d8-d125-4903-99a6-c325aea8d66e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:53.998421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2730be21-7db3-42f8-b8fc-f71f79854255 req-a96057d8-d125-4903-99a6-c325aea8d66e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:54.003055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2730be21-7db3-42f8-b8fc-f71f79854255 req-a96057d8-d125-4903-99a6-c325aea8d66e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:54.029604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2730be21-7db3-42f8-b8fc-f71f79854255 req-a96057d8-d125-4903-99a6-c325aea8d66e service nova] Creating event network-vif-plugged:cc84a956-8415-4ff0-bb48-04d2f3b8c36e for instance 10edd313-26a6-40c7-87c9-2804f0f53589 on n-h2-862769-3 Oct 28 19:31:54.051398 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2730be21-7db3-42f8-b8fc-f71f79854255 req-a96057d8-d125-4903-99a6-c325aea8d66e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094692 Oct 28 19:31:54.053726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2494/4996] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:54.851846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:54.852581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:54.870420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:54.878629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:54.879239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:54.883555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:54.884103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:54.884543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:55.580471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:55.606393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:55.627047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:55.630947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-031b61ef-48c3-47b3-8a55-9f94ce9977d3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 0.783446 Oct 28 19:31:55.649137 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2495/4997] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:54 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:31:56.676703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:56.678231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:56.694545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:56.695418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:56.697185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:56.698187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:56.710723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:56.711495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:57.665679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:57.677507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:57.688706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:57.698641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7567d2d-3936-4f76-8101-4e38f53c3e2c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 1.028383 Oct 28 19:31:57.706638 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2496/4998] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:56 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:31:58.736602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:58.737326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:31:58.750961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:58.751456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:58.751889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:58.752610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:58.753071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:58.753512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:58.896876 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c84311fd-9c06-4389-aac4-eac2a6162f2e tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 7.769977 Oct 28 19:31:58.905956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2503/4999] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:51 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 7782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:59.913999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5ae27546-71fd-49dc-b906-c0c3b5a92917 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7ffa01f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:59.922837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:00.055196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:00.065070 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5ae27546-71fd-49dc-b906-c0c3b5a92917 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.154459 Oct 28 19:32:00.066613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2504/5000] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:31:59 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:00.070859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:00.072978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:00.075207 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-823223b1-0e29-497c-a3c7-1287b1bb8e5f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1738 microversion: 2.20 time: 1.342747 Oct 28 19:32:00.096568 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2497/5001] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:31:58 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1738 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:32:01.106824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:01.108293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:01.116330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:01.127406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3eabe807-34da-4a5a-b085-9cd360ec44a0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d777cb0d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:01.153123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:01.161336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:01.161916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:01.162725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:01.163183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:01.169678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:01.223628 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3eabe807-34da-4a5a-b085-9cd360ec44a0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.108621 Oct 28 19:32:01.227170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2498/5002] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:01 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:01.243396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3eabe807-34da-4a5a-b085-9cd360ec44a0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:01.244889 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3eabe807-34da-4a5a-b085-9cd360ec44a0 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001913 Oct 28 19:32:01.255543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2499/5003] 10.222.0.44 () {56 vars in 886 bytes} [Fri Oct 28 19:32:01 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 19:32:02.241436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f40e0dce-c033-410d-aa53-d3d4c9108d9d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7791c1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:02.339412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f40e0dce-c033-410d-aa53-d3d4c9108d9d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.102745 Oct 28 19:32:02.340024 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2500/5004] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:02 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:02.750229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:02.768323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:02.771737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:02.779401 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c12d5b1-b520-4fd5-978f-cf7bd2d0f40d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1720 microversion: 2.20 time: 1.673664 Oct 28 19:32:02.780125 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2505/5005] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:01 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1720 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:03.240043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b406b4c1-a107-450d-b4b8-7b5f6b1ba7f6 req-9097a0ab-4340-4c4f-9876-bbd18ed6dabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "name": "network-vif-unplugged", "status": "completed", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:03.265481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b406b4c1-a107-450d-b4b8-7b5f6b1ba7f6 req-9097a0ab-4340-4c4f-9876-bbd18ed6dabb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:03.266183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b406b4c1-a107-450d-b4b8-7b5f6b1ba7f6 req-9097a0ab-4340-4c4f-9876-bbd18ed6dabb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:03.295348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b406b4c1-a107-450d-b4b8-7b5f6b1ba7f6 req-9097a0ab-4340-4c4f-9876-bbd18ed6dabb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:03.329661 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b406b4c1-a107-450d-b4b8-7b5f6b1ba7f6 req-9097a0ab-4340-4c4f-9876-bbd18ed6dabb service nova] Creating event network-vif-unplugged:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h2-862769-3 Oct 28 19:32:03.339602 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b406b4c1-a107-450d-b4b8-7b5f6b1ba7f6 req-9097a0ab-4340-4c4f-9876-bbd18ed6dabb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105743 Oct 28 19:32:03.344705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2501/5006] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:32:03.365830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bdb5b8c0-099a-4601-96af-c3be5dd068b4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ab7dc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:03.539925 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bdb5b8c0-099a-4601-96af-c3be5dd068b4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.182346 Oct 28 19:32:03.543165 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2506/5007] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:03 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:03.815439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:03.816498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:03.841973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:03.842997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:03.846630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:03.850010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:03.853015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:03.854878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:04.561550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-beb19674-d921-47f5-9b7f-0749ec80dbb6 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77296c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:04.663099 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-beb19674-d921-47f5-9b7f-0749ec80dbb6 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.107905 Oct 28 19:32:04.676570 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2507/5008] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:04 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:05.614225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:05.638167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:05.645241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:05.646496 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe80cd20-4226-415b-bb3e-dc4a689088ec tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1723 microversion: 2.20 time: 1.835770 Oct 28 19:32:05.659064 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2502/5009] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:03 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1723 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:05.687175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e94dbe6-972a-4338-a53b-e4c57b531cfe tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76bb7c10>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:05.693230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f68bb1cc-ed4b-4092-bfb0-74ee290dd58a"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:05.700785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:05.722756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:05.735240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:05.737132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:05.739115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:05.740043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:05.742513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:05.771460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e94dbe6-972a-4338-a53b-e4c57b531cfe tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.090508 Oct 28 19:32:05.780683 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2508/5010] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:05 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:06.676844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f1b3fc7-5507-44fb-98bd-57ebe0ac7d4b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.986325 Oct 28 19:32:06.708753 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2503/5011] 10.222.0.44 () {62 vars in 1364 bytes} [Fri Oct 28 19:32:05 2022] POST /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 188 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:32:06.792654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b04bc65-d66c-489c-9bcc-a364fce6a34b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d772b8ee0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:06.919507 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b04bc65-d66c-489c-9bcc-a364fce6a34b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.135523 Oct 28 19:32:06.927078 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2509/5012] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:06 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:07.007688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:07.008763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:07.015852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:07.016756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:07.017520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:07.018475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:07.019260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:07.019934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:07.070058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:07.099282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120628) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:32:07.229804 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3a291e04-7524-4ddc-8e90-632d57fd3b9c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/action" status: 202 len: 0 microversion: 2.20 time: 0.226997 Oct 28 19:32:07.251195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:07.252129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:07.261980 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2504/5013] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:32:07 2022] POST /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:32:07.269469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:07.270352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:07.271051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:07.272082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:07.272814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:07.274336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:07.938378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-035fa28b-baa9-41ee-a3de-5dd87f73748d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779fb550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:08.302810 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-035fa28b-baa9-41ee-a3de-5dd87f73748d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.369152 Oct 28 19:32:08.305547 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2505/5014] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:07 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:08.457370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:08.479430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:08.499844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:08.508001 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27a5e184-5916-4205-95a9-32da76c4152f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1749 microversion: 2.20 time: 1.264418 Oct 28 19:32:08.535165 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2510/5015] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:07 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1749 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:09.324624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2e78bfe-4d15-444a-b5ac-2b8e5332f106 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76d2b160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:09.461845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2e78bfe-4d15-444a-b5ac-2b8e5332f106 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.140788 Oct 28 19:32:09.464442 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2506/5016] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:09 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:09.549156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:09.550551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:09.565989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:09.573926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:09.577525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:09.579417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:09.585422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:09.586520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:10.021768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:10.043492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:10.058492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:10.059856 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3841c3ef-abc4-4308-8162-860c88150b33 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1749 microversion: 2.20 time: 0.515377 Oct 28 19:32:10.078933 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2511/5017] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:09 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1749 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:10.481088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-415a11c7-ec41-4548-9641-b85d2adb3637 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d768ed790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:10.793541 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-415a11c7-ec41-4548-9641-b85d2adb3637 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.316970 Oct 28 19:32:10.809689 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2507/5018] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:10 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:11.101840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:11.102498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:11.116563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:11.117600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:11.119167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:11.122249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:11.123107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:11.123834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:11.810614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df3fa26f-2516-4f2b-83e6-14447c7f458c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76d2b790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:11.944157 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df3fa26f-2516-4f2b-83e6-14447c7f458c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.136183 Oct 28 19:32:11.945071 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2508/5019] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:11 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:12.151496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:12.173768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:12.175405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:12.189942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce0cbcf4-035f-4a98-a173-934682a6ef24 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1749 microversion: 2.20 time: 1.093040 Oct 28 19:32:12.190563 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2512/5020] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:11 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1749 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:12.778280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d5806c5f-d26c-45a8-b67a-101a8d9ab48c tempest-ExtensionsTest-1199660974 tempest-ExtensionsTest-1199660974-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:12.780138 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d5806c5f-d26c-45a8-b67a-101a8d9ab48c tempest-ExtensionsTest-1199660974 tempest-ExtensionsTest-1199660974-project] 10.222.0.44 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.445518 Oct 28 19:32:12.781272 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2509/5021] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:32:12 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:32:12.792548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-26d6818d-0da1-4563-b771-5e2a16fd1480 tempest-ExtensionsTest-1199660974 tempest-ExtensionsTest-1199660974-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:12.795264 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-26d6818d-0da1-4563-b771-5e2a16fd1480 tempest-ExtensionsTest-1199660974 tempest-ExtensionsTest-1199660974-project] 10.222.0.44 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007869 Oct 28 19:32:12.819675 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2513/5022] 10.222.0.44 () {58 vars in 1134 bytes} [Fri Oct 28 19:32:12 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:32:12.963333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea182063-db74-4903-b5f9-9a49dcbc9ee7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77d6cc10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:13.115357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea182063-db74-4903-b5f9-9a49dcbc9ee7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.158185 Oct 28 19:32:13.132020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2510/5023] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:12 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:13.222493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:13.223796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:13.243871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:13.248622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:13.249458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:13.252396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:13.253082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:13.255949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:13.730007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:13.750893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:13.755918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:13.759848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27739f15-3383-4f17-a1e0-fde475a11e65 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 0.544311 Oct 28 19:32:13.775531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2514/5024] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:13 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:14.142176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f158709-fcee-4b9f-baca-6e39c28deab7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779fb550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:14.258662 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f158709-fcee-4b9f-baca-6e39c28deab7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.122028 Oct 28 19:32:14.263254 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2511/5025] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:14 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:14.794116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:14.794831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:14.816970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:14.817309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:14.817777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:14.818547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:14.823351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:14.824981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:15.279765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-240d4ab9-f2c7-412a-876b-85f50d8decf1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77a1c9d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:15.387919 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-240d4ab9-f2c7-412a-876b-85f50d8decf1 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.113141 Oct 28 19:32:15.392552 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2512/5026] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:15 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:16.103559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:16.113183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:16.115012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:16.116576 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f97412aa-f9e0-474b-983d-5a13c8ea1496 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 1.329200 Oct 28 19:32:16.139876 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2515/5027] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:14 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:16.408889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a254e8da-ea79-4cd0-bc6f-ef15e2c5d44f tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77d37e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:16.552966 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a254e8da-ea79-4cd0-bc6f-ef15e2c5d44f tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.148968 Oct 28 19:32:16.553476 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2513/5028] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:16 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:17.152392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:17.152392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:17.177264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:17.179535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:17.180011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:17.181007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:17.181222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:17.189897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:17.564272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:17.566526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:17.569001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=8,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:17.574385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36d4d118-221e-4790-a519-d48541b713ff tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d768485e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:17.575199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:17.576713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:17.578214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7d1ade5-2ed7-493f-8d56-7234efedcd85 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 0.434523 Oct 28 19:32:17.591288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2516/5029] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:17 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:17.695468 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36d4d118-221e-4790-a519-d48541b713ff tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.129712 Oct 28 19:32:17.722011 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2514/5030] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:17 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:18.624332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:18.624332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:18.653591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:18.654099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:18.654539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:18.655320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:18.655782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:18.656207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:18.713970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6c60f7b-894e-4688-b6dd-f57c0920d5c6 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77d379d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:18.811526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6c60f7b-894e-4688-b6dd-f57c0920d5c6 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.103665 Oct 28 19:32:18.822027 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2515/5031] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:18 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:19.466735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:19.495288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:19.504940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:19.511760 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b46b939-d67a-4487-a596-554203c11e20 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 0.892204 Oct 28 19:32:19.513770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2517/5032] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:18 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:19.829533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7823b642-d9fd-455c-b1a1-b0309a36e7ae tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77a1c310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:19.954506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7823b642-d9fd-455c-b1a1-b0309a36e7ae tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.128720 Oct 28 19:32:19.960155 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2516/5033] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:19 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:20.544587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:20.545471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:20.587034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:20.588287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:20.591742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:20.593515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:20.594122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:20.594670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:20.976892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-070043c5-90de-4060-8bb7-90916c1a9723 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77d37280>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:21.123029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-070043c5-90de-4060-8bb7-90916c1a9723 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.149660 Oct 28 19:32:21.124660 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2517/5034] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:20 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:21.575204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:21.600197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:21.606310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:21.612881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca6e5be9-8ed1-4aec-9c87-15025bf43088 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 1.073597 Oct 28 19:32:21.618446 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2518/5035] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:20 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:22.140376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb38d722-752c-4929-a1f7-7bc8a1f254bc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76c958b0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:22.648234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:22.649607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:22.659734 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:32:22.661019 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 19:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 (ip 10.222.0.44) !!! Oct 28 19:32:22.669323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:22.670871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:22.671870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:22.675763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:22.676615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:22.677286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:23.021111 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb38d722-752c-4929-a1f7-7bc8a1f254bc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1455 microversion: 2.1 time: 0.885619 Oct 28 19:32:23.021927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2518/5036] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:22 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1455 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:23.972402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:23.989037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:23.991145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:24.002589 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66b0485d-158a-42f4-a4c6-0eed0d8efcb8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 1.358532 Oct 28 19:32:24.008671 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2519/5037] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:22 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:24.037855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-034e6088-90b1-4dd2-989f-154aff0af40c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b6ef70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:24.049186 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:32:24.049355 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 19:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 (ip 10.222.0.44) !!! Oct 28 19:32:24.161451 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-034e6088-90b1-4dd2-989f-154aff0af40c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1464 microversion: 2.1 time: 0.127733 Oct 28 19:32:24.174147 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2519/5038] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:24 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:24.178771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-416d1c93-d02f-474e-ba43-6468d695e43b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d80094ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:24.279597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-416d1c93-d02f-474e-ba43-6468d695e43b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 200 len: 1464 microversion: 2.1 time: 0.104812 Oct 28 19:32:24.280788 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2520/5039] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:24 2022] GET /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:24.312550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:24.316100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:24.365301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:24.365986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:24.366441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:24.367238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:24.367705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:24.368135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:25.036670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:25.037294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:25.050821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:25.051323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:25.051762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:25.063340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:25.064067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:25.064509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:25.317165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:25.328570 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a6a8ca7-3e3a-4df6-9899-e25f0dad0aaf tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1468 microversion: 2.1 time: 1.034566 Oct 28 19:32:25.335460 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2520/5040] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:32:24 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1468 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:25.377503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1430121802"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:25.386532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:25.409556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:25.411181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:25.411917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:25.413854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:25.415660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:25.418063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:25.856620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22e983ca-55cb-4bd4-987e-d4192cd057c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "POST /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260/action" status: 202 len: 0 microversion: 2.1 time: 0.494660 Oct 28 19:32:25.867136 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2521/5041] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:32:25 2022] POST /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:32:25.881368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f442483b-c09d-4643-9f91-e47e4a32fe08 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b10430>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:25.967811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f442483b-c09d-4643-9f91-e47e4a32fe08 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.098758 Oct 28 19:32:25.972194 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2522/5042] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:25 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:26.488301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:26.509859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:26.516886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:26.520719 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-22468dd7-189f-43e7-99a7-ea0e558fc88f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1751 microversion: 2.20 time: 1.490402 Oct 28 19:32:26.536131 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2521/5043] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:25 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1751 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:32:26.989711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96529058-fc8e-4f50-8bfc-b47f46c139d4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b22310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:27.071386 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-96529058-fc8e-4f50-8bfc-b47f46c139d4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.087371 Oct 28 19:32:27.075119 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2523/5044] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:26 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:27.551461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:27.552052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:27.566108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:27.566388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:27.566834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:27.571694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:27.572245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:27.572715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:27.608796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d65102c4-e6e7-4f26-b4d1-d5d9de9d643b req-da1ed715-3ebe-4f5f-854d-30b6bcad3580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edd313-26a6-40c7-87c9-2804f0f53589", "name": "network-vif-unplugged", "status": "completed", "tag": "cc84a956-8415-4ff0-bb48-04d2f3b8c36e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:27.642194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d65102c4-e6e7-4f26-b4d1-d5d9de9d643b req-da1ed715-3ebe-4f5f-854d-30b6bcad3580 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:27.642750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d65102c4-e6e7-4f26-b4d1-d5d9de9d643b req-da1ed715-3ebe-4f5f-854d-30b6bcad3580 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:27.644827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d65102c4-e6e7-4f26-b4d1-d5d9de9d643b req-da1ed715-3ebe-4f5f-854d-30b6bcad3580 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:27.694505 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d65102c4-e6e7-4f26-b4d1-d5d9de9d643b req-da1ed715-3ebe-4f5f-854d-30b6bcad3580 service nova] Creating event network-vif-unplugged:cc84a956-8415-4ff0-bb48-04d2f3b8c36e for instance 10edd313-26a6-40c7-87c9-2804f0f53589 on n-h2-862769-3 Oct 28 19:32:27.708861 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d65102c4-e6e7-4f26-b4d1-d5d9de9d643b req-da1ed715-3ebe-4f5f-854d-30b6bcad3580 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105475 Oct 28 19:32:27.709932 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2524/5045] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:32:28.094118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-62fb0c20-cdcf-44ca-adf0-b473efc34904 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b105e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:28.192295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-62fb0c20-cdcf-44ca-adf0-b473efc34904 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.105083 Oct 28 19:32:28.193276 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2525/5046] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:28 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:28.424823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:28.442379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:28.447662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:28.452441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3fac160b-01ea-48f6-8788-60c7e8634679 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.905593 Oct 28 19:32:28.454867 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2522/5047] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:27 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:29.216381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2add1086-cb1b-4aac-9177-9cdd701ffe09 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779fb280>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:29.305264 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2add1086-cb1b-4aac-9177-9cdd701ffe09 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.101085 Oct 28 19:32:29.307059 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2526/5048] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:29 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:29.482288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:29.483178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:29.495489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:29.496071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:29.496546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:29.507826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:29.508649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:29.509752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:30.321373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-992a16aa-afbf-4bae-83d7-442d4e80c868 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b104c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:30.328987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:30.346635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:30.352431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:30.353980 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80151b3a-2feb-450e-97f8-5a0971e9216c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.876358 Oct 28 19:32:30.357048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2523/5049] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:29 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:30.495915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9a815df9-fed1-455f-8196-859ae127e6c6 req-4658c9e4-cec4-4b95-8c19-536bfb43a55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "name": "network-vif-plugged", "status": "completed", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:30.513666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=27 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:30.519776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9a815df9-fed1-455f-8196-859ae127e6c6 req-4658c9e4-cec4-4b95-8c19-536bfb43a55d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:30.522525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9a815df9-fed1-455f-8196-859ae127e6c6 req-4658c9e4-cec4-4b95-8c19-536bfb43a55d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:30.523240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9a815df9-fed1-455f-8196-859ae127e6c6 req-4658c9e4-cec4-4b95-8c19-536bfb43a55d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:30.578420 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9a815df9-fed1-455f-8196-859ae127e6c6 req-4658c9e4-cec4-4b95-8c19-536bfb43a55d service nova] Creating event network-vif-plugged:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:32:30.592227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9a815df9-fed1-455f-8196-859ae127e6c6 req-4658c9e4-cec4-4b95-8c19-536bfb43a55d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100289 Oct 28 19:32:30.594709 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2524/5050] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:32:30.904143 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-992a16aa-afbf-4bae-83d7-442d4e80c868 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.587239 Oct 28 19:32:30.905169 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2527/5051] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:30 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:32:31.386574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:31.388150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:31.413299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:31.414358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:31.415285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:31.416463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:31.417195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:31.417865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:31.502628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=81 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:31.922304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8e60d75-98ae-4999-a3d5-8b792bd501be tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b22040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:31.997430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8e60d75-98ae-4999-a3d5-8b792bd501be tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.079695 Oct 28 19:32:32.002867 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2528/5052] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:31 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:32.851699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-59fb12fa-a132-42da-a0a7-992512d3ee70 req-8b285db2-709b-4a1a-ac17-8dfb77368bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:32:32.871866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59fb12fa-a132-42da-a0a7-992512d3ee70 req-8b285db2-709b-4a1a-ac17-8dfb77368bf2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:32.872694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59fb12fa-a132-42da-a0a7-992512d3ee70 req-8b285db2-709b-4a1a-ac17-8dfb77368bf2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:32.874099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59fb12fa-a132-42da-a0a7-992512d3ee70 req-8b285db2-709b-4a1a-ac17-8dfb77368bf2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:32.901102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-59fb12fa-a132-42da-a0a7-992512d3ee70 req-8b285db2-709b-4a1a-ac17-8dfb77368bf2 service nova] Creating event network-changed:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h1-862769-3 Oct 28 19:32:32.914392 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-59fb12fa-a132-42da-a0a7-992512d3ee70 req-8b285db2-709b-4a1a-ac17-8dfb77368bf2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067105 Oct 28 19:32:32.917342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2529/5053] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:32:33.017654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-441cac39-285c-4339-a68d-740c528fde9b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b10790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:33.163585 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-441cac39-285c-4339-a68d-740c528fde9b tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.151095 Oct 28 19:32:33.164661 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2530/5054] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:33 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:33.746119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:33.759414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:33.761913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:33.763726 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae8ec4d1-5a92-40ff-80fe-f0cd816ad5c8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 2.382790 Oct 28 19:32:33.765024 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2525/5055] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:31 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:34.181484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c07873d4-ba19-4d31-8b84-5b49abb98d95 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76848550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:34.278192 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c07873d4-ba19-4d31-8b84-5b49abb98d95 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.101806 Oct 28 19:32:34.279359 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2531/5056] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:34 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:34.794609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:34.809444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:34.833261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:34.835523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:34.837003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:34.840516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:34.841124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:34.841654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:35.298432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b75cb0c4-7a99-4814-b813-8b8d6abf4514 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b10dc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:35.406106 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b75cb0c4-7a99-4814-b813-8b8d6abf4514 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.116363 Oct 28 19:32:35.407073 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2532/5057] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:35 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:35.842010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:35.874227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:35.878542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:35.888710 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65e85e42-d952-457a-8e85-94857a8a12da tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.097041 Oct 28 19:32:35.902765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2526/5058] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:34 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:36.423014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-40d2200c-0d0f-4647-a949-9fb20b64baaa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76848940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:36.728813 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-40d2200c-0d0f-4647-a949-9fb20b64baaa tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1455 microversion: 2.1 time: 0.311209 Oct 28 19:32:36.730817 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2533/5059] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:36 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1455 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:36.922310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:36.923092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:36.937783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:36.939698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:36.940758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:36.943144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:36.943989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:36.945464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:37.512722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:37.528613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:37.530344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:37.531445 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b80d5075-4d3e-4005-8442-e00e706f11bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.616091 Oct 28 19:32:37.532510 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2527/5060] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:36 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:37.747409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2c2c2a35-55dc-413d-9e45-0e81ca190680 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76b10b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:38.561848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:38.562527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:38.576019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:38.596305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:38.597075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:38.606597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:38.607456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:38.609945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:39.320704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:39.362977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:39.379231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:39.389811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4ebf823-0945-4033-be19-33ccb0c319cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.824519 Oct 28 19:32:39.404179 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2528/5061] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:38 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:40.433194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:40.433924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:40.454319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:40.455981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:40.458059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:40.461130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:40.461815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:40.471405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:41.427507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:41.441496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:41.450355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:41.452013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89f5b924-70c0-4c4d-a55e-504d6e57ce03 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.023721 Oct 28 19:32:41.467353 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2529/5062] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:40 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:42.494926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:42.496309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:42.513651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:42.525095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:42.527255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:42.528261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:42.532744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:42.533727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:42.867547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:42.882790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:32:43.783949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:43.809070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:43.817423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:43.819928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f6e0c13c-f75d-422d-bdf8-6e1a48182d57 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.330164 Oct 28 19:32:43.821457 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2530/5063] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:42 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:32:44.850562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:44.851923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:44.876006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:44.876691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:44.878946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:44.882103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:44.887248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:44.903415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:46.121175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:46.142977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:46.146116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:46.156261 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df716efd-7563-41d9-9c72-208fe491b0bd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.312485 Oct 28 19:32:46.160352 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2531/5064] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:44 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:47.202106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:47.203824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:47.240572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:47.247882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:47.251712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:47.258537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:47.260952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:47.263115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:47.763565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:47.783105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:47.786856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:47.791446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac004fa2-a0a2-48d1-b06a-009f047e59eb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.597130 Oct 28 19:32:47.812226 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2532/5065] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:47 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:48.832252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:48.835907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:48.860135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:48.864619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:48.866543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:48.869011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:48.870305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:48.872040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:49.500567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:49.551328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:49.561381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:49.573245 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02742735-67f1-4cf1-b537-168e14605961 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.747450 Oct 28 19:32:49.578529 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2533/5066] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:48 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:32:50.606406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:50.608066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:50.619670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:50.633564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:50.635848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:50.640103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:50.642205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:50.646823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:52.349113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:52.364589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:52.366099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:52.380127 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-824c308f-70f2-4a63-8911-599fac4158ba tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.778316 Oct 28 19:32:52.405356 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2534/5067] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:50 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:53.411473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:53.415004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:53.442301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:53.448218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:53.452009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:53.452978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:53.469564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:53.470278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:54.348176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:54.367296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:54.371280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:54.374341 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-129fc59a-46e2-47c3-a8c4-b3207d1cc8f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.966581 Oct 28 19:32:54.375525 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2535/5068] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:53 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:32:55.408041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:55.408876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:55.428245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:55.429786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:55.430266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:55.432649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:55.433118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:55.434936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:56.399130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:56.417388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:56.428341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:56.434393 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9591f52a-6819-44af-b0bf-b746ff6cda95 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.030270 Oct 28 19:32:56.458637 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2536/5069] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:55 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:57.471451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:57.472764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:57.492405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:57.494352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:57.495966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:57.503039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:57.503863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:57.504304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:58.202403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:58.219988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:58.231198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:32:58.234120 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3602e16e-bd92-4176-93d7-eff603ac53ee tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.767756 Oct 28 19:32:58.234748 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2537/5070] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:57 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:32:58.782401 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2c2c2a35-55dc-413d-9e45-0e81ca190680 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1464 microversion: 2.1 time: 21.041237 Oct 28 19:32:58.784279 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2534/5071] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:37 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1464 bytes in 21044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:58.800921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5cd09895-0fc2-4058-9fcf-83cd07651d15 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76aad9d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:59.117742 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5cd09895-0fc2-4058-9fcf-83cd07651d15 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 200 len: 1464 microversion: 2.1 time: 0.322733 Oct 28 19:32:59.120700 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2538/5072] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:32:58 2022] GET /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:32:59.133747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:59.134917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:59.158935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:59.174271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:59.176604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:59.183933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:59.187110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:59.187328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:59.267559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:32:59.269887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:32:59.298301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:59.299999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:59.300724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:32:59.304092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:32:59.307668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:32:59.309891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:00.168483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:00.185612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:00.187601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:00.191154 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4587f7a7-8e34-419b-a255-1f73dd6c5db8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.931592 Oct 28 19:33:00.195399 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2539/5073] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:32:59 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:00.283995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:00.351883 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0deb98f9-b6d8-4b75-a846-11879ca77373 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1466 microversion: 2.1 time: 1.222795 Oct 28 19:33:00.374280 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2535/5074] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:32:59 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1466 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:00.397547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a3d909a-8a34-40b5-8b74-192dc1d862de tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d772303a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:00.709731 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a3d909a-8a34-40b5-8b74-192dc1d862de tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?changes-since=2022-10-28T19%3A30%3A29Z" status: 200 len: 1901 microversion: 2.1 time: 0.319192 Oct 28 19:33:00.711032 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2540/5075] 10.222.0.44 () {58 vars in 1199 bytes} [Fri Oct 28 19:33:00 2022] GET /compute/v2.1/images?changes-since=2022-10-28T19%3A30%3A29Z => generated 1901 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:00.734474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8757deb7-b18c-4895-99ca-40ffa4974703 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ad2c10>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:00.832381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8757deb7-b18c-4895-99ca-40ffa4974703 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1019237485" status: 200 len: 485 microversion: 2.1 time: 0.110059 Oct 28 19:33:00.833757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2536/5076] 10.222.0.44 () {58 vars in 1231 bytes} [Fri Oct 28 19:33:00 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1019237485 => generated 485 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:00.855578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-be832450-2ca4-4707-b7f7-633aa42f831f tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d769bb310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.039654 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-be832450-2ca4-4707-b7f7-633aa42f831f tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?server=edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 956 microversion: 2.1 time: 0.190382 Oct 28 19:33:01.040266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2541/5077] 10.222.0.44 () {58 vars in 1209 bytes} [Fri Oct 28 19:33:00 2022] GET /compute/v2.1/images?server=edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 956 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:01.054362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7157366-567a-4973-84a8-c55362f0db05 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ac7b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.177832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7157366-567a-4973-84a8-c55362f0db05 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fv2.1%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 485 microversion: 2.1 time: 0.127334 Oct 28 19:33:01.181820 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2537/5078] 10.222.0.44 () {58 vars in 1317 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fv2.1%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589 => generated 485 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:01.193947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a4929b7-b391-46ab-9d43-3bc87af737b4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d80094280>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.245734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.247740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:01.271004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:01.271004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:01.271004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:01.271004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:01.271004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:01.272361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:01.336981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a4929b7-b391-46ab-9d43-3bc87af737b4 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 485 microversion: 2.1 time: 0.144997 Oct 28 19:33:01.339295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2542/5079] 10.222.0.44 () {58 vars in 1303 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589 => generated 485 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:01.366865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acd26de5-8bab-4dd9-8cdf-8843440ad3c8 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77230b80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.515839 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-acd26de5-8bab-4dd9-8cdf-8843440ad3c8 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.166098 Oct 28 19:33:01.516884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2543/5080] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:01.545718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6129ef36-0ca3-4739-aa00-4806ed5c6e61 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77e79f70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.704874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6129ef36-0ca3-4739-aa00-4806ed5c6e61 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.159563 Oct 28 19:33:01.707108 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2544/5081] 10.222.0.44 () {58 vars in 1149 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:01.727857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66576c2e-9b9d-46aa-955f-d41388eade0f tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d772960d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.821747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66576c2e-9b9d-46aa-955f-d41388eade0f tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.099837 Oct 28 19:33:01.822752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2545/5082] 10.222.0.44 () {58 vars in 1137 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:01.837726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e915083e-202b-4279-b23a-fbe966896f6a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d77230a60>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:01.985897 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e915083e-202b-4279-b23a-fbe966896f6a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?changes-since=2022-10-28T19%3A30%3A25Z" status: 200 len: 6333 microversion: 2.1 time: 0.153711 Oct 28 19:33:01.987284 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2546/5083] 10.222.0.44 () {58 vars in 1220 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-28T19%3A30%3A25Z => generated 6333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:02.010742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82db5f5a-a016-473d-8819-cf08db181662 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d772960d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.058180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:02.087049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:02.097267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:02.100178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe655196-43e7-4171-965e-0c45fe7b5d37 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.858848 Oct 28 19:33:02.102121 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2538/5084] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:01 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:02.142851 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82db5f5a-a016-473d-8819-cf08db181662 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1019237485" status: 200 len: 665 microversion: 2.1 time: 0.135060 Oct 28 19:33:02.142851 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2547/5085] 10.222.0.44 () {58 vars in 1252 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1019237485 => generated 665 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:02.161381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-781f8334-356a-4076-b5cc-7215a9f91d15 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d768ed820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.231324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-781f8334-356a-4076-b5cc-7215a9f91d15 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fv2.1%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1467 microversion: 2.1 time: 0.074287 Oct 28 19:33:02.232803 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2539/5086] 10.222.0.44 () {58 vars in 1338 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fv2.1%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1467 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:02.252981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c71bbcf-c543-4ef7-8b3e-cbe7b9fbc068 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7722bdc0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.342954 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c71bbcf-c543-4ef7-8b3e-cbe7b9fbc068 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1467 microversion: 2.1 time: 0.094001 Oct 28 19:33:02.344683 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2548/5087] 10.222.0.44 () {58 vars in 1324 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.44%2Fcompute%2Fservers%2F10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1467 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:02.365536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f68510e7-925e-486e-9bc9-b2f257139265 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ac7160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.520047 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f68510e7-925e-486e-9bc9-b2f257139265 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.158350 Oct 28 19:33:02.521144 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2540/5088] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:02.544474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a6c19052-ea5e-4219-a093-2ed780f41a4c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7ffa0310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.653434 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a6c19052-ea5e-4219-a093-2ed780f41a4c tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.114241 Oct 28 19:33:02.654180 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2549/5089] 10.222.0.44 () {58 vars in 1170 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:02.673783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1e37101-10cd-4829-a429-b9c7de959740 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ad2b80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.750235 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1e37101-10cd-4829-a429-b9c7de959740 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/d275f742-67cf-44be-b2bb-1596dfea8f48" status: 200 len: 784 microversion: 2.1 time: 0.080080 Oct 28 19:33:02.762013 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2541/5090] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/d275f742-67cf-44be-b2bb-1596dfea8f48 => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:33:02.767657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d08b5947-2680-4a02-b386-b50e91518e67 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d7722b430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:02.851216 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d08b5947-2680-4a02-b386-b50e91518e67 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.087913 Oct 28 19:33:02.854529 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2550/5091] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 19:33:02 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:02.871064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efd66dcc-bea8-49bf-bb8e-49295cc09286 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d779284c0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:03.134286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:03.134418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:03.156676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=30 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:03.161320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:03.162098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:03.162942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:03.163974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:03.164576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:03.165100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:03.172145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=84 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:03.894961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:03.904519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:03.914065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:03.915649 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f155dc7-6333-4eaf-ae27-735cd450bbd3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.787368 Oct 28 19:33:03.917526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2551/5092] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:03 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:33:03.968793 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efd66dcc-bea8-49bf-bb8e-49295cc09286 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090" status: 204 len: 0 microversion: 2.1 time: 1.103373 Oct 28 19:33:03.972274 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2542/5093] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:02 2022] DELETE /compute/v2.1/images/f3c4b482-85ba-47bf-bcf1-2170e92ae090 => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:03.980600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8985d694-363f-489b-8e86-f199ce81ecc2 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76ab71f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:04.893031 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8985d694-363f-489b-8e86-f199ce81ecc2 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042" status: 204 len: 0 microversion: 2.1 time: 0.916231 Oct 28 19:33:04.906737 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2552/5094] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:03 2022] DELETE /compute/v2.1/images/7e0da057-94bd-42b4-b4b8-7fd287d0c042 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:04.908123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78ffacef-ebbf-4e12-bc44-67ebb7849d71 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76c951f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:04.941711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:04.942319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:04.957548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:04.958045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:04.958483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:04.959269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:04.959725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:04.960143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:05.908173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:05.923516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:05.925127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:05.926372 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc05840a-2560-47bb-8850-3b33d42b15d0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.988680 Oct 28 19:33:05.926981 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2553/5095] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:04 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:33:05.944337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-37b67a3b-5724-4beb-b896-4c5453869e22 req-2dfb6cbd-3004-4c0f-857e-06a262412129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "name": "network-vif-unplugged", "status": "completed", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:05.968216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37b67a3b-5724-4beb-b896-4c5453869e22 req-2dfb6cbd-3004-4c0f-857e-06a262412129 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:05.968916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37b67a3b-5724-4beb-b896-4c5453869e22 req-2dfb6cbd-3004-4c0f-857e-06a262412129 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:05.977829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-37b67a3b-5724-4beb-b896-4c5453869e22 req-2dfb6cbd-3004-4c0f-857e-06a262412129 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:06.013601 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-37b67a3b-5724-4beb-b896-4c5453869e22 req-2dfb6cbd-3004-4c0f-857e-06a262412129 service nova] Creating event network-vif-unplugged:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:33:06.020470 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-37b67a3b-5724-4beb-b896-4c5453869e22 req-2dfb6cbd-3004-4c0f-857e-06a262412129 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086632 Oct 28 19:33:06.022411 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2554/5096] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:06.483761 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78ffacef-ebbf-4e12-bc44-67ebb7849d71 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f" status: 204 len: 0 microversion: 2.1 time: 1.585384 Oct 28 19:33:06.486972 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2543/5097] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:04 2022] DELETE /compute/v2.1/images/081c29e9-1fa7-4261-98fd-5403dc92631f => generated 0 bytes in 1588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:06.508545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:06.509896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:06.519299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:06.520257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:06.523350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:06.524718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:06.525412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:06.526072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:06.638305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:33:06.892538 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1c8b193-4b6d-4e1c-bfb7-611448d7670a tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 204 len: 0 microversion: 2.1 time: 0.386421 Oct 28 19:33:06.898907 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2555/5098] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:33:06 2022] DELETE /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:06.934418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:06.940832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:06.962467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:06.963263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:06.976765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:06.977582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:06.978740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:06.979018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:06.980106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:06.981992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:06.982808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:06.982947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:06.983969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:06.986497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:06.987335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:06.989155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:08.131338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:08.148049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:08.151016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:08.173585 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b773da5e-82ae-4360-a855-1c0590a98f59 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 1.217479 Oct 28 19:33:08.174999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2556/5099] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:06 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:08.370012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:08.382341 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc576795-5eaf-4541-85ce-65e5435c0f16 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1474 microversion: 2.1 time: 1.478502 Oct 28 19:33:08.425941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2544/5100] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:06 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1474 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:09.204271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:09.204883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:09.221518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:09.226835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:09.228338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:09.229326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:09.233378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:09.234112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:09.412939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:09.414058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:09.443308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:09.445827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:09.446475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:09.447930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:09.458941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:09.459901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:10.701533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:10.727583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ddb0baf2-d1ae-4cf0-8646-1756959ef5dc tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 200 len: 1432 microversion: 2.1 time: 1.318447 Oct 28 19:33:10.743775 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2545/5101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:09 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 1432 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:10.749785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c924e51b-3a10-4295-bccf-cd446958eb35 req-53999b05-773a-44e1-b195-d46c4ff33318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edd313-26a6-40c7-87c9-2804f0f53589", "name": "network-vif-deleted", "tag": "cc84a956-8415-4ff0-bb48-04d2f3b8c36e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:10.806490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c924e51b-3a10-4295-bccf-cd446958eb35 req-53999b05-773a-44e1-b195-d46c4ff33318 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:10.807055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c924e51b-3a10-4295-bccf-cd446958eb35 req-53999b05-773a-44e1-b195-d46c4ff33318 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:10.819733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c924e51b-3a10-4295-bccf-cd446958eb35 req-53999b05-773a-44e1-b195-d46c4ff33318 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:10.903835 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c924e51b-3a10-4295-bccf-cd446958eb35 req-53999b05-773a-44e1-b195-d46c4ff33318 service nova] Creating event network-vif-deleted:cc84a956-8415-4ff0-bb48-04d2f3b8c36e for instance 10edd313-26a6-40c7-87c9-2804f0f53589 on n-h2-862769-3 Oct 28 19:33:10.923182 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c924e51b-3a10-4295-bccf-cd446958eb35 req-53999b05-773a-44e1-b195-d46c4ff33318 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177997 Oct 28 19:33:10.929562 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2546/5102] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:11.285175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:11.320405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:11.335723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:11.342612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-19e9cd0d-afd6-4427-9111-9b84b6bd96c5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 2.142354 Oct 28 19:33:11.361021 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2557/5103] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:09 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:11.760907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:11.762425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: 10edd313-26a6-40c7-87c9-2804f0f53589] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:11.788103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:11.794057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:11.796587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:11.805176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:11.806474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:11.808243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:11.847671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] HTTP exception thrown: Instance 10edd313-26a6-40c7-87c9-2804f0f53589 could not be found. Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Request method failure captured: Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 HTTP/1.1 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC3Q8fLJJlTFvzWC3EbiHxgSxUpB5MxQRjxDArX33IGPP5nY5rVWncM34_8_tH2Bui36UvbFdETpCA2yALhkxZyzS8B3EdZjFoGAIr7zk0RiPQ1rl2svjaEI7odU_PlRIkLkZAwu8qwVH1Sak6LjY9Vjz2Km_6JAxjaMH1TkYywzl9Y Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: c6197c092ced4555b66f6d086a17628c Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ListImageFiltersTestJSON-1577935404 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c6197c092ced4555b66f6d086a17628c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c6197c092ced4555b66f6d086a17628c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c6197c092ced4555b66f6d086a17628c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c6197c092ced4555b66f6d086a17628c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ListImageFiltersTestJSON-1577935404 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: c6197c092ced4555b66f6d086a17628c Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1577935404 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ListImageFiltersTestJSON-1577935404-project Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 36699f62b10a4e0f98942f73d3df0e71 Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ListImageFiltersTestJSON-1577935404-project Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 10edd313-26a6-40c7-87c9-2804f0f53589 could not be found. Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '10edd313-26a6-40c7-87c9-2804f0f53589'} Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10edd313-26a6-40c7-87c9-2804f0f53589 could not be found. Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10edd313-26a6-40c7-87c9-2804f0f53589 could not be found. Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:11.857266 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10edd313-26a6-40c7-87c9-2804f0f53589 could not be found. Oct 28 19:33:11.862898 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:11.864975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Returning 404 to user: Instance 10edd313-26a6-40c7-87c9-2804f0f53589 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:11.872459 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47ba193b-9002-47f9-bcfa-4b8f44a9fa59 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589" status: 404 len: 111 microversion: 2.1 time: 0.118420 Oct 28 19:33:11.874655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2558/5104] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:11 2022] GET /compute/v2.1/servers/10edd313-26a6-40c7-87c9-2804f0f53589 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:11.897275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:11.902920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:11.935172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:11.935678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:11.936116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:11.936842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:11.937452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:11.937883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:12.009290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:33:12.018535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-919984471", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a47d2cc8-a23e-4336-8eed-4c4e99914f0b"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:12.189841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] validate_networks() for [('a47d2cc8-a23e-4336-8eed-4c4e99914f0b', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:33:12.274487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-244bc526-7190-495d-8869-a1addeba42a7 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 204 len: 0 microversion: 2.1 time: 0.392119 Oct 28 19:33:12.281411 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2559/5105] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:33:11 2022] DELETE /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:12.313815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:12.314568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:12.332800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:12.333328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:12.336941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:12.337816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:12.338304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:12.338767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:12.799890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:12.813439 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b96f8ed-ec4e-4bf9-b541-748258502914 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1472 microversion: 2.1 time: 0.530548 Oct 28 19:33:12.814403 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2560/5106] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:12 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:12.825772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:12.827287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:12.845427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:12.846842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:12.848460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:12.865016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:12.865358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:12.869812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:13.509169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:13.522059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:13.523757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:13.527754 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-90914a84-b09b-4189-a6fd-9a6e232c137d tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.708587 Oct 28 19:33:13.530515 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2561/5107] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:12 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:13.837441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:13.838399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:13.850870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:13.851558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:13.852167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:13.856868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:13.858066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:13.862477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:13.871240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:33:13.872133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:33:13.872624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:33:13.873042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:33:13.873457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:33:13.892641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:13.893152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:13.893598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:13.894530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:13.894853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:13.895734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:13.968380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Getting quotas for project 4afd52f67f99402ea6cc16e07198ddf3. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:13.974534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Getting quotas for user 436808b51190481698a29bb7af6ebb26 and project 4afd52f67f99402ea6cc16e07198ddf3. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:14.013264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:33:14.016114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:33:14.160874 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-acc50037-fe0c-41da-9a12-d8567972b8ba tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.542522 Oct 28 19:33:14.167094 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2547/5108] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:33:14.173124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6edeb51d-80b3-48be-8277-3bedcd331d30 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:14.175513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6edeb51d-80b3-48be-8277-3bedcd331d30 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:14.262953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:14.284097 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e8666b8-7f47-469f-a29c-2e510dc0e97d tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1472 microversion: 2.1 time: 0.450612 Oct 28 19:33:14.284720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2562/5109] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:13 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:14.292388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6edeb51d-80b3-48be-8277-3bedcd331d30 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:14.301563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6edeb51d-80b3-48be-8277-3bedcd331d30 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1227 microversion: 2.1 time: 0.132714 Oct 28 19:33:14.306225 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2548/5110] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:14 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1227 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:14.557238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:14.557999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:14.576935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:14.577442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:14.591338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:14.592352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:14.593933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:14.595377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:15.061683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:15.083347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:15.089260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:15.093441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-024b68bf-041c-42de-98b1-fde55ecfba44 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.539375 Oct 28 19:33:15.096468 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2563/5111] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:14 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:15.308303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:15.309716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:15.336164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:15.336500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e28eecb6-ca34-400e-90cd-22d84f47e93c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:15.337183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e28eecb6-ca34-400e-90cd-22d84f47e93c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:15.338004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:15.338817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:15.342533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:15.343291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:15.360254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:15.431463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e28eecb6-ca34-400e-90cd-22d84f47e93c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:15.440486 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e28eecb6-ca34-400e-90cd-22d84f47e93c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1227 microversion: 2.1 time: 0.108296 Oct 28 19:33:15.446024 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2564/5112] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:15 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1227 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:15.586057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36699f62b10a4e0f98942f73d3df0e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6197c092ced4555b66f6d086a17628c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:15.610851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94eb5862-5150-4deb-8e62-741e6551a206 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 200 len: 1430 microversion: 2.1 time: 0.299376 Oct 28 19:33:15.616974 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2549/5113] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:15 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 1430 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:15.627824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4959d062-c635-4dec-b036-5915f4808d9b req-08bcb5d7-41b8-47c8-861b-2e665c37f88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260", "name": "network-vif-deleted", "tag": "10da30ff-8748-4bd8-a70a-f6be7f15a747"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:15.651508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4959d062-c635-4dec-b036-5915f4808d9b req-08bcb5d7-41b8-47c8-861b-2e665c37f88f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:15.659493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4959d062-c635-4dec-b036-5915f4808d9b req-08bcb5d7-41b8-47c8-861b-2e665c37f88f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:15.667711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4959d062-c635-4dec-b036-5915f4808d9b req-08bcb5d7-41b8-47c8-861b-2e665c37f88f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:15.700465 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4959d062-c635-4dec-b036-5915f4808d9b req-08bcb5d7-41b8-47c8-861b-2e665c37f88f service nova] Creating event network-vif-deleted:10da30ff-8748-4bd8-a70a-f6be7f15a747 for instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 on n-h1-862769-3 Oct 28 19:33:15.728514 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4959d062-c635-4dec-b036-5915f4808d9b req-08bcb5d7-41b8-47c8-861b-2e665c37f88f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103996 Oct 28 19:33:15.729647 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2565/5114] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:16.127900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:16.130935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:16.157802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:16.163351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:16.169452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:16.173017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:16.175870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:16.180044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:16.474481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:16.475297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:16.504777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:16.505984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:16.508007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:16.511984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:16.514897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:16.515357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:16.821963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:16.832359 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35488ab9-d423-4a95-a32a-462e2186255b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1287 microversion: 2.1 time: 0.365818 Oct 28 19:33:16.843840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2566/5115] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:16 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1287 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:16.850737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:16.851724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] [instance: edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:16.864381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:16.865622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:16.866350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:16.867618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:16.868489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:16.869470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:16.888229 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] HTTP exception thrown: Instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 could not be found. Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Request method failure captured: Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 HTTP/1.1 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC3Q8fLJJlTFvzWC3EbiHxgSxUpB5MxQRjxDArX33IGPP5nY5rVWncM34_8_tH2Bui36UvbFdETpCA2yALhkxZyzS8B3EdZjFoGAIr7zk0RiPQ1rl2svjaEI7odU_PlRIkLkZAwu8qwVH1Sak6LjY9Vjz2Km_6JAxjaMH1TkYywzl9Y Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: c6197c092ced4555b66f6d086a17628c Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ListImageFiltersTestJSON-1577935404 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c6197c092ced4555b66f6d086a17628c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c6197c092ced4555b66f6d086a17628c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c6197c092ced4555b66f6d086a17628c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c6197c092ced4555b66f6d086a17628c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ListImageFiltersTestJSON-1577935404 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: c6197c092ced4555b66f6d086a17628c Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1577935404 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ListImageFiltersTestJSON-1577935404-project Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 36699f62b10a4e0f98942f73d3df0e71 Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ListImageFiltersTestJSON-1577935404-project Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 could not be found. Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260'} Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 could not be found. Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 could not be found. Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:16.890411 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 could not be found. Oct 28 19:33:16.895110 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:16.897734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Returning 404 to user: Instance edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:16.903591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14e75871-1d55-42aa-9691-f21b7bca2a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260" status: 404 len: 111 microversion: 2.1 time: 0.057363 Oct 28 19:33:16.904851 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2567/5116] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:16 2022] GET /compute/v2.1/servers/edbf3dc5-4cf7-4d4d-9f82-2e237f6b0260 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:16.919355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-456961da-6339-40ce-998f-5ea820373159 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d769bbd30>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:16.969293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:16.988518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:16.996011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:17.000876 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca1cd885-8fac-4468-86ae-07458a618b67 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.877698 Oct 28 19:33:17.004406 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2550/5117] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:16 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:17.471688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-debb93cb-849f-47e6-9d6d-8cf5b304b0f9 req-c550c73b-ac79-4d0a-a004-b15adb734242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "name": "network-vif-plugged", "status": "completed", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:17.512833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-debb93cb-849f-47e6-9d6d-8cf5b304b0f9 req-c550c73b-ac79-4d0a-a004-b15adb734242 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:17.516842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-debb93cb-849f-47e6-9d6d-8cf5b304b0f9 req-c550c73b-ac79-4d0a-a004-b15adb734242 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:17.518894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-debb93cb-849f-47e6-9d6d-8cf5b304b0f9 req-c550c73b-ac79-4d0a-a004-b15adb734242 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:17.574450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-debb93cb-849f-47e6-9d6d-8cf5b304b0f9 req-c550c73b-ac79-4d0a-a004-b15adb734242 service nova] Creating event network-vif-plugged:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h1-862769-3 Oct 28 19:33:17.585843 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-debb93cb-849f-47e6-9d6d-8cf5b304b0f9 req-c550c73b-ac79-4d0a-a004-b15adb734242 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118408 Oct 28 19:33:17.586625 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2551/5118] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:33:17.870226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:17.871845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:17.888823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:17.889719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:17.892136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:17.893158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:17.898042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:17.898841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:18.026859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:18.038744 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f8f9ac8-1c69-4635-929b-1ce9ef9a4d3d tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1285 microversion: 2.1 time: 0.173797 Oct 28 19:33:18.039359 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2552/5119] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:17 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:18.066893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:18.076493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:18.095597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:18.097197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:18.100631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:18.101595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:18.104894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:18.105569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:18.262523 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-456961da-6339-40ce-998f-5ea820373159 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/images/85c18ef6-9268-4dc4-b490-7ba729032416" status: 204 len: 0 microversion: 2.1 time: 1.351204 Oct 28 19:33:18.266586 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2568/5120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:16 2022] DELETE /compute/v2.1/images/85c18ef6-9268-4dc4-b490-7ba729032416 => generated 0 bytes in 1354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:18.272508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6bb099e0-5600-4dc3-b6e4-c4700f917a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76bb7940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:18.427669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:18.436954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:18.438389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:18.439616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-070fd11f-f09f-4042-afb3-c72221a4b3ef tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 0.390960 Oct 28 19:33:18.467370 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2553/5121] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:18 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:19.074231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:19.075299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:19.090488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:19.092016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:19.093693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:19.096685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:19.097376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:19.097942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:19.291026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:19.311388 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4876ec2e-caaa-40cb-a8b6-6b3aaf9e4f4c tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1285 microversion: 2.1 time: 0.250585 Oct 28 19:33:19.314250 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2554/5122] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:19 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:19.359920 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6bb099e0-5600-4dc3-b6e4-c4700f917a82 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/images/abc80c94-41dc-47ee-9f0d-2affab790949" status: 204 len: 0 microversion: 2.1 time: 1.092074 Oct 28 19:33:19.369861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8dae4f16-33a1-420a-b95d-d5580dfea5c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] Calling method '.version_select at 0x7f1d76c95670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:19.370115 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2569/5123] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:18 2022] DELETE /compute/v2.1/images/abc80c94-41dc-47ee-9f0d-2affab790949 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:19.469498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:19.470371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:19.488524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:19.493239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:19.496081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:19.500040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:19.501902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:19.504159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:20.265389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8dae4f16-33a1-420a-b95d-d5580dfea5c3 tempest-ListImageFiltersTestJSON-1577935404 tempest-ListImageFiltersTestJSON-1577935404-project] 10.222.0.44 "DELETE /compute/v2.1/images/12463ae8-0d6d-4877-bd5c-d54c9a7765f1" status: 204 len: 0 microversion: 2.1 time: 0.900404 Oct 28 19:33:20.266165 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2555/5124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:19 2022] DELETE /compute/v2.1/images/12463ae8-0d6d-4877-bd5c-d54c9a7765f1 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:20.337867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:20.339409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:20.354809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:20.356297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:20.367540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:20.368664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:20.375963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:20.376638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:21.665100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:21.681240 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9bfcfc2b-a029-47ab-baf5-912147cd0129 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 1.347013 Oct 28 19:33:21.682236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2556/5125] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:20 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:21.705011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:21.726226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:21.727720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:21.728967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b1aef14a-157d-474a-ae24-36652862e212 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1807 microversion: 2.20 time: 2.263488 Oct 28 19:33:21.729579 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2570/5126] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:19 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1807 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:22.706325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:22.706972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:22.728745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:22.729465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:22.730041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:22.732599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:22.734135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:22.734794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:22.767231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:22.769638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:22.802406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:22.802943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:22.803381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:22.804102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:22.805156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:22.805156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:22.921069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:23.645950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:23.648677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=71 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:23.661705 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-641b87a4-54f8-48c5-a941-bf883ce98196 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.959700 Oct 28 19:33:23.663853 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2557/5127] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:22 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:23.726097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:23.739277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:23.745403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:23.748990 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce4e7219-a14d-4b13-9aef-3b8bf204bf0b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1794 microversion: 2.20 time: 0.986259 Oct 28 19:33:23.752193 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2571/5128] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:33:22 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1794 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:33:23.934389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:24.301342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:24.505757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-790fb449-833e-4bc1-b732-b52b1fb5b977 req-63f72086-21ba-441d-90e4-25e313d410f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ed6470-5b4f-4a7c-bcdf-56a297b4f740", "tag": "4b1dcb1f-f50d-4d36-902e-b6b01ad536be"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:24.549685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:24.552083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-790fb449-833e-4bc1-b732-b52b1fb5b977 req-63f72086-21ba-441d-90e4-25e313d410f6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:24.559350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-790fb449-833e-4bc1-b732-b52b1fb5b977 req-63f72086-21ba-441d-90e4-25e313d410f6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:24.560428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-790fb449-833e-4bc1-b732-b52b1fb5b977 req-63f72086-21ba-441d-90e4-25e313d410f6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:24.647853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-790fb449-833e-4bc1-b732-b52b1fb5b977 req-63f72086-21ba-441d-90e4-25e313d410f6 service nova] Creating event network-changed:4b1dcb1f-f50d-4d36-902e-b6b01ad536be for instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 on n-h2-862769-3 Oct 28 19:33:24.656099 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-790fb449-833e-4bc1-b732-b52b1fb5b977 req-63f72086-21ba-441d-90e4-25e313d410f6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.803087 Oct 28 19:33:24.661791 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2558/5129] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:24.695034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:24.695965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:24.712135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:24.712654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:24.713110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:24.713857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:24.717178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:24.719998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:25.336076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:25.365990 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-529910c4-ef52-4370-a1de-db60d16a0b73 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.678671 Oct 28 19:33:25.367016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2572/5130] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:24 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:26.110641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-138efb5e-1c0c-4a41-8373-bb1852b42879 tempest-ListImageFiltersNegativeTestJSON-720899782 tempest-ListImageFiltersNegativeTestJSON-720899782-project] Calling method '.version_select at 0x7f1d779281f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:26.151921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-138efb5e-1c0c-4a41-8373-bb1852b42879 tempest-ListImageFiltersNegativeTestJSON-720899782 tempest-ListImageFiltersNegativeTestJSON-720899782-project] HTTP exception thrown: Image not found. Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-138efb5e-1c0c-4a41-8373-bb1852b42879 tempest-ListImageFiltersNegativeTestJSON-720899782 tempest-ListImageFiltersNegativeTestJSON-720899782-project] Request method failure captured: Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/images/db2c2cc0-a19d-4fc7-8451-c77662df4c4b HTTP/1.1 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC6FUOmpxHTdRsMCWAhj8A8o9jwrHy0rWVYhMI2FY93taxbKtwkcFgv_MTPtojMZ7MKsf_IiqnwENOv_JYLq2SIK6WFoLWqpRsXNS62jNoGRTEFBvdAvwMaUcNEZQWtxwzmRcBNuKPBbvtx1KFUbRDvzUE2ujwnuk53K7JKCJbPcLfw Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 15d19bc654e3492f8bc94a7fc667288a Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-720899782 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/15d19bc654e3492f8bc94a7fc667288a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_15d19bc654e3492f8bc94a7fc667288a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/15d19bc654e3492f8bc94a7fc667288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/15d19bc654e3492f8bc94a7fc667288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-720899782 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 15d19bc654e3492f8bc94a7fc667288a Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-720899782 Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ListImageFiltersNegativeTestJSON-720899782-project Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 154a3ffa97d0492886114ceb136fa46a Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-720899782-project Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: exception: Image not found. Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'db2c2cc0-a19d-4fc7-8451-c77662df4c4b'} Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db2c2cc0-a19d-4fc7-8451-c77662df4c4b Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 19:33:26.161317 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db2c2cc0-a19d-4fc7-8451-c77662df4c4b could not be found. Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-138efb5e-1c0c-4a41-8373-bb1852b42879 tempest-ListImageFiltersNegativeTestJSON-720899782 tempest-ListImageFiltersNegativeTestJSON-720899782-project] Returning 404 to user: Image not found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-138efb5e-1c0c-4a41-8373-bb1852b42879 tempest-ListImageFiltersNegativeTestJSON-720899782 tempest-ListImageFiltersNegativeTestJSON-720899782-project] 10.222.0.44 "GET /compute/v2.1/images/db2c2cc0-a19d-4fc7-8451-c77662df4c4b" status: 404 len: 62 microversion: 2.1 time: 0.523088 Oct 28 19:33:26.170780 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2559/5131] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 19:33:25 2022] GET /compute/v2.1/images/db2c2cc0-a19d-4fc7-8451-c77662df4c4b => generated 62 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:33:26.391300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:26.391969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:26.401011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:26.404292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:26.404789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:26.405225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:26.405941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:26.406395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:26.406849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:27.255124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:27.266313 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe05bf92-61a9-4dc7-b607-88c3462d2aaf tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.879449 Oct 28 19:33:27.268942 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2573/5132] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:26 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:28.295214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:28.296109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:28.312696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:28.316481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:28.317124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:28.318165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:28.325942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:28.326969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:28.666973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:28.680651 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf8919ac-cb54-4147-87db-05f5e84bc4d5 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.391505 Oct 28 19:33:28.681255 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2560/5133] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:28 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:29.734133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:29.735778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:29.764331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:29.769856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:29.770318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:29.775453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:29.780189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:29.780740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:30.234175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:30.251780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-51d336db-d97c-4a1b-a38d-1db0af4d1f55 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.523435 Oct 28 19:33:30.252704 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2574/5134] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:29 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:30.927367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7da4fd65-7063-4ddf-9757-77573cdd932d req-83abe2d2-aacb-414a-8872-055943e0f69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ed6470-5b4f-4a7c-bcdf-56a297b4f740", "name": "network-vif-plugged", "status": "completed", "tag": "4b1dcb1f-f50d-4d36-902e-b6b01ad536be"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:30.955699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7da4fd65-7063-4ddf-9757-77573cdd932d req-83abe2d2-aacb-414a-8872-055943e0f69b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:30.956643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7da4fd65-7063-4ddf-9757-77573cdd932d req-83abe2d2-aacb-414a-8872-055943e0f69b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:30.957301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7da4fd65-7063-4ddf-9757-77573cdd932d req-83abe2d2-aacb-414a-8872-055943e0f69b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:30.998632 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7da4fd65-7063-4ddf-9757-77573cdd932d req-83abe2d2-aacb-414a-8872-055943e0f69b service nova] Creating event network-vif-plugged:4b1dcb1f-f50d-4d36-902e-b6b01ad536be for instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 on n-h2-862769-3 Oct 28 19:33:31.017700 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7da4fd65-7063-4ddf-9757-77573cdd932d req-83abe2d2-aacb-414a-8872-055943e0f69b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.603727 Oct 28 19:33:31.034580 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2561/5135] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:31.282898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:31.283609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:31.295539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:31.296060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:31.296508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:31.311897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:31.312515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:31.312974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:31.538888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62102a1c-7972-4d5f-82f5-cdece7eeb5f3 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d77bf2280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG8ie5WUfIOW/z+DEd5Js3TLRb7DmxfKnhG2oU59Bpytpegw1MSo72jr3X+PK7lkeDM7AFEfczysv5HKWoLM3KWfmxkPJFPI5zk6L1jiCIdztqbId3Lgk1IHjjeoYqg8g=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62102a1c-7972-4d5f-82f5-cdece7eeb5f3 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 257 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG8ie5WUfIOW/z+DEd5Js3TLRb7DmxfKnhG2oU59Bpytpegw1MSo72jr3X+PK7lkeDM7AFEfczysv5HKWoLM3KWfmxkPJFPI5zk6L1jiCIdztqbId3Lgk1IHjjeoYqg8g=="}} Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG8ie5WUfIOW/z+DEd5Js3TLRb7DmxfKnhG2oU59Bpytpegw1MSo72jr3X+PK7lkeDM7AFEfczysv5HKWoLM3KWfmxkPJFPI5zk6L1jiCIdztqbId3Lgk1IHjjeoYqg8g=='}}} Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 28 19:33:31.551985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 19:33:31.555277 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.558111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62102a1c-7972-4d5f-82f5-cdece7eeb5f3 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:31.565131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62102a1c-7972-4d5f-82f5-cdece7eeb5f3 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.760212 Oct 28 19:33:31.574802 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2575/5136] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:30 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 774 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:33:31.585277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d80094d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-566461786", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:31.623456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:31.629814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for user 748963c218bb4175a7c7297cd7410ae8 and project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:31.663087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:31.712587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 2166 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-566461786", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:33:31.716108 n-d-862769-3 devstack@n-api.service[120629]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-566461786', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:31.717794 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:31.719891 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:31.723266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:31.724732 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6587c972-9406-455d-ad97-2f1432cfd521 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.148134 Oct 28 19:33:31.733006 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e1316767-8454-4997-928a-8bf7dd0bd61f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.456166 Oct 28 19:33:31.735147 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2576/5137] 10.222.0.44 () {60 vars in 1160 bytes} [Fri Oct 28 19:33:31 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:33:31.740294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-645a3ab9-f0e0-42fd-a62c-79afb302d15b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d7691af70>, body: {"keypair": {"name": "tempest-keypair-62016990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdfjlq5hySCia43qgGlw8w7slTDdN4zIsNEYC5hD5wTu0TQuTlvoFki39HZTyunOazI4vNej0L8iuKDwTNFHXFIhIm54+CQ+AmlKn3ORrU3fQrYYbfp20Ds0WKYUM4PIQ=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:31.755414 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2562/5138] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:31 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:31.758089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-645a3ab9-f0e0-42fd-a62c-79afb302d15b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:31.774944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-645a3ab9-f0e0-42fd-a62c-79afb302d15b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for user 748963c218bb4175a7c7297cd7410ae8 and project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:31.825471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-645a3ab9-f0e0-42fd-a62c-79afb302d15b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.089052 Oct 28 19:33:31.826131 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2577/5139] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:31.840398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d76ad24c0>, body: {"keypair": {"name": "tempest-keypair-62016990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUTi4/AoDsEej5/efLE3OzDezx+LOuTbhVbVEHmkdgX+HCjakCh1JkjqdJQDhe1hkTuyFz+o5k1qrUCK88bY4gwIhFA7WyVDY9f0GtiNevNPtIlBod/Z3gOQRfgBzlQ1Q=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:31.876830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:31.895264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for user 748963c218bb4175a7c7297cd7410ae8 and project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:32.022929 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] HTTP exception thrown: Key pair 'tempest-keypair-62016990' already exists. Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 271 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: {"keypair": {"name": "tempest-keypair-62016990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUTi4/AoDsEej5/efLE3OzDezx+LOuTbhVbVEHmkdgX+HCjakCh1JkjqdJQDhe1hkTuyFz+o5k1qrUCK88bY4gwIhFA7WyVDY9f0GtiNevNPtIlBod/Z3gOQRfgBzlQ1Q=="}} Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: exception: Key pair 'tempest-keypair-62016990' already exists. Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-62016990', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUTi4/AoDsEej5/efLE3OzDezx+LOuTbhVbVEHmkdgX+HCjakCh1JkjqdJQDhe1hkTuyFz+o5k1qrUCK88bY4gwIhFA7WyVDY9f0GtiNevNPtIlBod/Z3gOQRfgBzlQ1Q=='}}} Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result.read() Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '748963c218bb4175a7c7297cd7410ae8-tempest-keypair-62016990' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 19:33:32.027540 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result.read() Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 19:33:32.031786 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '748963c218bb4175a7c7297cd7410ae8-tempest-keypair-62016990' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 19, 33, 31, 999927), 'updated_at': None, 'name': 'tempest-keypair-62016990', 'user_id': '748963c218bb4175a7c7297cd7410ae8', 'fingerprint': '2b:d4:bd:41:d7:1a:5f:70:5a:15:7b:01:d2:95:fb:06', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUTi4/AoDsEej5/efLE3OzDezx+LOuTbhVbVEHmkdgX+HCjakCh1JkjqdJQDhe1hkTuyFz+o5k1qrUCK88bY4gwIhFA7WyVDY9f0GtiNevNPtIlBod/Z3gOQRfgBzlQ1Q==', 'type': 'ssh'}] Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi keypair.create() Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._create() Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-62016990' already exists. Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 28 19:33:32.035396 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-62016990' already exists. Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-62016990' already exists. Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 409 to user: Key pair 'tempest-keypair-62016990' already exists. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-979b6f5d-17f7-4e51-8c2e-da47ed698b40 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.193322 Oct 28 19:33:32.040490 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2563/5140] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:31 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 19:33:32.047435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34877460-35a3-48cb-9bd1-6213295310bc tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Calling method '.version_select at 0x7f1d771ff550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:32.081896 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34877460-35a3-48cb-9bd1-6213295310bc tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62016990" status: 202 len: 0 microversion: 2.1 time: 0.040247 Oct 28 19:33:32.083649 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2578/5141] 10.222.0.44 () {58 vars in 1215 bytes} [Fri Oct 28 19:33:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62016990 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:33:32.097236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b5beb90-acbf-49d6-8bb8-3d801b592914 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d76ac79d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtdeGbs4pOrmsjuiaPG94x5bTyNj8ZroCiMaCgYIY3X8naDHhPragY0s4VeEO+fgj/I9YYOsOXm7V0crGdI4QroYbJnjZhUX82XbS5We6cOJ6KGs8EWtFFsYoEmigof8g=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b5beb90-acbf-49d6-8bb8-3d801b592914 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 247 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtdeGbs4pOrmsjuiaPG94x5bTyNj8ZroCiMaCgYIY3X8naDHhPragY0s4VeEO+fgj/I9YYOsOXm7V0crGdI4QroYbJnjZhUX82XbS5We6cOJ6KGs8EWtFFsYoEmigof8g=="}} Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtdeGbs4pOrmsjuiaPG94x5bTyNj8ZroCiMaCgYIY3X8naDHhPragY0s4VeEO+fgj/I9YYOsOXm7V0crGdI4QroYbJnjZhUX82XbS5We6cOJ6KGs8EWtFFsYoEmigof8g=='}}} Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '' Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:33:32.102017 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 19:33:32.106429 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.108105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b5beb90-acbf-49d6-8bb8-3d801b592914 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:32.110858 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7b5beb90-acbf-49d6-8bb8-3d801b592914 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017904 Oct 28 19:33:32.121994 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2564/5142] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:32 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:33:32.124592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d77e79c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1258149994", "public_key": " "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:32.142566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:32.152849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for user 748963c218bb4175a7c7297cd7410ae8 and project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:32.175989 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 95 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1258149994", "public_key": " "}} Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1258149994', 'public_key': ' '}}} Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.178169 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.182076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.184716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:32.185762 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-239f5fc7-0468-4e1c-abee-e00d2362e340 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067861 Oct 28 19:33:32.193571 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2579/5143] 10.222.0.44 () {60 vars in 1158 bytes} [Fri Oct 28 19:33:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:33:32.203985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd0266b9-d3a5-4238-80ab-3bf4fb1a6e90 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d773929d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXVnbc5hk2kv9+OYWYCiLkCJHUwB/YMI7XE4Hhxk3iHw1xa1LLTW4uF4zFsEinaBNsyEm7sYbQIdfbZ4ShvASkH4kMHuM1T2ZYRpNu3486WU3FkrIE4oL/h573Xnec9TA=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd0266b9-d3a5-4238-80ab-3bf4fb1a6e90 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 507 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXVnbc5hk2kv9+OYWYCiLkCJHUwB/YMI7XE4Hhxk3iHw1xa1LLTW4uF4zFsEinaBNsyEm7sYbQIdfbZ4ShvASkH4kMHuM1T2ZYRpNu3486WU3FkrIE4oL/h573Xnec9TA=="}} Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXVnbc5hk2kv9+OYWYCiLkCJHUwB/YMI7XE4Hhxk3iHw1xa1LLTW4uF4zFsEinaBNsyEm7sYbQIdfbZ4ShvASkH4kMHuM1T2ZYRpNu3486WU3FkrIE4oL/h573Xnec9TA=='}}} Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 19:33:32.213023 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 19:33:32.216399 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.222389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd0266b9-d3a5-4238-80ab-3bf4fb1a6e90 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:32.225103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd0266b9-d3a5-4238-80ab-3bf4fb1a6e90 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.029386 Oct 28 19:33:32.231844 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2565/5144] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:32 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:33:32.241895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Action: 'create', calling method: .version_select at 0x7f1d76ab7040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1349456280", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:32.277762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:32.305089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Getting quotas for user 748963c218bb4175a7c7297cd7410ae8 and project e6401edb136946838784fd1d9c53f07d. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:32.334359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:32.348661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 118 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1349456280", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1349456280', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 19:33:32.350992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 19:33:32.355041 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.357062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:32.358322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5d30045-bb18-4ead-9f3f-4a61f1f7522b tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.126277 Oct 28 19:33:32.359271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2580/5145] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 19:33:32.370282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d78e25f-0a65-4464-8c8a-405b9e806138 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Calling method '.version_select at 0x7f1d76ac7820>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:32.385649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4d78e25f-0a65-4464-8c8a-405b9e806138 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-449982806 not found for user 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d78e25f-0a65-4464-8c8a-405b9e806138 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Request method failure captured: Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-449982806 HTTP/1.1 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC6K7G_-fL2CGQDPEydiDHG3SFANuxnT_EKmKzfsyuX2Lwj8r0q2SANDhgo84-2BfyLhD0jbkFuAL9Yhva9wvjcqRxrBUYwd-Kh_x7hsM-Rmz2-M57Ivpsu9KQYtLfvrQqZwi3cwCD7BmKM6MjXLtqik1Dc6KTpb2nR65b98c-gwhIY Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6401edb136946838784fd1d9c53f07d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6401edb136946838784fd1d9c53f07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e6401edb136946838784fd1d9c53f07d Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-735286200 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-KeyPairsNegativeTestJSON-735286200-project Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: method: Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: exception: Keypair tempest-keypair-non-existent-449982806 not found for user 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'tempest-keypair-non-existent-449982806'} Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-449982806 not found for user 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.392649 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-449982806 not found for user 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-449982806 not found for user 748963c218bb4175a7c7297cd7410ae8 Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d78e25f-0a65-4464-8c8a-405b9e806138 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] Returning 404 to user: Keypair tempest-keypair-non-existent-449982806 not found for user 748963c218bb4175a7c7297cd7410ae8 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:32.396278 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d78e25f-0a65-4464-8c8a-405b9e806138 tempest-KeyPairsNegativeTestJSON-735286200 tempest-KeyPairsNegativeTestJSON-735286200-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-449982806" status: 404 len: 144 microversion: 2.1 time: 0.031542 Oct 28 19:33:32.397949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2566/5146] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 19:33:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-449982806 => generated 144 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:32.761153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:32.762391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:32.795617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:32.796381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:32.796976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:32.797853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:32.802788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:32.803462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:33.595904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:33.630121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-389740c9-3a10-4620-a0a3-052f5104ee75 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1327 microversion: 2.1 time: 0.866619 Oct 28 19:33:33.632101 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2581/5147] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:32 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1327 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:34.660388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:34.661193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:34.694804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:34.695801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:34.696463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:34.698157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:34.700571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:34.701351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:34.971283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:34.983269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-32baf72d-6fbc-4e32-97fe-447e3a06e1b6 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1527 microversion: 2.1 time: 0.329514 Oct 28 19:33:34.984390 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2567/5148] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:34 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1527 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:35.007965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:35.009690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:35.019044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:35.019557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:35.019977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:35.020731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:35.021185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:35.021607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:35.383466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:35.396152 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4284298e-a725-4a42-9cc7-2d81b6ba563b tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1527 microversion: 2.1 time: 0.392846 Oct 28 19:33:35.398444 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2582/5149] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:35 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1527 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:35.758628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:35.761301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:35.775019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:35.775740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:35.776372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:35.777815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:35.780891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:35.781688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:35.814255 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] HTTP exception thrown: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Request method failure captured: Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 HTTP/1.1 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC52Il5SSGeAT7uz_4W-69SePovYh42-DwvW03gDjVHuU2x1CeY8y7dcmLAFd2u6rN76PF2Hx7mmMNg3JgbBlQS8rNfxkc63nmVdITHYGjE_b4QbRJPkPQgzhxJVOneKo3UdJjKkfK2wNNcCjE6SZiqcmEzw0CetyQ3Ri_WkZq-b-zY Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ce6dae7b3db646cf9caff2f8342eeb1d Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2054011631 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce6dae7b3db646cf9caff2f8342eeb1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce6dae7b3db646cf9caff2f8342eeb1d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce6dae7b3db646cf9caff2f8342eeb1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce6dae7b3db646cf9caff2f8342eeb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2054011631 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ce6dae7b3db646cf9caff2f8342eeb1d Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2054011631 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2054011631-project Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 032288311af54ff4b0e1114819b94496 Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2054011631-project Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '17ed6470-5b4f-4a7c-bcdf-56a297b4f740'} Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:33:35.815901 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:35.819168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Returning 404 to user: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:35.823071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2e87fcb2-06a1-4ecb-af0a-3c06b9250cf2 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] 10.222.0.44 "DELETE /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 404 len: 111 microversion: 2.1 time: 0.401207 Oct 28 19:33:35.830892 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2568/5150] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:33:35 2022] DELETE /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 111 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:35.835953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:35.836576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:35.853456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:35.855366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:35.855853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:35.856648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:35.857126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:35.857557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:36.272481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:36.301917 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4198410d-6230-4870-bbc8-5d69a99b9a90 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1527 microversion: 2.1 time: 0.470956 Oct 28 19:33:36.326650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Action: 'update', calling method: >, body: {"server": {"name": "17ed6470-5b4f-4a7c-bcdf-56a297b4f740_new"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:36.331148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:36.345007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:36.345929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:36.346803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:36.347303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2583/5151] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:35 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1527 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:36.348006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:36.348874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:36.349569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:36.384937 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] HTTP exception thrown: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Request method failure captured: Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: request: PUT /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 HTTP/1.1 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 64 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC52Il5SSGeAT7uz_4W-69SePovYh42-DwvW03gDjVHuU2x1CeY8y7dcmLAFd2u6rN76PF2Hx7mmMNg3JgbBlQS8rNfxkc63nmVdITHYGjE_b4QbRJPkPQgzhxJVOneKo3UdJjKkfK2wNNcCjE6SZiqcmEzw0CetyQ3Ri_WkZq-b-zY Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ce6dae7b3db646cf9caff2f8342eeb1d Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2054011631 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ce6dae7b3db646cf9caff2f8342eeb1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ce6dae7b3db646cf9caff2f8342eeb1d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce6dae7b3db646cf9caff2f8342eeb1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ce6dae7b3db646cf9caff2f8342eeb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2054011631 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ce6dae7b3db646cf9caff2f8342eeb1d Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2054011631 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2054011631-project Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 032288311af54ff4b0e1114819b94496 Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2054011631-project Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: {"server": {"name": "17ed6470-5b4f-4a7c-bcdf-56a297b4f740_new"}} Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '17ed6470-5b4f-4a7c-bcdf-56a297b4f740', 'body': {'server': {'name': '17ed6470-5b4f-4a7c-bcdf-56a297b4f740_new'}}} Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:33:36.387049 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:36.390203 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:36.399060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] Returning 404 to user: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:36.400230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0452cae8-0d25-447c-a81a-7113a5775a78 tempest-ServersNegativeTestMultiTenantJSON-2054011631 tempest-ServersNegativeTestMultiTenantJSON-2054011631-project] 10.222.0.44 "PUT /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 404 len: 111 microversion: 2.1 time: 0.077797 Oct 28 19:33:36.405730 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2569/5152] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 19:33:36 2022] PUT /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:36.411968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:36.412883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:36.433036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:36.433665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:36.434106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:36.438187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:36.438187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:36.438715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:36.524272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:33:36.702280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b54a35e7-4c78-4b05-a3a9-fe23d4e0bb7f tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 204 len: 0 microversion: 2.1 time: 0.294782 Oct 28 19:33:36.718225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:36.719016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:36.729858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2584/5153] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:33:36 2022] DELETE /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:36.734359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:36.734929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:36.735369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:36.736444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:36.736741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:36.737156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:37.037099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:37.069323 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd91369c-8cc0-43dd-bf02-e69150ed87d1 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1533 microversion: 2.1 time: 0.346205 Oct 28 19:33:37.084532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2570/5154] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:36 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1533 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:37.145490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Calling method '.version_select at 0x7f1d772b8430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:37.181357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:37.181873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:37.182318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:37.184614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:37.185101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:37.189564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:37.246562 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55e57075-cdda-4ecc-843c-4fc944c15c18 tempest-AbsoluteLimitsTestJSON-282450684 tempest-AbsoluteLimitsTestJSON-282450684-project] 10.222.0.44 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.395954 Oct 28 19:33:37.247755 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2585/5155] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 19:33:36 2022] GET /compute/v2.1/limits => generated 511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:38.103004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:38.104979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:38.135678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:38.137248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:38.139728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:38.142732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:38.146767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:38.149601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:38.460417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:38.474805 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24f3fcec-8930-43de-8a6e-286f83d43397 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1533 microversion: 2.1 time: 0.379435 Oct 28 19:33:38.475437 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2571/5156] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:38 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1533 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:39.500930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:39.502238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:39.513659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:39.518950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:39.519617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:39.521525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:39.522197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:39.525087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:39.866173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:39.876381 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27466f37-8630-417b-9f55-a9b2cf5b0417 tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1533 microversion: 2.1 time: 0.379977 Oct 28 19:33:39.880117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2586/5157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:39 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1533 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:40.286630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8e310a0b-2510-4464-a84a-31e9e0c96b53 req-01b7f0b6-dd75-460f-8c95-b3bf1cf93b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ed6470-5b4f-4a7c-bcdf-56a297b4f740", "name": "network-vif-deleted", "tag": "4b1dcb1f-f50d-4d36-902e-b6b01ad536be"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:40.338954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e310a0b-2510-4464-a84a-31e9e0c96b53 req-01b7f0b6-dd75-460f-8c95-b3bf1cf93b6e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:40.343411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e310a0b-2510-4464-a84a-31e9e0c96b53 req-01b7f0b6-dd75-460f-8c95-b3bf1cf93b6e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:40.344131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8e310a0b-2510-4464-a84a-31e9e0c96b53 req-01b7f0b6-dd75-460f-8c95-b3bf1cf93b6e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:40.402651 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8e310a0b-2510-4464-a84a-31e9e0c96b53 req-01b7f0b6-dd75-460f-8c95-b3bf1cf93b6e service nova] Creating event network-vif-deleted:4b1dcb1f-f50d-4d36-902e-b6b01ad536be for instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 on n-h2-862769-3 Oct 28 19:33:40.437516 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8e310a0b-2510-4464-a84a-31e9e0c96b53 req-01b7f0b6-dd75-460f-8c95-b3bf1cf93b6e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150368 Oct 28 19:33:40.438447 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2572/5158] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:40.910763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:40.915503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:40.940923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:40.941412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:40.941841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:40.942601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:40.951337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:40.959118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:41.073006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:41.074307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:41.074958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:41.075719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lazy-loading 'fault' on Instance uuid 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:33:41.252463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436808b51190481698a29bb7af6ebb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afd52f67f99402ea6cc16e07198ddf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:41.260019 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5bc4ad9-339e-421d-8853-e4e5f5f640db tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 200 len: 1317 microversion: 2.1 time: 0.355540 Oct 28 19:33:41.260613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2587/5159] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:40 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:42.294497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:42.299429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:42.300498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] [instance: 17ed6470-5b4f-4a7c-bcdf-56a297b4f740] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:42.321962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:42.322760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:42.326463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:42.327408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:42.328015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:42.328583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:42.359525 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] HTTP exception thrown: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Request method failure captured: Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 HTTP/1.1 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC5eoRSq5pB2OByuenASOUIbLfyDiz_YlcuCV3EFsCbEz_UGV0S01o4yCz2W--GzZ6Hi0AEzm5ZdS17usbkD-5wJP4cwbBcp10r17C_Js6IZmPWMyR8UWkk0FZ8Hp4YX081e12gIOCCUDSwb7Ap6ZI-SHTlu2-rxNO6nRMzmGNE0eb0 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 4afd52f67f99402ea6cc16e07198ddf3 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-317235402 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4afd52f67f99402ea6cc16e07198ddf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4afd52f67f99402ea6cc16e07198ddf3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4afd52f67f99402ea6cc16e07198ddf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4afd52f67f99402ea6cc16e07198ddf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-317235402 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 4afd52f67f99402ea6cc16e07198ddf3 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-317235402 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestMultiTenantJSON-317235402-project Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 436808b51190481698a29bb7af6ebb26 Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-317235402-project Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '17ed6470-5b4f-4a7c-bcdf-56a297b4f740'} Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:42.369527 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. Oct 28 19:33:42.372848 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:33:42.376153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] Returning 404 to user: Instance 17ed6470-5b4f-4a7c-bcdf-56a297b4f740 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:42.379805 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13daeb71-d866-4ece-952f-893e373f60de tempest-ServersNegativeTestMultiTenantJSON-317235402 tempest-ServersNegativeTestMultiTenantJSON-317235402-project] 10.222.0.44 "GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740" status: 404 len: 111 microversion: 2.1 time: 0.087489 Oct 28 19:33:42.384376 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2573/5160] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:42 2022] GET /compute/v2.1/servers/17ed6470-5b4f-4a7c-bcdf-56a297b4f740 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:54.609147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=18 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:54.613207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:54.613207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:54.613207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:54.617724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:54.623517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:54.637154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:54.638185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:54.640779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:54.642035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:54.642799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:54.651061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:54.701885 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f91f0e8-0aba-453f-9d77-6158d7327a7a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments/f68bb1cc-ed4b-4092-bfb0-74ee290dd58a" status: 200 len: 194 microversion: 2.20 time: 0.093477 Oct 28 19:33:54.702326 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2588/5161] 10.222.0.44 () {60 vars in 1454 bytes} [Fri Oct 28 19:33:54 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments/f68bb1cc-ed4b-4092-bfb0-74ee290dd58a => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:33:54.831650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:54.834027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:54.852573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:54.853401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=43 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:54.874662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:54.884822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:54.884822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:54.889650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:54.894227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:54.897297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:55.208662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lazy-loading 'services' on Instance uuid 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:33:55.440978 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b539af2-95c9-4537-aeff-d13fbd67d00e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments/f68bb1cc-ed4b-4092-bfb0-74ee290dd58a" status: 202 len: 0 microversion: 2.20 time: 0.611661 Oct 28 19:33:55.445570 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2574/5162] 10.222.0.44 () {60 vars in 1457 bytes} [Fri Oct 28 19:33:54 2022] DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments/f68bb1cc-ed4b-4092-bfb0-74ee290dd58a => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:55.455328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:55.457864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:55.488863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:55.490997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:55.492025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:55.493398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:55.498375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:55.499183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:55.572619 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-258d5155-e9e5-4de1-b3a3-c5046f6804bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120622 Oct 28 19:33:55.579761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2589/5163] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:33:55 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:33:56.594329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:56.603360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:56.620747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:56.621453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:56.622979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:56.622979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:56.622979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:56.623655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:56.709550 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d4ac10e8-d94c-457c-bd3c-4af2a5860170 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122421 Oct 28 19:33:56.712823 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2575/5164] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:33:56 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:33:57.730098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:57.743718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:57.768145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:57.769145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:57.773938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:57.778603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:57.779487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:57.780157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:57.944157 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-adde231a-1b39-45dd-9213-ce8248614e23 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.219730 Oct 28 19:33:57.948874 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2590/5165] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:33:57 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:33:58.962473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:58.965475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:33:59.012768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:59.013596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:59.019862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:59.022809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:59.030361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:59.032830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:59.199219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a85763ae-fedc-437d-b2aa-be80e36af367 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.237316 Oct 28 19:33:59.213588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2576/5166] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:33:58 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:34:00.217076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:00.220104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:00.237719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:00.238381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:00.239110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:00.239983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:00.242517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:00.243200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:00.314334 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1af7d82a-a16a-4866-b492-eb2f19d0a18c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101437 Oct 28 19:34:00.314887 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2591/5167] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:34:00 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:34:01.327159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:01.329646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:01.342216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:01.355818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:01.357104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:01.358402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:01.360011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:01.362628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:01.451923 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d38345ce-789a-4938-8ad6-b4a2853375e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126989 Oct 28 19:34:01.460665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2577/5168] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:34:01 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:34:02.473738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:02.479371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:02.517753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:02.519507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:02.524030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:02.527200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:02.530912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:02.533400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:02.631751 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50c249c2-51de-4b8a-b385-5b54001960e1 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165811 Oct 28 19:34:02.634770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2592/5169] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:34:02 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:34:03.647576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:03.654011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:03.674833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:03.678752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:03.679240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:03.680020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:03.686240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:03.686775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:03.773146 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8627ee9-8b71-45c7-8c57-a8d9a66c2244 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129761 Oct 28 19:34:03.779673 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2578/5170] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:34:03 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:34:04.786160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:04.790338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:04.825226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:04.825734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:04.826177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:04.826980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:04.833317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:04.836806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:04.936563 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d6f0684-fe9c-4aa4-9505-cb126b079bcd tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.152686 Oct 28 19:34:04.939369 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2593/5171] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:34:04 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:05.070666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:05.072057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:05.090370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:05.090925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:05.094031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:05.096039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:05.099412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:05.100084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:05.248450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:34:05.455143 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d36e6d2a-ccb2-4c19-b418-8b8e76562852 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 204 len: 0 microversion: 2.20 time: 0.391013 Oct 28 19:34:05.456220 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2579/5172] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:34:05 2022] DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:34:05.467482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:05.468393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:05.481348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:05.486274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:05.487027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:05.488041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:05.488842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:05.490013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:06.680699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:06.699556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:06.704989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:06.724178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-248466df-45ce-424d-a417-b7bbaa4d58cf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 1.262363 Oct 28 19:34:06.728497 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2594/5173] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:05 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:07.764037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:07.764791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:07.808784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:07.809293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:07.820054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:07.821044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:07.821539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:07.821973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:09.443029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:09.464524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:09.471840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:09.473648 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f7886acb-a975-4811-bd99-b4cb3e549c35 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1722 microversion: 2.20 time: 1.715177 Oct 28 19:34:09.474627 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2580/5174] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:07 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1722 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:10.516897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:10.519237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:10.528510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:10.529185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:10.529789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:10.534353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:10.535437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:10.536185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:10.795834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:10.812298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:10.824796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:10.826125 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a9eba1e7-419e-492a-bcaa-5abbef2c8596 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1654 microversion: 2.20 time: 0.324460 Oct 28 19:34:10.829615 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2595/5175] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:10 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1654 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:11.855101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:11.855721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:11.866441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:11.866954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:11.867621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:11.868560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:11.869370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:11.870255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:12.040841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:12.074735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:12.082062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:12.089608 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f832bcb9-3ee1-4966-b6ca-0fc0acb21bb3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1654 microversion: 2.20 time: 0.238261 Oct 28 19:34:12.095516 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2581/5176] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:11 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1654 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:13.126845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:13.132010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:13.176774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:13.186861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:13.187624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:13.199103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:13.203486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:13.204220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:13.898334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:13.904116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f2a7541b-1f54-4cb8-843b-0b8f6f3c8758 req-6ac3076d-b040-4c9c-a1e4-96f23298a048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212bb4fa-97c2-42ea-ae9e-4fd89f99dc98", "name": "network-vif-deleted", "tag": "5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:13.909931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:13.912708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:13.916112 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-651bc156-3a34-4261-a5aa-fbacf48cee08 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 200 len: 1654 microversion: 2.20 time: 0.800996 Oct 28 19:34:13.924298 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2596/5177] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:13 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 1654 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:13.928777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f2a7541b-1f54-4cb8-843b-0b8f6f3c8758 req-6ac3076d-b040-4c9c-a1e4-96f23298a048 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:13.931454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f2a7541b-1f54-4cb8-843b-0b8f6f3c8758 req-6ac3076d-b040-4c9c-a1e4-96f23298a048 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:13.932017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f2a7541b-1f54-4cb8-843b-0b8f6f3c8758 req-6ac3076d-b040-4c9c-a1e4-96f23298a048 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:13.982877 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f2a7541b-1f54-4cb8-843b-0b8f6f3c8758 req-6ac3076d-b040-4c9c-a1e4-96f23298a048 service nova] Creating event network-vif-deleted:5ea49b9a-7aea-443c-abe4-f1c3c7bc1f09 for instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 on n-h1-862769-3 Oct 28 19:34:14.000878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f2a7541b-1f54-4cb8-843b-0b8f6f3c8758 req-6ac3076d-b040-4c9c-a1e4-96f23298a048 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.853693 Oct 28 19:34:14.009573 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2582/5178] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:14.952135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:14.953394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:14.970767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:14.971578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:14.972774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:14.976514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:14.977209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:14.979705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:15.027091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] HTTP exception thrown: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Request method failure captured: Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 HTTP/1.1 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC2nCs5V5RlgXNe98k59oHqh9hZoOKc-Vvzzmk9qbPBCkJRJfLmCaGd97tFt_Vz0SXRN8QIDIhh_cHEaIwayPszmmOm7khx2u6Nn_Eh2Dh6V3jizC2ohJi5MDSgfNfq5j7gRKp88Wihkvw5504QPev9BXeB8CL6pjwjJ9HVLVJO8OAY Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_95f88e4c7194409a91baeb78e099e93f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: dea27583bf5144a5aeed6ec0c3c20ca4 Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '212bb4fa-97c2-42ea-ae9e-4fd89f99dc98'} Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:34:15.039383 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:34:15.043151 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:34:15.048610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Returning 404 to user: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:34:15.050321 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6602155-fbce-4eb3-804b-d2a6e468a183 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 404 len: 111 microversion: 2.20 time: 0.103251 Oct 28 19:34:15.055335 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2597/5179] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:14 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:34:15.061897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1e01bf8-9a17-466a-a58b-efb786a3e0c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '.version_select at 0x7f1d76ac7790>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:15.139522 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1e01bf8-9a17-466a-a58b-efb786a3e0c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720764812" status: 204 len: 0 microversion: 2.20 time: 0.080146 Oct 28 19:34:15.146589 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2583/5180] 10.222.0.44 () {60 vars in 1259 bytes} [Fri Oct 28 19:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720764812 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:34:15.547482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1824951616", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "257ace7b-1bfb-4144-9d5a-969623f0dad2"}, {"uuid": "5ca110cc-c718-4913-811a-b15b0b70aff8"}, {"uuid": "257ace7b-1bfb-4144-9d5a-969623f0dad2"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:15.644472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] validate_networks() for [('257ace7b-1bfb-4144-9d5a-969623f0dad2', None, None, None, None, None), ('5ca110cc-c718-4913-811a-b15b0b70aff8', None, None, None, None, None), ('257ace7b-1bfb-4144-9d5a-969623f0dad2', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:34:18.032793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-840be77d-ff98-43af-98eb-fd0bafc3c8a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'create', calling method: .version_select at 0x7f1d76ad2550>, body: {"keypair": {"name": "tempest-keypair-1999479373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHHzxmZWyC2/HkWvmeRzse+eaYfLhMjbzYZCepwwgQoLwNEFAYhzwKMPDfLvrrdeW975w8X261Wl6lxofD/1A5nxNrB9dUVVY0D/IoLn2i728cw0eBhVoQWlULOAl7Ebw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:18.076614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-840be77d-ff98-43af-98eb-fd0bafc3c8a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for project 95f88e4c7194409a91baeb78e099e93f. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:34:18.086503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-840be77d-ff98-43af-98eb-fd0bafc3c8a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for user dea27583bf5144a5aeed6ec0c3c20ca4 and project 95f88e4c7194409a91baeb78e099e93f. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:34:18.152808 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-840be77d-ff98-43af-98eb-fd0bafc3c8a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.124163 Oct 28 19:34:18.153442 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2584/5181] 10.222.0.44 () {62 vars in 1200 bytes} [Fri Oct 28 19:34:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 19:34:21.170345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:34:21.171964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:34:21.172582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:34:21.173127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:34:21.176041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:34:21.213355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:21.214521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:21.217001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:21.219538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:21.221508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:21.222519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:21.310608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Getting quotas for project 7f3c6f56ea0c4944a0c8dcc6ff99a7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:34:21.322584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Getting quotas for user 2b5083294b9143da93df5a8a35bce249 and project 7f3c6f56ea0c4944a0c8dcc6ff99a7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:34:21.382062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:34:21.391492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:34:21.519235 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf8eae91-9afb-4043-95d7-bac6c801c749 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.976070 Oct 28 19:34:21.530043 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2598/5182] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:34:21.541243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5593653a-5ffb-4de5-9779-b1df1c961ac6 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:21.542009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5593653a-5ffb-4de5-9779-b1df1c961ac6 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:21.719540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5593653a-5ffb-4de5-9779-b1df1c961ac6 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:21.733223 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5593653a-5ffb-4de5-9779-b1df1c961ac6 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1213 microversion: 2.1 time: 0.196485 Oct 28 19:34:21.752864 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2585/5183] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:21 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:22.759849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:22.761034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:22.778220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:22.786668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:22.789874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:22.792130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:22.795997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:22.799343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:22.980447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:23.002810 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4efa99de-5240-46ed-b63a-aada6edba61d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1209 microversion: 2.1 time: 0.249135 Oct 28 19:34:23.008695 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2599/5184] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:22 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1209 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:24.047595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:24.048840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:24.061117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:24.072313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:24.072818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:24.073915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:24.074127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:24.074591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:24.075111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:24.569082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:24.580864 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-08909fee-5939-45dc-8fda-f970a79da9b5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1271 microversion: 2.1 time: 0.537618 Oct 28 19:34:24.602366 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2586/5185] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:24 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1271 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:25.434926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2016633629", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:25.448987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:25.531614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] validate_networks() for None {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:34:25.608527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:25.609244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:25.624342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:25.626489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:25.629793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:25.630617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:25.631753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:25.641274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:25.642010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:25.863906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:25.873331 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d27e743-ab38-4e0c-b6c9-2419c2de68b4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1271 microversion: 2.1 time: 0.269415 Oct 28 19:34:25.880436 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2587/5186] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:25 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:26.512289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1798519173", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "968c50da-8ea0-4519-84fb-2b5bd5402d5f"}], "security_groups": [{"name": "tempest-securitygroup--295406200"}], "key_name": "tempest-keypair-1999479373", "user_data": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:26.553356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:34:26.554790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:34:26.555676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:34:26.556392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:34:26.556900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:34:26.570379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:26.571222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:26.572108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:26.573536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:26.575848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:26.576872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:26.597519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=65 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:26.633277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Getting quotas for project 223a5a581ed645b28038ea988a51fe2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:34:26.640868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Getting quotas for user a78e7475f56c42238b961af4b9a4de45 and project 223a5a581ed645b28038ea988a51fe2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:34:26.658047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:34:26.661051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:34:26.731886 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b707fc68-22f5-4072-89b5-67af79389a47 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300825 Oct 28 19:34:26.733422 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2600/5187] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:34:26.747978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c82906e1-8764-4c13-9356-c574072d8c9b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:26.749947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c82906e1-8764-4c13-9356-c574072d8c9b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:26.877553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c82906e1-8764-4c13-9356-c574072d8c9b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:26.891038 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c82906e1-8764-4c13-9356-c574072d8c9b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1214 microversion: 2.1 time: 0.149858 Oct 28 19:34:26.892574 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2601/5188] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:26 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:26.912528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:26.913483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:26.957818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:26.959012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:26.960008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:26.970822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:26.971537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:26.972239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:27.147200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] validate_networks() for [('968c50da-8ea0-4519-84fb-2b5bd5402d5f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:34:28.760061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:28.776422 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d10f4623-ffc3-4cea-ac44-5f8a57eaad8b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1313 microversion: 2.1 time: 1.868387 Oct 28 19:34:28.777096 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2602/5189] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:26 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1313 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:28.794862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:28.795602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:28.807819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:28.808665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:28.809268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:28.810219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:28.811276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:28.814911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:29.395816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:29.408222 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78d678c5-a4b2-46fd-b46b-cdb432bff18a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1272 microversion: 2.1 time: 0.629983 Oct 28 19:34:29.422093 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2603/5190] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:28 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1272 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:29.801021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:29.801487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:29.809823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:29.810976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:29.811632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:29.812633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:29.813306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:29.814231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:30.174603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:30.185789 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98c606d4-a9d3-4b7d-af9c-552450e74342 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1313 microversion: 2.1 time: 0.388635 Oct 28 19:34:30.194034 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2604/5191] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:29 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:30.441224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:30.447640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:30.463299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:30.468469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:30.469675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:30.470944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:30.474662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:30.476304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:30.854253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:30.864539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f7ef04a8-284f-4160-8ed3-5b23843a83c2 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1272 microversion: 2.1 time: 0.431165 Oct 28 19:34:30.869401 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2605/5192] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:30 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:30.915657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:34:30.916282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:34:30.916843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:34:30.917427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:34:30.917808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:34:30.937093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:30.937586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:30.943460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:30.944704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:30.945278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:30.946117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:30.986776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for project 95f88e4c7194409a91baeb78e099e93f. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:34:31.001042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Getting quotas for user dea27583bf5144a5aeed6ec0c3c20ca4 and project 95f88e4c7194409a91baeb78e099e93f. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:34:31.041023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:34:31.045586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:34:31.111090 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9fee3a5e-c4d6-415e-ba1c-bc1c05db49a8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.603350 Oct 28 19:34:31.112454 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2588/5193] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:34:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 4605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 19:34:31.123529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2484438c-e7b3-4b4d-b965-bade1dbd66c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:31.124144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2484438c-e7b3-4b4d-b965-bade1dbd66c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:31.209205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2484438c-e7b3-4b4d-b965-bade1dbd66c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:31.218915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:31.220983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:31.238737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2484438c-e7b3-4b4d-b965-bade1dbd66c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:31.244223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2484438c-e7b3-4b4d-b965-bade1dbd66c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:31.246407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:31.247629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:31.248086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:31.249352 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2484438c-e7b3-4b4d-b965-bade1dbd66c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1282 microversion: 2.20 time: 0.128631 Oct 28 19:34:31.252493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:31.255341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:31.255813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:31.270859 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2606/5194] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:31 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:31.741568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:31.755990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ca21586-2336-4d96-bd7d-914de6366f44 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1334 microversion: 2.1 time: 0.542372 Oct 28 19:34:31.775349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2589/5195] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:31 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1334 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:31.894512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:31.895985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:31.923642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:31.924791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:31.925641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:31.928694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:31.929436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:31.930256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:32.079636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:32.104496 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d0a03808-625e-45d4-bdc2-3736eac4e466 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1272 microversion: 2.1 time: 0.214923 Oct 28 19:34:32.118230 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2607/5196] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:31 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:32.279267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:32.280000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:32.289357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:32.290951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:32.292051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:32.292992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:32.293915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:32.294435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:32.457729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:32.512463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:32.515756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:32.517160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dcbf4653-3b47-4993-9bdc-6ba611a0b448 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1334 microversion: 2.20 time: 0.242182 Oct 28 19:34:32.533836 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2590/5197] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:32 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1334 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:32.781584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:32.782211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:32.795865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:32.796362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:32.796806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:32.798084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:32.798548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:32.799006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:33.128898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:33.129717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:33.146826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:33.147604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:33.148942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:33.148942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:33.149253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:33.149712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:33.652436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:33.669155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9691f43e-b5ca-4843-a83a-345d83ee5c0e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.891474 Oct 28 19:34:33.691346 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2608/5198] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:32 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:33.705596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:33.708342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:33.725327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:33.730678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:33.731907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:33.733035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:33.734091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:33.734843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:33.864776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:33.875404 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b1a3664-9bec-4af5-8110-193266b2faca tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.751867 Oct 28 19:34:33.891540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2591/5199] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:33 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:33.952615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:33.962209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:33.967669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:33.971312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dc21a7e3-7ae9-4614-91b0-fb43371504c4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1340 microversion: 2.20 time: 0.278448 Oct 28 19:34:33.991961 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2609/5200] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:33 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1340 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:34.090259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ba4ea966-1274-41d2-b32a-d57bf49165e3 req-bcff0d8f-038b-48d5-bee9-6864768e895d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "tag": "3c3401c0-2943-4693-9e17-73c15d6df3ac"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:34.109971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ba4ea966-1274-41d2-b32a-d57bf49165e3 req-bcff0d8f-038b-48d5-bee9-6864768e895d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:34.111236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ba4ea966-1274-41d2-b32a-d57bf49165e3 req-bcff0d8f-038b-48d5-bee9-6864768e895d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:34.111691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ba4ea966-1274-41d2-b32a-d57bf49165e3 req-bcff0d8f-038b-48d5-bee9-6864768e895d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:34.127854 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ba4ea966-1274-41d2-b32a-d57bf49165e3 req-bcff0d8f-038b-48d5-bee9-6864768e895d service nova] Creating event network-changed:3c3401c0-2943-4693-9e17-73c15d6df3ac for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:34:34.135448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ba4ea966-1274-41d2-b32a-d57bf49165e3 req-bcff0d8f-038b-48d5-bee9-6864768e895d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052295 Oct 28 19:34:34.138181 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2592/5201] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:34.703239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:34.703871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:34.722542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:34.723458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:34.724106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:34.725435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:34.726116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:34.726823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:34.900476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:34.901196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:34.916294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:34.916790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:34.917481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:34.918796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:34.919581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:34.920205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:35.392295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:35.424693 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fd2e3348-3686-4096-975b-371df863660a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.720738 Oct 28 19:34:35.428857 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2610/5202] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:34 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:35.459856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:35.463541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:35.480416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:35.481408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:35.483394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:35.484681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:35.485325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:35.486235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:36.349971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:36.365866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14cbc32e-d80e-4e46-a53a-fa217bac083b tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 1.469327 Oct 28 19:34:36.369899 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2593/5203] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:34 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:36.451632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:36.452500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:36.465877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:36.466830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:36.467276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:36.468171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:36.468785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:36.469362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:36.597518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:37.182546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:37.197871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:37.199598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:37.201066 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e86c43c2-acfe-42d7-8651-abb6b4055782 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1407 microversion: 2.20 time: 1.769757 Oct 28 19:34:37.204778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2611/5204] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:35 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1407 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:37.213889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-89ec7d40-c5c8-4cba-b9a2-1008239e50a5 req-e15b0213-dfb7-4c21-b3f9-c311ef3a9267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "tag": "c27bcf31-a085-4d1a-afd9-bd4b6fd25216"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:37.254774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-89ec7d40-c5c8-4cba-b9a2-1008239e50a5 req-e15b0213-dfb7-4c21-b3f9-c311ef3a9267 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:37.255727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-89ec7d40-c5c8-4cba-b9a2-1008239e50a5 req-e15b0213-dfb7-4c21-b3f9-c311ef3a9267 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:37.257258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-89ec7d40-c5c8-4cba-b9a2-1008239e50a5 req-e15b0213-dfb7-4c21-b3f9-c311ef3a9267 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:37.278211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-89ec7d40-c5c8-4cba-b9a2-1008239e50a5 req-e15b0213-dfb7-4c21-b3f9-c311ef3a9267 service nova] Creating event network-changed:c27bcf31-a085-4d1a-afd9-bd4b6fd25216 for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:34:37.318667 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-89ec7d40-c5c8-4cba-b9a2-1008239e50a5 req-e15b0213-dfb7-4c21-b3f9-c311ef3a9267 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108313 Oct 28 19:34:37.320636 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2612/5205] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:37.396640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:37.397784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:37.410273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:37.411763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:37.412404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:37.414341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:37.415509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:37.416090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:37.584286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:37.600719 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-629a77c2-3930-4052-bd0b-d0f2bd72740b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 1.153209 Oct 28 19:34:37.603812 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2594/5206] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:36 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:38.088575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:38.107690 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af98b259-90b8-4890-b3cc-c58d53d505da tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.715348 Oct 28 19:34:38.114752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2613/5207] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:37 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:38.243629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:38.244590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:38.253344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:38.254657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:38.257534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:38.258538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:38.259439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:38.259967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:38.625082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:38.625697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:38.640207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:38.640705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:38.641142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:38.641866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:38.642315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:38.642781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:38.977146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:38.991512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:38.995682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:39.002719 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7c4d3c3d-859a-49c3-9ec8-a52e1eb83b4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1407 microversion: 2.20 time: 0.764432 Oct 28 19:34:39.005058 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2595/5208] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:38 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1407 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:39.012647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c3f14dbd-ee23-4ea4-9ea9-2e446b1f189e req-ae94fd7e-7efe-438e-8daf-b520f019daf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07eb7854-b4ad-4d06-b4bf-d50968bc6d27", "tag": "3de31dc8-1112-4681-8f20-42f72db9b3cc"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:39.044441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3f14dbd-ee23-4ea4-9ea9-2e446b1f189e req-ae94fd7e-7efe-438e-8daf-b520f019daf1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:39.044941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3f14dbd-ee23-4ea4-9ea9-2e446b1f189e req-ae94fd7e-7efe-438e-8daf-b520f019daf1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:39.045367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c3f14dbd-ee23-4ea4-9ea9-2e446b1f189e req-ae94fd7e-7efe-438e-8daf-b520f019daf1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:39.065213 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c3f14dbd-ee23-4ea4-9ea9-2e446b1f189e req-ae94fd7e-7efe-438e-8daf-b520f019daf1 service nova] Creating event network-changed:3de31dc8-1112-4681-8f20-42f72db9b3cc for instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 on n-h1-862769-3 Oct 28 19:34:39.071465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c3f14dbd-ee23-4ea4-9ea9-2e446b1f189e req-ae94fd7e-7efe-438e-8daf-b520f019daf1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063995 Oct 28 19:34:39.072094 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2596/5209] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:39.132058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:39.132778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:39.145735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:39.148363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:39.148954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:39.151610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:39.152875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:39.153336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:39.932422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:39.946153 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-582266f3-9b7d-4491-8d91-a3958850e033 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 1.323937 Oct 28 19:34:39.946810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2614/5210] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:38 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:39.953664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6d7f2356-b713-4298-955d-09f539cf5814 req-e1a5f5cd-2269-4e1d-b731-3b356081f8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:39.969077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6d7f2356-b713-4298-955d-09f539cf5814 req-e1a5f5cd-2269-4e1d-b731-3b356081f8c8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:39.969954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6d7f2356-b713-4298-955d-09f539cf5814 req-e1a5f5cd-2269-4e1d-b731-3b356081f8c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:39.970824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6d7f2356-b713-4298-955d-09f539cf5814 req-e1a5f5cd-2269-4e1d-b731-3b356081f8c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:39.996872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6d7f2356-b713-4298-955d-09f539cf5814 req-e1a5f5cd-2269-4e1d-b731-3b356081f8c8 service nova] Creating event network-changed:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:34:40.005010 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6d7f2356-b713-4298-955d-09f539cf5814 req-e1a5f5cd-2269-4e1d-b731-3b356081f8c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055801 Oct 28 19:34:40.006271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2615/5211] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:40.035259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:40.037706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:40.048280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:40.050387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:40.051615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:40.053314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:40.055672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:40.067597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:40.289691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:40.315521 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-98e53584-ffac-4b45-939c-67015a79718a tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 1.187827 Oct 28 19:34:40.316613 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2597/5212] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:39 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:40.713564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:40.722845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:40.724801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:40.726303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c382ad86-f906-48e0-8ef8-321d7b82bb32 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1407 microversion: 2.20 time: 0.696435 Oct 28 19:34:40.739595 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2616/5213] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:40 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1407 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:34:40.970192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:40.970829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:40.973123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:40.978964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:40.979850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:40.980494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:40.981409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:40.982051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:40.982484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:41.022801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:41.339623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:41.340218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:41.342901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:41.348689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:41.349185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:41.349617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:41.350530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:41.351191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:41.351829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:41.402823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:41.412012 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d4aeec65-80f9-4c67-bc79-c0446ad4494c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.446388 Oct 28 19:34:41.412989 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2598/5214] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:40 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:41.755366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:41.755990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:41.767201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:41.767550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:41.768705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:41.782836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-58e49d68-543f-4aaf-a56b-2cedcd033258 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.447228 Oct 28 19:34:41.784714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:41.787977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:41.791412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:41.794836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:41.795751 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2617/5215] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:41 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:42.068802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6ddfe348-d84d-43b1-815c-a33ac3aa7706 req-89a23800-1bc1-4928-963f-acc68bec758c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "tag": "c23b2d80-818a-44d1-a5a7-83da900779fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:42.160494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6ddfe348-d84d-43b1-815c-a33ac3aa7706 req-89a23800-1bc1-4928-963f-acc68bec758c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:42.161190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6ddfe348-d84d-43b1-815c-a33ac3aa7706 req-89a23800-1bc1-4928-963f-acc68bec758c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:42.161637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6ddfe348-d84d-43b1-815c-a33ac3aa7706 req-89a23800-1bc1-4928-963f-acc68bec758c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:42.197121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6ddfe348-d84d-43b1-815c-a33ac3aa7706 req-89a23800-1bc1-4928-963f-acc68bec758c service nova] Creating event network-changed:c23b2d80-818a-44d1-a5a7-83da900779fc for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:34:42.213538 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6ddfe348-d84d-43b1-815c-a33ac3aa7706 req-89a23800-1bc1-4928-963f-acc68bec758c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154415 Oct 28 19:34:42.215278 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2618/5216] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:34:42.338355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:42.357543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:42.363856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:42.368358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-954c9ee0-66ae-446f-969a-4757e38cf49c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1407 microversion: 2.20 time: 0.615481 Oct 28 19:34:42.370190 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2599/5217] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:41 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:34:42.441020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:42.441743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:42.478872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:42.479645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:42.480271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:42.481227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:42.482269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:42.490057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:42.817823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:42.819706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:42.828607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:42.831445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:42.832325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:42.833531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:42.834215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:42.835431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:43.713377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:43.736050 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b02c9bfc-cd41-4568-9a2b-ff476dbea508 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 1.301183 Oct 28 19:34:43.743280 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2619/5218] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:42 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:43.758035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:43.762602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:43.778646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:43.779059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:43.781157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:43.783476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:43.784478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:43.787207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:43.788261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:43.792872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd522837-1ae0-4b3f-8252-04127bbe919f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.986473 Oct 28 19:34:43.795958 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2600/5219] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:42 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:44.355632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-475e0d82-8a0b-4f9b-a598-f5791b839a5c req-c5725e8b-aa83-4a0e-be43-bc284bffbc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "name": "network-vif-plugged", "status": "completed", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:44.391255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-475e0d82-8a0b-4f9b-a598-f5791b839a5c req-c5725e8b-aa83-4a0e-be43-bc284bffbc95 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:44.396348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-475e0d82-8a0b-4f9b-a598-f5791b839a5c req-c5725e8b-aa83-4a0e-be43-bc284bffbc95 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:44.397372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-475e0d82-8a0b-4f9b-a598-f5791b839a5c req-c5725e8b-aa83-4a0e-be43-bc284bffbc95 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:44.442666 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-475e0d82-8a0b-4f9b-a598-f5791b839a5c req-c5725e8b-aa83-4a0e-be43-bc284bffbc95 service nova] Creating event network-vif-plugged:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:34:44.468736 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-475e0d82-8a0b-4f9b-a598-f5791b839a5c req-c5725e8b-aa83-4a0e-be43-bc284bffbc95 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124067 Oct 28 19:34:44.469691 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2601/5220] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:34:44.935400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77377f88-c130-4e90-96ab-8c850712bb70 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: .version_select at 0x7f1d76ac74c0>, body: {"keypair": {"name": "tempest-keypair-731216559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8I1vLZwW5mzzUj4qlCoQlbcMNvBPBZNnTlBKkZKXsRiw38aKMXTiIM9eYfnlBf5pjfq504hTii9mymAx3G8xczX18mHw7thc8KtjB23GNQ7Rh2aNuyfx21JoyuzqnFzw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:44.986680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-77377f88-c130-4e90-96ab-8c850712bb70 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:34:45.000367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-77377f88-c130-4e90-96ab-8c850712bb70 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:34:45.070774 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77377f88-c130-4e90-96ab-8c850712bb70 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.599311 Oct 28 19:34:45.083901 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2602/5221] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:34:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:45.092998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:45.098664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:45.112597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:45.113349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:45.115485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:45.116622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:45.126655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:45.127380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:45.502502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:45.519593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:45.522089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:45.528827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7cbdace-1966-4118-a1ae-862e11845e4a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1407 microversion: 2.20 time: 1.780901 Oct 28 19:34:45.530814 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2620/5222] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:43 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1407 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:45.541675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:45.543721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:45.562750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:45.563553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:45.564197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:45.565173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:45.566457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:45.567158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:45.586359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:46.302861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:46.332508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-102c847b-c68c-4146-a5ba-cd5e80adeb07 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.800262 Oct 28 19:34:46.356232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:46.360096 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2621/5223] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:45 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:46.381114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06c1552f-936a-48ab-95bd-fdacf4422168 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 1.294681 Oct 28 19:34:46.386011 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2603/5224] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:45 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:46.559268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:46.561128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:46.570668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:46.574941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:46.580320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:46.581196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:46.581700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:46.582130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:47.324434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:47.336707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:47.344323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:47.349930 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-987c96fc-8294-4afd-a99e-69a1a75483b4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1407 microversion: 2.20 time: 0.794117 Oct 28 19:34:47.351946 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2622/5225] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:46 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1407 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:34:47.361851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:47.363297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:47.395383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:47.396133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:47.396760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:47.399593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:47.400819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:47.401410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:47.412666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:47.413457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:47.422536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:47.423538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:47.424850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:47.425707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:47.428593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:47.433645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:48.117596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:48.132214 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74fffaeb-e789-45ff-9219-6835941be7ee tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.772465 Oct 28 19:34:48.137678 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2604/5226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:47 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:48.146530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:48.155797 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a9373ba7-e464-4b31-865c-afc81fd00eb1 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.747147 Oct 28 19:34:48.169313 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2623/5227] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:47 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:48.383222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:48.384685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:48.397424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:48.398270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:48.398939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:48.411873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:48.412715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:48.413318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:48.414790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b136d8ac-460a-49a3-a753-b94b9330fdbd req-9b92774e-7c35-475b-bc87-0780524e530a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07eb7854-b4ad-4d06-b4bf-d50968bc6d27", "name": "network-vif-plugged", "status": "completed", "tag": "3de31dc8-1112-4681-8f20-42f72db9b3cc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:48.440952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b136d8ac-460a-49a3-a753-b94b9330fdbd req-9b92774e-7c35-475b-bc87-0780524e530a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:48.442830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b136d8ac-460a-49a3-a753-b94b9330fdbd req-9b92774e-7c35-475b-bc87-0780524e530a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:48.443312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b136d8ac-460a-49a3-a753-b94b9330fdbd req-9b92774e-7c35-475b-bc87-0780524e530a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:48.486111 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b136d8ac-460a-49a3-a753-b94b9330fdbd req-9b92774e-7c35-475b-bc87-0780524e530a service nova] Creating event network-vif-plugged:3de31dc8-1112-4681-8f20-42f72db9b3cc for instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 on n-h1-862769-3 Oct 28 19:34:48.499707 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b136d8ac-460a-49a3-a753-b94b9330fdbd req-9b92774e-7c35-475b-bc87-0780524e530a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091895 Oct 28 19:34:48.500919 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2624/5228] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:34:49.170737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:49.171554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:49.189878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:49.190284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:49.191018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:49.191674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:49.192005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:49.192801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:49.539120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:49.569565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:49.577703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:49.580350 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5224a7b5-8b7a-4dd5-96c5-6bd4c3731685 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1599 microversion: 2.20 time: 1.203577 Oct 28 19:34:49.583747 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2605/5229] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:34:48 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1599 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:34:49.591126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:49.592680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:49.624543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:49.625062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:49.629636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:49.632398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:49.634102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:49.634769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:49.640876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:49.782178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:49.797759 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eed598f2-8e47-4235-8d16-456457626e5e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.629963 Oct 28 19:34:49.799109 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2625/5230] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:49 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:49.809028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:49.811749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:49.828440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:49.831718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:49.833674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:49.835609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:49.836757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:49.839576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:50.002663 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6fb2df87-66cd-4623-9a70-5926291483a3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.202263 Oct 28 19:34:50.010750 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2626/5231] 10.222.0.44 () {60 vars in 1316 bytes} [Fri Oct 28 19:34:49 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:34:50.077207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:50.093900 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6fb1c832-e366-4faa-8342-0e94c49f57d4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.507775 Oct 28 19:34:50.094730 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2606/5232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:49 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:50.828149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:50.828819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:50.845881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:50.862160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:50.864336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:50.869182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:50.869884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:50.870986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:51.121925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:51.125343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:51.143533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:51.145498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:51.146670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:51.149416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:51.150785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:51.152419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:51.506961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:51.523645 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5aadbb7-772e-4c3a-943e-b9e3aaf73bc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1314 microversion: 2.1 time: 0.703205 Oct 28 19:34:51.524620 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2627/5233] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:50 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:51.540008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-794725548", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599ec161-dd8a-466f-859e-7811bbe9f61c"}], "security_groups": [{"name": "tempest-securitygroup--743171540"}], "key_name": "tempest-keypair-731216559", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:51.729474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:51.747631 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e42625f-3b89-43dc-8eec-1c2c86172bff tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.632202 Oct 28 19:34:51.754280 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2607/5234] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:51 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:52.008772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] validate_networks() for [('599ec161-dd8a-466f-859e-7811bbe9f61c', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:34:52.548137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:52.548750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:52.574388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:52.580502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:52.581657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:52.583941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:52.586186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:52.586964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:52.934789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:52.952357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5aec7cf9-e7fa-4744-bb5e-597911ec7cc8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1463 microversion: 2.1 time: 0.404733 Oct 28 19:34:52.956529 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2608/5235] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:52 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1463 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:52.971729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:52.972556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:52.989428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:52.990242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:52.990817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:52.992889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:52.996807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:52.999833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:53.758045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:53.766582 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f52570c-6511-4e74-9abd-2614969fb69a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.808379 Oct 28 19:34:53.799795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2609/5236] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:52 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:53.826858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4540b30d-5855-441e-997a-deb6ba86191e req-1928a497-5681-4a4a-980b-48101f62d53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:53.871455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4540b30d-5855-441e-997a-deb6ba86191e req-1928a497-5681-4a4a-980b-48101f62d53f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:53.871964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4540b30d-5855-441e-997a-deb6ba86191e req-1928a497-5681-4a4a-980b-48101f62d53f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:53.872403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4540b30d-5855-441e-997a-deb6ba86191e req-1928a497-5681-4a4a-980b-48101f62d53f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:53.887931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:34:53.888564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:34:53.889048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:34:53.889462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:34:53.889878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:34:53.912628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:53.913125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:53.913570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:53.925713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:53.926199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:53.926631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:53.938979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4540b30d-5855-441e-997a-deb6ba86191e req-1928a497-5681-4a4a-980b-48101f62d53f service nova] Creating event network-changed:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:34:53.957133 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4540b30d-5855-441e-997a-deb6ba86191e req-1928a497-5681-4a4a-980b-48101f62d53f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153481 Oct 28 19:34:53.965546 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2610/5237] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:53.988786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "179aa4b9-1f32-49da-b9b5-3fadb6e9f257", "device": "/dev/sdb"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:53.997665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:54.018595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:34:54.031131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:54.031653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:54.038001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:54.039269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:54.044013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:54.044520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:34:54.045152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:54.100624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:34:54.103028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:34:54.248529 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2344a84-e3be-4e34-a69a-659c7fd924c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.722552 Oct 28 19:34:54.260563 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2628/5238] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:34:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:34:54.270310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1ef77a8-685c-4d1d-b879-4dd41854c53e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:54.279700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b1ef77a8-685c-4d1d-b879-4dd41854c53e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:54.430079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1ef77a8-685c-4d1d-b879-4dd41854c53e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:54.437830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b1ef77a8-685c-4d1d-b879-4dd41854c53e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1240 microversion: 2.1 time: 0.175820 Oct 28 19:34:54.440258 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2629/5239] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:54 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1240 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:54.624873 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30ad78b7-e26c-4d17-ae51-e265b928c632 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "POST /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657605 Oct 28 19:34:54.625798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2611/5240] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:34:53 2022] POST /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:54.836639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:54.836639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:54.879543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:54.890481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:54.894146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:54.895062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:54.903564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:54.904685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:55.460759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:55.470277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:55.476647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:55.499730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:55.501003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:55.502043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:55.503709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:55.504904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:55.505720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:56.779589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:56.796924 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-87f4e4da-bfa1-486a-b065-8dfa8e57b80c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 1.973558 Oct 28 19:34:56.797723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2630/5241] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:54 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:56.809862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0d009ca6-8153-4bc4-8391-e400327dde87 req-6636101d-0250-4606-847f-bad851d6e01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "name": "network-vif-plugged", "status": "completed", "tag": "c23b2d80-818a-44d1-a5a7-83da900779fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:56.818995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:56.834002 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0db0639a-f3ce-4219-b4e3-223b641f8de2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1236 microversion: 2.1 time: 1.376051 Oct 28 19:34:56.837295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:56.838914 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2612/5242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:55 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1236 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:56.857387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d009ca6-8153-4bc4-8391-e400327dde87 req-6636101d-0250-4606-847f-bad851d6e01c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:56.858120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d009ca6-8153-4bc4-8391-e400327dde87 req-6636101d-0250-4606-847f-bad851d6e01c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:56.859854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0d009ca6-8153-4bc4-8391-e400327dde87 req-6636101d-0250-4606-847f-bad851d6e01c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:56.909539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0d009ca6-8153-4bc4-8391-e400327dde87 req-6636101d-0250-4606-847f-bad851d6e01c service nova] Creating event network-vif-plugged:c23b2d80-818a-44d1-a5a7-83da900779fc for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:34:56.922599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0d009ca6-8153-4bc4-8391-e400327dde87 req-6636101d-0250-4606-847f-bad851d6e01c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122725 Oct 28 19:34:56.923898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2631/5243] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:57.826569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:57.828322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:57.836200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:34:57.849862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:57.863720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:57.865037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:57.869204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:57.875227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:57.882804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:57.883616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:57.888412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:57.891044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:57.894559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:57.897351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:57.899474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:57.902896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:57.903788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:58.322083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:58.334054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ffedcc47-23d6-4941-aa56-672f6f4f88c5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1298 microversion: 2.1 time: 0.473636 Oct 28 19:34:58.335411 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2632/5244] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:57 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1298 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:34:58.483990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:58.495065 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e716ee29-9923-43dd-b8c8-334a9bbc7087 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.674469 Oct 28 19:34:58.498658 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2613/5245] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:57 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:59.334652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-00c2d048-f71e-4ea4-862d-8111ded66cc7 req-90306efd-ebe6-4446-9eea-f7a2ed9342ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "name": "network-vif-plugged", "status": "completed", "tag": "c27bcf31-a085-4d1a-afd9-bd4b6fd25216"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:59.365670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:59.366961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:59.372979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-00c2d048-f71e-4ea4-862d-8111ded66cc7 req-90306efd-ebe6-4446-9eea-f7a2ed9342ca service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:59.373477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-00c2d048-f71e-4ea4-862d-8111ded66cc7 req-90306efd-ebe6-4446-9eea-f7a2ed9342ca service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:59.373918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-00c2d048-f71e-4ea4-862d-8111ded66cc7 req-90306efd-ebe6-4446-9eea-f7a2ed9342ca service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:59.377870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:59.379142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:59.379809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:59.380959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:59.382514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:59.383287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:59.400647 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-00c2d048-f71e-4ea4-862d-8111ded66cc7 req-90306efd-ebe6-4446-9eea-f7a2ed9342ca service nova] Creating event network-vif-plugged:c27bcf31-a085-4d1a-afd9-bd4b6fd25216 for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:34:59.430328 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-00c2d048-f71e-4ea4-862d-8111ded66cc7 req-90306efd-ebe6-4446-9eea-f7a2ed9342ca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090239 Oct 28 19:34:59.433781 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2633/5246] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:59.516884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:59.523161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:59.524064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:34:59.536628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:59.539704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:59.540556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:59.541724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:59.545358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:59.546083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:59.546495 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b5cd649f-035a-4b97-ba5f-097e7b76fa7c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1298 microversion: 2.1 time: 0.188931 Oct 28 19:34:59.547722 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2614/5247] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:59 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:59.955904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:59.974972 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a84c0eed-8d87-421f-aee4-bc347d681bdc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.454437 Oct 28 19:34:59.976215 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2634/5248] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:59 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:35:00.575307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:00.576354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:00.605103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:00.609486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:00.610990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:00.612969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:00.631721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:00.632933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:00.997686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:00.998302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:01.011364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:01.012114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:01.012823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:01.016589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:01.017317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:01.017951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:01.468953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:01.480738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:01.487421 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-46117abe-16bf-4b1b-94f8-fd72baa07084 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 0.493302 Oct 28 19:35:01.502134 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7da80e49-829c-4feb-9730-39b6cc271f87 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 0.936306 Oct 28 19:35:01.503129 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2615/5249] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:00 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:01.507396 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2635/5250] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:00 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:35:01.531577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5e9b0e98-ed75-48cc-9ed5-e7f7d97d2a2a req-f76bcbdd-8501-452f-81fb-2d62aed8619c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "name": "network-vif-plugged", "status": "completed", "tag": "3c3401c0-2943-4693-9e17-73c15d6df3ac"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:01.544242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e9b0e98-ed75-48cc-9ed5-e7f7d97d2a2a req-f76bcbdd-8501-452f-81fb-2d62aed8619c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:01.544991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e9b0e98-ed75-48cc-9ed5-e7f7d97d2a2a req-f76bcbdd-8501-452f-81fb-2d62aed8619c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:01.545606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5e9b0e98-ed75-48cc-9ed5-e7f7d97d2a2a req-f76bcbdd-8501-452f-81fb-2d62aed8619c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:01.564842 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5e9b0e98-ed75-48cc-9ed5-e7f7d97d2a2a req-f76bcbdd-8501-452f-81fb-2d62aed8619c service nova] Creating event network-vif-plugged:3c3401c0-2943-4693-9e17-73c15d6df3ac for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:35:01.575543 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5e9b0e98-ed75-48cc-9ed5-e7f7d97d2a2a req-f76bcbdd-8501-452f-81fb-2d62aed8619c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047902 Oct 28 19:35:01.576529 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2616/5251] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:02.515704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:02.516339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:02.526758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:02.527970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:02.548574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:02.549119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:02.549648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:02.556194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:02.556719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:02.557170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:02.558097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:02.558674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:02.559092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:02.564052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:02.564553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:02.565149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:03.978592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:04.244946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:04.271496 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e92280d8-5e6c-4f8a-98f5-84f2a3d79bc1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 1.749880 Oct 28 19:35:04.273305 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2617/5252] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:02 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:04.288614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ca492f77-3677-41fc-8e93-f67235c478d8 req-dab91766-5317-4f41-a50e-faeace965562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67789fc5-c44b-4f0e-819d-fa93970cad4e", "tag": "5b7a5b06-aa5a-42c7-a263-3e9895fab848"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:04.303525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ca492f77-3677-41fc-8e93-f67235c478d8 req-dab91766-5317-4f41-a50e-faeace965562 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:04.304310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ca492f77-3677-41fc-8e93-f67235c478d8 req-dab91766-5317-4f41-a50e-faeace965562 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:04.305006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ca492f77-3677-41fc-8e93-f67235c478d8 req-dab91766-5317-4f41-a50e-faeace965562 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:04.319029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ca492f77-3677-41fc-8e93-f67235c478d8 req-dab91766-5317-4f41-a50e-faeace965562 service nova] Creating event network-changed:5b7a5b06-aa5a-42c7-a263-3e9895fab848 for instance 67789fc5-c44b-4f0e-819d-fa93970cad4e on n-h1-862769-3 Oct 28 19:35:04.325042 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ca492f77-3677-41fc-8e93-f67235c478d8 req-dab91766-5317-4f41-a50e-faeace965562 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050230 Oct 28 19:35:04.326842 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2618/5253] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:04.437716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:04.488651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:04.504050 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-406ddba3-261b-4c7b-b9bc-02c5f665cb9e tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1355 microversion: 2.1 time: 1.992357 Oct 28 19:35:04.506043 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2636/5254] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:02 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1355 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:05.300745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:05.301864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:05.327824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:05.330643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:05.331455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:05.338683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:05.341765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:05.342349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:05.529500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:05.530290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:05.560674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:05.562672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:05.566283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:05.567911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:05.568632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:05.569314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.021178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:06.047621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-45050b29-6816-4101-95e2-f54ad8278103 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1806 microversion: 2.1 time: 0.522320 Oct 28 19:35:06.064183 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2637/5255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:05 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1806 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:06.075142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:06.075661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:06.084883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:06.085453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:06.085894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.086762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:06.097311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:06.098208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.105433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:06.123476 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71c95530-5cda-4b91-8f10-4ee5029eb7d7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 0.829528 Oct 28 19:35:06.128105 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2619/5256] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:05 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:06.158844 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89de5f05-130e-4933-80ac-b441e59687e0 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f/ips" status: 200 len: 219 microversion: 2.1 time: 0.087270 Oct 28 19:35:06.159798 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2638/5257] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:35:06 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f/ips => generated 219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:35:06.175617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:06.176269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:06.186905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:06.187326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:06.187758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.188470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:06.201266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:06.201989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.296080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:35:06.491278 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3e694dea-3745-4d81-80e3-b51b1db16a7b tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 204 len: 0 microversion: 2.1 time: 0.319614 Oct 28 19:35:06.493937 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2620/5258] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:35:06 2022] DELETE /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:35:06.502913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:06.504373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:06.512461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:06.520373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:06.521689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.522710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:06.523358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:06.535196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:06.988941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:07.023143 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea3dee93-3918-430c-ad9a-8fa244deb20c tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1812 microversion: 2.1 time: 0.524415 Oct 28 19:35:07.024669 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2639/5259] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:06 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1812 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:07.158038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:07.159424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:07.170250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:07.171086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:07.171756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:07.173661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:07.174582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:07.175312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:07.610899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:07.615014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:07.625968 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59ecc8d1-6686-4cd3-ba86-244447b99603 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 0.473178 Oct 28 19:35:07.626984 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2621/5260] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:07 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:08.053471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:08.054606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:08.078002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:08.081461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:08.086417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:08.089416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:08.089959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:08.092760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:08.520248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:08.535995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c40cb8a-f887-4327-851b-47195ad136ac tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1812 microversion: 2.1 time: 0.491609 Oct 28 19:35:08.536610 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2640/5261] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:08 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1812 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:08.661844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:08.662889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:08.684690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:08.685407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:08.685955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:08.696433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:08.697377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:08.698229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:09.043585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:09.059196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-914fa42e-6073-4b6c-9087-d1cb36297621 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 0.402439 Oct 28 19:35:09.060158 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2622/5262] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:08 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:09.563148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:09.565889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:09.595270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:09.598442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:09.599083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:09.600020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:09.601832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:09.602278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:09.673567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ccbb59c6-88e7-49c7-85a0-d377377def5d req-3890f076-5f24-4c9b-b626-7b1483b3f64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "name": "network-vif-deleted", "tag": "c27bcf31-a085-4d1a-afd9-bd4b6fd25216"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:09.706235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ccbb59c6-88e7-49c7-85a0-d377377def5d req-3890f076-5f24-4c9b-b626-7b1483b3f64d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:09.707221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ccbb59c6-88e7-49c7-85a0-d377377def5d req-3890f076-5f24-4c9b-b626-7b1483b3f64d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:09.707808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ccbb59c6-88e7-49c7-85a0-d377377def5d req-3890f076-5f24-4c9b-b626-7b1483b3f64d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:09.724180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ccbb59c6-88e7-49c7-85a0-d377377def5d req-3890f076-5f24-4c9b-b626-7b1483b3f64d service nova] Creating event network-vif-deleted:c27bcf31-a085-4d1a-afd9-bd4b6fd25216 for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:35:09.730536 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ccbb59c6-88e7-49c7-85a0-d377377def5d req-3890f076-5f24-4c9b-b626-7b1483b3f64d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060670 Oct 28 19:35:09.733106 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2623/5263] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:35:10.086641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:10.087464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:10.109404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:10.112134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:10.113278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:10.114174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:10.114825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:10.119408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:10.933570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:10.946137 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a670081-8300-4b32-aa7b-ca30650c0471 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 0.863727 Oct 28 19:35:10.946760 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2624/5264] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:10 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:11.040274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:11.052380 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88a02124-3185-43b0-981d-003a580bbba3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1791 microversion: 2.1 time: 1.495768 Oct 28 19:35:11.056296 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2641/5265] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:09 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1791 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:11.969793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:11.971167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:11.990175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:11.990732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:11.991166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:11.991911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:11.992368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:11.992785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:12.061944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d4a9b3fa-bfc8-4045-9c4a-dd617dacc524 req-70a979b6-0ebb-482b-8a91-6c7c4fd540f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67789fc5-c44b-4f0e-819d-fa93970cad4e", "name": "network-vif-plugged", "status": "completed", "tag": "5b7a5b06-aa5a-42c7-a263-3e9895fab848"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:12.092116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d4a9b3fa-bfc8-4045-9c4a-dd617dacc524 req-70a979b6-0ebb-482b-8a91-6c7c4fd540f9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:12.096595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d4a9b3fa-bfc8-4045-9c4a-dd617dacc524 req-70a979b6-0ebb-482b-8a91-6c7c4fd540f9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:12.097283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d4a9b3fa-bfc8-4045-9c4a-dd617dacc524 req-70a979b6-0ebb-482b-8a91-6c7c4fd540f9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:12.153599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d4a9b3fa-bfc8-4045-9c4a-dd617dacc524 req-70a979b6-0ebb-482b-8a91-6c7c4fd540f9 service nova] Creating event network-vif-plugged:5b7a5b06-aa5a-42c7-a263-3e9895fab848 for instance 67789fc5-c44b-4f0e-819d-fa93970cad4e on n-h1-862769-3 Oct 28 19:35:12.169063 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d4a9b3fa-bfc8-4045-9c4a-dd617dacc524 req-70a979b6-0ebb-482b-8a91-6c7c4fd540f9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104043 Oct 28 19:35:12.180488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2642/5266] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:35:12.206614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-27517f09-3d33-4035-8f4a-7f416a24026e req-3aadfe8b-476e-4050-8dbe-1668bc937361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "name": "network-vif-deleted", "tag": "c23b2d80-818a-44d1-a5a7-83da900779fc"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:12.244980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-27517f09-3d33-4035-8f4a-7f416a24026e req-3aadfe8b-476e-4050-8dbe-1668bc937361 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:12.245686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-27517f09-3d33-4035-8f4a-7f416a24026e req-3aadfe8b-476e-4050-8dbe-1668bc937361 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:12.246364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-27517f09-3d33-4035-8f4a-7f416a24026e req-3aadfe8b-476e-4050-8dbe-1668bc937361 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:12.261291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:12.295944 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-27517f09-3d33-4035-8f4a-7f416a24026e req-3aadfe8b-476e-4050-8dbe-1668bc937361 service nova] Creating event network-vif-deleted:c23b2d80-818a-44d1-a5a7-83da900779fc for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:35:12.304987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-27517f09-3d33-4035-8f4a-7f416a24026e req-3aadfe8b-476e-4050-8dbe-1668bc937361 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121093 Oct 28 19:35:12.306554 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2643/5267] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:12.314115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:12.316223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:12.324266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:12.325808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:12.326635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:12.329096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:12.329976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:12.330848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:12.611849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:12.639327 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-daadc97c-a4db-45ad-b9be-9eb78ce84ea5 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 200 len: 1455 microversion: 2.1 time: 0.330966 Oct 28 19:35:12.642442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2644/5268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:12 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 1455 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:13.031642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:13.045912 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-926743ee-a1d0-49d9-8709-f48c824700f3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 1.076301 Oct 28 19:35:13.061059 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2625/5269] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:11 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:13.667411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:13.669056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:13.694475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:13.698053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:13.699210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:13.701193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:13.702405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:13.703170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:13.760221 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] HTTP exception thrown: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Request method failure captured: Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f HTTP/1.1 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6rr8qYBcwlrCXr_JMuq98mQIdjXB1GHYw0LMDdvHR3sfyS4rEDYVq3iaU4puMbh1Mz2PUQxcmAncbY_VR4WtjE-spMsoHbJMSTvwtf4q2gKm4tg4EM1T9Ad6FbfQtIXI7GyQRAm_8MxJ_4Zv0o22QD4uk9dzHCxW8oWVxZ0YPfcXw Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f3c6f56ea0c4944a0c8dcc6ff99a7b7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestMultiNic-1317335263 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b5083294b9143da93df5a8a35bce249 Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8066c813-b46e-4eca-a751-8df4a1cf9c1f'} Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:35:13.764028 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:35:13.767887 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:35:13.770224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Returning 404 to user: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:35:13.774765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e66ffd08-b2c8-4803-b2f8-026a2569c0fc tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 404 len: 111 microversion: 2.1 time: 0.113004 Oct 28 19:35:13.775945 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2645/5270] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:13 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:35:14.070774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:14.071407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:14.078381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:14.091574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:14.094851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:14.095921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:14.100383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:14.101113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:14.606370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b15d0956-63c0-474a-8660-56a004ab6bcc req-55cd21e4-58f2-400a-8d75-4e7a5c9d8f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8066c813-b46e-4eca-a751-8df4a1cf9c1f", "name": "network-vif-deleted", "tag": "3c3401c0-2943-4693-9e17-73c15d6df3ac"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:14.649608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b15d0956-63c0-474a-8660-56a004ab6bcc req-55cd21e4-58f2-400a-8d75-4e7a5c9d8f30 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:14.650190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b15d0956-63c0-474a-8660-56a004ab6bcc req-55cd21e4-58f2-400a-8d75-4e7a5c9d8f30 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:14.650737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b15d0956-63c0-474a-8660-56a004ab6bcc req-55cd21e4-58f2-400a-8d75-4e7a5c9d8f30 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:14.697289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b15d0956-63c0-474a-8660-56a004ab6bcc req-55cd21e4-58f2-400a-8d75-4e7a5c9d8f30 service nova] Creating event network-vif-deleted:3c3401c0-2943-4693-9e17-73c15d6df3ac for instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f on n-h2-862769-3 Oct 28 19:35:14.724625 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b15d0956-63c0-474a-8660-56a004ab6bcc req-55cd21e4-58f2-400a-8d75-4e7a5c9d8f30 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132796 Oct 28 19:35:14.725556 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2646/5271] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:35:15.084478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:15.112560 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f9934085-31c9-45cb-9e08-eed75f0f1e69 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1365 microversion: 2.1 time: 1.038144 Oct 28 19:35:15.136445 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2626/5272] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:14 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1365 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:16.161702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:16.163336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:16.183142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:16.184165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:16.184623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:16.185365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:16.185827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:16.186253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:17.195799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:17.211374 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4cf3b573-ac15-4bad-a07c-72d5b9408dd4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1555 microversion: 2.1 time: 1.047430 Oct 28 19:35:17.232915 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2647/5273] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:16 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1555 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:17.247178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:17.248509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:17.278495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:17.279611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:17.280253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:17.281914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:17.282609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:17.283471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:17.585483 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed2d864c-4d76-485f-bc52-a467b85a9b44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.348443 Oct 28 19:35:17.586748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2627/5274] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:35:17 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-interface => generated 284 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:23.760119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3f76d54d-0644-4f8a-8010-da78342d3a81 req-6a399ff6-7c98-47a6-93a9-1925465917aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67789fc5-c44b-4f0e-819d-fa93970cad4e", "tag": "5b7a5b06-aa5a-42c7-a263-3e9895fab848"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:23.786517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3f76d54d-0644-4f8a-8010-da78342d3a81 req-6a399ff6-7c98-47a6-93a9-1925465917aa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:23.787754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3f76d54d-0644-4f8a-8010-da78342d3a81 req-6a399ff6-7c98-47a6-93a9-1925465917aa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:23.789017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3f76d54d-0644-4f8a-8010-da78342d3a81 req-6a399ff6-7c98-47a6-93a9-1925465917aa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:23.814827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3f76d54d-0644-4f8a-8010-da78342d3a81 req-6a399ff6-7c98-47a6-93a9-1925465917aa service nova] Creating event network-changed:5b7a5b06-aa5a-42c7-a263-3e9895fab848 for instance 67789fc5-c44b-4f0e-819d-fa93970cad4e on n-h1-862769-3 Oct 28 19:35:23.834909 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3f76d54d-0644-4f8a-8010-da78342d3a81 req-6a399ff6-7c98-47a6-93a9-1925465917aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085297 Oct 28 19:35:23.836604 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2648/5275] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:35:24.532108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:24.532704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:24.552791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:24.553174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:24.553928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:24.555270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:24.555852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:24.556423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:24.609668 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-52b050f8-690a-4a11-85af-096c692ec05f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/ips" status: 200 len: 150 microversion: 2.20 time: 0.083918 Oct 28 19:35:24.619552 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2628/5276] 10.222.0.44 () {60 vars in 1289 bytes} [Fri Oct 28 19:35:24 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:35:27.999037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1401316695", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "04348c45-363f-4765-ba85-e974ee97ba36"}, {"uuid": "8d574e39-73e6-4195-8763-07e3f9030062"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:28.026340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:28.138220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] validate_networks() for [('04348c45-363f-4765-ba85-e974ee97ba36', None, None, None, None, None), ('8d574e39-73e6-4195-8763-07e3f9030062', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:35:29.280438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:29.282012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:29.323797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:29.331820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:29.332354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:29.332811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:29.333564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:29.334033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:29.339770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:29.403920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lazy-loading 'flavor' on Instance uuid a7861545-ef63-4ef6-952c-5cbb25ffd454 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:35:29.764261 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-33a51081-980d-4d8b-bbab-381ce34477e8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/action" status: 202 len: 0 microversion: 2.20 time: 0.487553 Oct 28 19:35:29.767185 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2629/5277] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:35:29 2022] POST /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:35:29.785144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:29.787880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:29.805091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:29.808096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:29.808638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:29.809460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:29.809933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:29.810360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:31.270139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:31.280922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:31.283227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:31.285172 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dfa10c9e-3182-4b80-a5f3-93c3aeac7c7e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 1.513315 Oct 28 19:35:31.286168 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2630/5278] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:29 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:32.071994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:35:32.072948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:35:32.074790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:35:32.075502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:35:32.077520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:35:32.093991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:32.094730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:32.095337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:32.096399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:32.098508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:32.099298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:32.169658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Getting quotas for project 7f3c6f56ea0c4944a0c8dcc6ff99a7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:35:32.188233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Getting quotas for user 2b5083294b9143da93df5a8a35bce249 and project 7f3c6f56ea0c4944a0c8dcc6ff99a7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:35:32.214619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:35:32.218281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:35:32.294852 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a9baf582-7af1-4065-8656-780df086c3ef tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.295034 Oct 28 19:35:32.305769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2649/5279] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:35:32.312253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a1a47ae-6bed-426b-8399-ec24f7056bdb tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:32.313074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a1a47ae-6bed-426b-8399-ec24f7056bdb tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:32.316332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:32.317980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:32.334488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:32.337040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:32.337888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:32.340855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:32.341512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:32.342967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:32.531948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a1a47ae-6bed-426b-8399-ec24f7056bdb tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:32.549351 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a1a47ae-6bed-426b-8399-ec24f7056bdb tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1213 microversion: 2.1 time: 0.241811 Oct 28 19:35:32.552052 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2631/5280] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:32 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:32.721473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:32.736362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:32.738150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:32.743711 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5148a1b-05a6-423a-a59b-f302a5d3e871 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 0.435811 Oct 28 19:35:32.744877 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2650/5281] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:32 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:33.575917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:33.576592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:33.591306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:33.593157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:33.593623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:33.594383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:33.597544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:33.600392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:33.775192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:33.775865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:33.790606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:33.791394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:33.791999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:33.793816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:33.796247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:33.796927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:34.567119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:34.579975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d0a37b5-8131-4607-8a24-1c979342a33a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1265 microversion: 2.1 time: 1.005367 Oct 28 19:35:34.583492 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2632/5282] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:33 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1265 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:34.859377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:34.876585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:34.880134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:34.884952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c84127f-9c7c-4f01-8fea-e3be1cef0bfa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 1.113798 Oct 28 19:35:34.888898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2651/5283] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:33 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:35:35.610286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:35.610993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:35.633033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:35.642304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:35.643072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:35.644169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:35.644929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:35.645513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:35.914903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:35.915781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:35.937378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:35.937769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:35.938400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:35.939526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:35.940830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:35.941804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:36.080164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:36.111353 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7347f1e2-607e-4204-857b-7935f73bbf7d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1271 microversion: 2.1 time: 0.505998 Oct 28 19:35:36.112865 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2633/5284] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:35 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1271 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:36.467912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:36.478944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:36.485691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:36.487908 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a11f18d9-0244-4c36-a855-72238abd8cde tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 0.579090 Oct 28 19:35:36.492050 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2652/5285] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:35 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:37.137267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:37.137882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:37.155127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:37.162307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:37.162792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:37.164141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:37.164624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:37.165072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:37.364079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:37.378637 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6449e587-0a8e-4dbd-b94c-ac32f1a4fe06 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1271 microversion: 2.1 time: 0.240378 Oct 28 19:35:37.379814 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2634/5286] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:37 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:37.543353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:37.545974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:37.574241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:37.575393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:37.577141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:37.581367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:37.582054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:37.584678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:38.407885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:38.408762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:38.425555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:38.426256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:38.427426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:38.429453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:38.432871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:38.433824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:38.490211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:38.505811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:38.511022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:38.514499 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d9381895-8a68-4576-b25f-24b630089e4f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 0.990655 Oct 28 19:35:38.516898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2653/5287] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:37 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:38.763440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:38.771611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:38.779016 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-66b7b3df-8604-463f-b79a-fe8a274003f2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1271 microversion: 2.1 time: 0.375961 Oct 28 19:35:38.783299 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2635/5288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:38 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:39.553766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:39.556189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:39.602368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:39.611298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:39.612107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:39.615901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:39.619291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:39.621286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:39.813822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:39.815867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:39.864061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:39.865352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:39.866463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:39.871239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:39.872449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:39.877750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:40.515330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:40.538424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:40.540601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:40.542510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:40.547946 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6310dbc4-2019-4c05-b00f-836b2e047f22 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1313 microversion: 2.1 time: 0.743186 Oct 28 19:35:40.548544 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24ef36c5-5a1e-4cf7-8393-603af6d896c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 1.003866 Oct 28 19:35:40.548847 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2636/5289] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:39 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:40.563190 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2654/5290] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:39 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:35:41.584400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:41.585042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:41.585924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:41.586791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:41.607976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:41.612042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:41.612536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:41.612977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:41.624985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:41.625523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:41.627684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:41.628510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:41.633364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:41.633838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:41.634596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:41.636717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:42.130405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:42.197724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:42.372013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:42.388815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf9ca7cf-d30f-408d-89e6-8620263649cf tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.813797 Oct 28 19:35:42.392379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2637/5291] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:41 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:42.723917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:42.726217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=56 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:42.770074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:42.772003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:42.774848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bbdf5a8e-8598-4eba-aa93-64b082883abe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1743 microversion: 2.20 time: 1.203259 Oct 28 19:35:42.776000 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2655/5292] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:41 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1743 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:43.428202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:43.428841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:43.431834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a7f23945-df5e-4eb0-ae23-ac1a18f0dda2 req-ffe80d3b-e9b9-4a67-9b0a-cd778068b8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d82589c-35bd-411f-8873-8fff3967ed8c", "tag": "d44b3653-adba-4a8e-ad83-9341783e1077"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:43.450954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:43.463607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:43.464931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:43.465389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:43.474502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:43.477063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:43.477627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:43.498676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a7f23945-df5e-4eb0-ae23-ac1a18f0dda2 req-ffe80d3b-e9b9-4a67-9b0a-cd778068b8ae service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:43.499144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a7f23945-df5e-4eb0-ae23-ac1a18f0dda2 req-ffe80d3b-e9b9-4a67-9b0a-cd778068b8ae service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:43.500956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a7f23945-df5e-4eb0-ae23-ac1a18f0dda2 req-ffe80d3b-e9b9-4a67-9b0a-cd778068b8ae service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:43.559661 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a7f23945-df5e-4eb0-ae23-ac1a18f0dda2 req-ffe80d3b-e9b9-4a67-9b0a-cd778068b8ae service nova] Creating event network-changed:d44b3653-adba-4a8e-ad83-9341783e1077 for instance 2d82589c-35bd-411f-8873-8fff3967ed8c on n-h2-862769-3 Oct 28 19:35:43.569192 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a7f23945-df5e-4eb0-ae23-ac1a18f0dda2 req-ffe80d3b-e9b9-4a67-9b0a-cd778068b8ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160551 Oct 28 19:35:43.571188 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2638/5293] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:43.805991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:43.806898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:43.818572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:43.821703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:43.825740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:43.829820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:43.830615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:43.838880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:44.488406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:44.506603 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8cf53b1b-c6b9-49a5-9265-cd3f2c66e99f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 1.095865 Oct 28 19:35:44.514189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2656/5294] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:43 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:44.636943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:44.655807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:44.660571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:44.661831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-736094a6-e064-47f8-b540-754805ddf12c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.861174 Oct 28 19:35:44.662416 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2639/5295] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:43 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:35:45.530241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:45.531285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:45.549868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:45.550608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:45.555431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:45.557769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:45.558266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:45.558724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:45.692895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:45.693565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:45.708626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:45.722203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:45.725651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:45.726807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:45.727476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:45.733390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:46.363232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:46.376062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:46.378879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:46.380573 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7c35251f-3334-46a5-b3bb-5108f7819dfb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.693142 Oct 28 19:35:46.381827 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2640/5296] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:45 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:35:46.445161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e946145f-8eb0-4794-83d6-089400309a84 req-59348971-bb17-4d0f-ba4f-361c3b2d85c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d82589c-35bd-411f-8873-8fff3967ed8c", "tag": "5b70e28c-0036-436f-bb59-2fb0a2422227"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:46.504227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e946145f-8eb0-4794-83d6-089400309a84 req-59348971-bb17-4d0f-ba4f-361c3b2d85c2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:46.504756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e946145f-8eb0-4794-83d6-089400309a84 req-59348971-bb17-4d0f-ba4f-361c3b2d85c2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:46.505190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e946145f-8eb0-4794-83d6-089400309a84 req-59348971-bb17-4d0f-ba4f-361c3b2d85c2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:46.554944 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e946145f-8eb0-4794-83d6-089400309a84 req-59348971-bb17-4d0f-ba4f-361c3b2d85c2 service nova] Creating event network-changed:5b70e28c-0036-436f-bb59-2fb0a2422227 for instance 2d82589c-35bd-411f-8873-8fff3967ed8c on n-h2-862769-3 Oct 28 19:35:46.565408 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e946145f-8eb0-4794-83d6-089400309a84 req-59348971-bb17-4d0f-ba4f-361c3b2d85c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123935 Oct 28 19:35:46.568420 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2641/5297] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:47.362081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:47.381446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09a2092f-dd39-47aa-8831-35393471f156 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 1.855115 Oct 28 19:35:47.408447 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2657/5298] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:45 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:47.429975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:47.431826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:47.444981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:47.445487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:47.445931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:47.446638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:47.447140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:47.449000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:47.988939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7222256e-a8a2-43ef-8e4c-f3ae37c74e05 req-00d81c34-0def-4cbf-8778-f03bfb3a6c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "name": "network-vif-plugged", "status": "completed", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:35:48.000598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:48.025517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:48.032277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:48.043853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9f6bbb8-aeaa-4e45-b948-83baf8a839c3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.630009 Oct 28 19:35:48.047433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7222256e-a8a2-43ef-8e4c-f3ae37c74e05 req-00d81c34-0def-4cbf-8778-f03bfb3a6c16 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:48.048183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7222256e-a8a2-43ef-8e4c-f3ae37c74e05 req-00d81c34-0def-4cbf-8778-f03bfb3a6c16 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:48.049002 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2642/5299] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:47 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:48.063707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7222256e-a8a2-43ef-8e4c-f3ae37c74e05 req-00d81c34-0def-4cbf-8778-f03bfb3a6c16 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:48.096341 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7222256e-a8a2-43ef-8e4c-f3ae37c74e05 req-00d81c34-0def-4cbf-8778-f03bfb3a6c16 service nova] Creating event network-vif-plugged:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:35:48.112277 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7222256e-a8a2-43ef-8e4c-f3ae37c74e05 req-00d81c34-0def-4cbf-8778-f03bfb3a6c16 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129376 Oct 28 19:35:48.113098 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2658/5300] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:48.406209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:48.407575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:48.433255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:48.438377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:48.439436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:48.442208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:48.445078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:48.445744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:48.986298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:48.997636 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7d4cdf0a-a747-44d4-b006-725c0e567d80 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.594997 Oct 28 19:35:49.000113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2643/5301] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:48 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:49.079603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:49.080324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:49.099088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:49.105395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:49.105924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:49.106753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:49.107208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:49.116617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:50.021742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:50.022410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:50.035520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:50.036025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:50.037234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:50.037974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:50.045932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:50.049941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:50.050789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:50.062095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:50.068415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:50.084982 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-762d92c3-da34-428a-a0d0-11919aec2d27 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 1.010266 Oct 28 19:35:50.085665 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2659/5302] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:49 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:50.606959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:50.615822 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-63d36a94-91d5-42fa-9ef4-472de7517740 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.598119 Oct 28 19:35:50.618538 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2644/5303] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:50 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:35:51.122161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:51.123043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:51.137473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:51.139513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:51.142793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:51.149587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:51.150222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:51.150671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:51.649291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:51.649795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:51.681815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:51.683093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:51.692525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:51.694290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:51.695448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:51.699114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:51.886948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:51.896811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:51.901796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:51.913808 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-439ccbcd-187e-4ee4-8185-16a6e70e51f5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.796079 Oct 28 19:35:51.919306 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2660/5304] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:51 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:52.611730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:52.620675 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f90af7a-6742-457b-ac52-313e7abaf025 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.981066 Oct 28 19:35:52.627102 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2645/5305] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:51 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:52.946283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:52.947357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:52.955832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:52.960761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:52.961704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:52.965565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:52.966197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:52.966803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:53.665422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:53.666789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:53.684445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:53.688233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:53.696196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:53.700656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:53.703860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:53.704357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:54.641590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:54.655075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2493296e-46ab-49e1-b84c-485a5a16fda4 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.998904 Oct 28 19:35:54.657004 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2646/5306] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:53 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:35:54.729428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:54.747924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:54.751069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:54.754539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0cd6993b-1b97-4eb0-a466-615833fcdeaa tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 1.812689 Oct 28 19:35:54.755723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2661/5307] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:52 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:55.680778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:55.681590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:55.705736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:55.707830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:55.711535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:55.712762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:55.713469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:55.714839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:55.783852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:55.785344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:55.868818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:55.872042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:55.872617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:55.875188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:55.880085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:55.881611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:56.456433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:56.466140 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01342c20-ee42-4b8b-8b8e-d26554cf3636 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.792029 Oct 28 19:35:56.466759 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2647/5308] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:55 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:56.481984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:56.495774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:56.523915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:56.524628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:56.525216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:56.526826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:56.527469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:56.528142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:56.610484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:56.620323 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-edeef072-5a1f-4aa5-ae29-b5881c4309ea tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/ips" status: 200 len: 149 microversion: 2.1 time: 0.143436 Oct 28 19:35:56.622218 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2648/5309] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:35:56 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/ips => generated 149 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:35:56.631538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:56.638682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:56.645672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f979a700-208c-4f18-8225-91b3b93c45ca tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.863709 Oct 28 19:35:56.649266 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2662/5310] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:55 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:35:57.495020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:57.497685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:57.518293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:57.534314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:57.534832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:57.551439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:57.553261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:57.556423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:57.679222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:57.679839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:57.703710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:57.704248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:57.710425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:57.715572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:57.722526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:57.722526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:58.685823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:58.701293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:58.707952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:58.710588 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a47fba30-60c2-4d0d-8634-58c17e05006a tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 1.037723 Oct 28 19:35:58.715367 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2663/5311] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:57 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:35:58.994388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:35:59.010413 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f2f3b53f-a4f7-4070-b800-b4bbbdbca471 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 1.523273 Oct 28 19:35:59.011767 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2649/5312] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:35:57 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:35:59.743889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:35:59.744690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:35:59.749933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:35:59.799887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:59.811894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:59.812592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:35:59.815872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:35:59.823406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:35:59.826192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.038161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:00.039562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:00.044309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=44 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:00.070247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.071380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.072018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.073116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.073996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.074884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.690032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:00.692017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:00.701896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:00.703507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:00.705191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53dcf890-c6bf-4567-b653-591b2fbd013c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.966594 Oct 28 19:36:00.707106 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2664/5313] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:35:59 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:00.713597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2f3e24e9-c51b-43bf-a73d-f58067d63fa4 req-18c00790-4890-4641-964c-ca3d9c5d5289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d82589c-35bd-411f-8873-8fff3967ed8c", "name": "network-vif-plugged", "status": "completed", "tag": "5b70e28c-0036-436f-bb59-2fb0a2422227"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:00.727280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2f3e24e9-c51b-43bf-a73d-f58067d63fa4 req-18c00790-4890-4641-964c-ca3d9c5d5289 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.731831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2f3e24e9-c51b-43bf-a73d-f58067d63fa4 req-18c00790-4890-4641-964c-ca3d9c5d5289 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.755577 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-185f08c9-c6f4-4905-b825-34dfb9a3dda9 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.706839 Oct 28 19:36:00.759591 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2650/5314] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:00 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:00.763941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2f3e24e9-c51b-43bf-a73d-f58067d63fa4 req-18c00790-4890-4641-964c-ca3d9c5d5289 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.800131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2f3e24e9-c51b-43bf-a73d-f58067d63fa4 req-18c00790-4890-4641-964c-ca3d9c5d5289 service nova] Creating event network-vif-plugged:5b70e28c-0036-436f-bb59-2fb0a2422227 for instance 2d82589c-35bd-411f-8873-8fff3967ed8c on n-h2-862769-3 Oct 28 19:36:00.814353 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2f3e24e9-c51b-43bf-a73d-f58067d63fa4 req-18c00790-4890-4641-964c-ca3d9c5d5289 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105676 Oct 28 19:36:00.815267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2665/5315] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:01.409243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba59ab46-991b-4dff-993d-dae560f7dbde"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:01.418195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:01.450882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:01.451869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:01.452499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:01.453617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:01.460867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:01.464304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:01.736472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:01.737539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:01.760462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:01.761528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:01.762144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:01.765055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:01.766264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:01.768561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:02.081010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:02.092814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:02.094284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:02.103948 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-766250f2-8ba1-4042-ae51-6bcbe2bb2382 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.372240 Oct 28 19:36:02.105374 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2666/5316] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:01 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:02.116214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:02.118296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:02.139322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:02.140133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:02.140812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:02.141955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:02.143165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:02.143748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:02.440551 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1aae607-f9bf-4c11-8242-21bfbf81fc1e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036813 Oct 28 19:36:02.444563 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2651/5317] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:36:01 2022] POST /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:02.889286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-04eab1bd-49ff-43d8-ada1-7163eb7463fd req-7832db78-92dc-47be-b2ca-1fd10fbd0549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d82589c-35bd-411f-8873-8fff3967ed8c", "name": "network-vif-plugged", "status": "completed", "tag": "d44b3653-adba-4a8e-ad83-9341783e1077"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:02.937804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:02.942774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04eab1bd-49ff-43d8-ada1-7163eb7463fd req-7832db78-92dc-47be-b2ca-1fd10fbd0549 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:02.943319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04eab1bd-49ff-43d8-ada1-7163eb7463fd req-7832db78-92dc-47be-b2ca-1fd10fbd0549 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:02.947685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04eab1bd-49ff-43d8-ada1-7163eb7463fd req-7832db78-92dc-47be-b2ca-1fd10fbd0549 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:02.948205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a506e187-7bec-4c6f-99d6-4e50308bb521 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.841542 Oct 28 19:36:02.959930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2667/5318] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:02 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:03.007560 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-04eab1bd-49ff-43d8-ada1-7163eb7463fd req-7832db78-92dc-47be-b2ca-1fd10fbd0549 service nova] Creating event network-vif-plugged:d44b3653-adba-4a8e-ad83-9341783e1077 for instance 2d82589c-35bd-411f-8873-8fff3967ed8c on n-h2-862769-3 Oct 28 19:36:03.030616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-04eab1bd-49ff-43d8-ada1-7163eb7463fd req-7832db78-92dc-47be-b2ca-1fd10fbd0549 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146419 Oct 28 19:36:03.039852 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2652/5319] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:03.136703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:03.137615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:03.150652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:03.151821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:03.152450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:03.155351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:03.156009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:03.157781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:03.917250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:03.930987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:03.934517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:03.936450 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4114e39d-34c4-4db0-9ed6-d86ce517f638 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.804004 Oct 28 19:36:03.937624 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2668/5320] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:03 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:03.977161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:03.978725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:04.024572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:04.031323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:04.034491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:04.038551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:04.040185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:04.041236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:04.098999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:04.806794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:04.816495 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7c84102b-7814-4e7f-a7cf-d50c7c4ff34a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1334 microversion: 2.1 time: 0.846976 Oct 28 19:36:04.837151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2653/5321] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:03 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1334 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:04.971776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:04.973565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:04.986928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:04.990060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:04.991870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:04.993207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:04.995293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:04.996980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:05.569670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:05.590919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:05.598498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:05.599822 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-648218d8-e04d-437e-90ba-54b35a977eb4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.640672 Oct 28 19:36:05.607871 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2669/5322] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:04 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:05.848145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:05.849035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:05.873952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:05.874481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:05.874956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:05.883468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:05.886710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:05.887369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.553816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:06.565539 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-67e0795c-4ed9-43d9-8d38-48a34a8300e2 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1668 microversion: 2.1 time: 0.722093 Oct 28 19:36:06.571805 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2654/5323] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:05 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1668 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:06.615907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:06.616469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:06.642622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:06.643290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:06.657341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.658112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.661215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.663471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.668702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.669232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.669945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.679227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.679636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.683465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.685845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.686518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.784922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4323dcb-3776-495c-bcc1-c3255f05222a tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c/ips" status: 200 len: 178 microversion: 2.1 time: 0.186785 Oct 28 19:36:06.792339 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2670/5324] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:36:06 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c/ips => generated 178 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:06.807642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:06.808471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:06.817442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.821449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.829829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.830954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.831661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.832277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.931012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:36:07.145047 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8626dad2-3923-4628-860e-c0bc6753ce61 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 204 len: 0 microversion: 2.1 time: 0.344277 Oct 28 19:36:07.150645 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2671/5325] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:36:06 2022] DELETE /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:36:07.160432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:07.165474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:07.179122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:07.179625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:07.180062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:07.182591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:07.183194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:07.183615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:07.218579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:08.040445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:08.059740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:08.061247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:08.069575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12c30508-23ac-49de-a64f-3b454b643398 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 1.433735 Oct 28 19:36:08.073226 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2655/5326] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:06 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:08.235342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:08.250889 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2e03d86-0932-4c90-ae97-8653a8b8cf26 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1674 microversion: 2.1 time: 1.094863 Oct 28 19:36:08.252072 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2672/5327] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:07 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1674 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:09.098527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:09.108399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:09.178854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:09.179361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:09.179802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:09.185603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:09.187812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:09.189488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:09.279955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:09.281573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:09.303246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:09.307952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:09.309616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:09.312538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:09.315401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:09.317903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:10.041480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:10.054255 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a9a3e5a-e501-41e3-8a8c-8df2d9ef20c3 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1674 microversion: 2.1 time: 0.780139 Oct 28 19:36:10.065845 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2673/5328] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:09 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1674 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:10.098804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e2cc957c-368a-4a0c-8fb6-feaf3ef17bab req-76df387a-855e-4e70-809a-47f0ddcfe344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d82589c-35bd-411f-8873-8fff3967ed8c", "name": "network-vif-deleted", "tag": "5b70e28c-0036-436f-bb59-2fb0a2422227"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:10.128569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e2cc957c-368a-4a0c-8fb6-feaf3ef17bab req-76df387a-855e-4e70-809a-47f0ddcfe344 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:10.133125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e2cc957c-368a-4a0c-8fb6-feaf3ef17bab req-76df387a-855e-4e70-809a-47f0ddcfe344 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:10.137309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e2cc957c-368a-4a0c-8fb6-feaf3ef17bab req-76df387a-855e-4e70-809a-47f0ddcfe344 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:10.157892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:10.167434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:10.190999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:10.192424 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd595564-b3dd-436b-ac6f-94eade1b4e1e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 1.099837 Oct 28 19:36:10.193037 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2656/5329] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:09 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:10.244937 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e2cc957c-368a-4a0c-8fb6-feaf3ef17bab req-76df387a-855e-4e70-809a-47f0ddcfe344 service nova] Creating event network-vif-deleted:5b70e28c-0036-436f-bb59-2fb0a2422227 for instance 2d82589c-35bd-411f-8873-8fff3967ed8c on n-h2-862769-3 Oct 28 19:36:10.263058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e2cc957c-368a-4a0c-8fb6-feaf3ef17bab req-76df387a-855e-4e70-809a-47f0ddcfe344 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165020 Oct 28 19:36:10.265424 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2674/5330] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:36:11.091089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:11.091860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:11.119024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:11.119464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:11.119908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:11.120649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:11.121235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:11.121566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:11.234578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:11.237019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:11.275154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:11.276516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:11.278440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:11.279522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:11.281504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:11.283879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:11.369084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5083294b9143da93df5a8a35bce249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3c6f56ea0c4944a0c8dcc6ff99a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:11.380829 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b086db3a-fcd0-485f-9835-6c3a1ab45969 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 200 len: 1454 microversion: 2.1 time: 0.291206 Oct 28 19:36:11.383993 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2657/5331] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:11 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 1454 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:11.890973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:11.913079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:11.918468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:11.941472 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c6f8e43c-d970-4618-8a54-021cc8f272b9 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.705060 Oct 28 19:36:11.945495 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2675/5332] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:11 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:12.306057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-95ae98ee-9454-4c52-ac09-927cd6f2ea08 req-9d9b7445-8f33-494f-b658-47d74b3c8700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d82589c-35bd-411f-8873-8fff3967ed8c", "name": "network-vif-deleted", "tag": "d44b3653-adba-4a8e-ad83-9341783e1077"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:12.363353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-95ae98ee-9454-4c52-ac09-927cd6f2ea08 req-9d9b7445-8f33-494f-b658-47d74b3c8700 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:12.367041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-95ae98ee-9454-4c52-ac09-927cd6f2ea08 req-9d9b7445-8f33-494f-b658-47d74b3c8700 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:12.368848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-95ae98ee-9454-4c52-ac09-927cd6f2ea08 req-9d9b7445-8f33-494f-b658-47d74b3c8700 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:12.411508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:12.412555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:12.442882 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-95ae98ee-9454-4c52-ac09-927cd6f2ea08 req-9d9b7445-8f33-494f-b658-47d74b3c8700 service nova] Creating event network-vif-deleted:d44b3653-adba-4a8e-ad83-9341783e1077 for instance 2d82589c-35bd-411f-8873-8fff3967ed8c on n-h2-862769-3 Oct 28 19:36:12.447476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:12.448827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:12.450544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:12.452640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:12.455734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:12.457771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:12.471441 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-95ae98ee-9454-4c52-ac09-927cd6f2ea08 req-9d9b7445-8f33-494f-b658-47d74b3c8700 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168475 Oct 28 19:36:12.478844 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2658/5333] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:12.516270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] HTTP exception thrown: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Request method failure captured: Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c HTTP/1.1 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6rr8qYBcwlrCXr_JMuq98mQIdjXB1GHYw0LMDdvHR3sfyS4rEDYVq3iaU4puMbh1Mz2PUQxcmAncbY_VR4WtjE-spMsoHbJMSTvwtf4q2gKm4tg4EM1T9Ad6FbfQtIXI7GyQRAm_8MxJ_4Zv0o22QD4uk9dzHCxW8oWVxZ0YPfcXw Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f3c6f56ea0c4944a0c8dcc6ff99a7b7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b5083294b9143da93df5a8a35bce249 Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2d82589c-35bd-411f-8873-8fff3967ed8c'} Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:12.522733 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Returning 404 to user: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:36:12.526608 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-65a1a1a7-8fc7-4d5e-8277-c1b8b9f47f29 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 404 len: 111 microversion: 2.1 time: 0.121552 Oct 28 19:36:12.535191 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2676/5334] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:12 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:36:12.971582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:12.972829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:13.023818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:13.028307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:13.032424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:13.036264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:13.044682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:13.046359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:13.838264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:13.853175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:13.860671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:13.862395 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57d3d16f-25cf-4076-89ec-77b7bdc0966e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.896519 Oct 28 19:36:13.866916 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2659/5335] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:12 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:14.897356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:14.898073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:14.931678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:14.932534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:14.932989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:14.933735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:14.934190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:14.934604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:15.592377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:15.611587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:15.613770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:15.615513 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fcf2d0cb-9834-45de-b9ea-2c2ac2ea44d5 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1738 microversion: 2.20 time: 0.722190 Oct 28 19:36:15.641671 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2677/5336] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:14 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1738 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:16.645233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:16.647056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:16.674654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:16.675198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:16.675646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:16.693634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:16.693634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:16.693634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:17.201074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:17.217372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:17.230104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:17.233003 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b131c863-fe23-477b-a864-0a190d631c89 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1720 microversion: 2.20 time: 0.594624 Oct 28 19:36:17.237092 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2660/5337] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:16 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1720 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:18.190179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:18.191411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:18.219467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.220007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.220531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.221342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.221956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.222469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.267986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:18.268685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:18.298419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.298968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.303215 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] HTTP exception thrown: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Request method failure captured: Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c HTTP/1.1 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6rr8qYBcwlrCXr_JMuq98mQIdjXB1GHYw0LMDdvHR3sfyS4rEDYVq3iaU4puMbh1Mz2PUQxcmAncbY_VR4WtjE-spMsoHbJMSTvwtf4q2gKm4tg4EM1T9Ad6FbfQtIXI7GyQRAm_8MxJ_4Zv0o22QD4uk9dzHCxW8oWVxZ0YPfcXw Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f3c6f56ea0c4944a0c8dcc6ff99a7b7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b5083294b9143da93df5a8a35bce249 Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2d82589c-35bd-411f-8873-8fff3967ed8c'} Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:36:18.304999 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Returning 404 to user: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:36:18.309506 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e0cb910f-632b-461b-b82e-749eecc1bc2d tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 404 len: 111 microversion: 2.1 time: 0.123079 Oct 28 19:36:18.310903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.312024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.312744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.315855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.333927 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2678/5338] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:36:18 2022] DELETE /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:36:18.353650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:18.361845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 2d82589c-35bd-411f-8873-8fff3967ed8c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:18.401469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.402175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.413384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.414450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.419419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.421824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.468491 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] HTTP exception thrown: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Request method failure captured: Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c HTTP/1.1 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6rr8qYBcwlrCXr_JMuq98mQIdjXB1GHYw0LMDdvHR3sfyS4rEDYVq3iaU4puMbh1Mz2PUQxcmAncbY_VR4WtjE-spMsoHbJMSTvwtf4q2gKm4tg4EM1T9Ad6FbfQtIXI7GyQRAm_8MxJ_4Zv0o22QD4uk9dzHCxW8oWVxZ0YPfcXw Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f3c6f56ea0c4944a0c8dcc6ff99a7b7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b5083294b9143da93df5a8a35bce249 Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2d82589c-35bd-411f-8873-8fff3967ed8c'} Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.470326 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Returning 404 to user: Instance 2d82589c-35bd-411f-8873-8fff3967ed8c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:36:18.474381 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83306961-341a-434d-a44d-e927434ad38f tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c" status: 404 len: 111 microversion: 2.1 time: 0.133016 Oct 28 19:36:18.481089 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2679/5339] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:18 2022] GET /compute/v2.1/servers/2d82589c-35bd-411f-8873-8fff3967ed8c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:36:18.486384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:18.487008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:18.494625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.495223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.495922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.496965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.497585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.498186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.524841 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] HTTP exception thrown: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Request method failure captured: Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f HTTP/1.1 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6rr8qYBcwlrCXr_JMuq98mQIdjXB1GHYw0LMDdvHR3sfyS4rEDYVq3iaU4puMbh1Mz2PUQxcmAncbY_VR4WtjE-spMsoHbJMSTvwtf4q2gKm4tg4EM1T9Ad6FbfQtIXI7GyQRAm_8MxJ_4Zv0o22QD4uk9dzHCxW8oWVxZ0YPfcXw Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f3c6f56ea0c4944a0c8dcc6ff99a7b7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b5083294b9143da93df5a8a35bce249 Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8066c813-b46e-4eca-a751-8df4a1cf9c1f'} Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:36:18.536712 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.541446 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.543426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Returning 404 to user: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:36:18.544485 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9277350d-4d30-4e40-9dff-c85aa3287223 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 404 len: 111 microversion: 2.1 time: 0.062435 Oct 28 19:36:18.548484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2680/5340] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:36:18 2022] DELETE /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:36:18.553625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:18.558365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] [instance: 8066c813-b46e-4eca-a751-8df4a1cf9c1f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:18.566452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.570682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.571425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.572405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.576180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.577384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.632559 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] HTTP exception thrown: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Request method failure captured: Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f HTTP/1.1 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6rr8qYBcwlrCXr_JMuq98mQIdjXB1GHYw0LMDdvHR3sfyS4rEDYVq3iaU4puMbh1Mz2PUQxcmAncbY_VR4WtjE-spMsoHbJMSTvwtf4q2gKm4tg4EM1T9Ad6FbfQtIXI7GyQRAm_8MxJ_4Zv0o22QD4uk9dzHCxW8oWVxZ0YPfcXw Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f3c6f56ea0c4944a0c8dcc6ff99a7b7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f3c6f56ea0c4944a0c8dcc6ff99a7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 7f3c6f56ea0c4944a0c8dcc6ff99a7b7 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersTestMultiNic-1317335263 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2b5083294b9143da93df5a8a35bce249 Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersTestMultiNic-1317335263-project Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8066c813-b46e-4eca-a751-8df4a1cf9c1f'} Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:36:18.634399 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. Oct 28 19:36:18.639250 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:36:18.641029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] Returning 404 to user: Instance 8066c813-b46e-4eca-a751-8df4a1cf9c1f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:36:18.642073 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-759ab254-03db-4c80-9514-3aea7f0af786 tempest-ServersTestMultiNic-1317335263 tempest-ServersTestMultiNic-1317335263-project] 10.222.0.44 "GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f" status: 404 len: 111 microversion: 2.1 time: 0.092436 Oct 28 19:36:18.647376 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2681/5341] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:18 2022] GET /compute/v2.1/servers/8066c813-b46e-4eca-a751-8df4a1cf9c1f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:36:18.881417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:18.894156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:18.898276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:18.899575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e4314ca-e898-4f32-9fec-6fa587031647 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1720 microversion: 2.20 time: 0.636353 Oct 28 19:36:18.903631 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2661/5342] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:18 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1720 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:19.209981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a43d9042-b510-47d1-af43-44b657cd7f98 req-0af08296-eff9-4457-a5c2-c50e92818cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "name": "network-vif-unplugged", "status": "completed", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:19.232742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a43d9042-b510-47d1-af43-44b657cd7f98 req-0af08296-eff9-4457-a5c2-c50e92818cad service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:19.239992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a43d9042-b510-47d1-af43-44b657cd7f98 req-0af08296-eff9-4457-a5c2-c50e92818cad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:19.239992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a43d9042-b510-47d1-af43-44b657cd7f98 req-0af08296-eff9-4457-a5c2-c50e92818cad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:19.289087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a43d9042-b510-47d1-af43-44b657cd7f98 req-0af08296-eff9-4457-a5c2-c50e92818cad service nova] Creating event network-vif-unplugged:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:36:19.315431 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a43d9042-b510-47d1-af43-44b657cd7f98 req-0af08296-eff9-4457-a5c2-c50e92818cad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109029 Oct 28 19:36:19.320823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2682/5343] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:36:19.934443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:19.935092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:19.962831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:19.963346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:19.963790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:19.964527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:19.964989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:19.965418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:20.405795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:20.415288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:20.422044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:20.423866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a0ceb8d5-988e-4ab2-9233-c848a364c21b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1720 microversion: 2.20 time: 0.494961 Oct 28 19:36:20.425264 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2662/5344] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:19 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1720 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:21.455126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:21.455918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:21.482080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:21.482385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:21.486917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:21.487808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:21.488331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:21.493832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:22.721332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca2dbd58-842c-423b-9afe-9f28e9bd6f62 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: .version_select at 0x7f1d76acf0d0>, body: {"keypair": {"name": "tempest-keypair-152287857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6vf07DqN+5Dxt+aUPrB2hNW0xc3qyu/OCAhw50gWbsTlHjXf/W2x+rbKsxAzLoFpzx6w1jl2vgh8dAS9v4obKbXOtOMg+Gh5IyGrwkjBklcFtmrRQsgnvZZum/cjXQ7A=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:22.784428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ca2dbd58-842c-423b-9afe-9f28e9bd6f62 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:36:22.810530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-ca2dbd58-842c-423b-9afe-9f28e9bd6f62 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:36:22.875606 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca2dbd58-842c-423b-9afe-9f28e9bd6f62 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156596 Oct 28 19:36:22.876258 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2663/5345] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:36:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:36:23.046303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:23.055895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:23.061200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:23.064810 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e37fc136-4747-443c-9098-f701fa6d519b tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1663 microversion: 2.20 time: 1.618784 Oct 28 19:36:23.066534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2683/5346] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:21 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1663 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:23.098091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30355381-cc02-4151-8937-4ba7b0c43895"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:23.101842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:23.114192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:23.119375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:23.120020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:23.120908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:23.121609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:23.122252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:24.017451 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cea7fb05-4c9c-4985-9093-4330c6d3ccae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.924255 Oct 28 19:36:24.023815 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2664/5347] 10.222.0.44 () {62 vars in 1364 bytes} [Fri Oct 28 19:36:23 2022] POST /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-volume_attachments => generated 188 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:36:24.678578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:24.679848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:24.689572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:24.711884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:24.724801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:24.732110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:24.733459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:24.740381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:25.725454 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b72169ab-cb8d-44ef-8fbe-efd3f492ffa4 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-volume_attachments/30355381-cc02-4151-8937-4ba7b0c43895" status: 202 len: 0 microversion: 2.20 time: 1.050619 Oct 28 19:36:25.726131 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2684/5348] 10.222.0.44 () {60 vars in 1457 bytes} [Fri Oct 28 19:36:24 2022] DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-volume_attachments/30355381-cc02-4151-8937-4ba7b0c43895 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:36:25.963759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:25.965019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:25.984266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:25.992764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:25.993505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:25.994430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:25.995076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:25.995659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:26.162941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120628) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:36:26.474044 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5398e296-2f16-4f9f-929a-2bb7feb40caf tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "POST /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/action" status: 202 len: 0 microversion: 2.20 time: 0.514279 Oct 28 19:36:26.483332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:26.484173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:26.484306 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2665/5349] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:36:25 2022] POST /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:36:26.494344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:26.511778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:26.520300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:26.522040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:26.522742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:26.523325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:28.657367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:28.680882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:28.693281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:28.703235 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c14b47a-6e45-4708-86f6-be76102cc391 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1671 microversion: 2.20 time: 2.223843 Oct 28 19:36:28.709143 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2685/5350] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:26 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1671 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:36:29.735975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:29.739157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:29.767832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:29.768756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:29.769621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:29.770755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:29.771402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:29.772034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:30.519629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:30.528743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:30.540895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:30.542195 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69d02a1e-ddb4-4605-8e29-490304844155 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1671 microversion: 2.20 time: 0.812212 Oct 28 19:36:30.543432 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2666/5351] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:29 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1671 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:31.017712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2042043756", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599ec161-dd8a-466f-859e-7811bbe9f61c"}], "security_groups": [{"name": "tempest-securitygroup--1092250338"}], "key_name": "tempest-keypair-152287857", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:31.099170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:31.514476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] validate_networks() for [('599ec161-dd8a-466f-859e-7811bbe9f61c', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:36:31.572333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:31.572959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:31.576148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:31.598668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:31.599365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:31.599829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:31.600601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:31.601064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:31.601488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:32.669158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:32.714438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:32.722364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:32.728799 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc615c06-8105-49a2-8352-1354db89d837 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1673 microversion: 2.20 time: 1.160845 Oct 28 19:36:32.737369 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2667/5352] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:31 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1673 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:33.764470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:33.765098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:33.767154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:33.793431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:33.793943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:33.794386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:33.795136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:33.795591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:33.796015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:33.907768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:34.419962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:36:34.420521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:36:34.421087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:36:34.421610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:36:34.422409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:36:34.441530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:34.445588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:34.447683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:34.449905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:34.453437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:34.454189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:34.532326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:36:34.549152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:36:34.587298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:36:34.593054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:36:34.620475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:34.644733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:34.651525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:34.655059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-003433a7-be1e-4896-9237-bba7684c49fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.894500 Oct 28 19:36:34.661110 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2668/5353] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:33 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:36:34.774347 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bd03bf2a-ba30-471a-ace2-ccb7aa76249e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.760258 Oct 28 19:36:34.778395 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2686/5354] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:36:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 3766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:36:34.787861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b458b309-78dc-4930-9827-ed0a069d07cc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:34.789118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b458b309-78dc-4930-9827-ed0a069d07cc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:35.024317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b458b309-78dc-4930-9827-ed0a069d07cc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:35.032789 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b458b309-78dc-4930-9827-ed0a069d07cc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1241 microversion: 2.1 time: 0.248670 Oct 28 19:36:35.046864 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2669/5355] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:34 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1241 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:35.688822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:35.690373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:35.735436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:35.738136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:35.738899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:35.741849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:35.744336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:35.746163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:36.072521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:36.073392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:36.128646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:36.141088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:36.141593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:36.147319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:36.151429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:36.151885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:36.262333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:36.272512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:36.280027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:36.281307 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e17a5115-505e-4d3d-be8b-7cc9d5d2c263 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.597389 Oct 28 19:36:36.292423 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2687/5356] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:35 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:36:36.476284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:36.497223 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-167104a7-e406-42ed-926c-acf30d6f6c03 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1245 microversion: 2.1 time: 0.429112 Oct 28 19:36:36.502472 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2670/5357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:36 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1245 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:36:37.311739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:37.312569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:37.332372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:37.334083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:37.336138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:37.337571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:37.338713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:37.340365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:37.392367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:37.530218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:37.564481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:37.632330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:37.634287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:37.635627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:37.639676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:37.640398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:37.641178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:38.090199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:38.097844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-45fb9a15-fe59-4bb9-9d9c-1000147c318f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1301 microversion: 2.1 time: 0.571863 Oct 28 19:36:38.118570 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2671/5358] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:37 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1301 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:38.137144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:38.151276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:38.155366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:38.175380 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e724019f-6a7c-4602-aa04-1baadc2464fe tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.863884 Oct 28 19:36:38.176843 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2688/5359] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:37 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:39.126003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:39.126770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:39.158086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:39.160865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:39.162319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:39.168507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:39.172278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:39.174054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:39.210035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:39.211562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:39.238726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:39.244402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:39.257805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:39.259121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:39.276652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:39.278354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:40.080429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:40.093225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4b00c10-add0-485d-bdc5-68bea70cb4a7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1299 microversion: 2.1 time: 0.971349 Oct 28 19:36:40.099163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2672/5360] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:39 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1299 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:40.436011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:40.463302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:40.464995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:40.483143 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63874fad-8212-4872-a141-6cf1a8b14e4c tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.270455 Oct 28 19:36:40.487584 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2689/5361] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:39 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:36:41.126235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:41.127630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:41.161512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:41.162758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:41.164261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:41.167389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:41.169099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:41.169716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:41.517568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:41.518583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:41.536836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:41.538488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:41.540014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:41.543746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:41.544443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:41.546528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:43.168611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:43.177120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:43.187943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:43.189214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2abfd20-82e3-4f69-abff-7f83d2fec078 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.679940 Oct 28 19:36:43.189783 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2690/5362] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:41 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:36:43.255252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:43.276557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c7cc5ab-f10b-4bc9-ac0e-e836abe67481 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1367 microversion: 2.1 time: 2.154758 Oct 28 19:36:43.286684 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2673/5363] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:41 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1367 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:44.247009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:44.248332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:44.265728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:44.266599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:44.267293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:44.270090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:44.270884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:44.271922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:44.307539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:44.308892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:44.334474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:44.336436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:44.339684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:44.340918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:44.346170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:44.351855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:44.493177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:44.572772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:45.029357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:45.403784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:45.447582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:45.453697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:45.458484 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-921a3821-35bf-4b6e-9e78-6ae4aedefba0 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.242171 Oct 28 19:36:45.467297 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2691/5364] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:44 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:45.476412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-aad8c35f-8631-44be-9678-e1b2f5fb7e9c req-6d39abdd-c8f8-4d90-b402-f08327697d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0790e724-c28e-4647-9b3a-ae5ab15cf674", "tag": "1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:45.533686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aad8c35f-8631-44be-9678-e1b2f5fb7e9c req-6d39abdd-c8f8-4d90-b402-f08327697d73 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:45.540216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aad8c35f-8631-44be-9678-e1b2f5fb7e9c req-6d39abdd-c8f8-4d90-b402-f08327697d73 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:45.541123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-aad8c35f-8631-44be-9678-e1b2f5fb7e9c req-6d39abdd-c8f8-4d90-b402-f08327697d73 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:45.590717 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-aad8c35f-8631-44be-9678-e1b2f5fb7e9c req-6d39abdd-c8f8-4d90-b402-f08327697d73 service nova] Creating event network-changed:1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6 for instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 on n-h2-862769-3 Oct 28 19:36:45.602769 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-aad8c35f-8631-44be-9678-e1b2f5fb7e9c req-6d39abdd-c8f8-4d90-b402-f08327697d73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130005 Oct 28 19:36:45.605534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2692/5365] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:46.018516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:46.060730 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f83c7a7-913b-4eaa-ae27-90d0c0cf76fb tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1367 microversion: 2.1 time: 1.758837 Oct 28 19:36:46.063141 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2674/5366] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:44 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1367 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:46.498331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:46.500179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:46.519492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:46.520408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:46.527334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:46.528551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:46.529594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:46.534794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:47.088508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:47.089343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:47.107386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:47.108091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:47.108636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:47.112066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:47.113121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:47.114429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:47.475045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:47.488750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:47.490305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:47.492690 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6bc1c10e-40a9-4189-a56c-8e4d092f30b8 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.999217 Oct 28 19:36:47.497481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2693/5367] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:46 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:47.649104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:47.666113 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-384c3050-9582-48f2-9ff6-17938428ea36 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1367 microversion: 2.1 time: 0.582872 Oct 28 19:36:47.671298 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2675/5368] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:47 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:48.527408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:48.529300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:48.557289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:48.557845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:48.558286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:48.559082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:48.559544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:48.559993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:48.694352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:48.695002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:48.738449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:48.739392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:48.740137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:48.741742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:48.742425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:48.743135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:49.631962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:49.641217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:49.642611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:49.650298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5bb0ce07-9ff5-488d-9c26-5618fcf47b05 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.126779 Oct 28 19:36:49.650825 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2694/5369] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:48 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:50.321433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:50.342279 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b08ce4ac-6f71-44b0-a88a-1e515135da5b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1367 microversion: 2.1 time: 1.652920 Oct 28 19:36:50.343848 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2676/5370] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:48 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1367 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:36:50.687436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:50.688060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:50.703795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:50.704300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:50.704738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:50.714436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:50.715062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:50.715516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:51.369407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:51.370081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:51.406733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:51.407322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:51.407863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:51.408627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:51.422501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:51.427379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:52.221253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:52.235359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:52.259168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:52.267211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-de3d6ba1-f916-4166-a5f8-ffb4b60f5f63 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.583755 Oct 28 19:36:52.279057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2695/5371] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:50 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:52.293918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9c4d46d3-3eec-4d0d-a014-a395d5e41535 req-c89bf6bc-ffec-4426-999a-e4c074123db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0790e724-c28e-4647-9b3a-ae5ab15cf674", "name": "network-vif-plugged", "status": "completed", "tag": "1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:52.309664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c4d46d3-3eec-4d0d-a014-a395d5e41535 req-c89bf6bc-ffec-4426-999a-e4c074123db8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:52.310212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c4d46d3-3eec-4d0d-a014-a395d5e41535 req-c89bf6bc-ffec-4426-999a-e4c074123db8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:52.311110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c4d46d3-3eec-4d0d-a014-a395d5e41535 req-c89bf6bc-ffec-4426-999a-e4c074123db8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:52.333007 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9c4d46d3-3eec-4d0d-a014-a395d5e41535 req-c89bf6bc-ffec-4426-999a-e4c074123db8 service nova] Creating event network-vif-plugged:1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6 for instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 on n-h2-862769-3 Oct 28 19:36:52.342881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9c4d46d3-3eec-4d0d-a014-a395d5e41535 req-c89bf6bc-ffec-4426-999a-e4c074123db8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061798 Oct 28 19:36:52.348552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2696/5372] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:52.760087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:52.773546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e2a73bce-056d-44dd-8cd2-80c06cf53ade tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1367 microversion: 2.1 time: 1.404906 Oct 28 19:36:52.774773 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2677/5373] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:51 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1367 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:36:53.299656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:53.300481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:53.313923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:53.314524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:53.319567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:53.320439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:53.321000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:53.321519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:53.805033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:53.805576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:53.821770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:53.823266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:53.823694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:53.824468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:53.827865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:53.828656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:53.855995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:53.865684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:53.880677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:53.882282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f676a038-9eec-4531-9745-01be2a63e127 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.588190 Oct 28 19:36:53.896756 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2697/5374] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:53 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:54.075545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:54.091638 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-27b6e27d-e8f1-4e81-bcf4-2057d3d1282c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1367 microversion: 2.1 time: 0.290655 Oct 28 19:36:54.092568 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2678/5375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:53 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:36:54.911715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:54.912952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:54.938796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:54.939555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:54.940177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:54.941048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:54.941659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:54.942235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:55.115522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:55.116764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:55.124361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:55.131543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:55.139279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:55.140380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:55.143934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:55.144589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:55.615379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:55.638392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:55.652968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:55.657012 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e7ec3b07-c8ad-4269-b664-11dcbd49c09e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.749391 Oct 28 19:36:55.675954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2698/5376] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:54 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:55.748098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:55.773375 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1c9c243-2ee2-4fde-9765-3f95aade788e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1558 microversion: 2.1 time: 0.661880 Oct 28 19:36:55.778077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2679/5377] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:55 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1558 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:55.806274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:55.807094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:55.817608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:55.827978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:55.828695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:55.829657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:55.830289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:55.832980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:56.285041 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-77e0317c-37e1-4f03-b725-4f6e7857e49b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.482960 Oct 28 19:36:56.285932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2699/5378] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:36:55 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/os-interface => generated 285 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:56.693714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:56.694963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:56.710397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:56.715153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:56.718644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:56.720443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:56.724177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:56.724893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:57.853620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:57.868964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:57.870533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:57.871857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51070556-a8f9-447e-add8-9bf183637296 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.182200 Oct 28 19:36:57.873007 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2680/5379] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:56 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:36:58.903111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:58.903742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:36:58.922738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:58.923184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:58.923599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:58.924240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:58.924792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:58.925106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:59.698134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-decce909-19a3-4dbf-9361-122b3b3d6b32 req-bcd370a1-4dd7-4a6c-a64d-9718ce6e4530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "name": "network-vif-plugged", "status": "completed", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:59.751254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-decce909-19a3-4dbf-9361-122b3b3d6b32 req-bcd370a1-4dd7-4a6c-a64d-9718ce6e4530 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:59.751832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-decce909-19a3-4dbf-9361-122b3b3d6b32 req-bcd370a1-4dd7-4a6c-a64d-9718ce6e4530 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:59.752277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-decce909-19a3-4dbf-9361-122b3b3d6b32 req-bcd370a1-4dd7-4a6c-a64d-9718ce6e4530 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:59.808265 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-decce909-19a3-4dbf-9361-122b3b3d6b32 req-bcd370a1-4dd7-4a6c-a64d-9718ce6e4530 service nova] Creating event network-vif-plugged:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:36:59.834682 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-decce909-19a3-4dbf-9361-122b3b3d6b32 req-bcd370a1-4dd7-4a6c-a64d-9718ce6e4530 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140204 Oct 28 19:36:59.838463 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2681/5380] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:59.844933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b1577b53-81c0-46ee-af80-25cd95a374fb req-d8a1e169-ef27-46ca-b4ae-21ec96e68e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0790e724-c28e-4647-9b3a-ae5ab15cf674", "tag": "1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:59.908769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1577b53-81c0-46ee-af80-25cd95a374fb req-d8a1e169-ef27-46ca-b4ae-21ec96e68e3f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:59.909297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1577b53-81c0-46ee-af80-25cd95a374fb req-d8a1e169-ef27-46ca-b4ae-21ec96e68e3f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:59.909924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1577b53-81c0-46ee-af80-25cd95a374fb req-d8a1e169-ef27-46ca-b4ae-21ec96e68e3f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:59.966769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:59.976364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:59.977810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:59.986396 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b1577b53-81c0-46ee-af80-25cd95a374fb req-d8a1e169-ef27-46ca-b4ae-21ec96e68e3f service nova] Creating event network-changed:1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6 for instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 on n-h2-862769-3 Oct 28 19:36:59.997946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4702821d-2901-4250-8d08-b17b90378bce tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 1.081152 Oct 28 19:37:00.005527 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2700/5381] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:36:58 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:37:00.016857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b1577b53-81c0-46ee-af80-25cd95a374fb req-d8a1e169-ef27-46ca-b4ae-21ec96e68e3f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176653 Oct 28 19:37:00.019128 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2682/5382] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:01.031081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:01.031791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:01.059361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:01.059361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:01.059683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:01.060211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:01.060676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:01.061119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:01.662901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-235431692", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:01.715209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:01.745544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:01.756994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:01.760012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:01.762751 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d17f113a-89b2-4eea-896a-8729d6e3aa76 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.736077 Oct 28 19:37:01.768090 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2683/5383] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:01 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:37:01.804129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] validate_networks() for [('db148bba-ab93-41af-8d32-cb8809926be5', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:37:02.795444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:02.797197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:02.827525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=36 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:02.831819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:02.832791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:02.833513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:02.834896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:02.839736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:02.841181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:03.560592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:03.577359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:03.592766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:03.596984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-27b54d50-8c1e-478c-a058-fa4e5f2b3d16 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1729 microversion: 2.20 time: 0.807154 Oct 28 19:37:03.600087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2684/5384] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:02 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1729 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:37:03.956952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:37:03.957418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:37:03.957594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:37:03.958006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:37:03.958409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:37:03.987847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:03.988713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:03.991026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:03.994469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:03.999026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:04.000718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:04.093216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Getting quotas for project 87f434bac604461c8cb49b3138ac414a. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:37:04.105638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Getting quotas for user eff93b137dbd497f857d23cc08565749 and project 87f434bac604461c8cb49b3138ac414a. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:37:04.138295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:37:04.140959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:37:04.270899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2bccb46f-fbaa-4bfe-9c8a-84322e1a193d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.259736 Oct 28 19:37:04.278048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2701/5385] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:37:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:37:04.291398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c2696693-691d-4a0d-8008-6e82c1243e31 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:04.293034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c2696693-691d-4a0d-8008-6e82c1243e31 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:04.420165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c2696693-691d-4a0d-8008-6e82c1243e31 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:04.435421 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c2696693-691d-4a0d-8008-6e82c1243e31 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1213 microversion: 2.1 time: 0.145966 Oct 28 19:37:04.443881 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2685/5386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:04 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:04.624917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:04.625809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:04.638779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:04.639238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:04.641600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:04.642345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:04.644772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:04.647052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:04.840237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:04.884401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:04.890081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:04.893373 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af8a4447-fea5-4486-93b6-54fa6b9443e3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1716 microversion: 2.20 time: 0.272984 Oct 28 19:37:04.899535 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2702/5387] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:04 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1716 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:37:05.459385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:05.463130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:05.498627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:05.531951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:05.534625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:05.551384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:05.553803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:05.554642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:05.575884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=88 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:05.707687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:05.727177 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7056521-054e-4ee2-8e9c-296d791f6cbf tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1217 microversion: 2.1 time: 0.272550 Oct 28 19:37:05.731715 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2686/5388] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:05 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:06.757041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:06.757667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:06.780372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:06.780931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:06.798491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:06.799462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:06.800387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:06.801190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:07.004181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:07.015775 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7a78661c-0b49-4aff-9ca2-2991d832b5c7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1265 microversion: 2.1 time: 0.267002 Oct 28 19:37:07.021180 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2703/5389] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:06 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:08.050047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:08.051342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:08.072661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:08.073175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:08.077845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:08.079205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:08.085929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:08.086679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:08.858224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:08.869875 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-def2142f-41f8-4d7d-967e-277da2230d93 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.824771 Oct 28 19:37:08.888076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2687/5390] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:08 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:09.903763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:09.904496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:09.920745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:09.922076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:09.922808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:09.923734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:09.925621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:09.926325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:10.002997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=82 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:10.617175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:10.630501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d96444f-d02c-4be6-81d7-8965234aa879 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.729490 Oct 28 19:37:10.638128 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2704/5391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:09 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:11.056488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-79fcb71b-07e7-465e-8014-9356d62c50b1 req-4584121e-4f23-4e99-8115-716b0fc7a6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06bff1f3-2f57-44f8-a51a-f451c8846d8a", "tag": "7f74e158-90ac-4d2a-a0d4-380032387477"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:11.072936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-79fcb71b-07e7-465e-8014-9356d62c50b1 req-4584121e-4f23-4e99-8115-716b0fc7a6e1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:11.079977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-79fcb71b-07e7-465e-8014-9356d62c50b1 req-4584121e-4f23-4e99-8115-716b0fc7a6e1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:11.083405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-79fcb71b-07e7-465e-8014-9356d62c50b1 req-4584121e-4f23-4e99-8115-716b0fc7a6e1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:11.116234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-79fcb71b-07e7-465e-8014-9356d62c50b1 req-4584121e-4f23-4e99-8115-716b0fc7a6e1 service nova] Creating event network-changed:7f74e158-90ac-4d2a-a0d4-380032387477 for instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a on n-h1-862769-3 Oct 28 19:37:11.128575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-79fcb71b-07e7-465e-8014-9356d62c50b1 req-4584121e-4f23-4e99-8115-716b0fc7a6e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075961 Oct 28 19:37:11.129635 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2688/5392] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:11.201229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:11.202324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:11.219468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:11.220289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:11.220866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:11.221741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:11.222348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:11.223173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:11.360304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lazy-loading 'services' on Instance uuid 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:37:11.586565 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03be14d8-0aa8-4540-a7c3-d23b8c8339de tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "DELETE /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27/os-volume_attachments/179aa4b9-1f32-49da-b9b5-3fadb6e9f257" status: 202 len: 0 microversion: 2.1 time: 0.390044 Oct 28 19:37:11.587859 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2705/5393] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:37:11 2022] DELETE /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27/os-volume_attachments/179aa4b9-1f32-49da-b9b5-3fadb6e9f257 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:37:11.662171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:11.663076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:11.679837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:11.682918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:11.684794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:11.688293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:11.690556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:11.692288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:12.144498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:12.153686 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a86b6411-93ca-4df8-8b96-fe6311772f01 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.496622 Oct 28 19:37:12.154383 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2689/5394] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:11 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:13.179808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:13.181149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:13.198630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:13.199421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:13.200038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:13.200907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:13.201523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:13.202176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:13.536942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:13.545625 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2bda591-7f3b-4c29-be1f-61c8ce527881 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.371580 Oct 28 19:37:13.552797 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2706/5395] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:13 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:14.581901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:14.582498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:14.590529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:14.594243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:14.595657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:14.596200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:14.596989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:14.597635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:14.598062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:14.824305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:14.836808 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ea6b649-268d-4a7c-ad9a-f62051f6d178 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.261967 Oct 28 19:37:14.838664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2690/5396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:14 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:15.863012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:15.863630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:15.866985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:15.868809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:15.884194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:15.888073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:15.889936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:15.893290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:15.894014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:15.895024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:16.362533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:16.376163 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b511e9e2-df83-4b8b-bb38-0633415d0f8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.518639 Oct 28 19:37:16.380263 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2707/5397] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:15 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:17.404288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:17.405065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:17.424361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:17.425764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:17.427035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:17.428485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:17.429204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:17.430048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:17.609844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:17.619586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cadb47a7-faff-4d49-8879-0b5011d1ff8e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.221680 Oct 28 19:37:17.620200 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2691/5398] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:17 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:18.163962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-39d5e42c-9901-430d-9c46-a7ae01d704de req-0171d94b-11a4-4406-9e25-d448331ea763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bff1f3-2f57-44f8-a51a-f451c8846d8a", "name": "network-vif-plugged", "status": "completed", "tag": "7f74e158-90ac-4d2a-a0d4-380032387477"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:18.216344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39d5e42c-9901-430d-9c46-a7ae01d704de req-0171d94b-11a4-4406-9e25-d448331ea763 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:18.220865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39d5e42c-9901-430d-9c46-a7ae01d704de req-0171d94b-11a4-4406-9e25-d448331ea763 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:18.221387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-39d5e42c-9901-430d-9c46-a7ae01d704de req-0171d94b-11a4-4406-9e25-d448331ea763 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:18.280772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-39d5e42c-9901-430d-9c46-a7ae01d704de req-0171d94b-11a4-4406-9e25-d448331ea763 service nova] Creating event network-vif-plugged:7f74e158-90ac-4d2a-a0d4-380032387477 for instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a on n-h1-862769-3 Oct 28 19:37:18.288302 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-39d5e42c-9901-430d-9c46-a7ae01d704de req-0171d94b-11a4-4406-9e25-d448331ea763 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129211 Oct 28 19:37:18.289238 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2708/5399] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:18.643533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:18.644812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:18.653625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:18.654415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:18.657941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:18.659224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:18.659881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:18.660473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:19.023595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:19.034296 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c29e126-a6ee-4886-8853-1e8293e7b072 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1313 microversion: 2.1 time: 0.395638 Oct 28 19:37:19.035540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2692/5400] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:18 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:19.745688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-870874576", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1709001e-233b-447e-af42-ee76970387ea"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:19.835684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] validate_networks() for [('1709001e-233b-447e-af42-ee76970387ea', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:37:20.063686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:20.065040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:20.080862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.082345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.085509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.086618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.087890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.088913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.692003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:20.703235 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-557adf52-6472-472e-a153-4339424f231d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1499 microversion: 2.1 time: 0.644734 Oct 28 19:37:20.722814 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2693/5401] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:20 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1499 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:20.739043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:37:20.739588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:37:20.740554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:37:20.742236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:37:20.743197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:37:20.760922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:20.766472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:20.781709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.782177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.782617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.783383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.783835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.784250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.789419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.795699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.796394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.797609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.798928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.801394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.808220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Getting quotas for project 962adae0eb564559b8355d167269db1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:37:20.816983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Getting quotas for user f8a716ac546745b2b8d9dc2546bc3bf0 and project 962adae0eb564559b8355d167269db1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:37:20.835618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:37:20.838005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:37:20.849504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lazy-loading 'flavor' on Instance uuid 06bff1f3-2f57-44f8-a51a-f451c8846d8a {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:37:20.943845 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93a43c00-758c-41a3-b8ac-ade8e26e10d9 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408604 Oct 28 19:37:20.945053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2709/5402] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:37:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:37:20.955857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:20.956617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:20.964780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.965530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.966255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:20.967201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:20.967853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:20.968575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:21.031387 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0eddde5b-748e-4a98-aaff-73a52ef09906 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "POST /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a/action" status: 200 len: 32 microversion: 2.1 time: 0.304653 Oct 28 19:37:21.031595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:37:21.032524 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2694/5403] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:37:20 2022] POST /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a/action => generated 32 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:37:21.041087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f3c141f-f1a3-4e72-a806-07381f7531e6 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:21.046581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f3c141f-f1a3-4e72-a806-07381f7531e6 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:21.175728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f3c141f-f1a3-4e72-a806-07381f7531e6 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:21.189030 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f3c141f-f1a3-4e72-a806-07381f7531e6 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1213 microversion: 2.1 time: 0.152352 Oct 28 19:37:21.189828 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2695/5404] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:21 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:21.200493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:21.202410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:21.221087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:21.222212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:21.223975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:21.225314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:21.225952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:21.226650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:21.249443 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2ad9ea5-189e-42b7-95b9-3ceab1564e8e tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "DELETE /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 204 len: 0 microversion: 2.1 time: 0.302819 Oct 28 19:37:21.250099 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2710/5405] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:37:20 2022] DELETE /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:37:21.261100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:21.261816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:21.270805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:21.271524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:21.272328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:21.273611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:21.274388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:21.275054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:21.576638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:21.585116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-255cb944-ef1b-4deb-894b-e78a7e37d8a4 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.392939 Oct 28 19:37:21.585718 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2696/5406] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:21 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:21.616042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:21.627699 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-51647902-fc80-4196-bba0-6d91b4118089 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1469 microversion: 2.1 time: 0.372913 Oct 28 19:37:21.629119 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2711/5407] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:21 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:22.213997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:22.219727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:22.243338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:22.244033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:22.245522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:22.246540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:22.248140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:22.249742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:22.322095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:22.332269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02007fcb-5412-4df7-b2d0-88347be6bb7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1265 microversion: 2.1 time: 0.123995 Oct 28 19:37:22.333694 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2697/5408] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:22 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:22.608574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:22.609846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:22.623804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:22.624511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:22.627324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:22.628257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:22.628892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:22.631269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:22.652243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:22.652921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:22.675010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:22.675777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:22.676388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:22.679550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:22.680210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:22.686573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:23.325041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:23.340293 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a96ba16-bd00-4ca1-b009-ae421ffe7160 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.735678 Oct 28 19:37:23.350897 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2712/5409] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:22 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:23.356900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:23.358167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:23.374490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:23.375343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:23.375963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:23.376835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:23.377724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:23.378296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:23.447623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:23.456831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-27be37b0-af19-4f3f-acc7-4e742b8d4618 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1469 microversion: 2.1 time: 0.808689 Oct 28 19:37:23.460795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2698/5410] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:22 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1469 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:23.516008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:23.525270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80fbb4b9-ca64-45c9-9fff-539b491ab515 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1271 microversion: 2.1 time: 0.172557 Oct 28 19:37:23.530756 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2713/5411] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:23 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:24.114231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-eebba8f6-9150-4baf-95b3-2050df8c488d req-76189088-5c93-4868-9ee2-9ab3fee4d876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07eb7854-b4ad-4d06-b4bf-d50968bc6d27", "name": "network-vif-deleted", "tag": "3de31dc8-1112-4681-8f20-42f72db9b3cc"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:24.130041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eebba8f6-9150-4baf-95b3-2050df8c488d req-76189088-5c93-4868-9ee2-9ab3fee4d876 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.130950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eebba8f6-9150-4baf-95b3-2050df8c488d req-76189088-5c93-4868-9ee2-9ab3fee4d876 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.131571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-eebba8f6-9150-4baf-95b3-2050df8c488d req-76189088-5c93-4868-9ee2-9ab3fee4d876 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.163039 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-eebba8f6-9150-4baf-95b3-2050df8c488d req-76189088-5c93-4868-9ee2-9ab3fee4d876 service nova] Creating event network-vif-deleted:3de31dc8-1112-4681-8f20-42f72db9b3cc for instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 on n-h1-862769-3 Oct 28 19:37:24.191309 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-eebba8f6-9150-4baf-95b3-2050df8c488d req-76189088-5c93-4868-9ee2-9ab3fee4d876 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082859 Oct 28 19:37:24.192348 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2699/5412] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:24.376201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:24.377485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:24.411174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.411976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.425616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.430902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.433079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.433737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.500796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:24.504651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:24.521681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.522187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.522636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.523401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.523867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.524299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.612475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.613165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.613754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.614361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lazy-loading 'fault' on Instance uuid 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:37:24.714971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e7475f56c42238b961af4b9a4de45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223a5a581ed645b28038ea988a51fe2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:24.727620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84f70349-aef6-4c1c-b3e9-ba401b67e0b8 tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 200 len: 1304 microversion: 2.1 time: 0.244947 Oct 28 19:37:24.736108 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2700/5413] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:24 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:24.741781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:24.742614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:24.758835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.759755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.760393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:24.761314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:24.761934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:24.762524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:25.024291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:25.044968 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe94d375-432a-47d1-ad6f-7be8cbf87424 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.678787 Oct 28 19:37:25.048487 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2714/5414] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:24 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:25.056378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-96e4d8f7-58a5-4415-a949-32f77eb39971 req-c388b8c0-291b-4623-ab2c-e24e9b90e355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675ad4db-c48b-4ed3-883d-dd61e9dfcc16", "tag": "2cac9ae3-053a-47aa-9178-bd56afc2e40d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:25.098885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-96e4d8f7-58a5-4415-a949-32f77eb39971 req-c388b8c0-291b-4623-ab2c-e24e9b90e355 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:25.099754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-96e4d8f7-58a5-4415-a949-32f77eb39971 req-c388b8c0-291b-4623-ab2c-e24e9b90e355 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:25.100444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-96e4d8f7-58a5-4415-a949-32f77eb39971 req-c388b8c0-291b-4623-ab2c-e24e9b90e355 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:25.145360 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-96e4d8f7-58a5-4415-a949-32f77eb39971 req-c388b8c0-291b-4623-ab2c-e24e9b90e355 service nova] Creating event network-changed:2cac9ae3-053a-47aa-9178-bd56afc2e40d for instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 on n-h2-862769-3 Oct 28 19:37:25.164016 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-96e4d8f7-58a5-4415-a949-32f77eb39971 req-c388b8c0-291b-4623-ab2c-e24e9b90e355 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111127 Oct 28 19:37:25.165526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2715/5415] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:25.217109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:25.252331 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-54a011b7-fa9d-4ba8-baaf-27fd2ae797ef tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.514723 Oct 28 19:37:25.253728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2701/5416] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:24 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:25.758831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:25.760147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] [instance: 07eb7854-b4ad-4d06-b4bf-d50968bc6d27] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:25.771655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:25.772396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:25.773028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:25.773909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:25.774524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:25.775161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:25.792793 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] HTTP exception thrown: Instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 could not be found. Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Request method failure captured: Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 HTTP/1.1 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC6-QG3hATgATj3MUccDqbeMHwe-mIhO5AJEDD69_xUisHYtqh-VPeFkczYuA4LMwpZG9T8I0CP5p9vFtZL754qHybm2Uv-Oc146L45DTX37ldhNcqu70p-W584VKmkOt4yvHMujUTkFQIT81bemcrOHBAfvBSJ5Y7mfAxxFKK6LFoI Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 223a5a581ed645b28038ea988a51fe2d Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesBackupsTest-2005846793 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/223a5a581ed645b28038ea988a51fe2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_223a5a581ed645b28038ea988a51fe2d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/223a5a581ed645b28038ea988a51fe2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/223a5a581ed645b28038ea988a51fe2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesBackupsTest-2005846793 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 223a5a581ed645b28038ea988a51fe2d Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesBackupsTest-2005846793 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesBackupsTest-2005846793-project Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: a78e7475f56c42238b961af4b9a4de45 Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesBackupsTest-2005846793-project Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 could not be found. Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '07eb7854-b4ad-4d06-b4bf-d50968bc6d27'} Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 could not be found. Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 could not be found. Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:25.794670 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 could not be found. Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] Returning 404 to user: Instance 07eb7854-b4ad-4d06-b4bf-d50968bc6d27 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:25.801367 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-074a002a-0158-4aba-9a79-f5fb8afd825f tempest-VolumesBackupsTest-2005846793 tempest-VolumesBackupsTest-2005846793-project] 10.222.0.44 "GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27" status: 404 len: 111 microversion: 2.1 time: 0.049165 Oct 28 19:37:25.803847 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2716/5417] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:25 2022] GET /compute/v2.1/servers/07eb7854-b4ad-4d06-b4bf-d50968bc6d27 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:37:26.076391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:26.078468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:26.087507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:26.088412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:26.089082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:26.090913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:26.091853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:26.092645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:26.281250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:26.282603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:26.297732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:26.298721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:26.304379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:26.305638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:26.306409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:26.307552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:26.347811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:26.356008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:26.363756 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4cd6d37-2265-4c1f-af77-f699b22ff83a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.294065 Oct 28 19:37:26.368845 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2702/5418] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:26 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:26.524837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:26.540697 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9fe7751b-23bb-4c0b-8f5c-69b6f065de7f tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.266427 Oct 28 19:37:26.546264 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2717/5419] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:26 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:27.396804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:27.396804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:27.416555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:27.417729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:27.418343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:27.419441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:27.420199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:27.421045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:27.565622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:27.567387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:27.582015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:27.582845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:27.583494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:27.585534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:27.587521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:27.588197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:27.649255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:27.660395 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a48080a-311c-4cdd-80f3-1add2dd7ff0b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.269003 Oct 28 19:37:27.662266 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2703/5420] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:27 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:27.799015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:27.807550 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88b32207-6fa4-4abf-b921-deea59d7cd70 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.245924 Oct 28 19:37:27.809820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2718/5421] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:27 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:28.685245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:28.686726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:28.694893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:28.695703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:28.696299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:28.697211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:28.697846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:28.698434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:28.833941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:28.834588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:28.850012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:28.851469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:28.852180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:28.853238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:28.853852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:28.854437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:29.279956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:29.294386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cbfe4381-ae0d-484b-bdc2-79e62e5b050d tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.464183 Oct 28 19:37:29.320053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2719/5422] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:28 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:29.433823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:29.449383 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4759c032-7be6-4231-9d81-db10b0c8d795 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.768315 Oct 28 19:37:29.453577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2704/5423] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:28 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:30.328716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:30.329406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:30.342563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.348652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.349329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.350086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.350562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.351016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.479644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:30.481391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:30.509578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.511449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.513488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.516523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.518451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.519157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.749635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:30.766588 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18b90889-f56d-4ecc-b855-473d0e169948 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.441781 Oct 28 19:37:30.767833 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2720/5424] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:30 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:30.798196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:30.800708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:30.808514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:30.832251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:30.845305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.850347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.851241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.852424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.855872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.857004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.919816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:30.930488 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53b88628-4f98-4f0e-9da7-63a450947b71 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/ips" status: 200 len: 151 microversion: 2.1 time: 0.138592 Oct 28 19:37:30.936756 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2721/5425] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:37:30 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/ips => generated 151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:30.949900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba59ab46-991b-4dff-993d-dae560f7dbde"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:30.960510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:30.987290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.988028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.988701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:30.989676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:30.991218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:30.992843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:31.178640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:31.181046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:31.189079 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14778121-3b52-4900-922e-b6bd1bb4f4d0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.715110 Oct 28 19:37:31.202740 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2705/5426] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:30 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:31.225830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Invalid volume: volume ba59ab46-991b-4dff-993d-dae560f7dbde is already attached to instances: 67789fc5-c44b-4f0e-819d-fa93970cad4e Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/os-volume_attachments HTTP/1.1 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 74 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: {"volumeAttachment": {"volumeId": "ba59ab46-991b-4dff-993d-dae560f7dbde"}} Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: exception: Invalid volume: volume ba59ab46-991b-4dff-993d-dae560f7dbde is already attached to instances: 67789fc5-c44b-4f0e-819d-fa93970cad4e Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': '0790e724-c28e-4647-9b3a-ae5ab15cf674', 'body': {'volumeAttachment': {'volumeId': 'ba59ab46-991b-4dff-993d-dae560f7dbde'}}} Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ba59ab46-991b-4dff-993d-dae560f7dbde is already attached to instances: 67789fc5-c44b-4f0e-819d-fa93970cad4e Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:37:31.227559 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ba59ab46-991b-4dff-993d-dae560f7dbde is already attached to instances: 67789fc5-c44b-4f0e-819d-fa93970cad4e Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ba59ab46-991b-4dff-993d-dae560f7dbde is already attached to instances: 67789fc5-c44b-4f0e-819d-fa93970cad4e Oct 28 19:37:31.232248 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:31.236091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 400 to user: Invalid volume: volume ba59ab46-991b-4dff-993d-dae560f7dbde is already attached to instances: 67789fc5-c44b-4f0e-819d-fa93970cad4e {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:31.236091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db89dbca-f230-41d3-879c-74c3cd3f0834 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.291353 Oct 28 19:37:31.236091 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2722/5427] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:37:30 2022] POST /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674/os-volume_attachments => generated 174 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:37:31.244883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:31.245682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:31.253019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:31.267541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:31.268480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:31.269421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:31.270054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:31.270744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:31.342441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:37:31.517530 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-73486909-374d-44e5-8cb5-b379bee7af04 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 204 len: 0 microversion: 2.1 time: 0.276181 Oct 28 19:37:31.519821 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2706/5428] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:37:31 2022] DELETE /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:37:31.529157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:31.530561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:31.539705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:31.540538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:31.541355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:31.543102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:31.543879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:31.544475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:31.795340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:31.796076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:31.806281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:31.806815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:31.824259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:31.825174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:31.825666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:31.829573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:32.012595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:32.017773 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-90dc9fec-1f1e-44ec-8b1a-f99e90ba5c4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1683 microversion: 2.1 time: 0.493715 Oct 28 19:37:32.037016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2723/5429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:31 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1683 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:32.053679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1e1b6083-f874-416e-b8d9-382f2da01492 req-8be58ab2-68c0-48b1-8493-f42e6434299d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675ad4db-c48b-4ed3-883d-dd61e9dfcc16", "name": "network-vif-plugged", "status": "completed", "tag": "2cac9ae3-053a-47aa-9178-bd56afc2e40d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:32.082395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:32.086596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1e1b6083-f874-416e-b8d9-382f2da01492 req-8be58ab2-68c0-48b1-8493-f42e6434299d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:32.090366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1e1b6083-f874-416e-b8d9-382f2da01492 req-8be58ab2-68c0-48b1-8493-f42e6434299d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:32.091046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1e1b6083-f874-416e-b8d9-382f2da01492 req-8be58ab2-68c0-48b1-8493-f42e6434299d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:32.129343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1e1b6083-f874-416e-b8d9-382f2da01492 req-8be58ab2-68c0-48b1-8493-f42e6434299d service nova] Creating event network-vif-plugged:2cac9ae3-053a-47aa-9178-bd56afc2e40d for instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 on n-h2-862769-3 Oct 28 19:37:32.154824 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1e1b6083-f874-416e-b8d9-382f2da01492 req-8be58ab2-68c0-48b1-8493-f42e6434299d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107080 Oct 28 19:37:32.156608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2724/5430] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:32.186043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:32.197254 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71471376-0a65-4af3-86da-d277e16d3206 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.406871 Oct 28 19:37:32.212648 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2707/5431] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:31 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:32.242432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:32.243497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:32.255517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:32.258741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:32.259421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:32.260191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:32.260664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:32.261089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:32.468905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:32.481551 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f9fa73d-34e1-4196-824d-b06068ba89ea tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.264792 Oct 28 19:37:32.482778 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2725/5432] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:32 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:33.050085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:33.050731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:33.065273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:33.088129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:33.088949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:33.089589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:33.090561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:33.091239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:33.091877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:33.225202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:33.226540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:33.277143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:33.283535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:33.284390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:33.285371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:33.286107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:33.291573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:33.574918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:33.584261 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ee991b2-6a4f-4702-b39c-25e94967212e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1683 microversion: 2.1 time: 0.537514 Oct 28 19:37:33.586812 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2708/5433] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:33 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1683 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:33.605890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:33.609090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:33.628911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:33.630546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:33.631984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:33.632802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:33.633845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:33.635154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:33.635969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:33.655248 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc60e12c-4c91-4761-9b01-5c6443c33584 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.436013 Oct 28 19:37:33.665811 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2726/5434] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:33 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:34.021698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:34.040238 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61ead05e-fa2c-4df6-b5a9-fc2863bc4bd2 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.447338 Oct 28 19:37:34.056477 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2709/5435] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:33 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:34.613920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:34.615371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:34.629866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:34.630683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:34.631147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:34.631872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:34.632340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:34.632772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:34.688885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:34.690128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:34.718769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:34.720273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:34.731685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:34.739662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:34.741662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:34.742214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:35.312430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:35.326138 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29fb9941-e606-42d7-885a-1682ab4bc7cc tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1313 microversion: 2.1 time: 0.642407 Oct 28 19:37:35.349505 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2710/5436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:34 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:35.369673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:35.373537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:35.407911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:35.414760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:35.415512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:35.419630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:35.430957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:35.431702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:35.440090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:35.455818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-227cef4a-4850-4fe8-91c1-26980fa56041 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 200 len: 1683 microversion: 2.1 time: 0.845771 Oct 28 19:37:35.468558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2727/5437] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:34 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 1683 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:35.505131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ac557bba-4fc2-4ab9-8ae3-6d5d5752c2ca req-4cbdb1e1-cfb8-4d39-b531-8d8529143b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0790e724-c28e-4647-9b3a-ae5ab15cf674", "name": "network-vif-deleted", "tag": "1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:35.535999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ac557bba-4fc2-4ab9-8ae3-6d5d5752c2ca req-4cbdb1e1-cfb8-4d39-b531-8d8529143b43 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:35.541134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ac557bba-4fc2-4ab9-8ae3-6d5d5752c2ca req-4cbdb1e1-cfb8-4d39-b531-8d8529143b43 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:35.543500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ac557bba-4fc2-4ab9-8ae3-6d5d5752c2ca req-4cbdb1e1-cfb8-4d39-b531-8d8529143b43 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:35.599227 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ac557bba-4fc2-4ab9-8ae3-6d5d5752c2ca req-4cbdb1e1-cfb8-4d39-b531-8d8529143b43 service nova] Creating event network-vif-deleted:1dd7cbdd-4f56-4c38-a4ee-34955f4a64e6 for instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 on n-h2-862769-3 Oct 28 19:37:35.624490 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ac557bba-4fc2-4ab9-8ae3-6d5d5752c2ca req-4cbdb1e1-cfb8-4d39-b531-8d8529143b43 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119612 Oct 28 19:37:35.632368 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2728/5438] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:37:35.856910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:35.874494 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc095c3d-a086-4c74-9202-9c49ed22d2c8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.521610 Oct 28 19:37:35.881763 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2711/5439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:35 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:36.354266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:36.355350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:36.372108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:36.372784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:36.374183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:36.375144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:36.375767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:36.377080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:36.483949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:36.484585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:36.505007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:36.512990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:36.513500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:36.514391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:36.517253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:36.517942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:36.616194 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 HTTP/1.1 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '0790e724-c28e-4647-9b3a-ae5ab15cf674'} Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:36.625914 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:37:36.630337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:36.638547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:36.639620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca873c07-cef1-4f1b-a8ac-6658c0b89cc9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 404 len: 111 microversion: 2.1 time: 0.160093 Oct 28 19:37:36.640215 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2712/5440] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:36 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:37:36.672337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94ba613d-9f44-476c-b04a-569e7ab52d70 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '.version_select at 0x7f1d76ad2670>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:36.719975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94ba613d-9f44-476c-b04a-569e7ab52d70 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152287857" status: 202 len: 0 microversion: 2.1 time: 0.072634 Oct 28 19:37:36.721844 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2713/5441] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:37:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152287857 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:37:36.872690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:36.889708 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-007ca75b-3b39-4564-ad68-1a45be776160 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1497 microversion: 2.1 time: 0.540682 Oct 28 19:37:36.890727 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2729/5442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:36 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1497 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:36.904867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:36.906001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:36.920609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:36.922331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:36.922803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:36.930129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:36.930860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:36.931317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:37.201789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:37.241955 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d15f31c0-d88d-40b2-933d-1ce72af10697 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.341178 Oct 28 19:37:37.248516 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2714/5443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:36 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:37.536088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:37.540352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:37.575967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:37.577090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:37.582171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:37.585484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:37.596087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:37.599299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:37.726760 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-562f641a-2bb6-4748-b134-e6d48745c597 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.196045 Oct 28 19:37:37.730006 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2730/5444] 10.222.0.44 () {60 vars in 1343 bytes} [Fri Oct 28 19:37:37 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454/os-volume_attachments => generated 25 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:37.866682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:37.869613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:37.885699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:37.886370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:37.886954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:37.890718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:37.891331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:37.893980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:37.943458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:37:38.145266 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dbad8673-127e-437b-8c9a-273c385d00a2 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 204 len: 0 microversion: 2.20 time: 0.285875 Oct 28 19:37:38.148039 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2715/5445] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:37:37 2022] DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:37:38.157330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:38.157945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:38.169561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:38.170449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:38.171579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:38.172932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:38.174807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:38.175481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:38.268907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:38.270146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:38.283031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:38.288543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:38.289342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:38.295962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:38.296789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:38.300021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:38.888861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:38.904011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:38.906093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:38.916447 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-055a7e96-6332-40bb-935a-2b3d010dd1ae tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 0.755072 Oct 28 19:37:38.930743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2731/5446] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:38 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:37:39.024909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:39.039899 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-600293df-cf6a-4afe-b88d-bf7ee4bcbe46 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.775360 Oct 28 19:37:39.043430 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2716/5447] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:38 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:39.487997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:39.488587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:39.500369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:39.501211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:39.503203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:39.505126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:39.506958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:39.507624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:39.706895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lazy-loading 'services' on Instance uuid 67789fc5-c44b-4f0e-819d-fa93970cad4e {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:37:39.856755 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3238a292-dd90-4a50-8eb6-931251737491 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments/ba59ab46-991b-4dff-993d-dae560f7dbde" status: 202 len: 0 microversion: 2.1 time: 0.378464 Oct 28 19:37:39.862649 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2732/5448] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:37:39 2022] DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments/ba59ab46-991b-4dff-993d-dae560f7dbde => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:37:39.872829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:39.875458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:39.888022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:39.892279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:39.892997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:39.894734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:39.897839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:39.898634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:39.937545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:39.947349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:39.948435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:39.950873 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b44ef22-05ff-4438-87b7-1ba40f808f76 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083296 Oct 28 19:37:39.951690 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2717/5449] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:39 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:39.963188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:39.964519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:39.965791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:39.966788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:39.967599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:39.968175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:40.070117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:40.071496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:40.096532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:40.098642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:40.099920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:40.100975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:40.105958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:40.107215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:40.616614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:40.647449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:40.669077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:40.670394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-711d75cf-1400-4b60-858b-4da59a6f5180 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1722 microversion: 2.20 time: 0.728794 Oct 28 19:37:40.671021 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2733/5450] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:39 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1722 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:37:40.749842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:40.759094 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8e0ad835-677c-4a7d-90ec-5fb6a9eacd8b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.695686 Oct 28 19:37:40.776541 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2718/5451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:40 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:40.992205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:41.026610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:41.049023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:41.049740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:41.050339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:41.053034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:41.053726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:41.055212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:41.165322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f27e5646-ab79-490a-9355-6d37c1dcff80 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193412 Oct 28 19:37:41.166462 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2734/5452] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:40 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:41.701959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:41.703180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:41.732712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:41.733419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:41.734020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:41.737390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:41.738220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:41.739139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:41.785752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:41.787384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:41.804328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:41.805192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:41.805795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:41.806894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:41.807540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:41.808454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:41.924114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:41.937074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:41.938572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:41.939822 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea64ccd2-85a5-4748-a286-57bb2353e301 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1655 microversion: 2.20 time: 0.243221 Oct 28 19:37:41.940386 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2719/5453] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:41 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1655 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:37:42.179972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:42.181784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:42.206547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:42.212454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:42.212902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:42.218184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:42.218765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:42.219149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:42.310896 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79fd1f71-0897-4f14-9c0d-a2e7489a8de1 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135569 Oct 28 19:37:42.311517 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2720/5454] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:42 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:37:42.343515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5c5154ec-b921-49d7-b2f4-d7128a148ca2 req-61413409-188d-4230-8168-6110ae394913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7861545-ef63-4ef6-952c-5cbb25ffd454", "name": "network-vif-deleted", "tag": "57659f39-9abe-4a91-84a0-b94f29720f44"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:42.362181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5c5154ec-b921-49d7-b2f4-d7128a148ca2 req-61413409-188d-4230-8168-6110ae394913 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:42.364580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5c5154ec-b921-49d7-b2f4-d7128a148ca2 req-61413409-188d-4230-8168-6110ae394913 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:42.367512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5c5154ec-b921-49d7-b2f4-d7128a148ca2 req-61413409-188d-4230-8168-6110ae394913 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:42.393408 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5c5154ec-b921-49d7-b2f4-d7128a148ca2 req-61413409-188d-4230-8168-6110ae394913 service nova] Creating event network-vif-deleted:57659f39-9abe-4a91-84a0-b94f29720f44 for instance a7861545-ef63-4ef6-952c-5cbb25ffd454 on n-h2-862769-3 Oct 28 19:37:42.407451 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5c5154ec-b921-49d7-b2f4-d7128a148ca2 req-61413409-188d-4230-8168-6110ae394913 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066447 Oct 28 19:37:42.411010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2721/5455] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:42.649487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:42.683510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29b1506c-3ace-41c3-b546-9957f4226190 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.901057 Oct 28 19:37:42.729763 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2735/5456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:41 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:42.975915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:42.976663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:42.991980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:42.992477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:42.992922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:42.996062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:42.996575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:42.999298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.091605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.092246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.092708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.093183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lazy-loading 'fault' on Instance uuid a7861545-ef63-4ef6-952c-5cbb25ffd454 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:37:43.216371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:43.226743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:43.228220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dea27583bf5144a5aeed6ec0c3c20ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f88e4c7194409a91baeb78e099e93f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:43.233265 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23788fe2-ffb2-4d30-aa79-24e7a1f967bb tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 200 len: 1372 microversion: 2.20 time: 0.262602 Oct 28 19:37:43.251445 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2722/5457] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:42 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:37:43.324346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:43.327192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:43.341395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.346023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.361691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.366899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.369521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.370113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.467184 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc67e5ca-dd8a-47a3-8bb8-5485451dd79b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147162 Oct 28 19:37:43.473184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2736/5458] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:43 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:43.694964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:43.695737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:43.707847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.712707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.713152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.713889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.714348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.714799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.741822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:43.743001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:43.753322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.761646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.764965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.767164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:43.767889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:43.769154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:43.807487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:37:44.025404 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8b4c842-ab2c-4fa3-be19-84a0628364c0 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "DELETE /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 204 len: 0 microversion: 2.1 time: 0.330778 Oct 28 19:37:44.026535 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2723/5459] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:37:43 2022] DELETE /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:37:44.051479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:44.056430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:44.067336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:44.076358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:44.077165 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0fc51b5b-fa01-4e8b-8561-e4c0af78c367 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.339502 Oct 28 19:37:44.081170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:44.081868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:44.082808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:44.085668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:44.086272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:44.092627 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2737/5460] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:43 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:44.262322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:44.278250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:44.287648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:44.288558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:44.289167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:44.290086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:44.290725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:44.291313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:44.315906 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] HTTP exception thrown: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Request method failure captured: Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 HTTP/1.1 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC2nCs5V5RlgXNe98k59oHqh9hZoOKc-Vvzzmk9qbPBCkJRJfLmCaGd97tFt_Vz0SXRN8QIDIhh_cHEaIwayPszmmOm7khx2u6Nn_Eh2Dh6V3jizC2ohJi5MDSgfNfq5j7gRKp88Wihkvw5504QPev9BXeB8CL6pjwjJ9HVLVJO8OAY Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_95f88e4c7194409a91baeb78e099e93f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: dea27583bf5144a5aeed6ec0c3c20ca4 Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a7861545-ef63-4ef6-952c-5cbb25ffd454'} Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:44.319380 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:44.324038 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:44.326405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Returning 404 to user: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:44.327550 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c6eed46-f013-4e0d-888f-a05f00410de3 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 404 len: 111 microversion: 2.20 time: 0.069294 Oct 28 19:37:44.328786 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2738/5461] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:44 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:37:44.347294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-283f8674-bf33-40c4-a054-7d9391870a2f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '.version_select at 0x7f1d77bf5790>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:44.393699 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-283f8674-bf33-40c4-a054-7d9391870a2f tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999479373" status: 204 len: 0 microversion: 2.20 time: 0.055880 Oct 28 19:37:44.396471 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2739/5462] 10.222.0.44 () {60 vars in 1262 bytes} [Fri Oct 28 19:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999479373 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:37:44.436470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:44.452171 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d13073a9-3f08-46f2-8187-b9b2fc0b144a tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1503 microversion: 2.1 time: 0.420235 Oct 28 19:37:44.458268 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2724/5463] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:44 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:44.489607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:44.492273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:44.513141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:44.514711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:44.515575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:44.520764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:44.521432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:44.522102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:44.556477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:44.603377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf262911-fc06-4b90-9b8d-eef483166f44 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116694 Oct 28 19:37:44.608639 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2740/5464] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:44 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:45.103921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:45.104670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:45.123016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:45.128839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:45.133878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:45.149183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:45.152096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:45.152841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:45.385915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:45.429625 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5d9ff893-e4fa-4038-8eac-3c718969d4b8 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.329679 Oct 28 19:37:45.445077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2725/5465] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:45 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:45.490873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:45.494564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:45.520311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:45.520922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:45.521274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:45.521991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:45.522439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:45.524618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:45.615623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:45.618837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:45.637858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:45.638322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:45.646888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:45.648222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:45.648718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:45.649138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:45.731240 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d73b26bd-f428-4bd1-81ac-9fc3e9db3568 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120038 Oct 28 19:37:45.739093 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2726/5466] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:45 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:45.878122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:45.941120 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29467e20-b66d-4ffb-88a5-e8d00274e461 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1503 microversion: 2.1 time: 0.455451 Oct 28 19:37:45.941746 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2741/5467] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:45 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:46.453451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:46.453992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:46.468106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:46.468699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:46.469231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:46.470057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:46.472681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:46.473207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:46.756439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:46.760194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:46.784083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:46.784767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:46.785380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:46.786917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:46.787562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:46.788150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:46.929879 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7cb57eb8-4be6-4b9e-a8fc-d6c79a65e80f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180506 Oct 28 19:37:46.930551 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2742/5468] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:46 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:46.936878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:46.948523 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12d1bfae-c2b0-4d1b-8689-4cf2e6c3cbf6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.498985 Oct 28 19:37:46.951309 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2727/5469] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:46 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:46.973640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:46.975535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:46.988510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:46.989865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:46.990511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:46.991460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:46.992146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:46.992773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:47.052710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-61cd7468-7dc0-44db-ad04-e9e69deed3a9 req-baf0ac06-4d49-4329-80cd-a05ad899dd47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675ad4db-c48b-4ed3-883d-dd61e9dfcc16", "name": "network-vif-deleted", "tag": "2cac9ae3-053a-47aa-9178-bd56afc2e40d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:47.082342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61cd7468-7dc0-44db-ad04-e9e69deed3a9 req-baf0ac06-4d49-4329-80cd-a05ad899dd47 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:47.082633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61cd7468-7dc0-44db-ad04-e9e69deed3a9 req-baf0ac06-4d49-4329-80cd-a05ad899dd47 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:47.083260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61cd7468-7dc0-44db-ad04-e9e69deed3a9 req-baf0ac06-4d49-4329-80cd-a05ad899dd47 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:47.109168 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-61cd7468-7dc0-44db-ad04-e9e69deed3a9 req-baf0ac06-4d49-4329-80cd-a05ad899dd47 service nova] Creating event network-vif-deleted:2cac9ae3-053a-47aa-9178-bd56afc2e40d for instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 on n-h2-862769-3 Oct 28 19:37:47.117389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-61cd7468-7dc0-44db-ad04-e9e69deed3a9 req-baf0ac06-4d49-4329-80cd-a05ad899dd47 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068553 Oct 28 19:37:47.119338 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2728/5470] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:37:47.145496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a716ac546745b2b8d9dc2546bc3bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962adae0eb564559b8355d167269db1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:47.165281 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fade0487-10dc-44cd-9338-1e2603b29a34 tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 200 len: 1461 microversion: 2.1 time: 0.200745 Oct 28 19:37:47.166889 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2743/5471] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:46 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 1461 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:47.943964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:47.947256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:47.963515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:47.970669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:47.971409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:47.972721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:47.980678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:47.982415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:47.988227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:47.990644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:48.005200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:48.008855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:48.009539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:48.019750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:48.020565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:48.021219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:48.090963 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-96643867-cad4-4c0a-9e94-688f58a25fc2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151885 Oct 28 19:37:48.091941 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2729/5472] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:47 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:48.195870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:48.196168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] [instance: 675ad4db-c48b-4ed3-883d-dd61e9dfcc16] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:48.205587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:48.205832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:48.208145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:48.209076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:48.212302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:48.212977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:48.246076 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] HTTP exception thrown: Instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 could not be found. Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Request method failure captured: Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 HTTP/1.1 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC9s50lg9XMneSdChiI9wSf2bI71FaqfLNo-wJLHCqggH3KeNoSL9ePw8I_NaosojZhOqXAXtD04GtWqMCtCbZMERkIcLDtzQfWdKjNHC90Yr6JlKJX-unOGffVYAIhvy7M6G6hvgOmPPyQZqYgrurM8t66zVGRli2RDA8_B5JL9Mdk Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 962adae0eb564559b8355d167269db1d Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesActionsTest-1555092078 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/962adae0eb564559b8355d167269db1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_962adae0eb564559b8355d167269db1d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/962adae0eb564559b8355d167269db1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/962adae0eb564559b8355d167269db1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesActionsTest-1555092078 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 962adae0eb564559b8355d167269db1d Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesActionsTest-1555092078 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesActionsTest-1555092078-project Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f8a716ac546745b2b8d9dc2546bc3bf0 Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesActionsTest-1555092078-project Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 could not be found. Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '675ad4db-c48b-4ed3-883d-dd61e9dfcc16'} Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 could not be found. Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 could not be found. Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:48.248198 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 could not be found. Oct 28 19:37:48.252862 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:48.263248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] Returning 404 to user: Instance 675ad4db-c48b-4ed3-883d-dd61e9dfcc16 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:48.264467 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cda95013-c495-4596-b97f-e63c7248920b tempest-VolumesActionsTest-1555092078 tempest-VolumesActionsTest-1555092078-project] 10.222.0.44 "GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16" status: 404 len: 111 microversion: 2.1 time: 0.076134 Oct 28 19:37:48.265588 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2730/5473] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:48 2022] GET /compute/v2.1/servers/675ad4db-c48b-4ed3-883d-dd61e9dfcc16 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:37:48.302017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:48.311220 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5263d97-fad6-436b-ae7e-fe8e6d85508b tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.335310 Oct 28 19:37:48.323653 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2744/5474] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:47 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:49.105923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:49.109656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:49.134785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:49.135584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:49.139885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:49.142958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:49.146634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:49.156302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:49.233686 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d6d103f-5192-4498-b5b1-2ed7ae8c36df tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132931 Oct 28 19:37:49.238753 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2731/5475] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:49 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:49.336699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:49.337321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:49.352615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:49.353118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:49.353555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:49.354276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:49.354749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:49.355175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:49.665430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:49.680412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b92d4327-2774-4039-ad1f-007d83cdd153 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.347626 Oct 28 19:37:49.681659 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2745/5476] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:49 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:50.259815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:50.259815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:50.289670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.291366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.294563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.300192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.301705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.302972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.422590 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae027ccd-1ce6-4e26-82bd-a9a0a19ff641 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.180442 Oct 28 19:37:50.428275 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2732/5477] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:37:50 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:37:50.536477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:50.538153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:50.555270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.563413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.563998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.564936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.565661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.566331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.616782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:37:50.709149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:50.709614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:50.714925 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b9750fe-ed63-42e4-8fa1-f2c75fb8ea6e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 204 len: 0 microversion: 2.1 time: 0.181830 Oct 28 19:37:50.719914 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2746/5478] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:37:50 2022] DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:37:50.724274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.724799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.725245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.725953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.727774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:50.728512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:50.734606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.735102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.737802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.738309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.738914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:50.739552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:50.740039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:50.740960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:51.171011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:51.180806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e48650f-715d-4bd8-80fd-eaa1e89e6ce4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1679 microversion: 2.1 time: 0.458342 Oct 28 19:37:51.181370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:51.183190 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2747/5479] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:50 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1679 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:51.196967 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7865e73b-a308-4785-900d-01c538df2fe0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 0.490774 Oct 28 19:37:51.196967 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2733/5480] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:50 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:51.307647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:51.309025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:51.339610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:51.342120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:51.344100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:51.346904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:51.349084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:51.351633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:51.398463 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] HTTP exception thrown: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Request method failure captured: Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 HTTP/1.1 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC2nCs5V5RlgXNe98k59oHqh9hZoOKc-Vvzzmk9qbPBCkJRJfLmCaGd97tFt_Vz0SXRN8QIDIhh_cHEaIwayPszmmOm7khx2u6Nn_Eh2Dh6V3jizC2ohJi5MDSgfNfq5j7gRKp88Wihkvw5504QPev9BXeB8CL6pjwjJ9HVLVJO8OAY Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_95f88e4c7194409a91baeb78e099e93f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: dea27583bf5144a5aeed6ec0c3c20ca4 Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'a7861545-ef63-4ef6-952c-5cbb25ffd454'} Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:51.400538 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Returning 404 to user: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:51.406541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e13f524d-4506-458a-8138-d123b6376380 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 404 len: 111 microversion: 2.20 time: 0.101916 Oct 28 19:37:51.409774 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2748/5481] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:37:51 2022] DELETE /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:37:51.412950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:51.413576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: a7861545-ef63-4ef6-952c-5cbb25ffd454] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:51.424232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:51.427293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:51.427987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:51.428923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:51.432230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:51.432898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:51.456988 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] HTTP exception thrown: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Request method failure captured: Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 HTTP/1.1 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC2nCs5V5RlgXNe98k59oHqh9hZoOKc-Vvzzmk9qbPBCkJRJfLmCaGd97tFt_Vz0SXRN8QIDIhh_cHEaIwayPszmmOm7khx2u6Nn_Eh2Dh6V3jizC2ohJi5MDSgfNfq5j7gRKp88Wihkvw5504QPev9BXeB8CL6pjwjJ9HVLVJO8OAY Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_95f88e4c7194409a91baeb78e099e93f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: dea27583bf5144a5aeed6ec0c3c20ca4 Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a7861545-ef63-4ef6-952c-5cbb25ffd454'} Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.459334 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. Oct 28 19:37:51.464565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:37:51.465648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Returning 404 to user: Instance a7861545-ef63-4ef6-952c-5cbb25ffd454 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:51.466870 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a0d17d9-1fd6-48a3-8f6f-98de5f043a09 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454" status: 404 len: 111 microversion: 2.20 time: 0.058307 Oct 28 19:37:51.468093 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2734/5482] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:37:51 2022] GET /compute/v2.1/servers/a7861545-ef63-4ef6-952c-5cbb25ffd454 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:37:52.214915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:52.215713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:52.230428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:52.231377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:52.239468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:52.240069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:52.240618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:52.242913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:52.247251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:52.247483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:52.248157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:52.248534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:52.253061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:52.254270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:52.255060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:52.255716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:52.261987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:54.347399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:54.359508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af7fdb39-f28b-46cb-8b4e-cf4c6687fd19 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1679 microversion: 2.1 time: 2.148563 Oct 28 19:37:54.360107 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2749/5483] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:52 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1679 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:54.664355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:54.680463 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ccca88aa-6fb5-48df-b41a-ae260c4bbb28 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1505 microversion: 2.1 time: 2.454585 Oct 28 19:37:54.696586 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2735/5484] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:52 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1505 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:54.789028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f6fff237-29aa-4069-bb9d-c70b028db905 req-98db4b93-efb3-4fd0-98e6-1bf9baf26388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67789fc5-c44b-4f0e-819d-fa93970cad4e", "name": "network-vif-deleted", "tag": "5b7a5b06-aa5a-42c7-a263-3e9895fab848"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:54.813416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6fff237-29aa-4069-bb9d-c70b028db905 req-98db4b93-efb3-4fd0-98e6-1bf9baf26388 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:54.822502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6fff237-29aa-4069-bb9d-c70b028db905 req-98db4b93-efb3-4fd0-98e6-1bf9baf26388 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:54.824843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6fff237-29aa-4069-bb9d-c70b028db905 req-98db4b93-efb3-4fd0-98e6-1bf9baf26388 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:54.856860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f6fff237-29aa-4069-bb9d-c70b028db905 req-98db4b93-efb3-4fd0-98e6-1bf9baf26388 service nova] Creating event network-vif-deleted:5b7a5b06-aa5a-42c7-a263-3e9895fab848 for instance 67789fc5-c44b-4f0e-819d-fa93970cad4e on n-h1-862769-3 Oct 28 19:37:54.891463 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f6fff237-29aa-4069-bb9d-c70b028db905 req-98db4b93-efb3-4fd0-98e6-1bf9baf26388 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096069 Oct 28 19:37:54.891463 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2750/5485] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:55.387609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:55.388415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:55.406242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.407689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.411241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.412738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.414468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.418218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.475882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.477676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.481492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.482171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lazy-loading 'fault' on Instance uuid 67789fc5-c44b-4f0e-819d-fa93970cad4e {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:37:55.561370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:55.570225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e1d4f85-9e7e-49ad-b8c1-699f7fcc4ba2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 200 len: 1330 microversion: 2.1 time: 0.186750 Oct 28 19:37:55.575818 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2736/5486] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:55 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 1330 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:55.725973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:55.726808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:55.746128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.746634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.747154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.747893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.748354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.748780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:56.131378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:56.142620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2974434-0229-4505-9f0a-6ac6e30a060e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1485 microversion: 2.1 time: 0.436545 Oct 28 19:37:56.145597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2751/5487] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:55 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1485 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:56.424603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-751059193", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:56.589429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] validate_networks() for [('db148bba-ab93-41af-8d32-cb8809926be5', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:37:56.599862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:56.600483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:37:56.620541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:56.621058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:56.621493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:56.622214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:56.622765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:56.623199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:56.693536 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e HTTP/1.1 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '67789fc5-c44b-4f0e-819d-fa93970cad4e'} Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:37:56.695506 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:37:56.699438 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02252c4e-b56e-474b-b8af-1ba41c01d6f5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 404 len: 111 microversion: 2.1 time: 0.100955 Oct 28 19:37:56.722071 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2752/5488] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:56 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:37:56.722071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd631a1c-ccfd-4105-ab20-12420ea5e78e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '.version_select at 0x7f1d7c0a1820>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:56.816242 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd631a1c-ccfd-4105-ab20-12420ea5e78e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731216559" status: 202 len: 0 microversion: 2.1 time: 0.101399 Oct 28 19:37:56.816835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2753/5489] 10.222.0.44 () {58 vars in 1218 bytes} [Fri Oct 28 19:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731216559 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:37:59.239934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:37:59.240490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:37:59.241030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:37:59.241623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:37:59.242047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:37:59.300647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:59.301032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:59.304396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:59.320802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:59.335466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-57b950dc-5a54-4ae1-83f9-d0087a7e6c2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: .version_select at 0x7f1d76b399d0>, body: {"keypair": {"name": "tempest-keypair-1987600165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa+nl80T23uHBxcloq+m7Awjpk418FsxJCXIyT4adiG4epo+OCmDUQHCSsGqRWLA/xqddnTqbq6AOJCg2sfwgsDFfB3BuMq65LBtAoywHWlQ1oTg8W+r5eZhBDmPk5aMw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:59.348741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:59.349868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:59.452687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-57b950dc-5a54-4ae1-83f9-d0087a7e6c2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:37:59.467994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Getting quotas for project 87f434bac604461c8cb49b3138ac414a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:37:59.474521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-57b950dc-5a54-4ae1-83f9-d0087a7e6c2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:37:59.503008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Getting quotas for user eff93b137dbd497f857d23cc08565749 and project 87f434bac604461c8cb49b3138ac414a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:37:59.563683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:37:59.585987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:37:59.599785 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-57b950dc-5a54-4ae1-83f9-d0087a7e6c2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.269382 Oct 28 19:37:59.609743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2754/5490] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:37:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:59.772346 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94f22515-b6af-4eba-be26-adce15ba89a1 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.350412 Oct 28 19:37:59.776425 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2737/5491] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:37:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:37:59.785414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e68e1c00-f755-448f-8fe3-093d7cc52eec tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:59.786135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e68e1c00-f755-448f-8fe3-093d7cc52eec tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:00.195371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e68e1c00-f755-448f-8fe3-093d7cc52eec tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:00.207695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e68e1c00-f755-448f-8fe3-093d7cc52eec tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1213 microversion: 2.1 time: 0.426372 Oct 28 19:38:00.229041 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2755/5492] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:59 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1213 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:00.756312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:00.756911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:00.775473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.775977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.776425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.777161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.777623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.778058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.824508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] HTTP exception thrown: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Request method failure captured: Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 HTTP/1.1 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC2nCs5V5RlgXNe98k59oHqh9hZoOKc-Vvzzmk9qbPBCkJRJfLmCaGd97tFt_Vz0SXRN8QIDIhh_cHEaIwayPszmmOm7khx2u6Nn_Eh2Dh6V3jizC2ohJi5MDSgfNfq5j7gRKp88Wihkvw5504QPev9BXeB8CL6pjwjJ9HVLVJO8OAY Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_95f88e4c7194409a91baeb78e099e93f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: dea27583bf5144a5aeed6ec0c3c20ca4 Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '212bb4fa-97c2-42ea-ae9e-4fd89f99dc98'} Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:38:00.840368 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.844339 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.848192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Returning 404 to user: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:38:00.851719 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aa0f04f7-c681-46b2-acc9-3e9fb67ae24e tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 404 len: 111 microversion: 2.20 time: 0.099417 Oct 28 19:38:00.855272 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2738/5493] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:38:00 2022] DELETE /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:38:00.862555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:00.863982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] [instance: 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:00.874485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.877801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.880234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.881293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.882975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.883746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.934811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] HTTP exception thrown: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Request method failure captured: Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 HTTP/1.1 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC2nCs5V5RlgXNe98k59oHqh9hZoOKc-Vvzzmk9qbPBCkJRJfLmCaGd97tFt_Vz0SXRN8QIDIhh_cHEaIwayPszmmOm7khx2u6Nn_Eh2Dh6V3jizC2ohJi5MDSgfNfq5j7gRKp88Wihkvw5504QPev9BXeB8CL6pjwjJ9HVLVJO8OAY Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_95f88e4c7194409a91baeb78e099e93f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/95f88e4c7194409a91baeb78e099e93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 95f88e4c7194409a91baeb78e099e93f Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375952871 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: dea27583bf5144a5aeed6ec0c3c20ca4 Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375952871-project Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '212bb4fa-97c2-42ea-ae9e-4fd89f99dc98'} Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.943236 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. Oct 28 19:38:00.949171 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:00.952057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] Returning 404 to user: Instance 212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:38:00.953213 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bccbc362-35a8-4b54-9e9b-fc3a87646194 tempest-AttachVolumeShelveTestJSON-375952871 tempest-AttachVolumeShelveTestJSON-375952871-project] 10.222.0.44 "GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98" status: 404 len: 111 microversion: 2.20 time: 0.094802 Oct 28 19:38:00.954328 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2756/5494] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:38:00 2022] GET /compute/v2.1/servers/212bb4fa-97c2-42ea-ae9e-4fd89f99dc98 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:38:01.244799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:01.245483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:01.265230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:01.265792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:01.266242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:01.267016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:01.267476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:01.267902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:01.541881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:01.559504 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53158022-e453-41f5-8cf5-b2f1448f2567 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1265 microversion: 2.1 time: 0.321868 Oct 28 19:38:01.564698 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2739/5495] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:01 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:02.587007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:02.587629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:02.603769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:02.605447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:02.606020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:02.606492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:02.624731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:02.625241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:02.625737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:03.736141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:03.751729 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11e59a67-25bb-47e2-acdc-f62bedec9d78 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1271 microversion: 2.1 time: 1.162399 Oct 28 19:38:03.753210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2757/5496] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:02 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1271 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:04.781202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:04.783863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:04.801051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:04.827361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:04.827859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:04.828296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:04.829031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:04.829482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:04.829902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:05.264019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:05.295336 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48ccdda4-706b-4d64-acd5-298b6e851936 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 0.518714 Oct 28 19:38:05.295975 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2740/5497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:04 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:06.320806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:06.322071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:06.338543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:06.342011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:06.344001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:06.345097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:06.345759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:06.346385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:06.994145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:07.013502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a02f05b8-e9d9-44aa-ab49-38aba0e8d702 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 0.697203 Oct 28 19:38:07.018289 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2758/5498] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:06 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:07.474848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-644640902", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599ec161-dd8a-466f-859e-7811bbe9f61c"}], "security_groups": [{"name": "tempest-securitygroup--252676357"}], "key_name": "tempest-keypair-1987600165", "user_data": "}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:07.792932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1a8de481-26d5-429f-a13d-ac6db96af7ba req-ebc74560-95e7-454d-8c54-1cd18058e868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5777b21-2d8a-42b6-801a-f87ad662df30", "tag": "1cfa68b9-d9db-4eaf-a699-b4008c70897b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:07.832318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1a8de481-26d5-429f-a13d-ac6db96af7ba req-ebc74560-95e7-454d-8c54-1cd18058e868 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:07.832815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1a8de481-26d5-429f-a13d-ac6db96af7ba req-ebc74560-95e7-454d-8c54-1cd18058e868 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:07.833253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1a8de481-26d5-429f-a13d-ac6db96af7ba req-ebc74560-95e7-454d-8c54-1cd18058e868 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:07.880560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] validate_networks() for [('599ec161-dd8a-466f-859e-7811bbe9f61c', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:38:07.892986 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1a8de481-26d5-429f-a13d-ac6db96af7ba req-ebc74560-95e7-454d-8c54-1cd18058e868 service nova] Creating event network-changed:1cfa68b9-d9db-4eaf-a699-b4008c70897b for instance e5777b21-2d8a-42b6-801a-f87ad662df30 on n-h2-862769-3 Oct 28 19:38:07.902214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1a8de481-26d5-429f-a13d-ac6db96af7ba req-ebc74560-95e7-454d-8c54-1cd18058e868 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113363 Oct 28 19:38:07.909189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2759/5499] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:38:08.047338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:08.048466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:08.060413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:08.062392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:08.063996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:08.068145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:08.073506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:08.074101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:09.301499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:09.316268 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ceab4959-57e6-4fef-be81-14d273223c95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 1.275931 Oct 28 19:38:09.325568 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2760/5500] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:08 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:09.392500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:09.538191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:10.288483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:38:10.288963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:38:10.289599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:38:10.290020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:38:10.290436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:38:10.318926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:10.319339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:10.337937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:10.338855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:10.339387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:10.340347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:10.351641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:10.352320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:10.355608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:10.386507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:10.387031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:10.397394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:10.398215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:10.401662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:10.402142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:10.453045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:38:10.463160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:38:10.485324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:38:10.488350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:38:10.686726 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4788ea12-8ca4-4cfb-a444-bbaa22aa0e5d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.212988 Oct 28 19:38:10.698906 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2741/5501] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:38:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 3229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:38:10.733041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5d5af00e-ba7d-405c-8300-775c7e1da9a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:10.734891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5d5af00e-ba7d-405c-8300-775c7e1da9a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:10.943344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5d5af00e-ba7d-405c-8300-775c7e1da9a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:10.957500 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5d5af00e-ba7d-405c-8300-775c7e1da9a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1241 microversion: 2.1 time: 0.257200 Oct 28 19:38:10.962489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2742/5502] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:10 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1241 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:11.005682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:11.016108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:11.022212 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64cdace9-f009-4f4c-8660-23dac1bd19cb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 0.674688 Oct 28 19:38:11.027932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2761/5503] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:10 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:11.985305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:11.986684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:12.004625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:12.020928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:12.023317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:12.026362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:12.029354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:12.029879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:12.072904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:12.078192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:12.132680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:12.135444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:12.138309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:12.142643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:12.146496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:12.151446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:12.337310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:12.351619 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e105c5b-d6e4-406c-9e27-523a3202de8e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1245 microversion: 2.1 time: 0.370680 Oct 28 19:38:12.360182 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2743/5504] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:11 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1245 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:12.661585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:12.674644 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4ea1f04f-ed6b-48a6-836b-68171b7dc78e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 0.626943 Oct 28 19:38:12.675291 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2762/5505] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:12 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:13.386204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:13.387358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:13.406336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:13.411594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:13.412291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:13.418090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:13.418850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:13.419496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:13.702324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:13.702967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:13.731373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:13.733576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:13.735116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:13.739632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:13.741796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:13.745295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:13.783352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:13.807394 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b4f8431-ff91-493f-9bb9-87aa3f491c1d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1301 microversion: 2.1 time: 0.425344 Oct 28 19:38:13.811536 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2744/5506] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:13 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1301 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:14.420711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b0a45299-36d8-4053-83e4-c4995e8fc20b req-b0b0fece-533f-4392-917e-afaab5f35ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5777b21-2d8a-42b6-801a-f87ad662df30", "name": "network-vif-plugged", "status": "completed", "tag": "1cfa68b9-d9db-4eaf-a699-b4008c70897b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:14.444345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b0a45299-36d8-4053-83e4-c4995e8fc20b req-b0b0fece-533f-4392-917e-afaab5f35ae1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:14.447456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b0a45299-36d8-4053-83e4-c4995e8fc20b req-b0b0fece-533f-4392-917e-afaab5f35ae1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:14.448206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b0a45299-36d8-4053-83e4-c4995e8fc20b req-b0b0fece-533f-4392-917e-afaab5f35ae1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:14.477712 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b0a45299-36d8-4053-83e4-c4995e8fc20b req-b0b0fece-533f-4392-917e-afaab5f35ae1 service nova] Creating event network-vif-plugged:1cfa68b9-d9db-4eaf-a699-b4008c70897b for instance e5777b21-2d8a-42b6-801a-f87ad662df30 on n-h2-862769-3 Oct 28 19:38:14.491950 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b0a45299-36d8-4053-83e4-c4995e8fc20b req-b0b0fece-533f-4392-917e-afaab5f35ae1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078597 Oct 28 19:38:14.507278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2745/5507] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:38:14.578600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:14.597996 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5887a2e-06ce-4552-9857-7b6ca5cb5cbe tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 0.892764 Oct 28 19:38:14.600936 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2763/5508] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:13 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:14.836507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:14.837912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:14.866424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:14.866945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:14.869316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:14.870353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:14.871250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:14.873331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:15.621938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:15.622621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:15.637149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:15.637644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:15.641071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:15.642257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:15.642926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:15.646887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:16.053066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:16.070838 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e683b6cf-33fc-45ac-81b0-cab3088e0f01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1299 microversion: 2.1 time: 1.237565 Oct 28 19:38:16.073165 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2746/5509] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:14 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1299 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:16.186169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:16.206998 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3aec09f9-1ce0-49c1-a42f-aafae77e3986 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1313 microversion: 2.1 time: 0.589038 Oct 28 19:38:16.209535 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2764/5510] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:15 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:17.115639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:17.116417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:17.131759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:17.132260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:17.132686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:17.138405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:17.139472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:17.145686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:17.232394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:17.233027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:17.258056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:17.258564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:17.274187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:17.275120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:17.275553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:17.275913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:18.080202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:18.089169 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c045a918-7754-48d7-b621-2aabdeb0f62d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1499 microversion: 2.1 time: 0.861183 Oct 28 19:38:18.096597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2765/5511] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:17 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1499 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:18.127828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:18.131029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:18.142183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:18.153953 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94a20c7f-bccd-4e5e-b9c1-1f1bb2070ce7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 1.044090 Oct 28 19:38:18.156398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:18.161690 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2747/5512] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:17 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:18.162770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:18.163478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:18.167706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:18.171372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:18.176239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:18.278533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lazy-loading 'flavor' on Instance uuid e5777b21-2d8a-42b6-801a-f87ad662df30 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:38:18.438844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-1b58e251-aec6-4b76-9502-1456768cba88 req-492ea2ca-a5b0-412c-8c1c-d58be76465d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6d8bd2-c1b2-44da-83c3-e715c16126d6", "tag": "89a9aef8-7649-4d39-a1d8-0583c2716ab7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:18.475948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1b58e251-aec6-4b76-9502-1456768cba88 req-492ea2ca-a5b0-412c-8c1c-d58be76465d9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:18.487459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1b58e251-aec6-4b76-9502-1456768cba88 req-492ea2ca-a5b0-412c-8c1c-d58be76465d9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:18.489166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1b58e251-aec6-4b76-9502-1456768cba88 req-492ea2ca-a5b0-412c-8c1c-d58be76465d9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:18.514925 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6af4cd79-2542-4203-a705-03473ef18164 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "POST /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30/action" status: 200 len: 32 microversion: 2.1 time: 0.395408 Oct 28 19:38:18.516483 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2766/5513] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:38:18 2022] POST /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30/action => generated 32 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 19:38:18.549027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:18.550018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:18.552791 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-1b58e251-aec6-4b76-9502-1456768cba88 req-492ea2ca-a5b0-412c-8c1c-d58be76465d9 service nova] Creating event network-changed:89a9aef8-7649-4d39-a1d8-0583c2716ab7 for instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 on n-h1-862769-3 Oct 28 19:38:18.558221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:18.558886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:18.559643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:18.560477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:18.561066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:18.562238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:18.579338 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-1b58e251-aec6-4b76-9502-1456768cba88 req-492ea2ca-a5b0-412c-8c1c-d58be76465d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151849 Oct 28 19:38:18.580589 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2748/5514] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:38:18.886143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:18.918410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c31f17c9-9220-4d9f-8368-67c7e5aee7be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.390963 Oct 28 19:38:18.937533 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2767/5515] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:18 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:19.188008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:19.188941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:19.206899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:19.219255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:19.220842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:19.223774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:19.226551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:19.233685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:19.952228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:19.953534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:19.972083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:19.972594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:19.973019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:19.973783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:19.982358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:19.986788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:20.117806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:20.134122 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b498f77-40c5-47b9-ba63-83f134700ccd tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 0.952155 Oct 28 19:38:20.141765 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2749/5516] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:19 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:20.639497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:20.649555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6d7f46c4-9656-4d3a-91d4-572292816fc6 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.701959 Oct 28 19:38:20.677015 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2768/5517] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:19 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:21.175513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:21.184930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:21.193128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:21.197826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:21.228900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:21.232979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:21.238187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:21.241878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:21.246383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:21.250649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:21.683046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:21.683825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:21.702445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:21.703522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:21.704343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:21.705402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:21.706225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:21.706928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:22.076870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:22.085365 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f961030-2d70-43d3-b767-20a388d6ab23 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 0.913689 Oct 28 19:38:22.098796 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2750/5518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:21 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:22.202531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:22.220469 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4eaaab96-9002-41ea-8d01-9d87c19d986c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.541933 Oct 28 19:38:22.221655 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2769/5519] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:21 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:23.114453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:23.115076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:23.134246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:23.135094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:23.137356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:23.140502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:23.141304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:23.145023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:23.208918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=72 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:23.249005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:23.251276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:23.271836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:23.273869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:23.276989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:23.278319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:23.280131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:23.283521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:23.697716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:23.711613 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-de79409f-2ed8-4fef-94f7-549843dab760 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.467941 Oct 28 19:38:23.714324 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2770/5520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:23 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:23.784744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:23.794462 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-264abb34-b29b-4a4f-bcf5-238ddb8582c4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 0.684479 Oct 28 19:38:23.807668 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2751/5521] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:23 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:24.739771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:24.740404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:24.756768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:24.757273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:24.757709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:24.758426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:24.766466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:24.767051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:24.819980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:24.820526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:24.839925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:24.851695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:24.853203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:24.855159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:24.861993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:24.862942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:25.335718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:25.358522 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1f8c526d-727f-4b2f-9de9-a1bea91ee6ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 0.542549 Oct 28 19:38:25.359516 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2752/5522] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:24 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:25.370884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:25.384478 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66f5f844-b122-4553-8444-a1b218f84648 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.646847 Oct 28 19:38:25.386044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2771/5523] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:24 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:26.381899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:26.382522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:26.395475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:26.398666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:26.401723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:26.405376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:26.406103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:26.408993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:26.411062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:26.411829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:26.434330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:26.437554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:26.439991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:26.442630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:26.443931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:26.444714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:27.139507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:27.156659 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a0d83995-8b6b-40c9-86db-6aaec27d7cdc tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 0.778357 Oct 28 19:38:27.157884 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2753/5524] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:26 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:27.165642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7ccdc950-ad28-4494-bd2e-2dd3e69314d7 req-1fab845c-68c6-487f-8617-24c8a4dd778f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6d8bd2-c1b2-44da-83c3-e715c16126d6", "name": "network-vif-plugged", "status": "completed", "tag": "89a9aef8-7649-4d39-a1d8-0583c2716ab7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:27.177144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:27.189645 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3325f8d6-8e5c-4fb0-91e3-e52f97010ef0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.785211 Oct 28 19:38:27.190919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ccdc950-ad28-4494-bd2e-2dd3e69314d7 req-1fab845c-68c6-487f-8617-24c8a4dd778f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:27.192260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ccdc950-ad28-4494-bd2e-2dd3e69314d7 req-1fab845c-68c6-487f-8617-24c8a4dd778f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:27.193048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7ccdc950-ad28-4494-bd2e-2dd3e69314d7 req-1fab845c-68c6-487f-8617-24c8a4dd778f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:27.205509 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2772/5525] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:26 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:27.217842 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7ccdc950-ad28-4494-bd2e-2dd3e69314d7 req-1fab845c-68c6-487f-8617-24c8a4dd778f service nova] Creating event network-vif-plugged:89a9aef8-7649-4d39-a1d8-0583c2716ab7 for instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 on n-h1-862769-3 Oct 28 19:38:27.231868 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7ccdc950-ad28-4494-bd2e-2dd3e69314d7 req-1fab845c-68c6-487f-8617-24c8a4dd778f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072371 Oct 28 19:38:27.232940 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2754/5526] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:28.184492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:28.185389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:28.211536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:28.211954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:28.212386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:28.218239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:28.219575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:28.232903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:28.235627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:28.236282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:28.239120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:28.239805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:28.240471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:28.249523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:28.250020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:28.250453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:28.914516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:28.924333 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61985677-c4c0-475a-97fe-792f1e47682d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.712014 Oct 28 19:38:28.933543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2755/5527] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:28 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:28.949474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:28.961078 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d3e29dc-fb9d-4d53-9c5e-edc0811d30e3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1366 microversion: 2.1 time: 0.780828 Oct 28 19:38:28.966927 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2773/5528] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:28 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:29.957629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:29.959051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:29.984664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:29.992874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:29.993530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:29.998148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:29.998598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:29.999407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:29.999869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:30.000288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:30.008477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:30.017686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:30.018399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:30.019407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:30.023147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:30.027558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:30.899120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:30.914232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-574ab443-ecca-4d9a-95a3-463b7fecf220 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.960427 Oct 28 19:38:30.927308 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2756/5529] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:29 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:31.010007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:31.019637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca0e860f-acd1-4961-84e6-bbb925461822 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1556 microversion: 2.1 time: 1.030595 Oct 28 19:38:31.035684 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2774/5530] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:29 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1556 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:31.054923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:31.057731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:31.067759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:31.068269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:31.068713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:31.071631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:31.072605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:31.073061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:31.196275 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-81819351-cc23-40ed-856c-24fd7dba00d4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153239 Oct 28 19:38:31.206240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2757/5531] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:38:31 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:31.959210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:31.959210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:31.996409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1746302036", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "981a8f9c-189e-46a2-9c94-79d751e4965f"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:32.005648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:32.006510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:32.020870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:32.028236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:32.029578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:32.035339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:32.265071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] validate_networks() for [('981a8f9c-189e-46a2-9c94-79d751e4965f', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:38:32.454784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:32.467259 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57dc30c4-17b1-4020-bcc0-ebc56a54a47c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.529367 Oct 28 19:38:32.488077 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2758/5532] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:31 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:33.148900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:38:33.149472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:38:33.150016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:38:33.150517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:38:33.151043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:38:33.153661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=38 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:33.193897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:33.196075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:33.198222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:33.200688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:33.203005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:33.206353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:33.265229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Getting quotas for project 6a64f33d32814a9c96449fc548889821. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:38:33.296616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Getting quotas for user ed285780668d464fa0d2761c52446690 and project 6a64f33d32814a9c96449fc548889821. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:38:33.334047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:38:33.339426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:38:33.454622 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af860bb4-051f-451d-9e0f-62defd86c7f8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698264 Oct 28 19:38:33.458226 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2775/5533] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:38:33.471551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1657c94-68e7-42ab-9880-3ad73b3e48be tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:33.472159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1657c94-68e7-42ab-9880-3ad73b3e48be tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:33.493606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:33.494479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:33.509828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:33.510513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:33.511951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:33.518096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:33.519019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:33.519644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:33.742682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1657c94-68e7-42ab-9880-3ad73b3e48be tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:33.759431 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1657c94-68e7-42ab-9880-3ad73b3e48be tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1215 microversion: 2.1 time: 0.293237 Oct 28 19:38:33.760036 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2759/5534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:33 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:33.865837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:33.889121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea57e053-3e40-4bf0-b154-786f89ae218f tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.397145 Oct 28 19:38:33.891895 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2776/5535] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:33 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:34.117301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e403b889-8a16-4890-8567-f90a86e8b597 req-d5018586-bca5-4b68-a194-0e68d7ccd5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6d8bd2-c1b2-44da-83c3-e715c16126d6", "tag": "89a9aef8-7649-4d39-a1d8-0583c2716ab7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:34.136199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e403b889-8a16-4890-8567-f90a86e8b597 req-d5018586-bca5-4b68-a194-0e68d7ccd5a5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.137716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e403b889-8a16-4890-8567-f90a86e8b597 req-d5018586-bca5-4b68-a194-0e68d7ccd5a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.138793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e403b889-8a16-4890-8567-f90a86e8b597 req-d5018586-bca5-4b68-a194-0e68d7ccd5a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:34.154016 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e403b889-8a16-4890-8567-f90a86e8b597 req-d5018586-bca5-4b68-a194-0e68d7ccd5a5 service nova] Creating event network-changed:89a9aef8-7649-4d39-a1d8-0583c2716ab7 for instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 on n-h1-862769-3 Oct 28 19:38:34.160933 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e403b889-8a16-4890-8567-f90a86e8b597 req-d5018586-bca5-4b68-a194-0e68d7ccd5a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382413 Oct 28 19:38:34.167777 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2760/5536] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:34.806556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2da4158-db02-4ed6-a2a4-71d6045f8d89 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:34.807298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2da4158-db02-4ed6-a2a4-71d6045f8d89 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:34.920248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:34.922651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:34.924759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:34.966116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.966574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.983037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:34.983856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.984324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.984755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:35.865845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2da4158-db02-4ed6-a2a4-71d6045f8d89 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:35.881945 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2da4158-db02-4ed6-a2a4-71d6045f8d89 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1215 microversion: 2.1 time: 1.097283 Oct 28 19:38:35.886986 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2777/5537] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:34 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1215 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:36.094887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:36.104179 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e88a0fe-93de-4033-821b-b9c939b04a1c tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 1.190389 Oct 28 19:38:36.104781 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2761/5538] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:34 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:36.909787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:36.910731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:36.955366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:36.957044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:36.961709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:36.962653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:36.967113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:36.968805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:36.993394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:37.131146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:37.131854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:37.165643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:37.169688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:37.173776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:37.174975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:37.178211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:37.180470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:37.247844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:37.259759 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4382d039-e9e4-492a-beaa-7cbc929644f4 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1273 microversion: 2.1 time: 0.354517 Oct 28 19:38:37.266025 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2778/5539] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:36 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:37.594823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:37.618068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-50643e66-97db-4ed4-80b4-44ea4f81b75d tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.487223 Oct 28 19:38:37.619662 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2762/5540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:37 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:38.286986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:38.289953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:38.306876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:38.315094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:38.320203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:38.324694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:38.327490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:38.334004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:38.650680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:38.651773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:38.694467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:38.695019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:38.695451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:38.696166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:38.696617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:38.703369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:39.512190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:39.538868 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e62a5eb9-1780-4d77-8475-94d9979cddbd tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 1.257140 Oct 28 19:38:39.564539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2779/5541] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:38 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:39.768570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:39.785101 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65c2ad77-291d-4144-93ab-0404f66842b5 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 1.146207 Oct 28 19:38:39.805254 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2763/5542] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:38 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:40.572437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:40.574177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:40.587868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:40.588913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:40.589562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:40.590665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:40.591449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:40.592159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:40.729542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-770104d5-7fb4-4777-b4fc-8c78f97b4b4a req-569c60a9-fce7-4bb6-bcf7-98afdf965f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e12cb0-97fa-4a81-853c-fdb02db719c0", "tag": "2250cdfe-b59e-4c21-9a11-74298a8158b6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:40.750035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-770104d5-7fb4-4777-b4fc-8c78f97b4b4a req-569c60a9-fce7-4bb6-bcf7-98afdf965f50 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:40.752398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-770104d5-7fb4-4777-b4fc-8c78f97b4b4a req-569c60a9-fce7-4bb6-bcf7-98afdf965f50 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:40.753888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-770104d5-7fb4-4777-b4fc-8c78f97b4b4a req-569c60a9-fce7-4bb6-bcf7-98afdf965f50 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:40.786910 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-770104d5-7fb4-4777-b4fc-8c78f97b4b4a req-569c60a9-fce7-4bb6-bcf7-98afdf965f50 service nova] Creating event network-changed:2250cdfe-b59e-4c21-9a11-74298a8158b6 for instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 on n-h2-862769-3 Oct 28 19:38:40.827101 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-770104d5-7fb4-4777-b4fc-8c78f97b4b4a req-569c60a9-fce7-4bb6-bcf7-98afdf965f50 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093888 Oct 28 19:38:40.827101 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2764/5543] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:40.832033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:40.839249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:40.849129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:40.850082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:40.850788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:40.851765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:40.852438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:40.853210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:41.087990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:41.096626 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5165c4e-8566-462c-a79f-b8a62db45ac2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 0.529194 Oct 28 19:38:41.107109 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2780/5544] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:40 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:41.305896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:41.338654 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-195684b0-e400-4cf2-8aa1-551bfcacc1fd tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.510528 Oct 28 19:38:41.367662 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2765/5545] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:40 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:42.124880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:42.126224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:42.150558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:42.153210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:42.154021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:42.155483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:42.159931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:42.161077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:42.374039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:42.374476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:42.387290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:42.388232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:42.388867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:42.389877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:42.390511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:42.391121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:42.609719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:42.619452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1e1b79c-362e-44e7-80ee-dde409187420 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 0.499112 Oct 28 19:38:42.620731 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2781/5546] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:42 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:42.831991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:42.844295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c3ce3efd-a705-427b-9c45-92740ae29f63 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.474463 Oct 28 19:38:42.844903 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2766/5547] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:42 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:43.646194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:43.648503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:43.674217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:43.681863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:43.682871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:43.687233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:43.688417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:43.692752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:43.693615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:43.871314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:43.874924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:43.885574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:43.888269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:43.894881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:43.896212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:43.896765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-680cddde-b989-47c7-9ccf-c660c4c1dc11 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 0.253413 Oct 28 19:38:43.897944 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2782/5548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:43 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:43.899166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:43.899928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:43.904778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:43.905269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:44.443302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:44.474569 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53ca90e4-cd46-4c0b-9dd5-7afdbbed2e92 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.607832 Oct 28 19:38:44.475233 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2767/5549] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:43 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:44.934495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:44.935230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:44.956524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:44.958134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:44.959434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:44.960508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:44.961464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:44.962343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:45.363713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:45.374363 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b46fff0b-ab1d-446a-b6d6-ef6bc1a844ee tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 0.447850 Oct 28 19:38:45.392364 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2783/5550] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:44 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:45.518777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:45.521177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:45.534426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:45.535017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:45.543537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:45.544677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:45.545343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:45.549540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:46.071960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:46.081247 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88299411-cc44-4551-bcde-6aac65d547be tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.573303 Oct 28 19:38:46.090019 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2768/5551] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:45 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:46.392278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:46.418294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:46.424063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:46.439588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:46.447142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:46.451120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:46.456672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:46.461841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:46.467010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:46.827036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:46.839674 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11d6d6bf-9f26-46bc-9818-e71e12261bb6 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 0.424524 Oct 28 19:38:46.860218 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2769/5552] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:46 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:47.063978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f6781531-191f-4780-89f2-f53a01340fcd req-463877e6-e13a-482a-bb73-de5aba387cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e12cb0-97fa-4a81-853c-fdb02db719c0", "name": "network-vif-plugged", "status": "completed", "tag": "2250cdfe-b59e-4c21-9a11-74298a8158b6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:47.104098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6781531-191f-4780-89f2-f53a01340fcd req-463877e6-e13a-482a-bb73-de5aba387cbb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.107115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6781531-191f-4780-89f2-f53a01340fcd req-463877e6-e13a-482a-bb73-de5aba387cbb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.108043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f6781531-191f-4780-89f2-f53a01340fcd req-463877e6-e13a-482a-bb73-de5aba387cbb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.140629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:47.141255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:47.142479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f6781531-191f-4780-89f2-f53a01340fcd req-463877e6-e13a-482a-bb73-de5aba387cbb service nova] Creating event network-vif-plugged:2250cdfe-b59e-4c21-9a11-74298a8158b6 for instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 on n-h2-862769-3 Oct 28 19:38:47.157163 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f6781531-191f-4780-89f2-f53a01340fcd req-463877e6-e13a-482a-bb73-de5aba387cbb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.765335 Oct 28 19:38:47.160747 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2784/5553] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:47.167561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.169891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.173014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.174634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.177023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.178659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.586830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:47.600107 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-06bd7bfc-379c-497b-a82d-9a711d65aefb tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1485 microversion: 2.1 time: 0.461493 Oct 28 19:38:47.602249 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2770/5554] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:47 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1485 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:47.631636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:47.632862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:47.645568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.651346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.652077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.653153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.653780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.654364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.835298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-be6df00e-3a1b-4a59-8820-86c24a90a8b7 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "POST /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30/action" status: 202 len: 0 microversion: 2.1 time: 0.203663 Oct 28 19:38:47.845870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:47.847779 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2785/5555] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:38:47 2022] POST /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:38:47.847971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:47.860373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.865203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.866168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.871898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.873305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.877501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.880406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:47.887049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:47.889768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:47.909164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.910667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.911832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:47.914418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:47.914930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:47.916745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:48.536111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:48.567394 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b3b86c8-d84f-4aa9-8be7-e4a233849c07 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1493 microversion: 2.1 time: 0.724931 Oct 28 19:38:48.600221 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2771/5556] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:47 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1493 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:48.628499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:48.642981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-05345245-5fac-423f-bac9-5ba65b06b9b8 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1315 microversion: 2.1 time: 0.774168 Oct 28 19:38:48.645009 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2786/5557] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:47 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:49.623249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:49.625326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:49.673179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:49.694632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:49.696285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:49.708973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:49.715334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:49.730959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:49.739589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:49.749511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:49.754545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:49.761828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:49.767253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:49.773622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:49.774371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:49.779279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:50.163882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:50.177117 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a07b4264-9cfe-4fd2-b8ed-58b5658e8426 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1501 microversion: 2.1 time: 0.498402 Oct 28 19:38:50.183761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:50.196196 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2787/5558] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:49 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1501 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:50.200356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e93b7e2-1508-49b3-94f7-a07893425946 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1493 microversion: 2.1 time: 0.587190 Oct 28 19:38:50.203322 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2772/5559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:49 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1493 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:50.223616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:50.229511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:50.249089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:50.258217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:50.258679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:50.276473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:50.278368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:50.281428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:50.626379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:50.638323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fbb0d0c4-fbf0-455e-b9f9-b096df14a0df tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1501 microversion: 2.1 time: 0.422047 Oct 28 19:38:50.654730 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2788/5560] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:50 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:50.664519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:50.667643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:50.676461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:50.677545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:50.678665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:50.680800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:50.681588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:50.682187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:50.719438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lazy-loading 'flavor' on Instance uuid a7e12cb0-97fa-4a81-853c-fdb02db719c0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:38:50.864734 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6e62c1a-fc17-4da1-a6fc-b2e3c3c30ede tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action" status: 202 len: 0 microversion: 2.1 time: 0.204558 Oct 28 19:38:50.865559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2773/5561] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:38:50 2022] POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:38:50.875615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:50.876495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:50.884202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:50.884783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:50.885588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:50.886555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:50.887317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:50.887961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:51.065122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:51.074975 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b3cff297-63d7-4ad1-8f70-d59c148e9458 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1509 microversion: 2.1 time: 0.203915 Oct 28 19:38:51.087449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2789/5562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:50 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:51.244093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:51.244820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:51.254906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:51.255399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:51.259441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:51.261864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:51.262540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:51.263159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:51.756642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:51.766643 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-89b2650d-f642-4efb-b653-ee90a29e6373 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1493 microversion: 2.1 time: 0.529591 Oct 28 19:38:51.767569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2774/5563] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:51 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1493 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:52.102582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:52.103140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:52.114648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.115180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.115607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.116313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.116760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.117166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.344111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:52.356162 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e532de4-8615-4b08-96b0-f7756bb767ec tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1492 microversion: 2.1 time: 0.257266 Oct 28 19:38:52.365420 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2790/5564] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:52 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1492 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:52.380528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:52.381061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:52.393005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.393824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.394534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.395478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.396234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.396743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.521351 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e270b2d-bcaa-4bcf-8c7c-e684bd747f1d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action" status: 202 len: 0 microversion: 2.1 time: 0.144943 Oct 28 19:38:52.522146 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2775/5565] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:38:52 2022] POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:38:52.539476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:52.540218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:52.551452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.553147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.554193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.556000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.556709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.558158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.790305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:52.791304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:52.816038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.816579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.817021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.817781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:52.818237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:52.818655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:52.886729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:52.901939 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-20fd10d0-a6ec-444e-bcdf-6ced296a1b62 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1498 microversion: 2.1 time: 0.367824 Oct 28 19:38:52.904489 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2791/5566] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:52 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1498 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:53.111462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:53.123036 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-30d70e83-4e73-4ffe-ae48-3f6ef7fc8b42 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1499 microversion: 2.1 time: 0.336347 Oct 28 19:38:53.125937 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2776/5567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:52 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1499 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:53.162313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:53.163451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:53.172165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:53.172915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:53.173504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:53.174365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:53.175024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:53.175598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:53.203090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:38:53.278388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:53.322594 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d4c849db-c58f-4232-b504-a267ba044346 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 204 len: 0 microversion: 2.1 time: 0.163182 Oct 28 19:38:53.329560 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2792/5568] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:38:53 2022] DELETE /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:53.334404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:53.335471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:53.357038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:53.360180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:53.361040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:53.361873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:53.362275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:53.364719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:53.797507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:53.815789 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc93461e-dac8-4008-8c67-5a6324a9482e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.483241 Oct 28 19:38:53.816780 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2777/5569] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:53 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:53.929273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:53.930014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:53.945547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:53.946352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:53.946833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:53.947591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:53.948051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:53.948474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:54.170029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:54.187521 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f93d603c-2117-4f1e-aaff-275dd9e12533 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1498 microversion: 2.1 time: 0.262844 Oct 28 19:38:54.188133 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2793/5570] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:53 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:54.849601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:54.850967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:54.871597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:54.872377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:54.880876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:54.883795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:54.885684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:54.894284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:55.159606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:55.174102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c94023e-60b7-4a5e-bffe-7beef8f8c763 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.328330 Oct 28 19:38:55.184017 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2778/5571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:54 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:55.216727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:55.218608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:55.228380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:55.229176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:55.229598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:55.231081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:55.234588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:55.236119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:55.405414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:55.414790 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e8205bd-d41a-4d73-99c8-69163dc9676d tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1498 microversion: 2.1 time: 0.202081 Oct 28 19:38:55.415376 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2794/5572] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:55 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:56.198811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:56.199731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:56.209277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:56.210228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:56.211227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:56.212136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:56.213654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:56.214613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:56.460625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:56.461310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:56.482369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:56.488108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:56.489543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:56.494098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:56.495154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:56.496020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:56.655042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:56.671300 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebdefb84-339f-46f9-8916-1f19b5841bab tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1505 microversion: 2.1 time: 0.474457 Oct 28 19:38:56.674386 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2779/5573] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:56 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:56.746265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:56.757661 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b59c767b-125b-4a28-8958-f47c54cc84d7 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1498 microversion: 2.1 time: 0.317777 Oct 28 19:38:56.758839 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2795/5574] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:56 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1498 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:57.242504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a044f829-d317-4585-8f9c-3b0c142bd5df req-fee8c115-504c-45d3-8957-e74bb076e503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5777b21-2d8a-42b6-801a-f87ad662df30", "name": "network-vif-deleted", "tag": "1cfa68b9-d9db-4eaf-a699-b4008c70897b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:57.277629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a044f829-d317-4585-8f9c-3b0c142bd5df req-fee8c115-504c-45d3-8957-e74bb076e503 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:57.278186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a044f829-d317-4585-8f9c-3b0c142bd5df req-fee8c115-504c-45d3-8957-e74bb076e503 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:57.279464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a044f829-d317-4585-8f9c-3b0c142bd5df req-fee8c115-504c-45d3-8957-e74bb076e503 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:57.301707 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a044f829-d317-4585-8f9c-3b0c142bd5df req-fee8c115-504c-45d3-8957-e74bb076e503 service nova] Creating event network-vif-deleted:1cfa68b9-d9db-4eaf-a699-b4008c70897b for instance e5777b21-2d8a-42b6-801a-f87ad662df30 on n-h2-862769-3 Oct 28 19:38:57.313674 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a044f829-d317-4585-8f9c-3b0c142bd5df req-fee8c115-504c-45d3-8957-e74bb076e503 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077754 Oct 28 19:38:57.314354 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2780/5575] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:57.703345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:57.703345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:57.715245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:57.717624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:57.718146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:57.729118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:57.729787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:57.730357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:57.772357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:57.773169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:57.773835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:57.774597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lazy-loading 'fault' on Instance uuid e5777b21-2d8a-42b6-801a-f87ad662df30 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:38:57.787530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:57.794237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:57.836297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:57.846440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7adac53c-e942-4dbf-9d9c-d5784b3ec8f0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 200 len: 1303 microversion: 2.1 time: 0.149541 Oct 28 19:38:57.847844 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2796/5576] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:57 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:57.877262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:57.880732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:57.883837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:57.888738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:57.889136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:57.889586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.130010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:58.143273 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9cb7bb77-310c-4581-9a29-e6f53382201a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1501 microversion: 2.1 time: 0.364925 Oct 28 19:38:58.159211 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2781/5577] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:57 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:58.169140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:58.169932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:58.182910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.185034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.186959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.193864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.193864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.193864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.251363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lazy-loading 'flavor' on Instance uuid a7e12cb0-97fa-4a81-853c-fdb02db719c0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:38:58.398981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f613b5d7-db9f-4b02-8492-8cf3e8bd7da2 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action" status: 202 len: 0 microversion: 2.1 time: 0.233082 Oct 28 19:38:58.410434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:58.411064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:58.417743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2797/5578] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:38:58 2022] POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:38:58.420592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.421285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.421896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.422773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.423380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.423952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.644896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:58.654161 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d3b1366-f3f7-4a4d-8fe3-09e02f9e906a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1509 microversion: 2.1 time: 0.248647 Oct 28 19:38:58.654985 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2782/5579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:58 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:58.871590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:58.872299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: e5777b21-2d8a-42b6-801a-f87ad662df30] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:58.888820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.889394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.889839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.890571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.891082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.891527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.936567 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] HTTP exception thrown: Instance e5777b21-2d8a-42b6-801a-f87ad662df30 could not be found. Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Request method failure captured: Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 HTTP/1.1 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC9cZQKf0QOE8oTOlzLl_P8bUDk0i6s8k_qLX8_CyyDmiTEapMrZ0Y8Z__IiGdMLIKzPYW3AdCXdGN147DjeBaD6fhoou0yPOHQrZZ5fZa6MLYX9O94WPyFUhEwhFRj2TJZDp7YlvrR9cLh3f6C0lWNpd15I4-cQjnKbyJHJx8fm9lg Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 87f434bac604461c8cb49b3138ac414a Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueTestJSON-14645915 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/87f434bac604461c8cb49b3138ac414a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_87f434bac604461c8cb49b3138ac414a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/87f434bac604461c8cb49b3138ac414a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/87f434bac604461c8cb49b3138ac414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueTestJSON-14645915 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 87f434bac604461c8cb49b3138ac414a Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueTestJSON-14645915 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueTestJSON-14645915-project Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: eff93b137dbd497f857d23cc08565749 Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueTestJSON-14645915-project Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e5777b21-2d8a-42b6-801a-f87ad662df30 could not be found. Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e5777b21-2d8a-42b6-801a-f87ad662df30'} Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5777b21-2d8a-42b6-801a-f87ad662df30 could not be found. Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5777b21-2d8a-42b6-801a-f87ad662df30 could not be found. Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:58.940314 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5777b21-2d8a-42b6-801a-f87ad662df30 could not be found. Oct 28 19:38:58.946992 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:38:58.949708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Returning 404 to user: Instance e5777b21-2d8a-42b6-801a-f87ad662df30 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:38:58.951030 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9f128a4d-f1f8-485b-8316-89f400a30a95 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30" status: 404 len: 111 microversion: 2.1 time: 0.083840 Oct 28 19:38:58.952342 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2798/5580] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:58 2022] GET /compute/v2.1/servers/e5777b21-2d8a-42b6-801a-f87ad662df30 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:38:58.970364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:58.971112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:58.981789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.982392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.983117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:58.984198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:58.984740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:58.985247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:59.067503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:38:59.228886 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-062a5f2c-e330-44b9-97e2-c9b248221561 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 204 len: 0 microversion: 2.1 time: 0.265781 Oct 28 19:38:59.230422 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2783/5581] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:38:58 2022] DELETE /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:59.241086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:59.242446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:59.253016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:59.253835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:59.256593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:59.257727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:59.259617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:59.260328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:59.532054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:59.547860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f843c60-a256-4bb3-9560-bd3848555f3e tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1491 microversion: 2.1 time: 0.309260 Oct 28 19:38:59.565272 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2799/5582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:59 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1491 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:59.678527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:59.679317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:59.691222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:59.692043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:59.694110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:59.695449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:59.696786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:59.697401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:59.704495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:59.902982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:59.916721 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a5e42b9-2fdf-4c2e-9ada-ee28379f5ae0 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1492 microversion: 2.1 time: 0.242737 Oct 28 19:38:59.918255 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2784/5583] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:59 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1492 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:59.947869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:59.948405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:38:59.962165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:59.962666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:59.963116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:59.963878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:59.964332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:59.964805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:00.101253 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b59b77e-bbca-40a4-82f6-2571ec0accdf tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action" status: 202 len: 0 microversion: 2.1 time: 0.157061 Oct 28 19:39:00.112091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:00.112730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:00.119240 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2800/5584] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:38:59 2022] POST /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:39:00.124894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:00.125762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:00.127760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:00.129552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:00.130204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:00.131076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:00.393844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:00.409006 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8834b7b-a3c3-4c38-af4b-9ddaec5980ea tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1498 microversion: 2.1 time: 0.301389 Oct 28 19:39:00.423698 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2785/5585] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:00 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:00.583140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:00.584395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:00.599000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:00.600750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:00.601095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:00.601815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:00.602280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:00.604829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:01.222510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:01.240236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-333e6a1d-0448-431b-b46c-5e9d351e3494 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1491 microversion: 2.1 time: 0.657762 Oct 28 19:39:01.241092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2801/5586] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:00 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1491 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:01.444724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:01.446008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:01.454117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:01.454918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:01.455522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:01.456399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:01.457032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:01.457616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:02.172371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:02.183219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ea6f21a-0368-43a0-a336-86aaefa2fc2a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1498 microversion: 2.1 time: 0.742538 Oct 28 19:39:02.188936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2786/5587] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:01 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1498 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:02.262868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:02.264311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:02.274922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:02.279323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:02.279948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:02.280841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:02.281442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:02.285837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:03.211733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:03.213012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:03.258523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:03.259524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:03.262949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:03.269471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:03.270162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:03.270789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:03.299729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:03.309791 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce63f889-658c-49ab-8f09-db12a5ca4a53 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1491 microversion: 2.1 time: 1.049468 Oct 28 19:39:03.313060 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2802/5588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:02 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1491 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:03.589590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:03.606510 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-26ce4c7d-df80-4782-9846-2b3971a76320 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1501 microversion: 2.1 time: 0.398703 Oct 28 19:39:03.617245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2787/5589] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:03 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:03.643589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:03.644284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:03.650805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:03.667757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:03.670768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:03.671402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:03.675026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:03.675722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:03.684468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:03.814235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:39:03.822824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5400fc80-7bb5-49e5-86f1-56a7ea19a9e5 req-bf8ebc65-57bf-4730-be3f-cc634917b1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bff1f3-2f57-44f8-a51a-f451c8846d8a", "name": "network-vif-deleted", "tag": "7f74e158-90ac-4d2a-a0d4-380032387477"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:03.863998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5400fc80-7bb5-49e5-86f1-56a7ea19a9e5 req-bf8ebc65-57bf-4730-be3f-cc634917b1c3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:03.864803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5400fc80-7bb5-49e5-86f1-56a7ea19a9e5 req-bf8ebc65-57bf-4730-be3f-cc634917b1c3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:03.865390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5400fc80-7bb5-49e5-86f1-56a7ea19a9e5 req-bf8ebc65-57bf-4730-be3f-cc634917b1c3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:03.903528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5400fc80-7bb5-49e5-86f1-56a7ea19a9e5 req-bf8ebc65-57bf-4730-be3f-cc634917b1c3 service nova] Creating event network-vif-deleted:7f74e158-90ac-4d2a-a0d4-380032387477 for instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a on n-h1-862769-3 Oct 28 19:39:03.918152 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5400fc80-7bb5-49e5-86f1-56a7ea19a9e5 req-bf8ebc65-57bf-4730-be3f-cc634917b1c3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112433 Oct 28 19:39:03.921870 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2788/5590] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:04.074471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-993db7da-50d6-4ce4-a70c-4f556f4acc3b tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 204 len: 0 microversion: 2.1 time: 0.435895 Oct 28 19:39:04.081194 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2803/5591] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:39:03 2022] DELETE /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:04.088492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:04.089799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:04.120807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:04.127813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:04.131549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:04.132811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:04.134668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:04.136150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:04.333932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:04.334981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:04.346903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:04.348355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:04.349348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:04.351871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:04.353680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:04.373319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:04.431710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:04.444424 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13722934-b899-4403-87d6-27f5a2494190 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1507 microversion: 2.1 time: 0.362557 Oct 28 19:39:04.445749 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2789/5592] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:04 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:04.466221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:04.472100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:04.472547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:04.473008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lazy-loading 'fault' on Instance uuid 06bff1f3-2f57-44f8-a51a-f451c8846d8a {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:39:04.861106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff93b137dbd497f857d23cc08565749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f434bac604461c8cb49b3138ac414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:04.868570 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b46d59c1-b62a-4aaa-a730-9527f659ae1a tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 200 len: 1303 microversion: 2.1 time: 0.539186 Oct 28 19:39:04.869165 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2804/5593] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:04 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 1303 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:05.471785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:05.472459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:05.488011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:05.493996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:05.494536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:05.495102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:05.495895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:05.496382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:05.496820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:05.754515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:05.765799 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b580ab1c-30dc-4a4e-8b17-5028d3414579 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1507 microversion: 2.1 time: 0.298711 Oct 28 19:39:05.766722 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2790/5594] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:05 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:05.897861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:05.898968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] [instance: 06bff1f3-2f57-44f8-a51a-f451c8846d8a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:05.906273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:05.906936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:05.907633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:05.909141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:05.909822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:05.910463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:05.926555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:05.928390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] HTTP exception thrown: Instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a could not be found. Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Request method failure captured: Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a HTTP/1.1 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC9cZQKf0QOE8oTOlzLl_P8bUDk0i6s8k_qLX8_CyyDmiTEapMrZ0Y8Z__IiGdMLIKzPYW3AdCXdGN147DjeBaD6fhoou0yPOHQrZZ5fZa6MLYX9O94WPyFUhEwhFRj2TJZDp7YlvrR9cLh3f6C0lWNpd15I4-cQjnKbyJHJx8fm9lg Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 87f434bac604461c8cb49b3138ac414a Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerRescueTestJSON-14645915 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/87f434bac604461c8cb49b3138ac414a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_87f434bac604461c8cb49b3138ac414a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/87f434bac604461c8cb49b3138ac414a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/87f434bac604461c8cb49b3138ac414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerRescueTestJSON-14645915 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 87f434bac604461c8cb49b3138ac414a Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerRescueTestJSON-14645915 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerRescueTestJSON-14645915-project Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: eff93b137dbd497f857d23cc08565749 Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerRescueTestJSON-14645915-project Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a could not be found. Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '06bff1f3-2f57-44f8-a51a-f451c8846d8a'} Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a could not be found. Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a could not be found. Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:05.930429 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a could not be found. Oct 28 19:39:05.934683 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:05.938987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] Returning 404 to user: Instance 06bff1f3-2f57-44f8-a51a-f451c8846d8a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:39:05.940295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ccae2886-2ca4-40ce-859a-6ab6b2f23cf0 tempest-ServerRescueTestJSON-14645915 tempest-ServerRescueTestJSON-14645915-project] 10.222.0.44 "GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a" status: 404 len: 111 microversion: 2.1 time: 0.047239 Oct 28 19:39:05.941283 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2805/5595] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:05 2022] GET /compute/v2.1/servers/06bff1f3-2f57-44f8-a51a-f451c8846d8a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:39:06.409458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:06.410180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:06.421696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:06.422194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:06.422627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:06.426392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:06.427197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:06.428450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:06.475675 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-158a20e4-4faa-4131-a8f7-4167e190a62f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/ips" status: 200 len: 150 microversion: 2.1 time: 0.070789 Oct 28 19:39:06.483620 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2791/5596] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:39:06 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/ips => generated 150 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:06.790792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:06.791467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:06.812921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e55b4663-25d5-4413-a131-b0a4fef5f587 req-51847a40-82f8-4b0c-8ef5-f04a86ee317c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e12cb0-97fa-4a81-853c-fdb02db719c0", "name": "network-vif-deleted", "tag": "2250cdfe-b59e-4c21-9a11-74298a8158b6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:06.817488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:06.819742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:06.821190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:06.833577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:06.835678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:06.835898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e55b4663-25d5-4413-a131-b0a4fef5f587 req-51847a40-82f8-4b0c-8ef5-f04a86ee317c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:06.838060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:06.838712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e55b4663-25d5-4413-a131-b0a4fef5f587 req-51847a40-82f8-4b0c-8ef5-f04a86ee317c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:06.841218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e55b4663-25d5-4413-a131-b0a4fef5f587 req-51847a40-82f8-4b0c-8ef5-f04a86ee317c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:06.873853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e55b4663-25d5-4413-a131-b0a4fef5f587 req-51847a40-82f8-4b0c-8ef5-f04a86ee317c service nova] Creating event network-vif-deleted:2250cdfe-b59e-4c21-9a11-74298a8158b6 for instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 on n-h2-862769-3 Oct 28 19:39:06.898591 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e55b4663-25d5-4413-a131-b0a4fef5f587 req-51847a40-82f8-4b0c-8ef5-f04a86ee317c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091330 Oct 28 19:39:06.904530 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2792/5597] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:07.077671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed285780668d464fa0d2761c52446690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a64f33d32814a9c96449fc548889821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:07.090405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0b48919-e6fd-4bea-8590-21d9cb23de21 tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 200 len: 1300 microversion: 2.1 time: 0.303672 Oct 28 19:39:07.107176 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2806/5598] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:06 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 1300 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:08.121418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:08.122611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] [instance: a7e12cb0-97fa-4a81-853c-fdb02db719c0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:08.142262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:08.147252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:08.149614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:08.150525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:08.152749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:08.155886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:08.191448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] HTTP exception thrown: Instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 could not be found. Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Request method failure captured: Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 HTTP/1.1 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC-zZQBPZDj1fEYSWcXYCKdq81rhWwhWQsoT6h_zHNrjYBaxVxHlHuRnaHt7ZtQa1JnPIrUTecGqFNo0arB9VP7BTVym-VxqX1HGvJHHJZArWhQxkK24jd743XmqWUSfHCbj69JOx3r9ltJfBXSZjg0rtRhOuqrgYJMxbgpiCMhBY5k Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 6a64f33d32814a9c96449fc548889821 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestServerAdvancedOps-289583031 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6a64f33d32814a9c96449fc548889821"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6a64f33d32814a9c96449fc548889821", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6a64f33d32814a9c96449fc548889821"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6a64f33d32814a9c96449fc548889821"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestServerAdvancedOps-289583031 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 6a64f33d32814a9c96449fc548889821 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestServerAdvancedOps-289583031 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestServerAdvancedOps-289583031-project Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ed285780668d464fa0d2761c52446690 Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestServerAdvancedOps-289583031-project Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 could not be found. Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a7e12cb0-97fa-4a81-853c-fdb02db719c0'} Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 could not be found. Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 could not be found. Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:08.196131 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 could not be found. Oct 28 19:39:08.200883 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:08.219981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] Returning 404 to user: Instance a7e12cb0-97fa-4a81-853c-fdb02db719c0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:39:08.225984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0b1e8a4-281a-4f14-adda-12c86556253a tempest-TestServerAdvancedOps-289583031 tempest-TestServerAdvancedOps-289583031-project] 10.222.0.44 "GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0" status: 404 len: 111 microversion: 2.1 time: 0.110935 Oct 28 19:39:08.228807 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2793/5599] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:08 2022] GET /compute/v2.1/servers/a7e12cb0-97fa-4a81-853c-fdb02db719c0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:39:09.468549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81e99ef0-844e-475b-af82-88f10e997e79"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:09.472714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:09.484101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:09.490462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:09.491609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:09.494101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:09.494776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:09.495928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:10.145887 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fde3ce70-887c-4efd-a486-ff8e2e385d7b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679266 Oct 28 19:39:10.170455 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2807/5600] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:39:09 2022] POST /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:23.747936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1380926682", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "f9ccaee6-4677-491a-9131-aba32108320d"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:23.776494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=7 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:23.778053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=45 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:23.844995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] validate_networks() for [('f9ccaee6-4677-491a-9131-aba32108320d', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:39:25.012588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:39:25.014142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:39:25.016025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:39:25.016765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:39:25.017527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:39:25.048336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:25.049831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:25.050466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:25.054430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:25.054975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:25.055505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:25.141164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Getting quotas for project 92940aa3ace44f52869f16a373e87673. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:39:25.154552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Getting quotas for user f41bc4dcd2f94470bb48b0352b83d59f and project 92940aa3ace44f52869f16a373e87673. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:39:25.197809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:39:25.200567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:39:25.294447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b62c991-b071-4e95-b636-47e171a9bb40 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555093 Oct 28 19:39:25.295707 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2794/5601] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:39:25.308662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb0eb9c4-f5d7-4be8-95fc-86cdc42e3052 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:25.310457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb0eb9c4-f5d7-4be8-95fc-86cdc42e3052 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:25.319214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:25.320189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:25.534853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb0eb9c4-f5d7-4be8-95fc-86cdc42e3052 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:25.546546 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb0eb9c4-f5d7-4be8-95fc-86cdc42e3052 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1214 microversion: 2.1 time: 0.241492 Oct 28 19:39:25.547188 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2808/5602] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:25 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:26.418569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81e99ef0-844e-475b-af82-88f10e997e79"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:26.465976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:26.487820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:26.489727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:26.491214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:26.492142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:26.495812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:26.497587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:26.580059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:26.580727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:26.620376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:26.620893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:26.621340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:26.622082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:26.622540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:26.622981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:26.793081 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Invalid volume: volume 81e99ef0-844e-475b-af82-88f10e997e79 is already attached to instances: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments HTTP/1.1 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 74 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: {"volumeAttachment": {"volumeId": "81e99ef0-844e-475b-af82-88f10e997e79"}} Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid volume: volume 81e99ef0-844e-475b-af82-88f10e997e79 is already attached to instances: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '5a6d8bd2-c1b2-44da-83c3-e715c16126d6', 'body': {'volumeAttachment': {'volumeId': '81e99ef0-844e-475b-af82-88f10e997e79'}}} Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 81e99ef0-844e-475b-af82-88f10e997e79 is already attached to instances: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:39:26.796358 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 81e99ef0-844e-475b-af82-88f10e997e79 is already attached to instances: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 81e99ef0-844e-475b-af82-88f10e997e79 is already attached to instances: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 Oct 28 19:39:26.801853 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:26.804721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 400 to user: Invalid volume: volume 81e99ef0-844e-475b-af82-88f10e997e79 is already attached to instances: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:39:26.806239 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af893869-0b4a-4a21-9b31-b68eac6b45ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.397160 Oct 28 19:39:26.807910 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2795/5603] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:39:26 2022] POST /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 174 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:39:26.820753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:26.837429 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e53d8e57-3a72-4713-bd2b-9a47a97416d5 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1218 microversion: 2.1 time: 0.270682 Oct 28 19:39:26.838044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2809/5604] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:26 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:26.926203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:26.926943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:26.943513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:26.947381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:26.950838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:26.951839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:26.952478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:26.954229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:27.224380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lazy-loading 'services' on Instance uuid 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:39:27.424837 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-831737b8-4c43-43b7-bbe5-71c0530a2393 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments/81e99ef0-844e-475b-af82-88f10e997e79" status: 202 len: 0 microversion: 2.1 time: 0.502798 Oct 28 19:39:27.426894 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2796/5605] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:39:26 2022] DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments/81e99ef0-844e-475b-af82-88f10e997e79 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:39:27.438116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:27.440947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:27.460605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:27.462234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:27.462974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:27.464411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:27.464879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:27.467495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:27.549364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c30f605d-ba63-4f3d-87ec-1bc3dc44e14c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114854 Oct 28 19:39:27.551075 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2810/5606] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:27 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:27.863398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:27.863915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:27.874884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:27.883173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:27.885251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:27.888867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:27.893093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:27.893603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:28.564262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:28.568385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:28.591463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:28.591864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:28.592331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:28.593076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:28.593567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:28.593988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:28.699705 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c3aaaef-904b-4cc1-bf99-827374d25b9e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141460 Oct 28 19:39:28.701899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2811/5607] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:28 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:29.036511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:29.053151 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d67876e-ea4f-4cc7-92ce-06d1961f16c8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1284 microversion: 2.1 time: 1.194934 Oct 28 19:39:29.057694 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2797/5608] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:27 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1284 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:29.715841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:29.718142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:29.740020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:29.747143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:29.747694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:29.748474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:29.748952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:29.749381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:29.868662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0e28a181-c84c-4554-bb2c-b13298d09f27 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155439 Oct 28 19:39:29.870358 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2812/5609] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:29 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:30.079321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:30.081381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:30.099637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:30.105110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:30.109223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:30.110569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:30.111339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:30.115254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:30.823501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:30.851076 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75f2886e-6a26-4d55-b244-aa0fc2e8fa09 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1272 microversion: 2.1 time: 0.776325 Oct 28 19:39:30.851696 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2798/5610] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:30 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1272 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:30.882243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:30.885146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:30.907178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:30.907915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:30.914944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:30.919331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:30.920195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:30.922342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:31.029904 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-61ed13d5-db85-428f-86ce-e9ce305c80fe tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152379 Oct 28 19:39:31.031151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2813/5611] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:30 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:31.876240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:31.877375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:31.897360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:31.901355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:31.903183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:31.904056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:31.907241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:31.907746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:32.044435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:32.047587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:32.075484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:32.076361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:32.085415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:32.086615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:32.087341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:32.087993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:32.172201 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e13eeddb-c125-48e5-a0fd-5075ba7162a4 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127578 Oct 28 19:39:32.175632 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2814/5612] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:32 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:32.830985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:32.843509 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2b023c5d-2e79-4141-a741-c26da61fef6e tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 0.973121 Oct 28 19:39:32.851836 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2799/5613] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:31 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:33.190668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:33.194088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:33.215297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:33.224033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:33.227548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:33.230945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:33.234952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:33.235763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:33.360442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6eb70bd2-21a4-4f6b-9114-2d62fd84e279 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176568 Oct 28 19:39:33.370203 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2815/5614] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:33 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:33.878377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:33.888767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:33.925600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:33.926382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:33.927060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:33.930774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:33.931595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:33.932249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:34.373275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:34.377357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:34.412801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:34.416507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:34.417405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:34.427303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:34.432190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:34.436275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:34.572637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1024f2d4-fd82-4220-86cc-2c69657665ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203612 Oct 28 19:39:34.577869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2816/5615] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:34 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:34.613993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:34.627887 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b89d7b0d-41f9-4c8a-8904-461ff02c4eb2 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 0.756783 Oct 28 19:39:34.628959 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2800/5616] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:33 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:35.022404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2020065418", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "722a9d5e-3a8a-476f-a2c3-9b261425953d"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:35.144974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] validate_networks() for [('722a9d5e-3a8a-476f-a2c3-9b261425953d', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:39:35.540745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:35.588141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:35.593004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:35.596321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:35.605843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:35.652063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:35.656095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:35.656962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:35.658448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:35.660275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:35.662321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:35.766080 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57b3b2b7-6fc6-4fa1-bba1-5374bd28244a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181833 Oct 28 19:39:35.767665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2801/5617] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:35 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:35.773724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:35.775362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:35.796705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:35.797463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:35.801751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:35.802979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:35.803677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:35.804351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:36.229871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:36.264285 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71c096c8-8d91-490e-9b12-294bce77ff15 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 0.494186 Oct 28 19:39:36.269542 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2802/5618] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:35 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:36.446056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5d44216d-8e3a-41f0-a169-16f4725c10f1 req-aed37f72-be78-413b-827a-d732561b4ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94840da9-28bf-4859-a5f2-77147f030902", "tag": "a36d7bd7-ff74-49b2-bca2-5937567c47fb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:36.456266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5d44216d-8e3a-41f0-a169-16f4725c10f1 req-aed37f72-be78-413b-827a-d732561b4ba7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:36.456753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5d44216d-8e3a-41f0-a169-16f4725c10f1 req-aed37f72-be78-413b-827a-d732561b4ba7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:36.457357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5d44216d-8e3a-41f0-a169-16f4725c10f1 req-aed37f72-be78-413b-827a-d732561b4ba7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:36.477256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5d44216d-8e3a-41f0-a169-16f4725c10f1 req-aed37f72-be78-413b-827a-d732561b4ba7 service nova] Creating event network-changed:a36d7bd7-ff74-49b2-bca2-5937567c47fb for instance 94840da9-28bf-4859-a5f2-77147f030902 on n-h2-862769-3 Oct 28 19:39:36.491864 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5d44216d-8e3a-41f0-a169-16f4725c10f1 req-aed37f72-be78-413b-827a-d732561b4ba7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049890 Oct 28 19:39:36.495895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2803/5619] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:36.780049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:36.782377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:36.796683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:36.797168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:36.797601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:36.798312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:36.798797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:36.799346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:36.877748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d94ead82-ed36-4c7b-8821-0d4637470690 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102187 Oct 28 19:39:36.885049 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2804/5620] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:36 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:37.295945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:37.296583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:37.307700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:37.308191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:37.308625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:37.309333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:37.309784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:37.310200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:37.406874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:39:37.407421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:39:37.407747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:39:37.408147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:39:37.408552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:39:37.419245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:37.419735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:37.420164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:37.420917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:37.421546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:37.421771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:37.466921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Getting quotas for project f0c813d988624110860426858462ac11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:39:37.482933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Getting quotas for user 5e94561cb29b4234b3c4499464a22d1c and project f0c813d988624110860426858462ac11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:39:37.517704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:39:37.521286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:39:37.621216 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64e14bec-0107-4804-a218-ccafb2d029e9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.041811 Oct 28 19:39:37.625193 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2817/5621] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:39:37.661079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6bdb67e8-c2ff-48a6-b23d-b45610a504ee tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:37.662135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6bdb67e8-c2ff-48a6-b23d-b45610a504ee tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:37.838617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bdb67e8-c2ff-48a6-b23d-b45610a504ee tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:37.851623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bdb67e8-c2ff-48a6-b23d-b45610a504ee tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:37.856391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bdb67e8-c2ff-48a6-b23d-b45610a504ee tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:37.863585 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6bdb67e8-c2ff-48a6-b23d-b45610a504ee tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1262 microversion: 2.26 time: 0.233938 Oct 28 19:39:37.864807 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2818/5622] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:37 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1262 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:37.891630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:37.895074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:37.918777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:37.933082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:37.937464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:37.938958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:37.939993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:37.942841 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57ffce6c-928e-4244-abce-cb10038729b8 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 0.647407 Oct 28 19:39:37.947358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:37.947970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:37.948973 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2805/5623] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:37 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:38.020277 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-366021bb-9fe2-4ffe-a0f1-3ce62a460085 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133068 Oct 28 19:39:38.024819 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2819/5624] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:37 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:38.894417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24751ba4-6820-4e0a-81e0-1635d3ee3f35 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:38.895168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24751ba4-6820-4e0a-81e0-1635d3ee3f35 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:38.975290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:38.979306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:39.016077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:39.023050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:39.023654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:39.042334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:39.049735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:39.066057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:39.801576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24751ba4-6820-4e0a-81e0-1635d3ee3f35 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:39.817592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24751ba4-6820-4e0a-81e0-1635d3ee3f35 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:39.834025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24751ba4-6820-4e0a-81e0-1635d3ee3f35 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:39.837071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24751ba4-6820-4e0a-81e0-1635d3ee3f35 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1262 microversion: 2.26 time: 0.947231 Oct 28 19:39:39.851021 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2806/5625] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:38 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1262 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:39.871403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:39.882256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:39.912226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:39.912727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:39.913164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:39.913935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:39.914337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:39.929076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:40.060179 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae9a5ff9-ecc1-42c3-a5d3-1f3a1e3b7f91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207792 Oct 28 19:39:40.073048 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2807/5626] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:39 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:40.457655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:40.470720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8996181-386e-4146-9cc8-e48b87c25da4 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 1.504091 Oct 28 19:39:40.488210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2820/5627] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:38 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:40.886180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:40.886996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:40.900295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:40.900801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:40.901306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:40.918965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:40.919481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:40.931526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.084181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:41.086632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:41.107654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.108072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.108514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.109241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.109698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.110122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.142478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:41.154084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:41.160611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:41.162403 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28292771-18f6-47ce-a1df-ca6a1bddbd93 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1332 microversion: 2.26 time: 0.281539 Oct 28 19:39:41.170740 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2808/5628] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:40 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1332 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:41.190164 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63e6546b-8ce7-461f-b0d5-4a6ac07289a3 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110022 Oct 28 19:39:41.241237 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2821/5629] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:39:41 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:39:41.368038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:41.368828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:41.384053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.384985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.385679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.386636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.387351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.391186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.447502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:39:41.502852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:41.503610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:41.515334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.516252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.516946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.517940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.522930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.523885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.627408 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad63e32f-d5a9-4ee2-944a-1967795c7423 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 204 len: 0 microversion: 2.1 time: 0.266133 Oct 28 19:39:41.628571 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2809/5630] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:39:41 2022] DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:41.638155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:41.639246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:41.646636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.647385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.648025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.648853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:41.649451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:41.649971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:41.681072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:42.345628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:42.360742 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f46e5089-0439-4366-b8db-26dce8d4b31d tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1681 microversion: 2.1 time: 0.727749 Oct 28 19:39:42.361651 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2810/5631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:41 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1681 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:42.367557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:42.373477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:42.391361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:42.393688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:42.404067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:42.405058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:42.405704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:42.406874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:43.084061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:43.095320 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c2ab2d3-24c4-40c9-b147-c5e72fe3d135 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 1.599648 Oct 28 19:39:43.095916 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2822/5632] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:41 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:43.250773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:43.266738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:43.268236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:43.269462 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e4a7ab18-72de-44e8-9f5d-ea7e660d2168 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1320 microversion: 2.26 time: 0.905886 Oct 28 19:39:43.274617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2811/5633] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:42 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1320 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:43.393979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:43.395014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:43.414425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:43.414953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:43.415506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:43.416067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:43.417090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:43.419387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:44.123452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:44.124083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:44.147522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:44.148079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:44.148546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:44.149694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:44.150164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:44.150595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:44.559454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:44.588191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42998f9a-9dcf-436b-b954-4abc2c9ae7d5 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1681 microversion: 2.1 time: 1.202723 Oct 28 19:39:44.604474 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2823/5634] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:43 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1681 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:44.609625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:44.610249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:44.619090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:44.619914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:44.620589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:44.621464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:44.622083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:44.622663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:44.713162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:44.723506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f152def-d730-47f3-a375-dcb4b00dff73 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 0.604609 Oct 28 19:39:44.724202 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2812/5635] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:44 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:45.249155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:45.265589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:45.269260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:45.277473 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40326cf0-37d0-4c93-ab3f-9cf80a374ba2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 0.668187 Oct 28 19:39:45.278977 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2824/5636] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:44 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:45.752786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:45.754236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:45.777728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:45.779408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:45.782581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:45.783785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:45.785576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:45.786317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:46.120778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:46.121482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:46.130286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:46.131218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:46.131890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:46.132848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:46.133540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:46.134423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:46.328095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:46.337633 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-173f38f3-6f46-4f7c-8a0d-5d9d58554538 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 0.589636 Oct 28 19:39:46.343151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2825/5637] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:45 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:46.355545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:46.356431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:46.370463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:46.371808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:46.373403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:46.383391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:46.384074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:46.384666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:46.400217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:46.415832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7b658829-ad8b-4d20-87e7-d9d77f71f693 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1614 microversion: 2.1 time: 0.791445 Oct 28 19:39:46.418157 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2813/5638] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:45 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1614 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:46.646232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:46.671870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:46.676212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:46.680959 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1dd05d41-714e-4775-b02c-1e79cc557923 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 0.335686 Oct 28 19:39:46.682920 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2826/5639] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:46 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:47.251487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e03ea618-2a29-4f9e-823e-c61e43095863 req-4188be3b-5b45-4611-9f59-d59cf8aa6539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6d8bd2-c1b2-44da-83c3-e715c16126d6", "name": "network-vif-deleted", "tag": "89a9aef8-7649-4d39-a1d8-0583c2716ab7"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:47.303690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e03ea618-2a29-4f9e-823e-c61e43095863 req-4188be3b-5b45-4611-9f59-d59cf8aa6539 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.304187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e03ea618-2a29-4f9e-823e-c61e43095863 req-4188be3b-5b45-4611-9f59-d59cf8aa6539 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.304693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e03ea618-2a29-4f9e-823e-c61e43095863 req-4188be3b-5b45-4611-9f59-d59cf8aa6539 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.329014 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e03ea618-2a29-4f9e-823e-c61e43095863 req-4188be3b-5b45-4611-9f59-d59cf8aa6539 service nova] Creating event network-vif-deleted:89a9aef8-7649-4d39-a1d8-0583c2716ab7 for instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 on n-h1-862769-3 Oct 28 19:39:47.341387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-43306e7b-f1bc-4070-9ebc-fd2b10cf9d8d req-3958845d-4e69-42cd-b3fa-ca69e5ea1f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94840da9-28bf-4859-a5f2-77147f030902", "name": "network-vif-plugged", "status": "completed", "tag": "a36d7bd7-ff74-49b2-bca2-5937567c47fb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:47.370269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e03ea618-2a29-4f9e-823e-c61e43095863 req-4188be3b-5b45-4611-9f59-d59cf8aa6539 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135515 Oct 28 19:39:47.378629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2814/5640] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:47.396610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:47.402363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:47.427428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.427689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.428649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.432399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.432597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-43306e7b-f1bc-4070-9ebc-fd2b10cf9d8d req-3958845d-4e69-42cd-b3fa-ca69e5ea1f1a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.434580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.435201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.439451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-43306e7b-f1bc-4070-9ebc-fd2b10cf9d8d req-3958845d-4e69-42cd-b3fa-ca69e5ea1f1a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.440076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-43306e7b-f1bc-4070-9ebc-fd2b10cf9d8d req-3958845d-4e69-42cd-b3fa-ca69e5ea1f1a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.463752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:47.471856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:47.493336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-43306e7b-f1bc-4070-9ebc-fd2b10cf9d8d req-3958845d-4e69-42cd-b3fa-ca69e5ea1f1a service nova] Creating event network-vif-plugged:a36d7bd7-ff74-49b2-bca2-5937567c47fb for instance 94840da9-28bf-4859-a5f2-77147f030902 on n-h2-862769-3 Oct 28 19:39:47.501068 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-43306e7b-f1bc-4070-9ebc-fd2b10cf9d8d req-3958845d-4e69-42cd-b3fa-ca69e5ea1f1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177359 Oct 28 19:39:47.502294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2827/5641] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:47.510424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:47.512512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:47.527302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.528104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.528838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.529720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.530490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.531144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.673781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:47.674274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:47.674717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:47.675185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lazy-loading 'fault' on Instance uuid 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:39:47.848189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:48.729742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:48.740764 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3f0390c-d37b-4888-9b0b-6cefa6142d2b tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 200 len: 1331 microversion: 2.1 time: 1.236499 Oct 28 19:39:48.768109 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2828/5642] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:47 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 1331 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:48.786960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:48.789692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:48.806073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:48.806906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:48.807560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:48.808603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:48.818845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:48.821149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:49.344050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:49.357873 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78882a11-8884-49a3-9020-f2f1120c8630 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1314 microversion: 2.1 time: 1.977605 Oct 28 19:39:49.358763 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2815/5643] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:47 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1314 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:49.551859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:49.570128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:49.571603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:49.572806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a535141b-03b1-40b2-ac10-588d781abe02 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 0.803585 Oct 28 19:39:49.574100 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2829/5644] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:48 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:49.681598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3d5d85de-e4e8-44a3-9e27-6fa9b56afb32 req-18405863-b507-4205-8d0b-d94017d70f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0", "tag": "456ffd6b-ba70-4362-9f7e-c4646b6ff034"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:49.699233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3d5d85de-e4e8-44a3-9e27-6fa9b56afb32 req-18405863-b507-4205-8d0b-d94017d70f9a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:49.699997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3d5d85de-e4e8-44a3-9e27-6fa9b56afb32 req-18405863-b507-4205-8d0b-d94017d70f9a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:49.700674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3d5d85de-e4e8-44a3-9e27-6fa9b56afb32 req-18405863-b507-4205-8d0b-d94017d70f9a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:49.720817 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3d5d85de-e4e8-44a3-9e27-6fa9b56afb32 req-18405863-b507-4205-8d0b-d94017d70f9a service nova] Creating event network-changed:456ffd6b-ba70-4362-9f7e-c4646b6ff034 for instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 on n-h1-862769-3 Oct 28 19:39:49.727357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3d5d85de-e4e8-44a3-9e27-6fa9b56afb32 req-18405863-b507-4205-8d0b-d94017d70f9a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182467 Oct 28 19:39:49.729322 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2816/5645] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:39:49.807958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:49.811968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:49.833937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:49.836483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:49.838520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:49.843490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:49.844585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:49.873145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:49.909958 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 HTTP/1.1 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5a6d8bd2-c1b2-44da-83c3-e715c16126d6'} Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:49.911808 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59ab0493-ae52-4f59-9663-56b082eb4064 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 404 len: 111 microversion: 2.1 time: 0.132508 Oct 28 19:39:49.921018 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2830/5646] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:49 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:39:49.927061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a37c674e-0938-44bd-958a-4c69fbc28d64 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '.version_select at 0x7f1d768feb80>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:49.932620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:50.013425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a37c674e-0938-44bd-958a-4c69fbc28d64 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987600165" status: 202 len: 0 microversion: 2.1 time: 0.090598 Oct 28 19:39:50.018592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2817/5647] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987600165 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:39:50.386480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:50.387170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:50.396492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:50.402033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:50.402901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:50.403924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:50.404630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:50.405288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:50.602723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:50.604168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:50.616147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:50.625412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:50.626101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:50.632133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:50.632890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:50.633519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:51.360139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:51.381489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27c318fa-ddcf-4daa-8f81-7931f41ee463 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1498 microversion: 2.1 time: 0.992986 Oct 28 19:39:51.382843 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2831/5648] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:50 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1498 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:51.439138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:51.474462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:51.481508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:51.484160 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-980eeb20-d093-4eba-aa99-8364484da90b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 0.885390 Oct 28 19:39:51.486809 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2818/5649] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:50 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:52.301855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27b82322-8559-4370-b925-01be4e05d8b0 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: .version_select at 0x7f1d7685b430>, body: {"keypair": {"name": "tempest-keypair-1768407043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkIeRo8tqeTPXVUkl6j+lEEfCj3kpXWUYged/kg8e/qeNxDlQ2f9qAzW6Uut+JBw7PXwK/xKP3SUnEdLMgftnuX07SB5z5CjhUbdXDvNaujbyFuFiZf61ngFfDC1KVxTQ=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:52.348056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-27b82322-8559-4370-b925-01be4e05d8b0 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:39:52.361263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:52.361913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:52.370515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-27b82322-8559-4370-b925-01be4e05d8b0 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:39:52.388546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:52.389223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:52.389783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:52.390730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:52.391295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:52.391829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:52.444301 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27b82322-8559-4370-b925-01be4e05d8b0 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146328 Oct 28 19:39:52.444674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:39:52.445813 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2832/5650] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:39:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:52.518643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:52.519321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:52.538822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:52.539330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:52.546037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:52.546992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:52.547506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:52.547945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:52.682525 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14db6c23-6659-48db-a483-7c938b6bd4da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "DELETE /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 204 len: 0 microversion: 2.1 time: 0.324644 Oct 28 19:39:52.687401 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2819/5651] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:39:52 2022] DELETE /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:52.701976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:52.704357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:52.722173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:52.727772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:52.729044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:52.729984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:52.730902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:52.731540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:54.315116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:54.325303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:54.327365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:54.327913 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f772a696-9c20-46da-8255-ee4fbcfb91df tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 1.814104 Oct 28 19:39:54.328477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2833/5652] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:52 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:54.707768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:54.722285 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-60f289d9-8f66-4377-9be1-0da2eaab9afc tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1504 microversion: 2.1 time: 2.032843 Oct 28 19:39:54.722939 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2820/5653] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:52 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1504 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:55.361559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:55.362197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:55.375659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:55.399533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:55.408707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:55.409398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:55.410394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:55.411492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:55.414435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:55.747123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:55.747754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:55.758933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:39:55.767149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:55.771529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:55.773295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:55.774264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:55.778400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:55.779075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:56.399606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:56.410752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:56.419409 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4648f188-ebc0-4654-9435-ac3c771992a1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 200 len: 1462 microversion: 2.1 time: 0.677392 Oct 28 19:39:56.421214 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2821/5654] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:55 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 1462 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:56.432072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5120baab-c9f7-475b-844b-cb66a7a5126b req-bf4c1837-0b84-426b-a654-c94b7c1e631e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94840da9-28bf-4859-a5f2-77147f030902", "name": "network-vif-deleted", "tag": "a36d7bd7-ff74-49b2-bca2-5937567c47fb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:56.440895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:56.450139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:56.459065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5120baab-c9f7-475b-844b-cb66a7a5126b req-bf4c1837-0b84-426b-a654-c94b7c1e631e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:56.459248 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8892be8c-4c8a-4454-9583-fe6a5233c8ac tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 1.105119 Oct 28 19:39:56.459966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5120baab-c9f7-475b-844b-cb66a7a5126b req-bf4c1837-0b84-426b-a654-c94b7c1e631e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:56.460605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5120baab-c9f7-475b-844b-cb66a7a5126b req-bf4c1837-0b84-426b-a654-c94b7c1e631e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:56.471292 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2834/5655] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:55 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:56.496059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5120baab-c9f7-475b-844b-cb66a7a5126b req-bf4c1837-0b84-426b-a654-c94b7c1e631e service nova] Creating event network-vif-deleted:a36d7bd7-ff74-49b2-bca2-5937567c47fb for instance 94840da9-28bf-4859-a5f2-77147f030902 on n-h2-862769-3 Oct 28 19:39:56.508585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-268395898", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599ec161-dd8a-466f-859e-7811bbe9f61c"}], "security_groups": [{"name": "tempest-securitygroup--1801956774"}], "key_name": "tempest-keypair-1768407043", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:56.514521 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5120baab-c9f7-475b-844b-cb66a7a5126b req-bf4c1837-0b84-426b-a654-c94b7c1e631e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090106 Oct 28 19:39:56.515398 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2822/5656] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:39:56.955222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] validate_networks() for [('599ec161-dd8a-466f-859e-7811bbe9f61c', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:39:57.450159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:57.451127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: 94840da9-28bf-4859-a5f2-77147f030902] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:57.464241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:57.468694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:57.469305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:57.470149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:57.471134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:57.471673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:57.512737 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] HTTP exception thrown: Instance 94840da9-28bf-4859-a5f2-77147f030902 could not be found. Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Request method failure captured: Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 HTTP/1.1 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC_oyMdNVfjfCxACBJlMpRUw3nj9kiCuzU8KaUcqKEogXJhEIj5_OAp07zpBdZrJkL08R-YbKQhrt5zxM0-eaXNu2D-W1s4RXkYnKwfLd3wP4pDlbRBp54G4H1xohVoW3DGA1-upb-IFi04fIY1FfYpbTmGLHOh4qGfb6u2XryNDd2Q Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 92940aa3ace44f52869f16a373e87673 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesActionsTest-1914839816 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/92940aa3ace44f52869f16a373e87673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_92940aa3ace44f52869f16a373e87673", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/92940aa3ace44f52869f16a373e87673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/92940aa3ace44f52869f16a373e87673"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesActionsTest-1914839816 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 92940aa3ace44f52869f16a373e87673 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesActionsTest-1914839816 Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesActionsTest-1914839816-project Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f41bc4dcd2f94470bb48b0352b83d59f Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesActionsTest-1914839816-project Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 94840da9-28bf-4859-a5f2-77147f030902 could not be found. Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '94840da9-28bf-4859-a5f2-77147f030902'} Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94840da9-28bf-4859-a5f2-77147f030902 could not be found. Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94840da9-28bf-4859-a5f2-77147f030902 could not be found. Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:39:57.514745 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94840da9-28bf-4859-a5f2-77147f030902 could not be found. Oct 28 19:39:57.519416 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:39:57.525309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Returning 404 to user: Instance 94840da9-28bf-4859-a5f2-77147f030902 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:39:57.526455 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2a96a21-78e9-4d8a-949f-66110968596c tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902" status: 404 len: 111 microversion: 2.1 time: 0.080658 Oct 28 19:39:57.532141 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2823/5657] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:57 2022] GET /compute/v2.1/servers/94840da9-28bf-4859-a5f2-77147f030902 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:39:57.545242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:39:57.546192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:39:57.582454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:57.586547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:57.587365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:57.588476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:57.589183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:57.589855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:59.329732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:59.343940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:59.356923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:39:59.359256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e9b7b1d-8281-4fef-8bc0-f848abf865b2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 1.825466 Oct 28 19:39:59.359900 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2824/5658] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:39:57 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:39:59.366249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-138591474", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "f9ccaee6-4677-491a-9131-aba32108320d"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:59.494642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] validate_networks() for [('f9ccaee6-4677-491a-9131-aba32108320d', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:39:59.608022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:39:59.610718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:39:59.611596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:39:59.612449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:39:59.613062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:39:59.640588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:59.641082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:59.641515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:59.648824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:59.649334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:59.649766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:59.720655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:39:59.731470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Getting quotas for user da54380cca684e769986e0e0bf4602f7 and project 5840e97a4c2c4bddbfc87953cf859114. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:39:59.784819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:39:59.787487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:39:59.859071 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d63ad345-ba3d-4335-b61c-6916810570c2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.355748 Oct 28 19:39:59.866554 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2835/5659] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:39:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:39:59.872145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-401691b4-5826-429b-ad36-311e200d0bc6 req-805eaaa4-b510-4cb6-8eaa-32608bd90f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0", "name": "network-vif-plugged", "status": "completed", "tag": "456ffd6b-ba70-4362-9f7e-c4646b6ff034"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:39:59.920814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-401691b4-5826-429b-ad36-311e200d0bc6 req-805eaaa4-b510-4cb6-8eaa-32608bd90f57 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:39:59.924265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-401691b4-5826-429b-ad36-311e200d0bc6 req-805eaaa4-b510-4cb6-8eaa-32608bd90f57 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:39:59.924951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-401691b4-5826-429b-ad36-311e200d0bc6 req-805eaaa4-b510-4cb6-8eaa-32608bd90f57 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:39:59.958586 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-401691b4-5826-429b-ad36-311e200d0bc6 req-805eaaa4-b510-4cb6-8eaa-32608bd90f57 service nova] Creating event network-vif-plugged:456ffd6b-ba70-4362-9f7e-c4646b6ff034 for instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 on n-h1-862769-3 Oct 28 19:39:59.979632 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-401691b4-5826-429b-ad36-311e200d0bc6 req-805eaaa4-b510-4cb6-8eaa-32608bd90f57 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111278 Oct 28 19:39:59.985103 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2836/5660] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:00.004519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6765791-0312-4b0e-9046-656cca620894 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:00.010563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6765791-0312-4b0e-9046-656cca620894 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:00.333810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e6765791-0312-4b0e-9046-656cca620894 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:00.345145 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6765791-0312-4b0e-9046-656cca620894 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1241 microversion: 2.1 time: 0.355416 Oct 28 19:40:00.346469 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2837/5661] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:39:59 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1241 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:00.390739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:00.391790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:00.424638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:00.435028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:00.435737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:00.437732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:00.439449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:00.439449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:01.000927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:01.011745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:01.013199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:01.019652 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c1e764b2-27a6-462c-8e62-62d9e93abd6c tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 0.634823 Oct 28 19:40:01.024027 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2838/5662] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:00 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:01.099338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:40:01.099901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:40:01.100229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:40:01.100631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:40:01.101180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:40:01.127592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:01.128080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:01.128515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:01.129245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:01.129707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:01.130128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:01.198899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Getting quotas for project 92940aa3ace44f52869f16a373e87673. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:40:01.214819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Getting quotas for user f41bc4dcd2f94470bb48b0352b83d59f and project 92940aa3ace44f52869f16a373e87673. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:40:01.259021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:40:01.262071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:40:01.369512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:01.370551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:01.380443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:01.383434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:01.384089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:01.385064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:01.386603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:01.387268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:01.395752 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0002d323-17c3-4d8c-b3a4-b1cd7cfdf768 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.033373 Oct 28 19:40:01.396794 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2825/5663] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:40:01.409493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29f65e10-0685-4313-90e2-dc3b594d0aea tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:01.410491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-29f65e10-0685-4313-90e2-dc3b594d0aea tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:01.682146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29f65e10-0685-4313-90e2-dc3b594d0aea tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:01.693727 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29f65e10-0685-4313-90e2-dc3b594d0aea tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1213 microversion: 2.1 time: 0.285269 Oct 28 19:40:01.695087 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2826/5664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:01 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1213 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:01.773311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:01.783781 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63c30711-808e-4ab6-a031-1ac06b29b5a9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1293 microversion: 2.1 time: 0.418534 Oct 28 19:40:01.784383 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2839/5665] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:01 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1293 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:02.049669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:02.050609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:02.084577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:02.087803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:02.093081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:02.095442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:02.096289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:02.103222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:02.636673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:02.668710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:02.672324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:02.678928 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3f37d895-7d4b-4f0d-8272-b3f8881d9052 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1362 microversion: 2.26 time: 0.633166 Oct 28 19:40:02.688023 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2827/5666] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:02 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:02.720129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:02.720754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:02.730597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:02.736599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:02.737357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:02.738294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:02.739010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:02.739645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:02.820224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:02.820898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:02.844033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:02.844543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:02.844987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:02.845715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:02.851899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:02.860581 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99cb2bfa-03b9-421d-bdb4-ad62cbe6b9f1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1217 microversion: 2.1 time: 0.144342 Oct 28 19:40:02.875216 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2840/5667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:02 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:02.875332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:02.875332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:03.051900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:03.060713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24d6cc51-c1d0-4b4d-95a9-30e06076a93f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1299 microversion: 2.1 time: 0.249293 Oct 28 19:40:03.061317 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2828/5668] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:02 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1299 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:03.724173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:03.725769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:03.749846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:03.750817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:03.751433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:03.752400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:03.753058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:03.755213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:03.893805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:03.895321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:03.910352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:03.912605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:03.913610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:03.916978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:03.920630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:03.922049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.101964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:04.111902 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f698874e-21eb-4d3b-9269-714415825519 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1283 microversion: 2.1 time: 0.228099 Oct 28 19:40:04.112477 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2829/5669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:03 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1283 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:04.131686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:04.132661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:04.151621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.153175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.153836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.154798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.156735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.157363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.351994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:04.356067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:04.376228 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e0f6e83-4dd6-4139-abff-2062efe4aa3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1299 microversion: 2.1 time: 0.250766 Oct 28 19:40:04.377485 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2830/5670] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:04 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:04.389614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:04.405112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:04.411536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:04.438149 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b46960d8-1321-4b3e-a5bf-4d1a36a5cdeb tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1546 microversion: 2.26 time: 0.719855 Oct 28 19:40:04.442094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2841/5671] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:03 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1546 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:04.475064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d76a535e0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:04.511199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.511701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.513308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.515007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:04.535003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.535003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.535003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.537922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.538603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.539258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.643964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.644525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.651015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.710238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.713459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.713932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.782142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:04.823103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24766fc4-101e-4652-b5cd-769d04f1d5c9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1299747746" status: 201 len: 0 microversion: 2.26 time: 0.353838 Oct 28 19:40:04.828862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2831/5672] 10.222.0.44 () {62 vars in 1380 bytes} [Fri Oct 28 19:40:04 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1299747746 => generated 0 bytes in 360 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 19:40:04.834402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76e65449-8b9f-4afa-b6a8-30e98f282307 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7686f670>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:04.850748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e65449-8b9f-4afa-b6a8-30e98f282307 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.851270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e65449-8b9f-4afa-b6a8-30e98f282307 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.852371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e65449-8b9f-4afa-b6a8-30e98f282307 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.912973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76e65449-8b9f-4afa-b6a8-30e98f282307 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1299747746" status: 204 len: 0 microversion: 2.26 time: 0.080482 Oct 28 19:40:04.913704 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2842/5673] 10.222.0.44 () {60 vars in 1361 bytes} [Fri Oct 28 19:40:04 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1299747746 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 19:40:04.930461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d768b19d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:04.945186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.946267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.947085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.948017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:04.955826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.957226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.958178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.959218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.959871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.960601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:04.994158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:04.995166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:04.995816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.021174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:05.075456 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b19573f-ae4c-488b-be23-af8c79905081 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 204 len: 0 microversion: 2.26 time: 0.155983 Oct 28 19:40:05.077813 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2832/5674] 10.222.0.44 () {60 vars in 1295 bytes} [Fri Oct 28 19:40:04 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:40:05.088091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0d8c57b-cc41-469f-8270-0a38b6f32b14 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d76b2de50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.103011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0d8c57b-cc41-469f-8270-0a38b6f32b14 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.104273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0d8c57b-cc41-469f-8270-0a38b6f32b14 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.108094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0d8c57b-cc41-469f-8270-0a38b6f32b14 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.138994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.139947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:05.146407 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0d8c57b-cc41-469f-8270-0a38b6f32b14 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 200 len: 12 microversion: 2.26 time: 0.062782 Oct 28 19:40:05.148804 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2843/5675] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 19:40:05 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 12 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:05.153824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.154456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.155065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.156002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.156557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.157513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.162639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d77a9c430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.199786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.202865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.203959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.205353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:05.243957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.246196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.249390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.250463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.251403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.254835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.299791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:05.322944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.327398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.328106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.352879 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3a7fbec-e46c-43dd-b029-bc1e2c22d9da tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1271 microversion: 2.1 time: 0.196028 Oct 28 19:40:05.353753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.356668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.357362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.358216 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2833/5676] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:05 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:05.405728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.406658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:05.418858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.421173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.422507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.424202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.425714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.426532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.428942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:05.469111 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a860a410-4102-4145-a323-3eb554f0f690 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-290466635" status: 201 len: 0 microversion: 2.26 time: 0.313307 Oct 28 19:40:05.472721 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2844/5677] 10.222.0.44 () {62 vars in 1377 bytes} [Fri Oct 28 19:40:05 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-290466635 => generated 0 bytes in 317 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 19:40:05.484872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-471c71d0-3151-40ab-aef5-18df1bea213d tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d77b683a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.503988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-471c71d0-3151-40ab-aef5-18df1bea213d tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.507388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-471c71d0-3151-40ab-aef5-18df1bea213d tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.508101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-471c71d0-3151-40ab-aef5-18df1bea213d tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.539012 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-471c71d0-3151-40ab-aef5-18df1bea213d tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 200 len: 35 microversion: 2.26 time: 0.060146 Oct 28 19:40:05.540251 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2845/5678] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 19:40:05 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 35 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:05.551819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7685b4c0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.567064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.570720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.573378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.574236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:05.594992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.595919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.596564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.597517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.598180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.598843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.603131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:05.620025 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ad6e843-6ff5-4ab5-b3a8-4f3870df51b6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1299 microversion: 2.1 time: 0.216629 Oct 28 19:40:05.634010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2834/5679] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:05 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:05.654113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.654895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.655780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.700458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:05.715964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:05.721833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-01d7f6fa-e110-4715-b582-e47cb27b1a25 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-290466635" status: 204 len: 0 microversion: 2.26 time: 0.175059 Oct 28 19:40:05.726588 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2846/5680] 10.222.0.44 () {60 vars in 1361 bytes} [Fri Oct 28 19:40:05 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-290466635 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:40:05.732368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6dbdab39-a577-48c9-948b-2173b2f81b37 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7689c9d0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.753178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6dbdab39-a577-48c9-948b-2173b2f81b37 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.753678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6dbdab39-a577-48c9-948b-2173b2f81b37 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.754122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6dbdab39-a577-48c9-948b-2173b2f81b37 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.783654 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6dbdab39-a577-48c9-948b-2173b2f81b37 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 200 len: 12 microversion: 2.26 time: 0.055977 Oct 28 19:40:05.786983 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2835/5681] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 19:40:05 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:05.800457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d76817f70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:05.816530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.818207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.819569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.831778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:05.849673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.850334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.850599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.852439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.855075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.857484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.939177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:05.941195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:05.946792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:05.971332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:06.015527 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e88adad6-6816-4b4f-ae8e-492ad8c3762a tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 204 len: 0 microversion: 2.26 time: 0.219360 Oct 28 19:40:06.016180 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2847/5682] 10.222.0.44 () {60 vars in 1295 bytes} [Fri Oct 28 19:40:05 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:40:06.027241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d768b1040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.043391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.044276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.044961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.045746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:06.056069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.057075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.057729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.058652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.059495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.060140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.101097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.102228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.103141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.115330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.116177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.116823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.169112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:06.210226 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-73616b83-b327-4cda-86ef-33db7c620977 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-459233583" status: 201 len: 0 microversion: 2.26 time: 0.186971 Oct 28 19:40:06.215297 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2836/5683] 10.222.0.44 () {62 vars in 1377 bytes} [Fri Oct 28 19:40:06 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-459233583 => generated 0 bytes in 193 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 19:40:06.229961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7c5413a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.247064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.248232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.248790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.249545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:06.324486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.325518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.325955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.331141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.331910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.332382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.379669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.380473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:06.389070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.391424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.393922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.396331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.397067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.398726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.399174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.401510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.402119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.432204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.432742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.433416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.469071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:06.516762 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-95a7ae09-ff73-44fd-8cea-b974cd1cadf2 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1336283255" status: 201 len: 0 microversion: 2.26 time: 0.296973 Oct 28 19:40:06.522081 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2848/5684] 10.222.0.44 () {62 vars in 1380 bytes} [Fri Oct 28 19:40:06 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1336283255 => generated 0 bytes in 302 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 19:40:06.540906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7681f9d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.566447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.570635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.572185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.572692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:06.593310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.594943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.595586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.596347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.596812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.599303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.692003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.692538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.692969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.746889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:06.805497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:06.814757 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-81f12015-a6ec-4d13-ab06-047206e3cd86 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.440632 Oct 28 19:40:06.826776 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2837/5685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:06 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:06.835767 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4552468-d1f3-4edb-b644-baff1c3ebf3f tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 204 len: 0 microversion: 2.26 time: 0.311218 Oct 28 19:40:06.836432 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2849/5686] 10.222.0.44 () {60 vars in 1295 bytes} [Fri Oct 28 19:40:06 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:40:06.847522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e90d8abe-f676-41a9-9995-e5fe050ba2e0 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7681f8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.856642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.857245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e90d8abe-f676-41a9-9995-e5fe050ba2e0 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.858339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e90d8abe-f676-41a9-9995-e5fe050ba2e0 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.859207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e90d8abe-f676-41a9-9995-e5fe050ba2e0 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.860333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:06.872989 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e90d8abe-f676-41a9-9995-e5fe050ba2e0 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 200 len: 12 microversion: 2.26 time: 0.031483 Oct 28 19:40:06.875342 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2850/5687] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 19:40:06 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:06.884547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.885761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.887672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.888494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.889868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7685b700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:06.895939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.898999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.903645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.904143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.904585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.905074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:06.914942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.919187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.920697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.922714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.924223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.926513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:06.988061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:06.991527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:06.991984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.027913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:07.033270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:07.046152 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3e2c79e1-2f68-49ac-8860-87761f13df9f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1299 microversion: 2.1 time: 0.217695 Oct 28 19:40:07.053008 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2838/5688] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:06 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:07.064466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2210bca-2392-493f-bf52-d74f3855f5c4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 204 len: 0 microversion: 2.26 time: 0.182544 Oct 28 19:40:07.068099 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2851/5689] 10.222.0.44 () {60 vars in 1295 bytes} [Fri Oct 28 19:40:06 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 19:40:07.078361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7699dee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:07.092497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.093421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.094066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.095357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:07.106411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.107184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.107805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.108688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.109348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.110156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.149673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.150565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.151279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.163789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.166673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.167289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.221772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:07.241644 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f14f5ce-e9b6-4a4f-a984-9dae1176a5a6 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1302367158" status: 201 len: 0 microversion: 2.26 time: 0.167731 Oct 28 19:40:07.250130 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2839/5690] 10.222.0.44 () {62 vars in 1380 bytes} [Fri Oct 28 19:40:07 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-1302367158 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 19:40:07.254503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d771ff9d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:07.276302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.277522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.277975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.283644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:07.301201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.301981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.303702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.304608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.306563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.307038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.371352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.372101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.372532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.383329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.384310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.385216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.422458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:07.448218 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a15bf441-78b6-486e-8e8f-cd0d987b34ae tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-946800227" status: 201 len: 0 microversion: 2.26 time: 0.198882 Oct 28 19:40:07.450289 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2852/5691] 10.222.0.44 () {62 vars in 1377 bytes} [Fri Oct 28 19:40:07 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags/tempest-tag-946800227 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 28 19:40:07.459970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Action: 'update_all', calling method: .version_select at 0x7f1d776491f0>, body: {"tags": ["tempest-tag-670444265", "tempest-tag-2111587370"]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:07.473563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.474054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.474488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.475004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:07.493651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.494629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.499058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.500145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.500636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.501075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.573509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.574262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.580566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.622284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:07.657999 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8d94d86-a8fa-445e-81db-74406dc4dd03 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 200 len: 61 microversion: 2.26 time: 0.202639 Oct 28 19:40:07.664549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2840/5692] 10.222.0.44 () {62 vars in 1312 bytes} [Fri Oct 28 19:40:07 2022] PUT /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 61 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:07.670502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2fb6a1b-b632-4e84-bf1a-1c1c6108cfcf tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d7691a550>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:07.701294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2fb6a1b-b632-4e84-bf1a-1c1c6108cfcf tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.701784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2fb6a1b-b632-4e84-bf1a-1c1c6108cfcf tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.702213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2fb6a1b-b632-4e84-bf1a-1c1c6108cfcf tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.743591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2fb6a1b-b632-4e84-bf1a-1c1c6108cfcf tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 200 len: 61 microversion: 2.26 time: 0.076293 Oct 28 19:40:07.749316 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2853/5693] 10.222.0.44 () {60 vars in 1292 bytes} [Fri Oct 28 19:40:07 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:07.756259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '.version_select at 0x7f1d76b6e040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:07.771383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.772070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.775728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.776360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:07.838115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.839001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.839137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:07.839900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:07.840475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.846499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.847581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.848031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.848459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.848731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.852671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.853140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.856348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.857339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.882388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:07.959136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:07.959785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:07.960329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:07.981775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lazy-loading 'flavor' on Instance uuid bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:08.000081 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bb1fb2e-e9de-49c1-ade2-69f76bd4f42b tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags" status: 204 len: 0 microversion: 2.26 time: 0.248142 Oct 28 19:40:08.002784 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2841/5694] 10.222.0.44 () {60 vars in 1295 bytes} [Fri Oct 28 19:40:07 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:40:08.010724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:08.012914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:08.036309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:08.037973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:08.038740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:08.040030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:08.041149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:08.042269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:08.116552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:40:08.400961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91b0279a-d0e5-40c1-ae91-34186f2a1aa9 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 204 len: 0 microversion: 2.26 time: 0.394214 Oct 28 19:40:08.404718 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2842/5695] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:40:08 2022] DELETE /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:40:08.421596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:08.426624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:08.447845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:08.448641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:08.449093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:08.449818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:08.450281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:08.450717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:08.806202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:08.817369 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a89a063-f499-429f-a5e7-308195afe9c1 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.983815 Oct 28 19:40:08.824028 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2854/5696] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:07 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:08.829122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:08.833666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:08.850808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:08.851516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:08.852118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:08.860435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:08.861323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:08.861962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:09.211136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:09.221382 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0efab1e1-20e9-4248-bf9f-f09fedc50b3e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.815232 Oct 28 19:40:09.224388 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2843/5697] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:08 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:09.564874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:09.574002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:09.581522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:09.583196 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ad4e9bbc-4929-4cfc-a3d0-8511b6d9b8b4 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1552 microversion: 2.26 time: 0.757895 Oct 28 19:40:09.586135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2855/5698] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:08 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1552 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:09.850493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:09.851284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:09.875289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:09.875884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:09.876348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:09.879201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:09.880002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:09.881020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:10.084446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-84d2b812-0b28-46c4-9e58-5fe470923a99 req-4616d8ae-e8a2-40ff-bf9a-d1e371efa35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a7f15d-adce-4184-845e-a955a873c67c", "tag": "2a42828a-4fb4-4772-abe6-e09fdb6444a3"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:10.131282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:10.134440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-84d2b812-0b28-46c4-9e58-5fe470923a99 req-4616d8ae-e8a2-40ff-bf9a-d1e371efa35f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:10.135054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-84d2b812-0b28-46c4-9e58-5fe470923a99 req-4616d8ae-e8a2-40ff-bf9a-d1e371efa35f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:10.135480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-84d2b812-0b28-46c4-9e58-5fe470923a99 req-4616d8ae-e8a2-40ff-bf9a-d1e371efa35f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:10.168623 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-84d2b812-0b28-46c4-9e58-5fe470923a99 req-4616d8ae-e8a2-40ff-bf9a-d1e371efa35f service nova] Creating event network-changed:2a42828a-4fb4-4772-abe6-e09fdb6444a3 for instance a0a7f15d-adce-4184-845e-a955a873c67c on n-h2-862769-3 Oct 28 19:40:10.210030 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-84d2b812-0b28-46c4-9e58-5fe470923a99 req-4616d8ae-e8a2-40ff-bf9a-d1e371efa35f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127402 Oct 28 19:40:10.211104 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2856/5699] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:40:10.252990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:10.253705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:10.260271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:10.260762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:10.261192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:10.261907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:10.262348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:10.262989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:10.342295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:11.070451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:11.086934 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a821911-7296-42f5-8a38-d93fe9731a07 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 1.241335 Oct 28 19:40:11.093376 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2844/5700] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:09 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:11.114385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:11.120902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:11.132972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:11.134144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:11.137867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:11.144968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:11.147403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:11.147987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:11.184198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:11.279085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:11.328760 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc8767cb-0e35-40dc-9c2f-6e075abc4e4f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 1.076968 Oct 28 19:40:11.334016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2857/5701] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:10 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:11.648888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:11.661222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:11.662900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:11.664246 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebf64574-0a79-4573-af15-c8817bbfb894 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1552 microversion: 2.26 time: 0.569633 Oct 28 19:40:11.678861 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2845/5702] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:11 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1552 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:12.114788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:12.116173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:12.130284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:12.132829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:12.133627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:12.139047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:12.140095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:12.141149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:12.232211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-844fdefb-565a-4bec-85c0-4f831b3f59ac req-722d7542-8335-4086-a1f5-85fb035ff18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d129f066-1385-40ad-b1d6-de5c424cbf2a", "tag": "d50154a6-b7d4-42ec-b7aa-13972d0bc20c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:12.247063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:12.272339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-844fdefb-565a-4bec-85c0-4f831b3f59ac req-722d7542-8335-4086-a1f5-85fb035ff18b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:12.275209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-844fdefb-565a-4bec-85c0-4f831b3f59ac req-722d7542-8335-4086-a1f5-85fb035ff18b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:12.281666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-844fdefb-565a-4bec-85c0-4f831b3f59ac req-722d7542-8335-4086-a1f5-85fb035ff18b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:12.330294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-844fdefb-565a-4bec-85c0-4f831b3f59ac req-722d7542-8335-4086-a1f5-85fb035ff18b service nova] Creating event network-changed:d50154a6-b7d4-42ec-b7aa-13972d0bc20c for instance d129f066-1385-40ad-b1d6-de5c424cbf2a on n-h2-862769-3 Oct 28 19:40:12.353860 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-844fdefb-565a-4bec-85c0-4f831b3f59ac req-722d7542-8335-4086-a1f5-85fb035ff18b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123205 Oct 28 19:40:12.355790 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2846/5703] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:40:12.373323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:12.374221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:12.389170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:12.389693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:12.390141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:12.390913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:12.391389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:12.391814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:12.963774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:12.979229 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-477e660f-95c6-473e-b01f-23ff48ff4685 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.865496 Oct 28 19:40:12.981721 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2858/5704] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:12 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:12.995655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:13.003203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:13.028326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:13.029826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:13.030720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:13.033570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:13.037570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:13.038859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:13.372540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:13.384331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:13.387336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e94561cb29b4234b3c4499464a22d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c813d988624110860426858462ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:13.389057 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fde25a4a-da48-4181-be2e-64b0e25272f7 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 200 len: 1510 microversion: 2.26 time: 0.405533 Oct 28 19:40:13.390299 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2859/5705] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:12 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:13.396596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9910df80-86c5-4e7c-b7d7-083dbd153689 req-6dab8b5f-5958-47b7-b002-0d1526c6a577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0", "name": "network-vif-deleted", "tag": "456ffd6b-ba70-4362-9f7e-c4646b6ff034"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:13.417150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9910df80-86c5-4e7c-b7d7-083dbd153689 req-6dab8b5f-5958-47b7-b002-0d1526c6a577 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:13.417657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9910df80-86c5-4e7c-b7d7-083dbd153689 req-6dab8b5f-5958-47b7-b002-0d1526c6a577 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:13.420835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9910df80-86c5-4e7c-b7d7-083dbd153689 req-6dab8b5f-5958-47b7-b002-0d1526c6a577 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:13.463079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:13.467007 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9910df80-86c5-4e7c-b7d7-083dbd153689 req-6dab8b5f-5958-47b7-b002-0d1526c6a577 service nova] Creating event network-vif-deleted:456ffd6b-ba70-4362-9f7e-c4646b6ff034 for instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 on n-h1-862769-3 Oct 28 19:40:13.480862 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9910df80-86c5-4e7c-b7d7-083dbd153689 req-6dab8b5f-5958-47b7-b002-0d1526c6a577 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088574 Oct 28 19:40:13.481772 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2860/5706] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:13.523997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:13.537554 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c4c5f6e-ed7a-4a93-9010-d9b2de36adde tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 1.180059 Oct 28 19:40:13.538461 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2847/5707] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:12 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:14.005361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:14.006085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:14.020601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:14.021115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:14.021584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:14.022300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:14.031358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:14.031889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:14.418050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:14.419537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] [instance: bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:14.438296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:14.441900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:14.448453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:14.450174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:14.452129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:14.454929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:14.488351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:14.490888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] HTTP exception thrown: Instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 could not be found. Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Request method failure captured: Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 HTTP/1.1 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC_1k4V-3P6DinufFuN5bxNv3G3zubm6mCJNegcGXg3NnnmI_L853IEALGKlSkyjfx8a5SQ4Wh4MzhUOxnXaFDrZj-JPVg2G_iGbGU19Cgnw5Qh_lqOE-MGFVl4TPnIaE5zZ5hDwnxIY7KnHu124Ago9-oUk4bNiRhzo10VU-gf8VlM Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.26 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f0c813d988624110860426858462ac11 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerTagsTestJSON-1514174893 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f0c813d988624110860426858462ac11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f0c813d988624110860426858462ac11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f0c813d988624110860426858462ac11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f0c813d988624110860426858462ac11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerTagsTestJSON-1514174893 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f0c813d988624110860426858462ac11 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerTagsTestJSON-1514174893 Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerTagsTestJSON-1514174893-project Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 5e94561cb29b4234b3c4499464a22d1c Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerTagsTestJSON-1514174893-project Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 could not be found. Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0'} Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 could not be found. Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 could not be found. Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:40:14.495281 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 could not be found. Oct 28 19:40:14.500077 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:14.500757 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-579a3686-5211-4e6a-9a65-aa8c1ef897cf tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.497571 Oct 28 19:40:14.512241 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2861/5708] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:13 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:14.512736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] Returning 404 to user: Instance bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:40:14.514227 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37eb3315-96bb-42b9-94ea-77d3185dcf54 tempest-ServerTagsTestJSON-1514174893 tempest-ServerTagsTestJSON-1514174893-project] 10.222.0.44 "GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0" status: 404 len: 111 microversion: 2.26 time: 0.102698 Oct 28 19:40:14.517707 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2848/5709] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:14 2022] GET /compute/v2.1/servers/bdd9aa2a-f369-40b0-9a75-1a48bc5bdef0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 19:40:14.565961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:14.566802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:14.591217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:14.592843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:14.593323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:14.599835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:14.600213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:14.600698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:15.015457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:15.025848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-feff62bd-8739-471a-8c5b-d7e680ffc2ce tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.464468 Oct 28 19:40:15.027158 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2862/5710] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:14 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:15.532861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:15.534453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:15.553857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:15.554730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:15.555381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:15.556393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:15.557054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:15.559880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:15.833805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:15.853527 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f13eeb0-a2e5-4861-bbbd-4f7c9eada8ab tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.334913 Oct 28 19:40:15.857778 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2849/5711] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:15 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:16.051660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:16.052918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:16.065753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:16.066254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:16.066717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:16.068540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:16.069059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:16.069496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:16.262702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:16.279785 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04b57006-7f60-4da1-a4fe-ade3e739221c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.231923 Oct 28 19:40:16.282201 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2863/5712] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:16 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:16.884332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:16.884937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:16.896930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:16.897435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:16.905482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:16.906623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:16.907291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:16.907885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:17.310784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:17.311964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:17.387854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:17.390060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:17.391557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:17.396475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:17.397278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:17.400875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:17.829813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:17.845986 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6777fc21-2360-4bda-aff1-e5a6a5d08584 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.965644 Oct 28 19:40:17.850265 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2850/5713] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:16 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:17.872484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0c8b0869-519f-46c7-a227-45974e25513f req-b5c9a167-a102-4f33-91ad-ae818f29c91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a7f15d-adce-4184-845e-a955a873c67c", "name": "network-vif-plugged", "status": "completed", "tag": "2a42828a-4fb4-4772-abe6-e09fdb6444a3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:17.915033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0c8b0869-519f-46c7-a227-45974e25513f req-b5c9a167-a102-4f33-91ad-ae818f29c91b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:17.918269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0c8b0869-519f-46c7-a227-45974e25513f req-b5c9a167-a102-4f33-91ad-ae818f29c91b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:17.919472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0c8b0869-519f-46c7-a227-45974e25513f req-b5c9a167-a102-4f33-91ad-ae818f29c91b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:17.948776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:17.957511 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0c8b0869-519f-46c7-a227-45974e25513f req-b5c9a167-a102-4f33-91ad-ae818f29c91b service nova] Creating event network-vif-plugged:2a42828a-4fb4-4772-abe6-e09fdb6444a3 for instance a0a7f15d-adce-4184-845e-a955a873c67c on n-h2-862769-3 Oct 28 19:40:17.961378 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a18f7ce1-8d5e-4f0f-af0a-9e6fd12f5934 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.653866 Oct 28 19:40:17.962029 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2864/5714] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:17 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:17.986043 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0c8b0869-519f-46c7-a227-45974e25513f req-b5c9a167-a102-4f33-91ad-ae818f29c91b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133363 Oct 28 19:40:17.987033 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2851/5715] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:18.873142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:18.873993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:18.902435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:18.903826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:18.905590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:18.907119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:18.910872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:18.917982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:18.991591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:18.992215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:19.010970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:19.016190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:19.016707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:19.017464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:19.017930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:19.018363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:19.518658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:19.542319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0dafdb7-4325-44c2-a688-6840d8ce1d0b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1313 microversion: 2.1 time: 0.673671 Oct 28 19:40:19.543852 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2865/5716] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:18 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:19.600301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:19.621805 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9344b83-b7f2-47e3-95d3-732fa5b23147 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.631956 Oct 28 19:40:19.622927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2852/5717] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:18 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:20.566852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:20.567998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:20.594360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:20.599378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:20.600568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:20.601504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:20.602609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:20.603474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:20.647600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:20.648273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:20.683641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:20.686986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:20.697097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:20.697097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:20.697708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:20.698309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:21.088249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:21.109280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b54c0d76-80c1-4e49-ba62-da78c4442a72 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1498 microversion: 2.1 time: 0.546119 Oct 28 19:40:21.112451 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2866/5718] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:20 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1498 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:21.160971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b12159ef-a14f-492b-ade2-98eb5c2d943c req-a386e561-e433-43c5-adad-6fee5193cbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d129f066-1385-40ad-b1d6-de5c424cbf2a", "name": "network-vif-plugged", "status": "completed", "tag": "d50154a6-b7d4-42ec-b7aa-13972d0bc20c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:21.183764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:21.198293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b12159ef-a14f-492b-ade2-98eb5c2d943c req-a386e561-e433-43c5-adad-6fee5193cbed service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:21.198965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b12159ef-a14f-492b-ade2-98eb5c2d943c req-a386e561-e433-43c5-adad-6fee5193cbed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:21.200369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6199e43a-948d-428b-af33-199d6ffc1353 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.556696 Oct 28 19:40:21.201619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b12159ef-a14f-492b-ade2-98eb5c2d943c req-a386e561-e433-43c5-adad-6fee5193cbed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:21.205201 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2853/5719] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:20 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:21.260552 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b12159ef-a14f-492b-ade2-98eb5c2d943c req-a386e561-e433-43c5-adad-6fee5193cbed service nova] Creating event network-vif-plugged:d50154a6-b7d4-42ec-b7aa-13972d0bc20c for instance d129f066-1385-40ad-b1d6-de5c424cbf2a on n-h2-862769-3 Oct 28 19:40:21.269884 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b12159ef-a14f-492b-ade2-98eb5c2d943c req-a386e561-e433-43c5-adad-6fee5193cbed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154799 Oct 28 19:40:21.275967 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2867/5720] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:22.227158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:22.227823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:22.235581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:22.249846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:22.252296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:22.252789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:22.253640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:22.253986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:22.254419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:22.312261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:22.312857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:22.316613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:22.355852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:22.359130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:22.366848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:22.367852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:22.368342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:22.369228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:22.455431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:40:22.678282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3531758e-4870-4587-8ef5-133c44c044fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 204 len: 0 microversion: 2.1 time: 0.368629 Oct 28 19:40:22.681330 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2868/5721] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:40:22 2022] DELETE /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:40:22.705428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:22.709614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:22.738546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:22.740443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:22.740905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:22.741671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:22.742636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:22.743406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:22.780830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:22.795425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a617bf44-0268-4f36-b3c7-b23554341378 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.572228 Oct 28 19:40:22.796503 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2854/5722] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:22 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:23.093426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:23.103298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f9c11fa-5517-47ee-89ea-77976e489b99 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1504 microversion: 2.1 time: 0.414091 Oct 28 19:40:23.112277 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2869/5723] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:22 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:23.819200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:23.819837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:23.836075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:23.837668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:23.841718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:23.843071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:23.844526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:23.852184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:24.141426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:24.143134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:24.182359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:24.185930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:24.190954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:24.197157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:24.200295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:24.201951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:24.737659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:24.752830 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09f90932-d3a1-43ef-a4de-580de4f13100 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1367 microversion: 2.1 time: 0.937420 Oct 28 19:40:24.766741 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2855/5724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:23 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1367 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:40:25.058407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:25.070250 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93516403-2471-4c1a-82e6-07c69d46541b tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1504 microversion: 2.1 time: 0.933949 Oct 28 19:40:25.074679 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2870/5725] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:24 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1504 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:25.714266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d3fc7189-3ea5-4df2-bc38-f56ccef58025 req-14324ef1-4c81-4606-b8ea-6f5179b3a35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a7f15d-adce-4184-845e-a955a873c67c", "name": "network-vif-deleted", "tag": "2a42828a-4fb4-4772-abe6-e09fdb6444a3"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:25.752901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d3fc7189-3ea5-4df2-bc38-f56ccef58025 req-14324ef1-4c81-4606-b8ea-6f5179b3a35a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:25.756031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d3fc7189-3ea5-4df2-bc38-f56ccef58025 req-14324ef1-4c81-4606-b8ea-6f5179b3a35a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:25.759506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d3fc7189-3ea5-4df2-bc38-f56ccef58025 req-14324ef1-4c81-4606-b8ea-6f5179b3a35a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:25.781068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:25.785635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:25.803740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:25.822541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:25.823330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:25.825259 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d3fc7189-3ea5-4df2-bc38-f56ccef58025 req-14324ef1-4c81-4606-b8ea-6f5179b3a35a service nova] Creating event network-vif-deleted:2a42828a-4fb4-4772-abe6-e09fdb6444a3 for instance a0a7f15d-adce-4184-845e-a955a873c67c on n-h2-862769-3 Oct 28 19:40:25.827378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:25.828177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:25.828789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:25.839070 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d3fc7189-3ea5-4df2-bc38-f56ccef58025 req-14324ef1-4c81-4606-b8ea-6f5179b3a35a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135700 Oct 28 19:40:25.841170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2856/5726] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:26.107001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:26.107800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:26.127708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:26.131002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:26.131577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:26.132351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:26.132832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:26.133267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:26.241996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:26.243056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:26.243803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:26.244502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lazy-loading 'fault' on Instance uuid a0a7f15d-adce-4184-845e-a955a873c67c {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:40:26.344100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:26.374600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25730643-600a-4eab-be72-81aaf41837ca tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1558 microversion: 2.1 time: 0.596176 Oct 28 19:40:26.374806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41bc4dcd2f94470bb48b0352b83d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92940aa3ace44f52869f16a373e87673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:26.376858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2871/5727] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:25 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1558 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:26.379498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:26.400510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:26.401801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:26.403647 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4c56277-f65c-4b5a-8a65-7bd35dcf9a06 tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 200 len: 1303 microversion: 2.1 time: 0.301677 Oct 28 19:40:26.405596 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2857/5728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:26 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:40:26.417356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:26.422596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:26.423500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:26.424564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:26.425232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:26.425848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:26.895036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f282d350-672b-49a2-8187-f067add42513 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.491009 Oct 28 19:40:26.895852 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2872/5729] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 19:40:26 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-interface => generated 285 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:27.432544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:27.433298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] [instance: a0a7f15d-adce-4184-845e-a955a873c67c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:27.474782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:27.475429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:27.477765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:27.478799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:27.482543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:27.483024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:27.531385 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] HTTP exception thrown: Instance a0a7f15d-adce-4184-845e-a955a873c67c could not be found. Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Request method failure captured: Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c HTTP/1.1 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC_oyMdNVfjfCxACBJlMpRUw3nj9kiCuzU8KaUcqKEogXJhEIj5_OAp07zpBdZrJkL08R-YbKQhrt5zxM0-eaXNu2D-W1s4RXkYnKwfLd3wP4pDlbRBp54G4H1xohVoW3DGA1-upb-IFi04fIY1FfYpbTmGLHOh4qGfb6u2XryNDd2Q Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 92940aa3ace44f52869f16a373e87673 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesActionsTest-1914839816 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/92940aa3ace44f52869f16a373e87673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_92940aa3ace44f52869f16a373e87673", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/92940aa3ace44f52869f16a373e87673"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/92940aa3ace44f52869f16a373e87673"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesActionsTest-1914839816 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 92940aa3ace44f52869f16a373e87673 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesActionsTest-1914839816 Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesActionsTest-1914839816-project Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: f41bc4dcd2f94470bb48b0352b83d59f Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesActionsTest-1914839816-project Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a0a7f15d-adce-4184-845e-a955a873c67c could not be found. Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a0a7f15d-adce-4184-845e-a955a873c67c'} Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a7f15d-adce-4184-845e-a955a873c67c could not be found. Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a7f15d-adce-4184-845e-a955a873c67c could not be found. Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:40:27.547232 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a7f15d-adce-4184-845e-a955a873c67c could not be found. Oct 28 19:40:27.552479 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:40:27.553954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] Returning 404 to user: Instance a0a7f15d-adce-4184-845e-a955a873c67c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:40:27.555044 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58dc082a-2f14-4009-9dc8-9b825f3f72fd tempest-VolumesActionsTest-1914839816 tempest-VolumesActionsTest-1914839816-project] 10.222.0.44 "GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c" status: 404 len: 111 microversion: 2.1 time: 0.127025 Oct 28 19:40:27.563500 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2858/5730] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:40:27 2022] GET /compute/v2.1/servers/a0a7f15d-adce-4184-845e-a955a873c67c => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:40:28.519317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-507631744", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:28.643177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:40:28.643706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:40:28.644194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:40:28.644596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:40:28.645008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:40:28.688275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:28.689134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:28.689744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:28.690649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:28.691470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:28.692105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:28.764601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Getting quotas for project ef8af43ff56a4aa0bed51b49ca7f920e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:40:28.778720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Getting quotas for user fa2329e68d0f433d8d894fc3370978e1 and project ef8af43ff56a4aa0bed51b49ca7f920e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:40:28.827230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:40:28.830501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:40:28.978674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b166fc8e-1cc0-4a9e-b652-6f5815599a73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.769470 Oct 28 19:40:28.979999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2873/5731] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:40:28.991342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d794db0a-dc94-4dc6-9221-82e9f45348a2 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:28.992641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d794db0a-dc94-4dc6-9221-82e9f45348a2 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:29.192524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d794db0a-dc94-4dc6-9221-82e9f45348a2 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:29.206392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d794db0a-dc94-4dc6-9221-82e9f45348a2 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:29.208410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d794db0a-dc94-4dc6-9221-82e9f45348a2 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:29.232761 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d794db0a-dc94-4dc6-9221-82e9f45348a2 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d" status: 200 len: 1277 microversion: 2.47 time: 0.224769 Oct 28 19:40:29.235580 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2859/5732] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:28 2022] GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:29.396557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-306543923", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": "none"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:29.530727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:40:29.547427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:40:29.547929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:40:29.549551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:40:29.550178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:40:29.586901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:29.587431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:29.593064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:29.603940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:29.604785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:29.616189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:29.725870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Getting quotas for project ef8af43ff56a4aa0bed51b49ca7f920e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:40:29.757954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Getting quotas for user fa2329e68d0f433d8d894fc3370978e1 and project ef8af43ff56a4aa0bed51b49ca7f920e. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:40:29.877779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:40:29.895926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:40:30.164815 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5d7f19dd-68ff-419c-9526-6203dcb34aac tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.772134 Oct 28 19:40:30.183113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3c48f302-0761-4970-abce-48e85e5aa416 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:30.185947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2874/5733] 10.222.0.44 () {62 vars in 1188 bytes} [Fri Oct 28 19:40:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 19:40:30.186622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3c48f302-0761-4970-abce-48e85e5aa416 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:30.378649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3c48f302-0761-4970-abce-48e85e5aa416 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "PUT /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 991 microversion: 2.47 time: 0.201869 Oct 28 19:40:30.383242 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2860/5734] 10.222.0.44 () {62 vars in 1297 bytes} [Fri Oct 28 19:40:30 2022] PUT /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 991 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:30.404507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31405c99-95b7-4a67-b236-ce56826bc00c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:30.406626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-31405c99-95b7-4a67-b236-ce56826bc00c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:30.549605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-31405c99-95b7-4a67-b236-ce56826bc00c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:30.597681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-31405c99-95b7-4a67-b236-ce56826bc00c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:30.604106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-31405c99-95b7-4a67-b236-ce56826bc00c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:30.612656 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-31405c99-95b7-4a67-b236-ce56826bc00c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1277 microversion: 2.47 time: 0.208493 Oct 28 19:40:30.645886 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2875/5735] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:30 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:31.337247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e06f38ac-7765-43a4-aa12-88ef06cc066a req-f63fd986-8c71-4db8-91e2-9e21de287d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d129f066-1385-40ad-b1d6-de5c424cbf2a", "tag": "d50154a6-b7d4-42ec-b7aa-13972d0bc20c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:31.380668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e06f38ac-7765-43a4-aa12-88ef06cc066a req-f63fd986-8c71-4db8-91e2-9e21de287d26 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:31.383392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e06f38ac-7765-43a4-aa12-88ef06cc066a req-f63fd986-8c71-4db8-91e2-9e21de287d26 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:31.385807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e06f38ac-7765-43a4-aa12-88ef06cc066a req-f63fd986-8c71-4db8-91e2-9e21de287d26 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:31.452274 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e06f38ac-7765-43a4-aa12-88ef06cc066a req-f63fd986-8c71-4db8-91e2-9e21de287d26 service nova] Creating event network-changed:d50154a6-b7d4-42ec-b7aa-13972d0bc20c for instance d129f066-1385-40ad-b1d6-de5c424cbf2a on n-h2-862769-3 Oct 28 19:40:31.478557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e06f38ac-7765-43a4-aa12-88ef06cc066a req-f63fd986-8c71-4db8-91e2-9e21de287d26 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141314 Oct 28 19:40:31.481076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2861/5736] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:31.646063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3ed5780-0805-43d3-885e-c46e08887f24 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:31.647349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3ed5780-0805-43d3-885e-c46e08887f24 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:32.693507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3ed5780-0805-43d3-885e-c46e08887f24 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:32.710416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3ed5780-0805-43d3-885e-c46e08887f24 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:32.716522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3ed5780-0805-43d3-885e-c46e08887f24 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:32.721111 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3ed5780-0805-43d3-885e-c46e08887f24 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1277 microversion: 2.47 time: 1.077286 Oct 28 19:40:32.739218 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2876/5737] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:31 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1277 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:33.752933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:33.754227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:33.777459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:33.779691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:33.782389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:33.783368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:33.786462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:33.787208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:33.996039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:34.010041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:34.012018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:34.018501 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a4e9a32-ba6f-45d0-86f7-a47d87c5264f tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1329 microversion: 2.47 time: 0.269849 Oct 28 19:40:34.020721 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2862/5738] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:33 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1329 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:35.050299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:35.053113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:35.078121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:35.081188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:35.082709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:35.086921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:35.087934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:35.090124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:35.305910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:35.321519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:35.326850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:35.331589 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3c7e671-3a25-4572-8ee4-19b787a2a606 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1335 microversion: 2.47 time: 0.284769 Oct 28 19:40:35.335319 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2877/5739] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:35 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1335 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:40:36.369078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:36.369693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:36.401804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:36.402307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:36.402784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:36.412251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:36.424423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:36.428185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:36.811581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:36.833512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:36.841482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:36.846796 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6684e63b-3783-4ffd-b5c1-ba28b17add3c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1335 microversion: 2.47 time: 0.482596 Oct 28 19:40:36.852034 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2863/5740] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:36 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1335 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:40:37.880574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:37.882006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:37.899853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:37.901436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:37.902089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:37.903300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:37.904597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:37.906078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.145815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:38.175827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:38.177382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:38.178657 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f69f7408-7627-4ed9-a2a0-7ff4d29ad645 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1356 microversion: 2.47 time: 0.304299 Oct 28 19:40:38.186481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2878/5741] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:37 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1356 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:38.218909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:38.231002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:38.273796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:38.277467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:38.278004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.278931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:38.286441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:38.287650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.470887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:40:38.477127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:40:38.477843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:40:38.478268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:40:38.478684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:40:38.614928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:38.628359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:38.629011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:38.634715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.635997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:38.637072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:38.637854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.708505 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed5e702e-06a7-4bbe-b2d7-1192fd8c8a77 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "POST /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d/action" status: 202 len: 1078 microversion: 2.47 time: 0.500033 Oct 28 19:40:38.709699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2864/5742] 10.222.0.44 () {62 vars in 1319 bytes} [Fri Oct 28 19:40:38 2022] POST /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d/action => generated 1078 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 19:40:38.732885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:38.733615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:38.744982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:38.746266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:38.747010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.748375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:38.750185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:38.753927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:38.989229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:39.018954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:39.025665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:39.031074 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d7b7d2a-49f0-4f45-9bea-185730eccab1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.302454 Oct 28 19:40:39.034658 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2879/5743] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:38 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:40.065450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:40.067321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:40.071344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:40.103429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:40.106966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:40.108297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:40.110388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:40.114435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:40.158307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:40.659724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:40.718425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:40.722441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:40.731263 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d63e8343-fd2f-4d04-af38-7222b3043dd8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.672118 Oct 28 19:40:40.740610 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2865/5744] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:40 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:41.769570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:41.772243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:41.780690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:41.811176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:41.811691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:41.815142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:41.816468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:41.817149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:41.817751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:41.826092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:41.941551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:41.954018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:41.955771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:41.957198 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-739d888c-f034-42ec-97e4-565dea78f826 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.193355 Oct 28 19:40:41.958355 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2880/5745] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:41 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:42.994665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:42.996750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:43.044459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:43.048503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:43.054925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:43.057057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:43.062333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:43.063229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:44.095907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:44.106736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:44.111551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:44.115264 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-255e9d3f-3f24-47d9-bbe2-3f3f8da56a2d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 1.129610 Oct 28 19:40:44.136943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2866/5746] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:42 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:45.144602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:45.145260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:45.147503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:45.178029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:45.180262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:45.182123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:45.184799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:45.185576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:45.186310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:45.370131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:45.385928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:45.389752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:45.401488 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c69da567-f525-418b-8dde-514b8678a52a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.260965 Oct 28 19:40:45.408247 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2881/5747] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:45 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:46.436089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:46.437422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:46.449742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:46.454871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:46.459011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:46.460031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:46.460679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:46.463045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:46.604283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:46.613986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:46.618749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:46.622587 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fbabb995-178a-44c4-8bcc-d44b088d0292 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.193041 Oct 28 19:40:46.625586 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2867/5748] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:46 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:47.657089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:47.660835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:47.689372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:47.693017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:47.696836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:47.698871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:47.699456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:47.707615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:48.237112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:48.246163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:48.247708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:48.248970 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34d63b47-f41c-4d80-9cc7-24d70fb8b91c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.598740 Oct 28 19:40:48.249543 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2882/5749] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:47 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:49.277647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:49.278575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:49.297959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:49.298868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:49.299538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:49.300500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:49.303058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:49.303828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:49.480797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:49.495859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:49.497332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:49.502067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-071e5c21-78c4-4101-940e-45eac4be356c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.229194 Oct 28 19:40:49.508485 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2868/5750] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:49 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:50.534835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:50.535668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:50.555317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:50.556020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:50.556567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:50.558613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:50.561396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:50.564586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:50.800655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:50.809763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:50.823688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:50.825091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6cf2d1e5-f323-4555-be4e-173b686d5c00 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.294819 Oct 28 19:40:50.828049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2883/5751] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:50 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:51.859391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:51.860015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:51.884170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:51.884673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:51.885111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:51.885834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:51.886287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:51.886738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:52.221158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:52.241373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:52.253402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:52.260358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5627a485-d09a-4079-8b51-38e506950d10 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.401189 Oct 28 19:40:52.261036 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2869/5752] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:51 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:53.295653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:53.298248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:53.310572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:53.313355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:53.314518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:53.315215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:53.316512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:53.317232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:53.317873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:53.776910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:53.827071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a937bac9-8bcf-4016-a954-d93f536bba31 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'create', calling method: .version_select at 0x7f1d76ceb280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1003538839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoSvRqM4tTpbmy1DNPg7JQRPnxAlSU+rMstUDgdlBl2zVvKgBJ4fUTiWgNV+qaxY20qcuDymYlntznosxPcjqGf6gdeKlLzVFTNQDLeLw3v6Kz1FqsQv9AJGDC6g8cHKw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:53.839870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:53.841608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:53.842881 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27702b83-1060-48fb-8080-f5eeb2c967df tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.552465 Oct 28 19:40:53.855031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=46 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:40:53.864734 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2884/5753] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:53 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:53.894216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-a937bac9-8bcf-4016-a954-d93f536bba31 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:40:53.912728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-a937bac9-8bcf-4016-a954-d93f536bba31 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for user e1acfd8db9c04d8eb136ea3c7215a34b and project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:40:53.974659 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a937bac9-8bcf-4016-a954-d93f536bba31 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.153547 Oct 28 19:40:53.977617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2870/5754] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:40:53 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:54.873760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:54.874639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:54.897786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:54.898283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:54.898809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:54.899533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:54.899997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:54.900401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:55.313011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:55.335224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:55.338918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:55.340154 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8ae8e99-c012-4f51-8661-e9836956bc2a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.472464 Oct 28 19:40:55.348244 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2885/5755] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:54 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:55.520726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:55.521316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:55.539397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:55.542601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:55.543499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:55.548571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:55.550791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:55.559433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:55.714713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b0d1978-1120-4140-99b1-444a8d05fc01 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/ips" status: 200 len: 150 microversion: 2.1 time: 0.198214 Oct 28 19:40:55.754121 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2871/5756] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:40:55 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/ips => generated 150 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:40:56.372879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:56.373956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:56.430808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:56.431840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:56.432474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:56.433519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:56.434241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:56.434938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:56.976041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:56.990747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:57.016028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:57.018894 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc8418e6-c911-4a92-aec3-1583870f0b9c tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.653833 Oct 28 19:40:57.021779 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2886/5757] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:56 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:40:57.517139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-177139891", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "c30ce50d-58e0-4350-8b0a-572a01f0adf1"}], "key_name": "tempest-TestNetworkBasicOps-1003538839", "security_groups": [{"name": "tempest-secgroup-smoke-520353432"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:40:58.051819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:58.053169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:58.064817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:58.070902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:58.071686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:58.072838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:58.073535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:58.074203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:58.348451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:58.364764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:58.372642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:58.374211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e56508a-05c0-4c37-b32f-d2ac0d1bc7a5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.326900 Oct 28 19:40:58.391995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2887/5758] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:58 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:40:58.438449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] validate_networks() for [('c30ce50d-58e0-4350-8b0a-572a01f0adf1', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:40:59.409627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:40:59.411461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:40:59.429538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:59.430553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:59.431583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:59.434059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:40:59.438155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:40:59.439281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:40:59.794882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:59.843817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:59.850961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:40:59.863533 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae555b96-6503-4fbc-88d1-5d57b93dcdd5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.456057 Oct 28 19:40:59.868679 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2888/5759] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:40:59 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:00.003596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:41:00.004126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:41:00.004501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:41:00.004914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:41:00.005327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:41:00.027079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:00.027493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:00.027938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:00.042848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:00.043373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:00.044131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:00.061922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:00.091512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:41:00.114718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for user e1acfd8db9c04d8eb136ea3c7215a34b and project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:41:00.177993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:41:00.205859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5744430-a86c-4c8d-96f5-bc11cfdc0cb3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:00.210272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:00.211543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:41:00.227951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:00.229233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:00.246432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:00.251901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:00.252766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:00.253560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:00.309424 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1ebde584-f750-46b1-a2c5-50891c703cf8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.800245 Oct 28 19:41:00.310772 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2872/5760] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:40:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 2803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:41:00.322202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f3ad902-8073-4006-8bb2-903258476554 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:00.323143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f3ad902-8073-4006-8bb2-903258476554 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:00.738192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f3ad902-8073-4006-8bb2-903258476554 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:00.768506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f3ad902-8073-4006-8bb2-903258476554 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1248 microversion: 2.1 time: 0.450225 Oct 28 19:41:00.771745 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2873/5761] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:00 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1248 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:00.900290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:00.902222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:00.933526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:00.934054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:00.936319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:00.940703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:00.941265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:00.941724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:00.976803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe5c7557-2951-44a0-9ca7-53d852c9bf1a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "POST /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775978 Oct 28 19:41:00.979699 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2889/5762] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:41:00 2022] POST /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:01.326946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:01.345847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:01.353974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:01.359532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f3810a3-f7ad-495e-854e-5a6fe32f6123 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.464547 Oct 28 19:41:01.363489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2874/5763] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:00 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:01.797299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:01.798021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:01.815378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:01.815669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:01.825827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:01.826850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:01.827346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:01.827786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:02.150331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:02.166612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ade6bc47-b277-4a21-98b4-8d34efbf26e8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1244 microversion: 2.1 time: 0.373134 Oct 28 19:41:02.170035 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2890/5764] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:01 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1244 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:02.392881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:02.393511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:02.427003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:02.427693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:02.428156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:02.428929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:02.429401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:02.429907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:02.577263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:02.588549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:02.590425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:02.594984 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-585c7807-b57d-447b-869a-a29ef0dfc70a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.206655 Oct 28 19:41:02.598024 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2875/5765] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:02 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:03.197219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:03.197848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:03.230533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:03.231133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:03.231609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:03.232395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:03.247548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:03.249966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:03.629929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:03.631100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:03.658198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:03.666247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:03.668148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:03.675945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:03.678247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:03.681021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:03.840601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:03.849583 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-444e95a2-ba6f-41dc-9fdb-ad5646e8cc04 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1306 microversion: 2.1 time: 0.656342 Oct 28 19:41:03.856552 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2891/5766] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:03 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1306 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:03.936971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:03.950539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:03.962540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:03.980601 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12be72e3-5ffd-4f4b-b479-632b65489d68 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.351236 Oct 28 19:41:03.988177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2876/5767] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:03 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:04.881162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:04.881812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:04.902727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:04.907345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:04.923024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:04.924182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:04.924712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:04.930739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:05.011792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:05.012936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:05.094313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:05.094878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:05.107380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:05.118414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:05.127140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:05.127732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:05.347695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:05.364988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:05.366457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:05.386910 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d105962d-b82e-4897-ad64-4f3894da9732 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.360765 Oct 28 19:41:05.389767 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2877/5768] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:05 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:41:05.905889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:05.915607 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b46f8aab-bc38-4332-ad47-9a7473deef58 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 1.039691 Oct 28 19:41:05.920006 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2892/5769] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:04 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:06.418461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:06.420150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:06.434906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:06.453179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:06.453678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:06.454433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:06.454937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:06.455372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:06.669385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:06.682437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:06.684709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:06.686673 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85b296c8-1921-44d8-a547-1c1853dfe839 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.272200 Oct 28 19:41:06.687825 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2878/5770] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:06 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:06.955540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:06.956161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:06.964250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:06.964765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:06.965214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:06.965949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:06.966550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:06.966857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:07.713780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:07.715197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:07.726903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:07.727445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:07.739637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:07.740132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:07.744544 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c53039a-504b-43a2-9a39-9a761c11c894 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 0.796208 Oct 28 19:41:07.746120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:07.747930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2893/5771] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:06 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:07.749940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:07.754720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:07.991996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:08.008193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:08.009397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:08.015877 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-126936c5-04c7-4631-b4a9-a280dfb80e40 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.301706 Oct 28 19:41:08.027273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2879/5772] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:07 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:41:08.094516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4b321992-0f0d-4bb7-9fbb-71959ce49b29 req-fbe2bfce-fbb0-4893-a14f-c41d192561e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f53f9f-9351-4eb6-adbb-cce39896267e", "tag": "cea90001-929e-4758-8f73-2522be01e366"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:08.125188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4b321992-0f0d-4bb7-9fbb-71959ce49b29 req-fbe2bfce-fbb0-4893-a14f-c41d192561e3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:08.125188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4b321992-0f0d-4bb7-9fbb-71959ce49b29 req-fbe2bfce-fbb0-4893-a14f-c41d192561e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:08.125188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4b321992-0f0d-4bb7-9fbb-71959ce49b29 req-fbe2bfce-fbb0-4893-a14f-c41d192561e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:08.155105 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4b321992-0f0d-4bb7-9fbb-71959ce49b29 req-fbe2bfce-fbb0-4893-a14f-c41d192561e3 service nova] Creating event network-changed:cea90001-929e-4758-8f73-2522be01e366 for instance 71f53f9f-9351-4eb6-adbb-cce39896267e on n-h2-862769-3 Oct 28 19:41:08.169326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4b321992-0f0d-4bb7-9fbb-71959ce49b29 req-fbe2bfce-fbb0-4893-a14f-c41d192561e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085440 Oct 28 19:41:08.170204 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2894/5773] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:41:08.773049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:08.773728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:08.785394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:08.797724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:08.798343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:08.802882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:08.803518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:08.809635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:09.061921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:09.065420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:09.080408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:09.084620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:09.085433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:09.086513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:09.089096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:09.090190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:09.399139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:09.409295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:09.416569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:09.421876 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e843c74-e243-4c1d-a66a-84bee62bdc73 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.366985 Oct 28 19:41:09.422662 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2895/5774] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:09 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:09.484371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:09.496740 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04870c27-fafc-45f6-8e89-cf2d6aee5854 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 0.728083 Oct 28 19:41:09.497315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2880/5775] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:08 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:10.455553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:10.456224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:10.488337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:10.491201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:10.492951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:10.496314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:10.496805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:10.505909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:10.524875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:10.525541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:10.546197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:10.551059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:10.551555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:10.554028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:10.554962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:10.555438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:10.555871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:10.556004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:10.768593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:11.312802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:11.342359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:11.342359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:11.360697 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-326b7152-8b21-464c-b14d-4c8e54e6b81a tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1365 microversion: 2.47 time: 0.906352 Oct 28 19:41:11.369173 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2896/5776] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:10 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1365 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:11.941076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:11.960344 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c47d5417-67ed-43c6-82b4-f692c1c4b8d1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 1.444398 Oct 28 19:41:11.961795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2881/5777] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:10 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:12.399362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:12.400106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:12.423093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:12.446508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:12.447118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:12.449089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:12.456621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:12.457497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:12.985430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:12.986354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:13.009065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:13.009999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:13.017475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:13.031855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:13.033717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:13.034652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:13.452166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:13.467771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:13.469374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:13.470653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af75537c-d0fe-45fa-ac69-c18c4b314f13 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1371 microversion: 2.47 time: 1.075969 Oct 28 19:41:13.471252 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2897/5778] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:12 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1371 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:13.729297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:13.738771 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0672efa-d018-43bc-adef-2abc7776c92c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 0.757057 Oct 28 19:41:13.743900 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2882/5779] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:12 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:41:14.507815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:14.510843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:14.550517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:14.554097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:14.554611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:14.568794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:14.572392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:14.572896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:14.769563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:14.770383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:14.815587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:14.816122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:14.816576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:14.817340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:14.827413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:14.828083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:15.464228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:15.490004 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cff4d8d6-d2f6-4291-8b3e-d1bb1afe1f7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 0.724913 Oct 28 19:41:15.491401 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2883/5780] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:14 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:41:15.841763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:15.870708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:15.873425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:15.879855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76cbc778-75ad-4545-8f2f-9c690a09b779 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1371 microversion: 2.47 time: 1.378286 Oct 28 19:41:15.881507 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2898/5781] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:14 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1371 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:16.096248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-04a3f377-6b68-4165-9646-4a97e1bf5f56 req-0af31b59-f4c9-4158-9812-da663591143f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f53f9f-9351-4eb6-adbb-cce39896267e", "name": "network-vif-plugged", "status": "completed", "tag": "cea90001-929e-4758-8f73-2522be01e366"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:16.154647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04a3f377-6b68-4165-9646-4a97e1bf5f56 req-0af31b59-f4c9-4158-9812-da663591143f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:16.161776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04a3f377-6b68-4165-9646-4a97e1bf5f56 req-0af31b59-f4c9-4158-9812-da663591143f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:16.162237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04a3f377-6b68-4165-9646-4a97e1bf5f56 req-0af31b59-f4c9-4158-9812-da663591143f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:16.215075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-04a3f377-6b68-4165-9646-4a97e1bf5f56 req-0af31b59-f4c9-4158-9812-da663591143f service nova] Creating event network-vif-plugged:cea90001-929e-4758-8f73-2522be01e366 for instance 71f53f9f-9351-4eb6-adbb-cce39896267e on n-h2-862769-3 Oct 28 19:41:16.296605 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-04a3f377-6b68-4165-9646-4a97e1bf5f56 req-0af31b59-f4c9-4158-9812-da663591143f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201005 Oct 28 19:41:16.303358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2884/5782] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:16.535132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:16.535738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:16.542669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:16.550464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:16.551405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:16.552838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:16.555855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:16.556503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:16.907630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:16.908369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:16.926238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:16.927158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:16.927820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:16.928766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:16.931399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:16.932087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:17.110492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.156212 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f7ef17b-5cc1-4975-b709-65384301a62f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1373 microversion: 2.1 time: 0.625509 Oct 28 19:41:17.184447 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2899/5783] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:16 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1373 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:17.241968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.255067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.263820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.265378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69c9ba3b-b4ee-41f3-8341-348fd5a33f34 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1356 microversion: 2.47 time: 0.362601 Oct 28 19:41:17.266212 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2885/5784] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:16 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1356 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 19:41:17.296895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:17.302112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.308220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Searching by: {'deleted': False, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 19:41:17.346933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:17.347484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:17.347934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:17.348714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:17.349176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:17.349598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:17.530142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:41:17.726806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.753064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:17.754812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:17.755486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:17.779845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:17.818124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:18.006520 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf09a729-135b-4b17-9f08-5ad4d9926243 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.713800 Oct 28 19:41:18.007295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2900/5785] 10.222.0.44 () {60 vars in 1187 bytes} [Fri Oct 28 19:41:17 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:18.046120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:18.047006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:18.091073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.091073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.101547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.101547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.101547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.101547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.172248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:41:18.202126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:18.205418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:18.222112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.227710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.228543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.229505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.230810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.232391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.477647 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7ba4ab08-2143-4b0d-b022-c79c8fc7fd9e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "DELETE /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 204 len: 0 microversion: 2.47 time: 0.436294 Oct 28 19:41:18.481021 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2886/5786] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:41:18 2022] DELETE /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:41:18.499395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:18.500451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:18.530315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.532168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.534604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.536841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.541979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.542943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.692022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:18.706150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:18.711678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:18.713489 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22a60235-3975-4159-a885-9568a32ff67d tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1362 microversion: 2.47 time: 0.227973 Oct 28 19:41:18.714772 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2887/5787] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:18 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:18.833207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:18.853047 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a0a5c657-2f61-4998-902d-420894c2143e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1544 microversion: 2.1 time: 0.660050 Oct 28 19:41:18.856428 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2901/5788] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:18 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1544 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:18.928125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:18.931944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:18.943062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.944698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.945464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:18.946459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:18.947207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:18.947891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:19.269755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:19.283068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6481a16d-2131-4637-a049-715652cca507 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1544 microversion: 2.1 time: 0.392449 Oct 28 19:41:19.284343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2888/5789] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:18 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1544 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:19.743527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:19.744953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:19.775487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:19.779747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:19.780602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:19.780951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:19.781415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:19.781839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:20.079232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:20.096085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:20.097602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:20.098894 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-432329c9-45f2-4216-8e36-a69523e37c0e tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1362 microversion: 2.47 time: 0.359627 Oct 28 19:41:20.126858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2902/5790] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:19 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:21.130486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:21.131507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:21.174124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:21.204150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:21.206755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:21.211941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:21.213279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:21.256938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:21.355419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:21.464867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:21.475534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:21.476125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:21.476790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lazy-loading 'fault' on Instance uuid 70d39cef-adb6-40c7-8cfc-21feeb7fe79d {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:41:21.723992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:21.744063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:21.748218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:21.754584 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0723b5a6-63b8-4ca1-a76c-e4eee31224f8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 200 len: 1367 microversion: 2.47 time: 0.625840 Oct 28 19:41:21.759042 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2889/5791] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:21 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 1367 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:22.816093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:22.816867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: 70d39cef-adb6-40c7-8cfc-21feeb7fe79d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:22.838066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:22.840669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:22.841493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:22.842829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:22.846411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:22.847300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:22.890647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:22.891857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:22.905899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:22.906329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:22.907611 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] HTTP exception thrown: Instance 70d39cef-adb6-40c7-8cfc-21feeb7fe79d could not be found. Oct 28 19:41:22.910140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:22.912463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:22.913006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Request method failure captured: Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d HTTP/1.1 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDArIvSxoBYeRFyUu6dikmo8J1UpFe3sDDaoeeWj8e54TdE54pBwj0jWjHgcX-NdkHwONsyq_8dAy6ph2FvCxjMax2vb4TgZa0SWsjh8yVGoJ33u3vZOOaEnFK2zW_1yuJodXd8zsUQ0hp63TtpwJDF_KowNxtyDH3G79w_gZ3O8ZVU Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: ef8af43ff56a4aa0bed51b49ca7f920e Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerShowV247Test-1932443928 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef8af43ff56a4aa0bed51b49ca7f920e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef8af43ff56a4aa0bed51b49ca7f920e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef8af43ff56a4aa0bed51b49ca7f920e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef8af43ff56a4aa0bed51b49ca7f920e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerShowV247Test-1932443928 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: ef8af43ff56a4aa0bed51b49ca7f920e Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerShowV247Test-1932443928 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerShowV247Test-1932443928-project Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: fa2329e68d0f433d8d894fc3370978e1 Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerShowV247Test-1932443928-project Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 70d39cef-adb6-40c7-8cfc-21feeb7fe79d could not be found. Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '70d39cef-adb6-40c7-8cfc-21feeb7fe79d'} Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d39cef-adb6-40c7-8cfc-21feeb7fe79d could not be found. Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d39cef-adb6-40c7-8cfc-21feeb7fe79d could not be found. Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:22.916196 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d39cef-adb6-40c7-8cfc-21feeb7fe79d could not be found. Oct 28 19:41:22.921860 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:22.923788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:22.932408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Returning 404 to user: Instance 70d39cef-adb6-40c7-8cfc-21feeb7fe79d could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:41:22.947292 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41ce7653-5920-4945-9bcb-c529091a8ab8 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d" status: 404 len: 111 microversion: 2.47 time: 0.134596 Oct 28 19:41:22.953579 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2903/5792] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:22 2022] GET /compute/v2.1/servers/70d39cef-adb6-40c7-8cfc-21feeb7fe79d => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:41:22.989204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:22.993753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:23.029828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.033824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.036030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.043828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.046074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.048164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.164041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:41:23.288983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lazy-loading 'services' on Instance uuid d129f066-1385-40ad-b1d6-de5c424cbf2a {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:41:23.539077 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1ab909ed-4c73-40ba-8130-d26cd56c70f2 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments/a5744430-a86c-4c8d-96f5-bc11cfdc0cb3" status: 202 len: 0 microversion: 2.1 time: 0.653368 Oct 28 19:41:23.540275 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2890/5793] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:41:22 2022] DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments/a5744430-a86c-4c8d-96f5-bc11cfdc0cb3 => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:41:23.543378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=44 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:23.571279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:23.596119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:23.632005 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ee6650b-f263-49d6-9ae1-23376b141da1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d" status: 204 len: 0 microversion: 2.47 time: 0.666913 Oct 28 19:41:23.632908 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2904/5794] 10.222.0.44 () {60 vars in 1280 bytes} [Fri Oct 28 19:41:22 2022] DELETE /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 19:41:23.662669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.671159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.673423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.688555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:23.689387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.690669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.691916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.695824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:23.748263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.754741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.755761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.760106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.764226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.765121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.895516 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f2d0e8dc-1679-4b25-99cd-0ee71516da3c tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.341159 Oct 28 19:41:23.910881 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2891/5795] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:23 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:24.120776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:24.156123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:24.174612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:24.198121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18001f50-be2a-44e0-8ca0-61a9fd89f867 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d" status: 200 len: 1362 microversion: 2.47 time: 0.545010 Oct 28 19:41:24.199746 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2905/5796] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:23 2022] GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:24.909275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:24.915282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:24.930573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:24.956576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:24.958452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:24.961199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:24.962021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:24.962520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:24.975505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:25.072193 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-793dba23-bcc9-4c52-bfad-8a909bf3745f tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167034 Oct 28 19:41:25.072744 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2892/5797] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:24 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:25.241303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:25.241970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:25.260621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:25.261628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:25.262301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:25.263488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:25.265856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:25.266522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:26.011877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:26.040726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:26.044550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa2329e68d0f433d8d894fc3370978e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8af43ff56a4aa0bed51b49ca7f920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:26.047441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4099c319-9a27-4d0c-a8ed-5a03d705f2e1 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d" status: 200 len: 1362 microversion: 2.47 time: 0.820009 Oct 28 19:41:26.052163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2906/5798] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:25 2022] GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 19:41:26.085972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:26.088549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:26.112444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:26.113290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:26.113942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:26.116357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:26.117905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:26.120203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:26.213974 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f50796a7-2b59-4f83-b822-cb9959a8fb06 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133003 Oct 28 19:41:26.214936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2893/5799] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:26 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:26.559354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-061b2532-16c7-42b2-984a-0d8b10addd71 req-e79a4dbd-e6b1-41fd-82b7-05484353ba1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f53f9f-9351-4eb6-adbb-cce39896267e", "tag": "cea90001-929e-4758-8f73-2522be01e366"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:26.588002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-061b2532-16c7-42b2-984a-0d8b10addd71 req-e79a4dbd-e6b1-41fd-82b7-05484353ba1e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:26.588507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-061b2532-16c7-42b2-984a-0d8b10addd71 req-e79a4dbd-e6b1-41fd-82b7-05484353ba1e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:26.589828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-061b2532-16c7-42b2-984a-0d8b10addd71 req-e79a4dbd-e6b1-41fd-82b7-05484353ba1e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:26.617121 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-061b2532-16c7-42b2-984a-0d8b10addd71 req-e79a4dbd-e6b1-41fd-82b7-05484353ba1e service nova] Creating event network-changed:cea90001-929e-4758-8f73-2522be01e366 for instance 71f53f9f-9351-4eb6-adbb-cce39896267e on n-h2-862769-3 Oct 28 19:41:26.633058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-061b2532-16c7-42b2-984a-0d8b10addd71 req-e79a4dbd-e6b1-41fd-82b7-05484353ba1e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108911 Oct 28 19:41:26.634451 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2907/5800] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:41:27.083388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:27.085375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] [instance: b3f8a52f-590d-4852-99dd-3b060956ef2d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:27.108688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:27.109931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:27.110535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:27.111674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:27.112329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:27.114608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:27.209477 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] HTTP exception thrown: Instance b3f8a52f-590d-4852-99dd-3b060956ef2d could not be found. Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Request method failure captured: Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d HTTP/1.1 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDArIvSxoBYeRFyUu6dikmo8J1UpFe3sDDaoeeWj8e54TdE54pBwj0jWjHgcX-NdkHwONsyq_8dAy6ph2FvCxjMax2vb4TgZa0SWsjh8yVGoJ33u3vZOOaEnFK2zW_1yuJodXd8zsUQ0hp63TtpwJDF_KowNxtyDH3G79w_gZ3O8ZVU Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ef8af43ff56a4aa0bed51b49ca7f920e Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerShowV247Test-1932443928 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef8af43ff56a4aa0bed51b49ca7f920e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef8af43ff56a4aa0bed51b49ca7f920e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef8af43ff56a4aa0bed51b49ca7f920e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef8af43ff56a4aa0bed51b49ca7f920e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerShowV247Test-1932443928 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ef8af43ff56a4aa0bed51b49ca7f920e Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerShowV247Test-1932443928 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerShowV247Test-1932443928-project Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: fa2329e68d0f433d8d894fc3370978e1 Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerShowV247Test-1932443928-project Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance b3f8a52f-590d-4852-99dd-3b060956ef2d could not be found. Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'b3f8a52f-590d-4852-99dd-3b060956ef2d'} Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f8a52f-590d-4852-99dd-3b060956ef2d could not be found. Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f8a52f-590d-4852-99dd-3b060956ef2d could not be found. Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:27.228156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f8a52f-590d-4852-99dd-3b060956ef2d could not be found. Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] Returning 404 to user: Instance b3f8a52f-590d-4852-99dd-3b060956ef2d could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:41:27.233142 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4a1e091-3076-4c29-8dd6-7a1a68d6c0b5 tempest-ServerShowV247Test-1932443928 tempest-ServerShowV247Test-1932443928-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d" status: 404 len: 111 microversion: 2.47 time: 0.151583 Oct 28 19:41:27.250051 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2894/5801] 10.222.0.44 () {60 vars in 1277 bytes} [Fri Oct 28 19:41:27 2022] GET /compute/v2.1/servers/b3f8a52f-590d-4852-99dd-3b060956ef2d => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:41:27.259373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:27.262142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:27.295482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:27.304199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:27.305923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:27.308144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:27.310003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:27.313604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:27.478400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:27.509455 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd40a0a2-dbf7-4d52-a71b-b16d2990489e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.282492 Oct 28 19:41:27.515677 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2908/5802] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:27 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:28.525125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:28.529032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:28.606982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:28.608122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:28.615999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:28.617283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:28.631578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:28.632509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:28.751338 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f5760f0c-5daa-4eeb-b53b-f60ab05038cf tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230147 Oct 28 19:41:28.754247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2895/5803] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:28 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:29.765727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:29.769250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:29.793586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:29.799890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:29.816941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:29.817608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:29.818939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:29.827357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:29.828007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:29.907088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3da7ee8-14cd-45e9-86db-4e2ffb9c15e9 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145730 Oct 28 19:41:29.911753 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2909/5804] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:29 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:30.924789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:30.927294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:30.959593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:30.960236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:30.960826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:30.961939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:30.962466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:30.962959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:31.078622 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff88101b-3dae-4583-9df9-2239e606d833 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157168 Oct 28 19:41:31.079304 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2896/5805] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:30 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:32.092861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:32.096744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:32.115570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:32.118166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:32.121402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:32.122560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:32.123372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:32.127292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:32.213262 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9d81afe9-d13e-4ada-9d07-d861cc042735 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122492 Oct 28 19:41:32.216454 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2910/5806] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:32 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:33.226796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:33.236779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:33.282000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:33.283868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:33.284965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:33.286582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:33.288321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:33.289607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:33.377903 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-93bed497-b0e5-4355-accc-4a4754d994f8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155021 Oct 28 19:41:33.381119 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2897/5807] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:33 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:34.392266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:34.395043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:34.424387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:34.426582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:34.428511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:34.430171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:34.431397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:34.433376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:34.555471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:34.586991 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e21982a-6f4c-4ae2-ae7e-4f13736e6871 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187511 Oct 28 19:41:34.588912 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2911/5808] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:34 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:35.602412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:35.604854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:35.651603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:35.652247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:35.652678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:35.653466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:35.653971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:35.654419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:35.758898 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5922a05d-1d1a-45a6-8e8a-be597ffd88a8 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.161711 Oct 28 19:41:35.768962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2898/5809] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 19:41:35 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:41:35.914225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:35.914974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:35.922032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:35.922522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:35.935299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:35.936722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:35.937607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:35.938240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:35.993450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:41:36.161525 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2dd0254d-09e7-487f-9757-333b3130eb33 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 204 len: 0 microversion: 2.1 time: 0.257438 Oct 28 19:41:36.167195 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2912/5810] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:41:35 2022] DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:41:36.173077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:36.174356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:36.193794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:36.197543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:36.200824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:36.205364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:36.207414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:36.212976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:36.681591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:36.708520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38fce80e-1d39-4536-9298-60838c6b1367 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1682 microversion: 2.1 time: 0.540150 Oct 28 19:41:36.713224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2899/5811] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:36 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1682 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:37.751960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:37.753848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:37.776449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:37.778901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:37.779511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:37.787869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:37.789180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:37.790113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:38.177619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:38.208878 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf262813-96db-4d7f-a57a-95b62001db91 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1682 microversion: 2.1 time: 0.468887 Oct 28 19:41:38.209488 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2913/5812] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:37 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1682 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:39.238109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:39.238787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:39.250636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:39.251175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:39.251720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:39.255162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:39.255946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:39.257323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:39.626283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:39.640188 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8fd3cbdf-b208-40eb-9a6b-7d891b7c0880 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1682 microversion: 2.1 time: 0.406904 Oct 28 19:41:39.656246 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2900/5813] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:39 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1682 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:40.668273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:40.668911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:40.685958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:40.687953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:40.688676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:40.691784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:40.692513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:40.704203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:40.900835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:40.917273 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d4fb779-76c8-4e33-8391-f420848c4848 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1614 microversion: 2.1 time: 0.253543 Oct 28 19:41:40.918238 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2914/5814] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:40 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1614 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:41.535283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8d38b6a7-eefd-4293-94c7-7b2ce384c753 req-6d8d2ce5-2793-4236-84e3-b2755be652e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d129f066-1385-40ad-b1d6-de5c424cbf2a", "name": "network-vif-deleted", "tag": "d50154a6-b7d4-42ec-b7aa-13972d0bc20c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:41.564311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d38b6a7-eefd-4293-94c7-7b2ce384c753 req-6d8d2ce5-2793-4236-84e3-b2755be652e8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.565461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d38b6a7-eefd-4293-94c7-7b2ce384c753 req-6d8d2ce5-2793-4236-84e3-b2755be652e8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.584616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8d38b6a7-eefd-4293-94c7-7b2ce384c753 req-6d8d2ce5-2793-4236-84e3-b2755be652e8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:41.615862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8d38b6a7-eefd-4293-94c7-7b2ce384c753 req-6d8d2ce5-2793-4236-84e3-b2755be652e8 service nova] Creating event network-vif-deleted:d50154a6-b7d4-42ec-b7aa-13972d0bc20c for instance d129f066-1385-40ad-b1d6-de5c424cbf2a on n-h2-862769-3 Oct 28 19:41:41.627783 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8d38b6a7-eefd-4293-94c7-7b2ce384c753 req-6d8d2ce5-2793-4236-84e3-b2755be652e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096616 Oct 28 19:41:41.634854 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2901/5815] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:41.946857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:41.947464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:41.967802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.968306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.969025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:41.969786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.970217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.984195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:42.063613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:42.066043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:42.076737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:42.083115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:42.083115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:42.083115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lazy-loading 'fault' on Instance uuid d129f066-1385-40ad-b1d6-de5c424cbf2a {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:41:42.099623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:42.100520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:42.101167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:42.102795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:42.104972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:42.110300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:42.250961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da54380cca684e769986e0e0bf4602f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5840e97a4c2c4bddbfc87953cf859114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:42.253967 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-304bede1-e40a-4321-9a89-036f2dc5f6b4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e/action" status: 200 len: 24563 microversion: 2.1 time: 0.192414 Oct 28 19:41:42.264915 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2902/5816] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:41:42 2022] POST /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e/action => generated 24563 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:41:42.268733 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fea3f4fd-17c5-4602-b11a-f8483eadb283 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 200 len: 1331 microversion: 2.1 time: 0.323612 Oct 28 19:41:42.271000 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2915/5817] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:41 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 1331 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:43.295667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:43.296434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:43.332485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:43.334591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:43.335238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:43.336009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:43.342892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:43.343348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:43.379869 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a HTTP/1.1 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd129f066-1385-40ad-b1d6-de5c424cbf2a'} Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:43.384078 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:43.389423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:43.393450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:41:43.397809 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21ad304a-6b98-4531-99d9-58a17ee8f5e7 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 404 len: 111 microversion: 2.1 time: 0.108626 Oct 28 19:41:43.399805 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2903/5818] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:43 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:41:43.409673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47c4d9d5-f2a1-419b-a7a9-27e1d4414b11 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '.version_select at 0x7f1d768178b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:43.464344 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47c4d9d5-f2a1-419b-a7a9-27e1d4414b11 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768407043" status: 202 len: 0 microversion: 2.1 time: 0.059350 Oct 28 19:41:43.465470 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2916/5819] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 19:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768407043 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:41:52.003142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:52.004367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:52.038377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:52.038377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:52.038842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:52.039462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:52.039926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:52.041318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:52.073775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:52.075969 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a HTTP/1.1 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'd129f066-1385-40ad-b1d6-de5c424cbf2a'} Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:41:52.078265 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.084183 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.087062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:41:52.088178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc3f1597-eb0e-4dc1-a6a7-b466595f1f4a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 404 len: 111 microversion: 2.1 time: 0.089676 Oct 28 19:41:52.089348 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2904/5820] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:41:51 2022] DELETE /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:41:52.098479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:52.099128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: d129f066-1385-40ad-b1d6-de5c424cbf2a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:41:52.115924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:52.116770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:52.118436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:52.121417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:52.122702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:52.123331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:52.170048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a HTTP/1.1 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd129f066-1385-40ad-b1d6-de5c424cbf2a'} Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:41:52.180778 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. Oct 28 19:41:52.186678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:41:52.190209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance d129f066-1385-40ad-b1d6-de5c424cbf2a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:41:52.193746 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5f26e648-9b96-4d2f-bdf7-2cbac52a2a29 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a" status: 404 len: 111 microversion: 2.1 time: 0.099781 Oct 28 19:41:52.203308 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2917/5821] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:52 2022] GET /compute/v2.1/servers/d129f066-1385-40ad-b1d6-de5c424cbf2a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:42:00.499914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:00.500590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:00.548716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=26 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:00.555497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.556924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.559017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.561050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.564331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.565170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.653808 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 HTTP/1.1 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '5a6d8bd2-c1b2-44da-83c3-e715c16126d6'} Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:42:00.662085 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.667199 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.669845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:00.672776 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-613650d5-bb0b-428c-9c57-4839985e696e tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 404 len: 111 microversion: 2.1 time: 0.178809 Oct 28 19:42:00.675371 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2905/5822] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:42:00 2022] DELETE /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:42:00.685253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:00.686543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 5a6d8bd2-c1b2-44da-83c3-e715c16126d6] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:00.695312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:00.718680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.723987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.726771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.729431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.730133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.732938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.814247 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 HTTP/1.1 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '5a6d8bd2-c1b2-44da-83c3-e715c16126d6'} Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.833782 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. Oct 28 19:42:00.838464 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.843928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 5a6d8bd2-c1b2-44da-83c3-e715c16126d6 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:00.845584 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9efe5326-77b0-428e-a040-d03caa5eb1f6 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6" status: 404 len: 111 microversion: 2.1 time: 0.165516 Oct 28 19:42:00.847419 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2918/5823] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:00 2022] GET /compute/v2.1/servers/5a6d8bd2-c1b2-44da-83c3-e715c16126d6 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:42:00.857035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:00.857641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:00.869716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.870283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.874533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.875543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.876092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.876594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.926932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 HTTP/1.1 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '0790e724-c28e-4647-9b3a-ae5ab15cf674'} Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:42:00.931842 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.937287 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.942568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:00.945788 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3575eee8-44c9-4311-b0cf-3d835160752a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 404 len: 111 microversion: 2.1 time: 0.093612 Oct 28 19:42:00.947273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2906/5824] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:42:00 2022] DELETE /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:42:00.956313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:00.957357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 0790e724-c28e-4647-9b3a-ae5ab15cf674] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:00.965827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.966814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.967702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.968789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:00.969510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:00.970286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:00.988827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 HTTP/1.1 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '0790e724-c28e-4647-9b3a-ae5ab15cf674'} Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:00.990889 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. Oct 28 19:42:00.997122 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:00.999970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 0790e724-c28e-4647-9b3a-ae5ab15cf674 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:01.001157 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b084069a-4faa-4e33-9cea-d8836ed8ad8a tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674" status: 404 len: 111 microversion: 2.1 time: 0.050326 Oct 28 19:42:01.001951 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2919/5825] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:00 2022] GET /compute/v2.1/servers/0790e724-c28e-4647-9b3a-ae5ab15cf674 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:42:01.384954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa95b29a-e7f9-46bb-86e0-d75cae08af7c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'create', calling method: .version_select at 0x7f1d7783bca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1097712321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJE906/BkcWB0eyWTVYQZQ0YEetftTRoODeKFDir5GYitHV7ym7ZUYuzFENBlzJ79ET6BnS7qsXJz/ly2fY1/qtWXeduihnFrm2jsEKpm8oUBWeX7z6OLRAwlOh15IxWCg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:42:01.441798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-fa95b29a-e7f9-46bb-86e0-d75cae08af7c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:42:01.476738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-fa95b29a-e7f9-46bb-86e0-d75cae08af7c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for user e1acfd8db9c04d8eb136ea3c7215a34b and project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:42:01.558478 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa95b29a-e7f9-46bb-86e0-d75cae08af7c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.178877 Oct 28 19:42:01.560280 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2907/5826] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:42:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:04.671494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-586542744", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "6b20cdbb-5b8a-4d1f-8cd1-69eb67fce858"}], "key_name": "tempest-TestNetworkBasicOps-1097712321", "security_groups": [{"name": "tempest-secgroup-smoke-253000078"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:42:05.103823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] validate_networks() for [('6b20cdbb-5b8a-4d1f-8cd1-69eb67fce858', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:42:06.700328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:42:06.700943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:42:06.701225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:42:06.701636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:42:06.702048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:42:06.721067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:06.721565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:06.721988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:06.722765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:06.723223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:06.743334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:06.783925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:06.832567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:42:06.847401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for user e1acfd8db9c04d8eb136ea3c7215a34b and project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:42:06.895886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:42:06.898351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:42:07.121008 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f2a6626-cbaa-46a8-a0de-b3cfd341212c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.454071 Oct 28 19:42:07.134137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a7fc47bf-813b-4ae5-9a15-70a7799ca939 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:07.135476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a7fc47bf-813b-4ae5-9a15-70a7799ca939 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:07.147677 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2920/5827] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:42:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:42:07.323912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a7fc47bf-813b-4ae5-9a15-70a7799ca939 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:07.334836 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a7fc47bf-813b-4ae5-9a15-70a7799ca939 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1248 microversion: 2.1 time: 0.205644 Oct 28 19:42:07.335449 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2908/5828] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:07 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1248 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:08.357967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-47584526-d083-462f-8429-5eaef3027eea tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:08.359364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-47584526-d083-462f-8429-5eaef3027eea tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:08.559972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-47584526-d083-462f-8429-5eaef3027eea tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:08.570632 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-47584526-d083-462f-8429-5eaef3027eea tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1248 microversion: 2.1 time: 0.216765 Oct 28 19:42:08.583438 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2921/5829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:08 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1248 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:09.608783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:09.609662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:09.642027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:09.646627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:09.648200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:09.656524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:09.658530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:09.660687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:10.213955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:10.261779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee52472c-470d-4042-9db6-f5e5749c8756 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1308 microversion: 2.1 time: 0.655153 Oct 28 19:42:10.263184 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2909/5830] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:09 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1308 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:10.394922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:10.395621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:10.433779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:10.441216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:10.441835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:10.444787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:10.445567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:10.449756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:10.508603 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e HTTP/1.1 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '67789fc5-c44b-4f0e-819d-fa93970cad4e'} Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:42:10.510235 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.515942 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.519392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:10.520479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a8240431-7158-46db-b073-ba1c051005ff tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 404 len: 111 microversion: 2.1 time: 0.130812 Oct 28 19:42:10.533954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2922/5831] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:42:10 2022] DELETE /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:42:10.543990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:10.545415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] [instance: 67789fc5-c44b-4f0e-819d-fa93970cad4e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:10.554749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:10.555527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:10.556654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:10.558011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:10.558846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:10.559545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:10.579765 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] HTTP exception thrown: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Request method failure captured: Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e HTTP/1.1 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC7UxNRXAgBmX9-n_oxrDZfsO667F-iydAZV7v4LFjqaSFlIoFIwypKWID11Rgbz4R-K1nULKHsUvoOgeo_59wio0tShEYdAyK3pyy-Wx2Kb1RZTpc4VMxCm3Z8635xjSAnijzEtO3S9lek3hI4bexL9OoeHusablxKln5G1T-se7F4 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5840e97a4c2c4bddbfc87953cf859114", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5840e97a4c2c4bddbfc87953cf859114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5840e97a4c2c4bddbfc87953cf859114 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881295283 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: da54380cca684e769986e0e0bf4602f7 Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-AttachVolumeNegativeTest-1881295283-project Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '67789fc5-c44b-4f0e-819d-fa93970cad4e'} Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:10.581940 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. Oct 28 19:42:10.588606 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:42:10.591316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] Returning 404 to user: Instance 67789fc5-c44b-4f0e-819d-fa93970cad4e could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:10.592449 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68052de0-8402-46a4-ae8d-569bda222281 tempest-AttachVolumeNegativeTest-1881295283 tempest-AttachVolumeNegativeTest-1881295283-project] 10.222.0.44 "GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e" status: 404 len: 111 microversion: 2.1 time: 0.054277 Oct 28 19:42:10.606253 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2910/5832] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:10 2022] GET /compute/v2.1/servers/67789fc5-c44b-4f0e-819d-fa93970cad4e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:42:11.291892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:11.292575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:11.305430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:11.305943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:11.311906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:11.315327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:11.315825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:11.316268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:11.663876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:11.675340 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-90d215aa-66ab-4834-8b23-3bfb906eff96 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1306 microversion: 2.1 time: 0.389667 Oct 28 19:42:11.699500 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2923/5833] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:11 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1306 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:12.711463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:12.712860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:12.729596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:12.739974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:12.740935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:12.742233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:12.743363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:12.744074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:13.518086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:13.533691 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3917528-3cfa-4f0e-b1a3-ef137b99475e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.822952 Oct 28 19:42:13.539158 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2911/5834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:12 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:14.563102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:14.563739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:14.581963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:14.584103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:14.584549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:14.585294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:14.590025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:14.590451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:15.247058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:15.267362 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa827322-df8b-4720-9476-86d89e3e0fe9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.710123 Oct 28 19:42:15.281044 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2924/5835] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:14 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:15.838156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4367ead2-3030-42c1-a114-6f7b23f4172b req-84dd3cb4-02c0-427b-bdbd-03aa3ed4280c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332ab4f3-adb2-439f-bcdd-363c81dd50a4", "tag": "b3baf22d-0a88-4fd0-a7e8-142136414afd"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:42:15.867559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4367ead2-3030-42c1-a114-6f7b23f4172b req-84dd3cb4-02c0-427b-bdbd-03aa3ed4280c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:15.868057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4367ead2-3030-42c1-a114-6f7b23f4172b req-84dd3cb4-02c0-427b-bdbd-03aa3ed4280c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:15.888145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4367ead2-3030-42c1-a114-6f7b23f4172b req-84dd3cb4-02c0-427b-bdbd-03aa3ed4280c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:15.944572 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4367ead2-3030-42c1-a114-6f7b23f4172b req-84dd3cb4-02c0-427b-bdbd-03aa3ed4280c service nova] Creating event network-changed:b3baf22d-0a88-4fd0-a7e8-142136414afd for instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 on n-h1-862769-3 Oct 28 19:42:15.959048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4367ead2-3030-42c1-a114-6f7b23f4172b req-84dd3cb4-02c0-427b-bdbd-03aa3ed4280c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124022 Oct 28 19:42:15.960604 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2912/5836] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:16.297260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:16.297888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:16.317892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:16.318472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:16.318962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:16.319722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:16.320184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:16.326793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:16.785382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:16.948757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:16.960996 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c46fbcd2-cbfc-4af5-bc57-ed08de722e52 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.666007 Oct 28 19:42:16.961770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2925/5837] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:16 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:17.990284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:17.991129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:17.994364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:18.024337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:18.024987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:18.030916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:18.031898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:18.036626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:18.044004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:18.736671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:18.758979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6292ccf-b26d-4f25-a11f-f64bbc5a7ddd tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.773627 Oct 28 19:42:18.760023 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2913/5838] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:17 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:19.783771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:19.784546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:19.808907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:19.810661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:19.811202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:19.811668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:19.812429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:19.812890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:19.813321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:20.569539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:20.579926 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8bc7b165-4ddb-40d2-82b7-bf0d9d106cb9 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.800198 Oct 28 19:42:20.584831 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2926/5839] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:19 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:21.610246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:21.612080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:21.625465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:21.627834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:21.630333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:21.632987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:21.633615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:21.635408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:22.020894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:22.056834 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6065ce43-c507-4a63-b233-b3c29deef3e2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.451030 Oct 28 19:42:22.058014 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2914/5840] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:21 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:23.094450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:23.095258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:23.120913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:23.122334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:23.123054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:23.124438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:23.125547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:23.133365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:23.926836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:23.937777 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-46c20e96-1078-4b66-a6a3-37f1743ca2f8 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.856340 Oct 28 19:42:23.938378 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2927/5841] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:23 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:24.982348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:24.984380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:25.027462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:25.027970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:25.034094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:25.038078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:25.038849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:25.043980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:25.828699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:25.845739 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9cf0a3b-c327-4181-b897-5408344a8e7a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.882151 Oct 28 19:42:25.849712 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2915/5842] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:24 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:25.930048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d17b7920-62a0-4d90-b95b-f1a8f7c610c9 req-e7add583-d460-44c8-9e0b-8d03e61c8427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332ab4f3-adb2-439f-bcdd-363c81dd50a4", "name": "network-vif-plugged", "status": "completed", "tag": "b3baf22d-0a88-4fd0-a7e8-142136414afd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:42:25.952390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d17b7920-62a0-4d90-b95b-f1a8f7c610c9 req-e7add583-d460-44c8-9e0b-8d03e61c8427 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:25.952903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d17b7920-62a0-4d90-b95b-f1a8f7c610c9 req-e7add583-d460-44c8-9e0b-8d03e61c8427 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:25.953345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d17b7920-62a0-4d90-b95b-f1a8f7c610c9 req-e7add583-d460-44c8-9e0b-8d03e61c8427 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:25.986654 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d17b7920-62a0-4d90-b95b-f1a8f7c610c9 req-e7add583-d460-44c8-9e0b-8d03e61c8427 service nova] Creating event network-vif-plugged:b3baf22d-0a88-4fd0-a7e8-142136414afd for instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 on n-h1-862769-3 Oct 28 19:42:25.993451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d17b7920-62a0-4d90-b95b-f1a8f7c610c9 req-e7add583-d460-44c8-9e0b-8d03e61c8427 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067140 Oct 28 19:42:25.994734 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2928/5843] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:26.407038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-acaf1161-f95d-411f-9a83-87888a902bef tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Action: 'create', calling method: .version_select at 0x7f1d76cebdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-963097847", "metadata": {"Type": "work"}}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:42:26.894419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:26.901175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:26.923212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:26.923912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:26.929998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:26.938671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:26.938671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:26.943308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:27.305523 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-acaf1161-f95d-411f-9a83-87888a902bef tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.343158 Oct 28 19:42:27.307717 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2916/5844] 10.222.0.44 () {60 vars in 1156 bytes} [Fri Oct 28 19:42:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1346 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 28 19:42:27.321697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee5e1699-2cac-4122-803c-7932626a0e97 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d77e5f1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:27.402934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:27.422879 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee5e1699-2cac-4122-803c-7932626a0e97 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.105681 Oct 28 19:42:27.424143 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2917/5845] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:27 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:27.459694 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-96f125ad-24ff-49c1-9426-b36c633a289c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1373 microversion: 2.1 time: 0.583604 Oct 28 19:42:27.480942 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2929/5846] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:26 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1373 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:28.439987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88ac320e-8156-424e-ab10-2c8b58e2e43b tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d76b28040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:28.493412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:28.494032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:28.507843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:28.508243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:28.508682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:28.528581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:28.529182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:28.533680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:28.585693 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88ac320e-8156-424e-ab10-2c8b58e2e43b tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.151871 Oct 28 19:42:28.586516 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2918/5847] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:28 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:28.911484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:28.922938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98e34ac3-446c-484f-ac82-4f069fad717e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1545 microversion: 2.1 time: 0.433851 Oct 28 19:42:28.925999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2930/5848] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:28 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1545 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:42:28.952737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:28.954527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:42:28.968734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:28.972599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:28.982190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:28.983612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:42:28.984325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:42:28.985170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:42:29.324133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:42:29.332602 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f9e9c65-2848-416b-a357-d97a2b1fa4ad tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1545 microversion: 2.1 time: 0.384337 Oct 28 19:42:29.338447 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2919/5849] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:42:28 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1545 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:42:29.602284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17c41f8c-98e1-484c-a3c1-570a3d987cad tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d769ef160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:29.758550 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17c41f8c-98e1-484c-a3c1-570a3d987cad tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.160365 Oct 28 19:42:29.760048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2931/5850] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:29 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:30.780616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6439396-fc33-4f8a-8b3a-ef49599c2b68 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d76b283a0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:31.316742 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6439396-fc33-4f8a-8b3a-ef49599c2b68 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 353 microversion: 2.1 time: 0.539507 Oct 28 19:42:31.327571 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2920/5851] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:30 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 353 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:31.342351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48c86eee-bdab-4f25-bfea-f2d8b3b15b23 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d768705e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:31.404006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48c86eee-bdab-4f25-bfea-f2d8b3b15b23 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 353 microversion: 2.1 time: 0.075541 Oct 28 19:42:31.404884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2932/5852] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:31 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:31.421598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-408d9c62-65a0-4c19-9416-d832190878e8 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d77887ee0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:31.568356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-408d9c62-65a0-4c19-9416-d832190878e8 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 202 len: 0 microversion: 2.1 time: 0.152193 Oct 28 19:42:31.569396 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2921/5853] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 19:42:31 2022] DELETE /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:42:31.580986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-820fab38-85d2-4ee7-a5a7-846ac1949cfd tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d76b39940>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:31.669376 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-820fab38-85d2-4ee7-a5a7-846ac1949cfd tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.094307 Oct 28 19:42:31.671067 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2933/5854] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:31 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:32.696925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c19cf14d-f230-4bc9-93ff-8136d2ae2526 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d7783b1f0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:32.812115 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c19cf14d-f230-4bc9-93ff-8136d2ae2526 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.120144 Oct 28 19:42:32.813084 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2922/5855] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:32 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:33.828231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-79bd8bc7-ad90-4213-abc5-e6b36da9eac4 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d76785af0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:34.414287 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-79bd8bc7-ad90-4213-abc5-e6b36da9eac4 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.591953 Oct 28 19:42:34.422757 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2934/5856] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:33 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:35.442244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c955e855-2869-4e51-9ecb-5bd91e961181 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d76d2b310>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:35.600935 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c955e855-2869-4e51-9ecb-5bd91e961181 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 200 len: 352 microversion: 2.1 time: 0.163930 Oct 28 19:42:35.615084 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2923/5857] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:35 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:42:36.622162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-691b5bee-12c2-42fc-9b31-1f67bc5e52a9 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Calling method '.version_select at 0x7f1d76816430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:42:36.751134 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-691b5bee-12c2-42fc-9b31-1f67bc5e52a9 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] HTTP exception thrown: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-691b5bee-12c2-42fc-9b31-1f67bc5e52a9 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Request method failure captured: Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf HTTP/1.1 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDCh2uW8R_xd6WodqNjhxhgb_jqWUILuCzSNWLl-4Air36DJkHFZYcrmd-DDdHoJbL-snuP31zd3Td1K4uiLms55AuuXnT3MNsVoWj09E7UVJE1x_tHFojaOCHxBV4P57o1Z4-sidn3CaXbizXAQReHiXfW7rVysBaEb4A7T8Mfmd7E Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: dee179e4c23f406595d19a3da099c8c2 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesGetTestJSON-40366582 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/dee179e4c23f406595d19a3da099c8c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_dee179e4c23f406595d19a3da099c8c2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/dee179e4c23f406595d19a3da099c8c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/dee179e4c23f406595d19a3da099c8c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesGetTestJSON-40366582 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: dee179e4c23f406595d19a3da099c8c2 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesGetTestJSON-40366582 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesGetTestJSON-40366582-project Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 754a72d0848c4243b202a5df40c01e97 Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesGetTestJSON-40366582-project Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: method: Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: exception: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf'} Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. (HTTP 404) (Request-ID: req-6a503134-6936-4f62-925a-70703853246a) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 19:42:36.757701 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. Oct 28 19:42:36.760820 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:42:36.764957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-691b5bee-12c2-42fc-9b31-1f67bc5e52a9 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] Returning 404 to user: Volume 3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:42:36.766559 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-691b5bee-12c2-42fc-9b31-1f67bc5e52a9 tempest-VolumesGetTestJSON-40366582 tempest-VolumesGetTestJSON-40366582-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf" status: 404 len: 109 microversion: 2.1 time: 0.150178 Oct 28 19:42:36.767584 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2935/5858] 10.222.0.44 () {58 vars in 1245 bytes} [Fri Oct 28 19:42:36 2022] GET /compute/v2.1/os-volumes/3bbf10c3-5fb6-4b1d-a6ed-de2cd08ad2cf => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:43:01.382444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:01.382981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:01.388614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.392297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=45 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.416534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:01.420684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:01.421299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:01.422220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:01.423070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:01.423660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:01.500931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:43:01.684854 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-906d2a01-c2e5-4fb7-850f-3939ff28a204 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "DELETE /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 204 len: 0 microversion: 2.1 time: 0.304665 Oct 28 19:43:01.690408 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2924/5859] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:43:01 2022] DELETE /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:01.701489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:01.707029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:01.717821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.739482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=47 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.755031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:01.764601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:01.765474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:01.766007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:01.766494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:01.766955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:02.296325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:02.369811 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c73924d0-e91f-4da5-bb14-4a7a10cd258b tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1551 microversion: 2.1 time: 0.673286 Oct 28 19:43:02.401546 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2936/5860] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:01 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1551 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:03.435164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:03.440375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:03.473630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:03.480803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:03.483196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:03.486224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:03.488175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:03.491461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:05.449093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:05.461662 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0f502ef-fced-4ac2-885d-e062f0d9f372 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1551 microversion: 2.1 time: 2.041703 Oct 28 19:43:05.462269 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2925/5861] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:03 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1551 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:05.757963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Calling method '.version_select at 0x7f1d76870280>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:05.765919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:05.766419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:05.767160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:05.833256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:05.833859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:05.834310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:05.892219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:05.898900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:05.899526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:05.926650 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a9b89ab8-7790-4dfd-a0e4-bf0f1a65947b tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-658153497-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.095686 Oct 28 19:43:05.927317 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2937/5862] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:43:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:06.486623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:06.488407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:06.504434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:06.508914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:06.509955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:06.511405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:06.513281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:06.513933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:06.737211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:06.813452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f2d87f0-28d9-4ad2-8f82-4190a7a7cfb5 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1484 microversion: 2.1 time: 0.330537 Oct 28 19:43:06.823713 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2926/5863] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:06 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1484 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:06.826435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c76c6faa-aa94-404e-a36f-b5dd54e74689 req-2fac0e71-0e46-40a0-804f-57b2cf2d9213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332ab4f3-adb2-439f-bcdd-363c81dd50a4", "name": "network-vif-deleted", "tag": "b3baf22d-0a88-4fd0-a7e8-142136414afd"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:06.867289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c76c6faa-aa94-404e-a36f-b5dd54e74689 req-2fac0e71-0e46-40a0-804f-57b2cf2d9213 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:06.868455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c76c6faa-aa94-404e-a36f-b5dd54e74689 req-2fac0e71-0e46-40a0-804f-57b2cf2d9213 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:06.872595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c76c6faa-aa94-404e-a36f-b5dd54e74689 req-2fac0e71-0e46-40a0-804f-57b2cf2d9213 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:06.932263 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c76c6faa-aa94-404e-a36f-b5dd54e74689 req-2fac0e71-0e46-40a0-804f-57b2cf2d9213 service nova] Creating event network-vif-deleted:b3baf22d-0a88-4fd0-a7e8-142136414afd for instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 on n-h1-862769-3 Oct 28 19:43:06.955305 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c76c6faa-aa94-404e-a36f-b5dd54e74689 req-2fac0e71-0e46-40a0-804f-57b2cf2d9213 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142540 Oct 28 19:43:06.956490 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2938/5864] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:07.852108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:07.854494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:07.879887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:07.885303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:07.886085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:07.889522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:07.893942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:07.895089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:08.049308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:08.053224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:08.057225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:08.058094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lazy-loading 'fault' on Instance uuid 332ab4f3-adb2-439f-bcdd-363c81dd50a4 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:43:08.280416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:08.334092 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6726d8e-4bc5-4c9c-9fb6-e6729643df63 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 200 len: 1338 microversion: 2.1 time: 0.456738 Oct 28 19:43:08.342936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2927/5865] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:07 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 1338 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:09.401995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:09.402741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 332ab4f3-adb2-439f-bcdd-363c81dd50a4] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:09.425231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:09.425650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:09.426239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:09.428205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:09.429524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:09.431080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:09.467860 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] HTTP exception thrown: Instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 could not be found. Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Request method failure captured: Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 HTTP/1.1 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDAyazqOc0tlIPi8VTr3-if-olnCoy5o8-c_wEaPbV10jHWMIIneq4UaDcAbppfG1ao7poMvUDmaiIYoPva6_HkRI_9cZvJKwkgTpDR4S1-K3YfXZuV9yOWrgeuVpk_386570Zhsrgj0A6ma-Y8K9ZmlxFJtjm-0c_r8dsFQeS389BU Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1a49d2e64df444e8ac9c997ef2b5d381 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestNetworkBasicOps-529356868 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1a49d2e64df444e8ac9c997ef2b5d381", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestNetworkBasicOps-529356868 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1a49d2e64df444e8ac9c997ef2b5d381 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestNetworkBasicOps-529356868 Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestNetworkBasicOps-529356868-project Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: e1acfd8db9c04d8eb136ea3c7215a34b Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestNetworkBasicOps-529356868-project Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 could not be found. Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '332ab4f3-adb2-439f-bcdd-363c81dd50a4'} Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 could not be found. Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 could not be found. Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:09.473521 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 could not be found. Oct 28 19:43:09.477008 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:43:09.481013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Returning 404 to user: Instance 332ab4f3-adb2-439f-bcdd-363c81dd50a4 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:43:09.488097 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-13909a4a-99e8-4b1c-8ef1-a75be2a968f2 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4" status: 404 len: 111 microversion: 2.1 time: 0.093074 Oct 28 19:43:09.499712 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2939/5866] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:09 2022] GET /compute/v2.1/servers/332ab4f3-adb2-439f-bcdd-363c81dd50a4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:43:10.272281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f658a6a4-3b2b-4470-aecd-b2ac3744c7c3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '.version_select at 0x7f1d77efcdc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:10.325298 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f658a6a4-3b2b-4470-aecd-b2ac3744c7c3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1097712321" status: 202 len: 0 microversion: 2.1 time: 0.056763 Oct 28 19:43:10.326520 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2928/5867] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 19:43:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1097712321 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:43:19.116968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:19.117882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:19.139276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:19.139785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:19.140243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:19.140968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:19.141442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:19.141857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:19.171559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:19.181134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-be2cc6f2-b5ae-4380-b241-45b9b566512c req-2d33af03-4d9f-4cc6-9615-86dd79ed42fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f53f9f-9351-4eb6-adbb-cce39896267e", "tag": "cea90001-929e-4758-8f73-2522be01e366"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:19.219818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be2cc6f2-b5ae-4380-b241-45b9b566512c req-2d33af03-4d9f-4cc6-9615-86dd79ed42fb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:19.220317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be2cc6f2-b5ae-4380-b241-45b9b566512c req-2d33af03-4d9f-4cc6-9615-86dd79ed42fb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:19.220748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-be2cc6f2-b5ae-4380-b241-45b9b566512c req-2d33af03-4d9f-4cc6-9615-86dd79ed42fb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:19.268975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-be2cc6f2-b5ae-4380-b241-45b9b566512c req-2d33af03-4d9f-4cc6-9615-86dd79ed42fb service nova] Creating event network-changed:cea90001-929e-4758-8f73-2522be01e366 for instance 71f53f9f-9351-4eb6-adbb-cce39896267e on n-h2-862769-3 Oct 28 19:43:19.292637 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-be2cc6f2-b5ae-4380-b241-45b9b566512c req-2d33af03-4d9f-4cc6-9615-86dd79ed42fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122682 Oct 28 19:43:19.294089 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2929/5868] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 28 19:43:19.304738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:43:19.537097 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aafeda12-0595-413c-9b5e-228999f07ac3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "DELETE /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 204 len: 0 microversion: 2.1 time: 0.434443 Oct 28 19:43:19.547100 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2940/5869] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:43:19 2022] DELETE /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:19.557171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:19.558505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:19.593288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:19.595635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:19.598211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:19.601310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:19.607056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:19.607619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:20.233849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:20.251133 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b82967b5-ae8f-46d4-bcde-769f7e840bdc tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1668 microversion: 2.1 time: 0.698778 Oct 28 19:43:20.252091 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2930/5870] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:19 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1668 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:21.286122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:21.287482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:21.304882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:21.305680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:21.306580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:21.307615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:21.310455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:21.313312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:22.421171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:22.430145 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af7458a4-5338-4dc8-9606-338f29a06449 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1668 microversion: 2.1 time: 1.148489 Oct 28 19:43:22.439553 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2941/5871] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:21 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1668 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:43:23.487769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:23.489365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:23.502591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:23.507321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:23.508108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:23.509043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:23.519773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:23.523116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:23.573640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-850570e2-61e0-46c8-b92d-c548b73fb59d req-1f2260b7-6128-419f-ba2c-a6fcb439a465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f53f9f-9351-4eb6-adbb-cce39896267e", "name": "network-vif-unplugged", "status": "completed", "tag": "cea90001-929e-4758-8f73-2522be01e366"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:23.601110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-850570e2-61e0-46c8-b92d-c548b73fb59d req-1f2260b7-6128-419f-ba2c-a6fcb439a465 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:23.604023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-850570e2-61e0-46c8-b92d-c548b73fb59d req-1f2260b7-6128-419f-ba2c-a6fcb439a465 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:23.607454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-850570e2-61e0-46c8-b92d-c548b73fb59d req-1f2260b7-6128-419f-ba2c-a6fcb439a465 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:23.649902 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-850570e2-61e0-46c8-b92d-c548b73fb59d req-1f2260b7-6128-419f-ba2c-a6fcb439a465 service nova] Creating event network-vif-unplugged:cea90001-929e-4758-8f73-2522be01e366 for instance 71f53f9f-9351-4eb6-adbb-cce39896267e on n-h2-862769-3 Oct 28 19:43:23.689809 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-850570e2-61e0-46c8-b92d-c548b73fb59d req-1f2260b7-6128-419f-ba2c-a6fcb439a465 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118433 Oct 28 19:43:23.715539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2942/5872] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:24.040611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:24.055533 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5776dc68-e7f8-402c-bafb-777c764030b7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1668 microversion: 2.1 time: 0.572777 Oct 28 19:43:24.060862 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2931/5873] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:23 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1668 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:25.088990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:25.089955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:25.105288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:25.107018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:25.107554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:25.109999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:25.110544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:25.112709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:25.287097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-68605d66-786b-450e-a8a6-579e244d4e5d req-00177857-a9db-44bd-ac27-f9e7e1dfd374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f53f9f-9351-4eb6-adbb-cce39896267e", "name": "network-vif-deleted", "tag": "cea90001-929e-4758-8f73-2522be01e366"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:25.344440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-68605d66-786b-450e-a8a6-579e244d4e5d req-00177857-a9db-44bd-ac27-f9e7e1dfd374 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:25.344950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-68605d66-786b-450e-a8a6-579e244d4e5d req-00177857-a9db-44bd-ac27-f9e7e1dfd374 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:25.345391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-68605d66-786b-450e-a8a6-579e244d4e5d req-00177857-a9db-44bd-ac27-f9e7e1dfd374 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:25.398091 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-68605d66-786b-450e-a8a6-579e244d4e5d req-00177857-a9db-44bd-ac27-f9e7e1dfd374 service nova] Creating event network-vif-deleted:cea90001-929e-4758-8f73-2522be01e366 for instance 71f53f9f-9351-4eb6-adbb-cce39896267e on n-h2-862769-3 Oct 28 19:43:25.407447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-68605d66-786b-450e-a8a6-579e244d4e5d req-00177857-a9db-44bd-ac27-f9e7e1dfd374 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126156 Oct 28 19:43:25.412163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2932/5874] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:43:25.673137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:25.723618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-be5b1ea1-cf37-4024-a146-9068b1ee1263 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 200 len: 1601 microversion: 2.1 time: 0.639242 Oct 28 19:43:25.725321 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2943/5875] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:25 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 1601 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:26.760453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:26.761907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 71f53f9f-9351-4eb6-adbb-cce39896267e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:43:26.808001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:26.808503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:26.808946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:26.809679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:26.810147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:26.810578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:26.882479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] HTTP exception thrown: Instance 71f53f9f-9351-4eb6-adbb-cce39896267e could not be found. Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Request method failure captured: Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e HTTP/1.1 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDAyazqOc0tlIPi8VTr3-if-olnCoy5o8-c_wEaPbV10jHWMIIneq4UaDcAbppfG1ao7poMvUDmaiIYoPva6_HkRI_9cZvJKwkgTpDR4S1-K3YfXZuV9yOWrgeuVpk_386570Zhsrgj0A6ma-Y8K9ZmlxFJtjm-0c_r8dsFQeS389BU Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1a49d2e64df444e8ac9c997ef2b5d381 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkBasicOps-529356868 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1a49d2e64df444e8ac9c997ef2b5d381", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkBasicOps-529356868 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1a49d2e64df444e8ac9c997ef2b5d381 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkBasicOps-529356868 Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkBasicOps-529356868-project Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: e1acfd8db9c04d8eb136ea3c7215a34b Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkBasicOps-529356868-project Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 71f53f9f-9351-4eb6-adbb-cce39896267e could not be found. Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '71f53f9f-9351-4eb6-adbb-cce39896267e'} Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f53f9f-9351-4eb6-adbb-cce39896267e could not be found. Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f53f9f-9351-4eb6-adbb-cce39896267e could not be found. Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:26.884615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f53f9f-9351-4eb6-adbb-cce39896267e could not be found. Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Returning 404 to user: Instance 71f53f9f-9351-4eb6-adbb-cce39896267e could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4359e60-d599-438d-99be-81357229d26d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e" status: 404 len: 111 microversion: 2.1 time: 0.136392 Oct 28 19:43:26.893244 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2933/5876] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:26 2022] GET /compute/v2.1/servers/71f53f9f-9351-4eb6-adbb-cce39896267e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:43:28.462533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0cc2245d-634d-4734-beca-efdad1bdf5fb tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '.version_select at 0x7f1d7685b8b0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:28.612570 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0cc2245d-634d-4734-beca-efdad1bdf5fb tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1003538839" status: 202 len: 0 microversion: 2.1 time: 0.156172 Oct 28 19:43:28.626199 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2944/5877] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 19:43:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1003538839 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:44:00.331985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7f920b4-3770-4628-b2d8-3b91aee99b6e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'create', calling method: .version_select at 0x7f1d7791c0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-687950095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABN7U8DKMTq6kutqwWvx1ho26/qonoLorAkjFFcWctHffMQVPaq5NAfI0XxLoITrf4zPDZ9IXMwzC1Dmx5HdKkODrXqtlkvVwN7WV0xXwzdmbk8zED5kEIWCI7XusD57g=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:00.339246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:00.350116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=18 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:00.422736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d7f920b4-3770-4628-b2d8-3b91aee99b6e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:44:00.443495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d7f920b4-3770-4628-b2d8-3b91aee99b6e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for user e1acfd8db9c04d8eb136ea3c7215a34b and project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:44:00.546213 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7f920b4-3770-4628-b2d8-3b91aee99b6e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.205974 Oct 28 19:44:00.548452 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2934/5878] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:44:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:44:05.508688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1550021731", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "f1b1cf2e-4efc-4ee9-a65f-c1be607c78dc"}], "key_name": "tempest-TestNetworkBasicOps-687950095", "security_groups": [{"name": "tempest-secgroup-smoke-1342829703"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:05.616283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:05.620674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.293584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] validate_networks() for [('f1b1cf2e-4efc-4ee9-a65f-c1be607c78dc', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:44:08.499629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:44:08.500356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:44:08.501044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:44:08.501880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:44:08.502865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:44:08.553651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:08.555005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:08.557125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:08.560935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:08.569151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:08.574526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:08.636172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:44:08.645748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Getting quotas for user e1acfd8db9c04d8eb136ea3c7215a34b and project 1a49d2e64df444e8ac9c997ef2b5d381. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:44:08.665849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:44:08.670312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:44:08.809646 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7760d6bc-bdb5-4bf8-bf60-36e3934e64e3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.310692 Oct 28 19:44:08.810910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2945/5879] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:44:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 3313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:44:08.823003 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:44:08.823003 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 19:44:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a (ip 10.222.0.44) !!! Oct 28 19:44:08.832832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3c872e5d-e57c-4da0-8f6e-61cc5352c80e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:08.832832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3c872e5d-e57c-4da0-8f6e-61cc5352c80e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:09.118482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3c872e5d-e57c-4da0-8f6e-61cc5352c80e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:09.136853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3c872e5d-e57c-4da0-8f6e-61cc5352c80e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1248 microversion: 2.1 time: 0.318461 Oct 28 19:44:09.149444 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2935/5880] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:08 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1248 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:10.181318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a894d6f-02e8-4fe2-a2ed-ee29fc792f2e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:10.181957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a894d6f-02e8-4fe2-a2ed-ee29fc792f2e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:11.078783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a894d6f-02e8-4fe2-a2ed-ee29fc792f2e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:11.116943 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a894d6f-02e8-4fe2-a2ed-ee29fc792f2e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1248 microversion: 2.1 time: 0.940711 Oct 28 19:44:11.118997 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2946/5881] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:10 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1248 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:12.141691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c470c071-0383-4d58-b346-a3e909a5f94d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:12.142544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c470c071-0383-4d58-b346-a3e909a5f94d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:12.463352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c470c071-0383-4d58-b346-a3e909a5f94d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:12.476129 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c470c071-0383-4d58-b346-a3e909a5f94d tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1248 microversion: 2.1 time: 0.338423 Oct 28 19:44:12.483132 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2936/5882] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:12 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1248 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:13.512554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:13.513196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:13.548780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:13.552263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:13.552263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:13.559477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:13.561744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:13.562203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:13.786125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:13.799007 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-330b7f0e-aa5e-49e7-b87f-b017822dea15 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1300 microversion: 2.1 time: 0.295453 Oct 28 19:44:13.801356 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2947/5883] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:13 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:14.829396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:14.834984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:14.855601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:14.857021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:14.859161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:14.862591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:14.864272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:14.865426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:15.199487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:15.214929 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f28ebfba-ab12-4407-9a47-0457aca4f72c tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1306 microversion: 2.1 time: 0.395283 Oct 28 19:44:15.235270 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2937/5884] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:14 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:16.389808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:16.546719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:16.556467 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75fe4cd7-6d26-4f9d-9768-1a7450c23de3 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1306 microversion: 2.1 time: 0.312226 Oct 28 19:44:16.560810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2948/5885] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:16 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:17.592252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:17.594887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:17.638237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:17.639329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:17.644034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:17.645358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:17.646998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:17.649294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:18.171436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:18.203809 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f120015-54ee-4103-a543-25b87ecd61ca tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 0.618902 Oct 28 19:44:18.205058 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2938/5886] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:17 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:19.280146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:19.281172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:19.327829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.361515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:19.368852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:19.372907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:19.374805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:19.382625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:19.389235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:20.164376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:20.181148 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f836448b-62dd-438b-86d8-27dd458922a7 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 0.909563 Oct 28 19:44:20.183724 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2949/5887] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:19 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:21.252305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:21.254387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:21.280903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-30a8f786-301f-49f0-bddb-2394c30b881c req-fb75b584-e6cb-48be-bd0b-972398a9bb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b9a822-d11e-4bfc-8b10-b195c3423d1a", "tag": "23295473-fd60-40d5-ba03-d67793acb709"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:21.313154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:21.316889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:21.319626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:21.322996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:21.324062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:21.325456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:21.327984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.337299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-30a8f786-301f-49f0-bddb-2394c30b881c req-fb75b584-e6cb-48be-bd0b-972398a9bb8d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:21.344079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-30a8f786-301f-49f0-bddb-2394c30b881c req-fb75b584-e6cb-48be-bd0b-972398a9bb8d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:21.345252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-30a8f786-301f-49f0-bddb-2394c30b881c req-fb75b584-e6cb-48be-bd0b-972398a9bb8d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:21.393725 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-30a8f786-301f-49f0-bddb-2394c30b881c req-fb75b584-e6cb-48be-bd0b-972398a9bb8d service nova] Creating event network-changed:23295473-fd60-40d5-ba03-d67793acb709 for instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a on n-h1-862769-3 Oct 28 19:44:21.410836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-30a8f786-301f-49f0-bddb-2394c30b881c req-fb75b584-e6cb-48be-bd0b-972398a9bb8d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137222 Oct 28 19:44:21.415594 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2950/5888] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:44:22.471901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:22.797063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:22.816854 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6da8020c-9d83-40c2-b200-ac7fef1ec438 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 1.570784 Oct 28 19:44:22.818426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2939/5889] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:21 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:23.872831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:23.891937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:23.943490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:23.947341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:23.954291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:23.957842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:23.959874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:23.960967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:25.091512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:25.197775 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a05733a-bc3d-4f70-9461-32fd110d0c3a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 1.312744 Oct 28 19:44:25.211147 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2951/5890] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:23 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:26.257589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:26.260902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:26.334938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:26.343595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:26.344462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:26.352467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:26.353563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:26.354367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:28.456602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:28.514327 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7a97d8c4-e749-4fc1-b600-1afc75c8bc34 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 2.250408 Oct 28 19:44:28.525617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2940/5891] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:26 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:29.585761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:29.595398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:29.625788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:29.644857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:29.646042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:29.647590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:29.648652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:29.649574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:29.988642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:30.031706 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f19bcf6-1e3b-4197-b3cd-a7d47484fd82 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 0.460748 Oct 28 19:44:30.034911 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2952/5892] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:29 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:31.097327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:31.108732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:31.124453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:31.169602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:31.171240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:31.185908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:31.190400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:31.192172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:31.193675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:31.534375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:31.549910 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bf6c687-dcc1-4047-89eb-ef3dee27062e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 0.494994 Oct 28 19:44:31.556486 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2941/5893] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:31 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:32.231090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-09d8d903-8e94-467f-a9e1-2fab835ace67 req-711008f6-4003-4206-a32b-c8c65b736cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b9a822-d11e-4bfc-8b10-b195c3423d1a", "name": "network-vif-plugged", "status": "completed", "tag": "23295473-fd60-40d5-ba03-d67793acb709"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:32.247350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-09d8d903-8e94-467f-a9e1-2fab835ace67 req-711008f6-4003-4206-a32b-c8c65b736cf3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:32.253215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-09d8d903-8e94-467f-a9e1-2fab835ace67 req-711008f6-4003-4206-a32b-c8c65b736cf3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:32.257004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-09d8d903-8e94-467f-a9e1-2fab835ace67 req-711008f6-4003-4206-a32b-c8c65b736cf3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:32.284864 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-09d8d903-8e94-467f-a9e1-2fab835ace67 req-711008f6-4003-4206-a32b-c8c65b736cf3 service nova] Creating event network-vif-plugged:23295473-fd60-40d5-ba03-d67793acb709 for instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a on n-h1-862769-3 Oct 28 19:44:32.303620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-09d8d903-8e94-467f-a9e1-2fab835ace67 req-711008f6-4003-4206-a32b-c8c65b736cf3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.471002 Oct 28 19:44:32.304804 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2953/5894] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:44:32.584633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:32.585791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:32.689792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:32.697591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:32.698393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:32.704875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:32.707777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:32.710947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:33.296879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:33.309003 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b67cada9-d9f8-424c-86b1-fae09a111ea1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1374 microversion: 2.1 time: 0.732223 Oct 28 19:44:33.314410 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2942/5895] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:32 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1374 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:34.362496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:34.363740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:34.385620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:34.388883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:34.391942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:34.395488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:34.397131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:34.400113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:35.420705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:35.446024 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-927fcfac-05d9-4e0f-9165-da0c30638ac4 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1547 microversion: 2.1 time: 1.093433 Oct 28 19:44:35.449528 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2954/5896] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:34 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1547 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:44:35.493477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:35.501351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:35.552976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:35.567186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:35.575860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:35.577366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:35.578480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:35.579422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:36.682960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Calling method '.version_select at 0x7f1d76ab4430>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:36.685375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:36.686771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:36.686771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:36.722487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=43 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:36.732554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:36.759613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:36.760108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:36.760545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:36.792773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:36.793616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:36.794333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:36.803229 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b146145-5f83-4419-b235-1d0e402637eb tempest-PortsAdminExtendedAttrsTestJSON-25459018 tempest-PortsAdminExtendedAttrsTestJSON-25459018-project-admin] 10.222.0.44 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.523317 Oct 28 19:44:36.804183 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2955/5897] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 19:44:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:44:36.818615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:36.861844 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-74c1b24b-a955-4d41-aec3-49b3987bce84 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1547 microversion: 2.1 time: 1.390560 Oct 28 19:44:36.864282 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2943/5898] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:35 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1547 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:44.112700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f0fb8a08-79e4-48ed-8292-423a6f96ffa7 req-3f340aa8-53b8-485d-b80c-915936ccb49c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b9a822-d11e-4bfc-8b10-b195c3423d1a", "tag": "23295473-fd60-40d5-ba03-d67793acb709"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:44.185875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f0fb8a08-79e4-48ed-8292-423a6f96ffa7 req-3f340aa8-53b8-485d-b80c-915936ccb49c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:44.189641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f0fb8a08-79e4-48ed-8292-423a6f96ffa7 req-3f340aa8-53b8-485d-b80c-915936ccb49c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:44.193665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f0fb8a08-79e4-48ed-8292-423a6f96ffa7 req-3f340aa8-53b8-485d-b80c-915936ccb49c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:44.228436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f0fb8a08-79e4-48ed-8292-423a6f96ffa7 req-3f340aa8-53b8-485d-b80c-915936ccb49c service nova] Creating event network-changed:23295473-fd60-40d5-ba03-d67793acb709 for instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a on n-h1-862769-3 Oct 28 19:44:44.242526 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f0fb8a08-79e4-48ed-8292-423a6f96ffa7 req-3f340aa8-53b8-485d-b80c-915936ccb49c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329792 Oct 28 19:44:44.244955 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2956/5899] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:44:48.918354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bcd5f06e-76f0-460d-81fa-ce242cd527ba tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Action: 'create', calling method: .version_select at 0x7f1d7783b040>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2114601044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGka3IcjC0HQgTju+SiLJorfcAp6xmNPQu+7qETfyDv8GowsHXoUaLcS+MISgY0Sz9FLMceAoaPjcTC7LaEq3Lmd7SltZky6kfVnfqwB+tFnHwEOMFMHNoBLpZXTByGZnw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:48.930471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=5 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:48.931616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=42 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:48.945784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bcd5f06e-76f0-460d-81fa-ce242cd527ba tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Getting quotas for project 52f7c611e4c748248588ce42eb648483. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:44:48.956025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-bcd5f06e-76f0-460d-81fa-ce242cd527ba tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Getting quotas for user a78658b4530542029393f0d81c5d3d3a and project 52f7c611e4c748248588ce42eb648483. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:44:49.028536 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bcd5f06e-76f0-460d-81fa-ce242cd527ba tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114679 Oct 28 19:44:49.029447 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2944/5900] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:44:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:44:51.556175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1740002220", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0cba7b9c-483b-4201-b8d4-26ece4975f13", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2114601044", "security_groups": [{"name": "tempest-secgroup-smoke-53707040"}], "networks": [{"uuid": "cbe59e43-5b06-4287-a89e-e9e29921480a"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:44:51.786549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] validate_networks() for [('cbe59e43-5b06-4287-a89e-e9e29921480a', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:44:53.273141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:44:53.274153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:44:53.274153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:44:53.275518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:44:53.275967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:44:53.294619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:53.295663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:53.296271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:53.297218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:53.297998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:53.298595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:53.331131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Getting quotas for project 52f7c611e4c748248588ce42eb648483. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:44:53.339974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Getting quotas for user a78658b4530542029393f0d81c5d3d3a and project 52f7c611e4c748248588ce42eb648483. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:44:53.462476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:44:53.465902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cba7b9c-483b-4201-b8d4-26ece4975f13',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:44:53.773782 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fb902d3-9504-48a0-aedf-469e1c1d2e54 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.224151 Oct 28 19:44:53.776511 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2957/5901] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:44:51 2022] POST /compute/v2.1/servers => generated 404 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:44:53.792087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ebc913fa-17aa-44dd-acef-7d9d2c528f15 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:53.792906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ebc913fa-17aa-44dd-acef-7d9d2c528f15 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:53.915940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ebc913fa-17aa-44dd-acef-7d9d2c528f15 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:53.939466 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ebc913fa-17aa-44dd-acef-7d9d2c528f15 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1099 microversion: 2.1 time: 0.148190 Oct 28 19:44:53.946874 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2945/5902] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:53 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1099 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:44:54.973804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:54.976914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:54.989888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:54.990775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:54.993665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:54.993665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:54.993665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:54.996276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:55.138674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:55.152085 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a93aec08-f545-4e9c-9fb4-8c1379a1bfc6 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1149 microversion: 2.1 time: 0.183074 Oct 28 19:44:55.153473 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2958/5903] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:54 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1149 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:56.183293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:56.183838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:56.193148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:56.193862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:56.194496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:56.195332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:56.195816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:56.196346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:56.279472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:56.291047 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d059e4cf-a77c-4284-a90d-dc4aa5e798d9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1215 microversion: 2.1 time: 0.113361 Oct 28 19:44:56.304052 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2946/5904] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:56 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:57.338748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:57.349418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:57.379884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:57.381920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:57.383386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:57.385117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:57.386435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:57.387658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:57.654325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:57.723289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c80d202-7ef9-4475-b28d-fdd238e5b872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1215 microversion: 2.1 time: 0.405984 Oct 28 19:44:57.756071 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2959/5905] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:57 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:58.779366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:44:58.780244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:44:58.797510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:58.798064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:58.798510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:58.799367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:44:58.799925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:44:58.800271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:44:59.074870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:44:59.083436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dca38a6f-5579-4315-86f3-c395b44ce92a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1215 microversion: 2.1 time: 0.308221 Oct 28 19:44:59.093828 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2947/5906] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:44:58 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:00.138855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:00.142246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:00.192252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:00.195649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:00.198360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:00.202894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:00.213057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:00.214343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:00.949761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:00.981358 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b867bf81-0cbe-4959-83cf-4e6ba30c8222 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1281 microversion: 2.1 time: 0.845253 Oct 28 19:45:00.995437 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2960/5907] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:00 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1281 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:01.315475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:01.344756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:01.388175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:01.401439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:01.403786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:01.406530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:01.410236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:01.415563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:01.629428 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d411681-7d04-457c-95f7-c2165fdd820a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a/action" status: 200 len: 24570 microversion: 2.1 time: 0.314904 Oct 28 19:45:01.646202 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2948/5908] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:45:01 2022] POST /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a/action => generated 24570 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:45:02.039959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:02.042434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:02.056586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:02.057799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:02.058311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:02.059415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:02.059991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:02.062595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:03.139087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:03.159741 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e29444d-3ab7-4642-98c6-c7e6ce934da4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1281 microversion: 2.1 time: 1.118485 Oct 28 19:45:03.161910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2961/5909] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:02 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1281 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:45:04.192530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:04.346522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-86f198db-1e0f-4bb6-a918-391838095b7b req-266475c4-bfed-423a-bb29-9cfc5f51259c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:04.382445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:04.384260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:04.396603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-86f198db-1e0f-4bb6-a918-391838095b7b req-266475c4-bfed-423a-bb29-9cfc5f51259c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:04.399058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-86f198db-1e0f-4bb6-a918-391838095b7b req-266475c4-bfed-423a-bb29-9cfc5f51259c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:04.400310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-86f198db-1e0f-4bb6-a918-391838095b7b req-266475c4-bfed-423a-bb29-9cfc5f51259c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:04.443863 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-86f198db-1e0f-4bb6-a918-391838095b7b req-266475c4-bfed-423a-bb29-9cfc5f51259c service nova] Creating event network-changed:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:45:04.495972 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-86f198db-1e0f-4bb6-a918-391838095b7b req-266475c4-bfed-423a-bb29-9cfc5f51259c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114156 Oct 28 19:45:04.502558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2962/5910] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:45:04.739037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:04.743368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:04.774423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:04.776049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:04.776920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:04.778611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:04.780622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:04.782362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:05.919488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:05.945471 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94d4e542-0aac-4e97-bd35-a94b609873ad tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1281 microversion: 2.1 time: 1.755820 Oct 28 19:45:05.951298 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2949/5911] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:04 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1281 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:45:07.007914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:07.010960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:07.015689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:07.048423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:07.049252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:07.052535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:07.055816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:07.059587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:07.060433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:07.099800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:08.209986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:08.293628 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1644ab3-1d71-47b9-b494-0084c862cd85 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1281 microversion: 2.1 time: 1.304806 Oct 28 19:45:08.294481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2963/5912] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:06 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1281 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:09.341574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:09.342496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:09.363731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:09.377176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:09.377865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:09.378619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:09.380029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:09.380522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:10.010491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:10.043799 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ab3a56f-7c1d-48e8-b71e-bd115f4b128b tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.714812 Oct 28 19:45:10.059879 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2950/5913] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:09 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:11.094580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:11.097528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:11.158663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:11.159410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:11.167948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:11.172796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:11.174808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:11.181194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:11.549778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:11.562961 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9778845-3587-429c-82ed-faac3e200c7a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.480184 Oct 28 19:45:11.564958 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2964/5914] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:11 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:12.598316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:12.599671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:12.611860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:12.614413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:12.615646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:12.619882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:12.622787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:12.623794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:12.980099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:12.984441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:13.027214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:13.028248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:13.029576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:13.031797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:13.034461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:13.034965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:13.035659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:13.047256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1d00d3e-a302-4b6f-9ca1-5255a092e4c4 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.457696 Oct 28 19:45:13.048903 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2951/5915] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:12 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:13.114891 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11403164-6a1e-4293-84bb-079f7455333e tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "POST /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a/action" status: 200 len: 32631 microversion: 2.1 time: 0.139863 Oct 28 19:45:13.123985 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2965/5916] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:45:12 2022] POST /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a/action => generated 32631 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:45:14.077712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:14.079754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:14.093067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:14.094030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:14.095266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:14.096791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:14.098112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:14.099182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:14.768314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:14.777112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1ab940a-d181-4a23-a739-4bc155a7a546 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.706259 Oct 28 19:45:14.809410 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2952/5917] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:14 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:15.807566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:15.809465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:15.820129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:15.820907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:15.821519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:15.822391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:15.823130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:15.823710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:16.159995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:16.160605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:16.176696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:16.177205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:16.184637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:16.185443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:16.185929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:16.186377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:16.264782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:45:16.439156 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6485b0d5-cd62-495c-a4a3-1b00f3260ae6 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "DELETE /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 204 len: 0 microversion: 2.1 time: 0.282394 Oct 28 19:45:16.446024 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2953/5918] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:45:16 2022] DELETE /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:45:16.733451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5ab60f66-dce1-4001-9366-d6ac7f73994a req-d5672088-5021-4ef9-adc2-fe2b380c70b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b9a822-d11e-4bfc-8b10-b195c3423d1a", "tag": "23295473-fd60-40d5-ba03-d67793acb709"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:16.758277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5ab60f66-dce1-4001-9366-d6ac7f73994a req-d5672088-5021-4ef9-adc2-fe2b380c70b4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:16.759240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5ab60f66-dce1-4001-9366-d6ac7f73994a req-d5672088-5021-4ef9-adc2-fe2b380c70b4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:16.759876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5ab60f66-dce1-4001-9366-d6ac7f73994a req-d5672088-5021-4ef9-adc2-fe2b380c70b4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:16.788958 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5ab60f66-dce1-4001-9366-d6ac7f73994a req-d5672088-5021-4ef9-adc2-fe2b380c70b4 service nova] Creating event network-changed:23295473-fd60-40d5-ba03-d67793acb709 for instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a on n-h1-862769-3 Oct 28 19:45:16.803956 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5ab60f66-dce1-4001-9366-d6ac7f73994a req-d5672088-5021-4ef9-adc2-fe2b380c70b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354482 Oct 28 19:45:16.807877 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2954/5919] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:45:16.819435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:16.820856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:16.834451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:16.838841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:16.839568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:16.841200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:16.843409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:16.844627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:17.280306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:17.320748 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c39aa22e-5403-4c7d-9e31-b45a43ac344f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 1.503940 Oct 28 19:45:17.329609 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2966/5920] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:15 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:17.370181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:17.382229 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e11ab140-594b-4154-b189-13a90d525e6f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1672 microversion: 2.1 time: 0.572728 Oct 28 19:45:17.383034 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2955/5921] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:16 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1672 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:18.367640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:18.369943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:18.392758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:18.393653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:18.394323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:18.395450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:18.396144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:18.396812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:18.405808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:18.407311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:18.417467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:18.419669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:18.420382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:18.431771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:18.432641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:18.433318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:18.865981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:18.880273 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8618ca5b-526c-49b9-9ab7-4f6beccf1984 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.516454 Oct 28 19:45:18.894887 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2967/5922] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:18 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:19.028036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:19.030830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:19.038941 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9739be7-7e5a-49b7-ba35-dd2e40467dd1 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1672 microversion: 2.1 time: 0.637144 Oct 28 19:45:19.048640 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2956/5923] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:18 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1672 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:45:19.650518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7bcf87d1-d476-4e0c-8397-300bbadf4df2 req-c7553ca7-f382-4e49-884e-fe1484ae2524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b9a822-d11e-4bfc-8b10-b195c3423d1a", "name": "network-vif-deleted", "tag": "23295473-fd60-40d5-ba03-d67793acb709"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:19.676796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7bcf87d1-d476-4e0c-8397-300bbadf4df2 req-c7553ca7-f382-4e49-884e-fe1484ae2524 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:19.693578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7bcf87d1-d476-4e0c-8397-300bbadf4df2 req-c7553ca7-f382-4e49-884e-fe1484ae2524 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:19.698212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7bcf87d1-d476-4e0c-8397-300bbadf4df2 req-c7553ca7-f382-4e49-884e-fe1484ae2524 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:19.750396 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7bcf87d1-d476-4e0c-8397-300bbadf4df2 req-c7553ca7-f382-4e49-884e-fe1484ae2524 service nova] Creating event network-vif-deleted:23295473-fd60-40d5-ba03-d67793acb709 for instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a on n-h1-862769-3 Oct 28 19:45:19.767598 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7bcf87d1-d476-4e0c-8397-300bbadf4df2 req-c7553ca7-f382-4e49-884e-fe1484ae2524 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142458 Oct 28 19:45:19.773753 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2968/5924] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:45:19.909089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:19.909721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:19.921004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:19.968958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:19.969545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:19.977364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:19.979262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:19.980882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:19.983331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:20.072938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:20.073776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:20.099199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:20.108658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:20.113881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:20.119594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:20.119872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:20.123927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:20.251245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:20.252091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:20.253109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:20.253875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lazy-loading 'fault' on Instance uuid 67b9a822-d11e-4bfc-8b10-b195c3423d1a {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:45:20.412405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1acfd8db9c04d8eb136ea3c7215a34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49d2e64df444e8ac9c997ef2b5d381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:20.428714 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42394a46-5a94-4e7c-a32e-820940bdc403 tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 200 len: 1338 microversion: 2.1 time: 0.361138 Oct 28 19:45:20.431853 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2969/5925] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:20 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 1338 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:45:20.832977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:20.873529 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2565451b-91bc-4dee-b68d-d20b2a6f61ae tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.971903 Oct 28 19:45:20.880621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2957/5926] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:19 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:21.459896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:21.461377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] [instance: 67b9a822-d11e-4bfc-8b10-b195c3423d1a] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:21.481730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:21.486116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:21.488136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:21.491895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:21.494707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:21.497199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:21.561847 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] HTTP exception thrown: Instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a could not be found. Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Request method failure captured: Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a HTTP/1.1 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDAyazqOc0tlIPi8VTr3-if-olnCoy5o8-c_wEaPbV10jHWMIIneq4UaDcAbppfG1ao7poMvUDmaiIYoPva6_HkRI_9cZvJKwkgTpDR4S1-K3YfXZuV9yOWrgeuVpk_386570Zhsrgj0A6ma-Y8K9ZmlxFJtjm-0c_r8dsFQeS389BU Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1a49d2e64df444e8ac9c997ef2b5d381 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestNetworkBasicOps-529356868 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1a49d2e64df444e8ac9c997ef2b5d381", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1a49d2e64df444e8ac9c997ef2b5d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestNetworkBasicOps-529356868 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1a49d2e64df444e8ac9c997ef2b5d381 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestNetworkBasicOps-529356868 Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestNetworkBasicOps-529356868-project Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: e1acfd8db9c04d8eb136ea3c7215a34b Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestNetworkBasicOps-529356868-project Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a could not be found. Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '67b9a822-d11e-4bfc-8b10-b195c3423d1a'} Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a could not be found. Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a could not be found. Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:45:21.565813 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a could not be found. Oct 28 19:45:21.572769 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:45:21.574727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Returning 404 to user: Instance 67b9a822-d11e-4bfc-8b10-b195c3423d1a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:45:21.579236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d972e14c-2374-4934-ae7d-45e150fd852a tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a" status: 404 len: 111 microversion: 2.1 time: 0.123200 Oct 28 19:45:21.594188 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2970/5927] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:21 2022] GET /compute/v2.1/servers/67b9a822-d11e-4bfc-8b10-b195c3423d1a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:45:21.905812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:21.906498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:21.929900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:21.930464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:21.930894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:21.931879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:21.932539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:21.933171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:22.413674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:22.455190 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de33a29c-5f1b-43cc-884d-5a807e5e4bdf tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.544250 Oct 28 19:45:22.472948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5596ef6d-2835-438b-b832-9d409da8854f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] Calling method '.version_select at 0x7f1d77bd4820>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:22.485210 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2958/5928] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:21 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:22.528158 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5596ef6d-2835-438b-b832-9d409da8854f tempest-TestNetworkBasicOps-529356868 tempest-TestNetworkBasicOps-529356868-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-687950095" status: 202 len: 0 microversion: 2.1 time: 0.060507 Oct 28 19:45:22.528765 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2971/5929] 10.222.0.44 () {58 vars in 1254 bytes} [Fri Oct 28 19:45:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-687950095 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:45:23.502170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:23.503662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:23.512597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:23.513426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:23.514056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:23.515540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:23.516384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:23.517013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:24.069123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:24.099757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b9687f99-cedd-4037-bd00-89011ab69ecd req-b1760553-428c-44a6-8595-c90c29556146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "name": "network-vif-plugged", "status": "completed", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:24.116418 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d840bb53-a7a6-4eda-9109-a322da036872 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.634527 Oct 28 19:45:24.135901 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2959/5930] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:23 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:24.148427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b9687f99-cedd-4037-bd00-89011ab69ecd req-b1760553-428c-44a6-8595-c90c29556146 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:24.150318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b9687f99-cedd-4037-bd00-89011ab69ecd req-b1760553-428c-44a6-8595-c90c29556146 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:24.150911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b9687f99-cedd-4037-bd00-89011ab69ecd req-b1760553-428c-44a6-8595-c90c29556146 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:24.188100 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b9687f99-cedd-4037-bd00-89011ab69ecd req-b1760553-428c-44a6-8595-c90c29556146 service nova] Creating event network-vif-plugged:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:45:24.209379 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b9687f99-cedd-4037-bd00-89011ab69ecd req-b1760553-428c-44a6-8595-c90c29556146 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129918 Oct 28 19:45:24.211477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2972/5931] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:45:25.158959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:25.160245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:25.184682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:25.185420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:25.186026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:25.188122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:25.197827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:25.198284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:25.910893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:25.949587 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-202125bb-0f0b-4885-8103-f5f5defb895a tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1269 microversion: 2.1 time: 0.785055 Oct 28 19:45:25.960580 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2960/5932] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:25 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1269 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:26.985851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:26.986577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:27.001817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:27.002593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:27.003506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:27.005161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:27.007253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:27.007906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:27.548948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:27.557446 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e29b395f-d1c5-43ef-ba24-23feaa52eb2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1459 microversion: 2.1 time: 0.577558 Oct 28 19:45:27.563796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2973/5933] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:26 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1459 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:27.592362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:45:27.593061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:45:27.611746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:27.612634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:27.613246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:27.614240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:27.614899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:27.616187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:28.186173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:45:28.199030 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fed57760-d215-44af-a17a-4c0be63c3a05 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1459 microversion: 2.1 time: 0.612078 Oct 28 19:45:28.218949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2961/5934] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:45:27 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1459 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:45:38.576305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-54cb16da-ab7e-439e-b2b3-dd23c3578392 req-d1c6dbef-acf8-4768-8271-098c35255c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:38.588033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:38.593970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=47 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:38.605962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54cb16da-ab7e-439e-b2b3-dd23c3578392 req-d1c6dbef-acf8-4768-8271-098c35255c5e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:38.610723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54cb16da-ab7e-439e-b2b3-dd23c3578392 req-d1c6dbef-acf8-4768-8271-098c35255c5e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:38.611529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-54cb16da-ab7e-439e-b2b3-dd23c3578392 req-d1c6dbef-acf8-4768-8271-098c35255c5e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:38.642475 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-54cb16da-ab7e-439e-b2b3-dd23c3578392 req-d1c6dbef-acf8-4768-8271-098c35255c5e service nova] Creating event network-changed:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:45:38.660718 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-54cb16da-ab7e-439e-b2b3-dd23c3578392 req-d1c6dbef-acf8-4768-8271-098c35255c5e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088878 Oct 28 19:45:38.661953 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2974/5935] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:45:48.451552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-446f8a9c-1f3b-42fe-8e83-86b0ef56f766 req-a928dd34-1dfb-485d-a8f4-26661bfafa32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:48.475079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=9 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:48.477030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=31 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:48.484178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-446f8a9c-1f3b-42fe-8e83-86b0ef56f766 req-a928dd34-1dfb-485d-a8f4-26661bfafa32 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:48.490192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-446f8a9c-1f3b-42fe-8e83-86b0ef56f766 req-a928dd34-1dfb-485d-a8f4-26661bfafa32 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:48.490856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-446f8a9c-1f3b-42fe-8e83-86b0ef56f766 req-a928dd34-1dfb-485d-a8f4-26661bfafa32 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:48.537089 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-446f8a9c-1f3b-42fe-8e83-86b0ef56f766 req-a928dd34-1dfb-485d-a8f4-26661bfafa32 service nova] Creating event network-changed:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:45:48.580308 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-446f8a9c-1f3b-42fe-8e83-86b0ef56f766 req-a928dd34-1dfb-485d-a8f4-26661bfafa32 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133566 Oct 28 19:45:48.582569 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2962/5936] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:45:50.620293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b2d578b8-4f61-4a9c-828a-334578b722d7 req-2d24073f-7b97-49f2-b1bf-ed52d19f87b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:45:50.633339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.634681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.666331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b2d578b8-4f61-4a9c-828a-334578b722d7 req-2d24073f-7b97-49f2-b1bf-ed52d19f87b1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:45:50.672154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b2d578b8-4f61-4a9c-828a-334578b722d7 req-2d24073f-7b97-49f2-b1bf-ed52d19f87b1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:45:50.672524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b2d578b8-4f61-4a9c-828a-334578b722d7 req-2d24073f-7b97-49f2-b1bf-ed52d19f87b1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:45:50.695377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b2d578b8-4f61-4a9c-828a-334578b722d7 req-2d24073f-7b97-49f2-b1bf-ed52d19f87b1 service nova] Creating event network-changed:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:45:50.708021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b2d578b8-4f61-4a9c-828a-334578b722d7 req-2d24073f-7b97-49f2-b1bf-ed52d19f87b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091472 Oct 28 19:45:50.708685 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2975/5937] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:02.118391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:02.120474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:02.356237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-756d02f2-1008-4ddf-aa1a-d2ca4b9bb21a tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1014677939", "availability_zone": "foo_zone"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:02.367967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.aggregate [None req-756d02f2-1008-4ddf-aa1a-d2ca4b9bb21a tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Generated uuid ba6ef87f-90f4-4679-9d83-c5b12deb65d6 for aggregate {{(pid=120628) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 19:46:02.417928 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-756d02f2-1008-4ddf-aa1a-d2ca4b9bb21a tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.307072 Oct 28 19:46:02.418559 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2963/5938] 10.222.0.44 () {60 vars in 1164 bytes} [Fri Oct 28 19:46:02 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:02.431046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dc7cb6ef-9b99-465a-9090-6891e6a2320b tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:02.515546 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dc7cb6ef-9b99-465a-9090-6891e6a2320b tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.086364 Oct 28 19:46:02.529610 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2976/5939] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:46:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:02.533058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:02.537841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:02.538344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:02.542960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:02.544543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:02.545090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:02.545527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:02.592240 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6613d10-ea75-41aa-a04f-09c8b83fdeed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063863 Oct 28 19:46:02.594162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2964/5940] 10.222.0.44 () {58 vars in 1176 bytes} [Fri Oct 28 19:46:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:02.606035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-21e05dce-3e3a-4517-888e-98f09d6c2f13 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:02.616487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-21e05dce-3e3a-4517-888e-98f09d6c2f13 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014512 Oct 28 19:46:02.625852 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2977/5941] 10.222.0.44 () {58 vars in 1143 bytes} [Fri Oct 28 19:46:02 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:02.632428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-39cdb9c4-ca0e-4fbc-901a-3f1c850b231d tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-3"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:02.659566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39cdb9c4-ca0e-4fbc-901a-3f1c850b231d tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:02.662775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39cdb9c4-ca0e-4fbc-901a-3f1c850b231d tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:02.666329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39cdb9c4-ca0e-4fbc-901a-3f1c850b231d tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:03.212938 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-39cdb9c4-ca0e-4fbc-901a-3f1c850b231d tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.585905 Oct 28 19:46:03.216577 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2965/5942] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:46:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:03.234431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-061f099b-fb87-427a-946f-7cc75f1f066a tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:03.260244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-061f099b-fb87-427a-946f-7cc75f1f066a tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.032705 Oct 28 19:46:03.273056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6052ded5-c58a-46d7-b7b4-4d025aa9ae59 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-272638455", "availability_zone": "foo_zone"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:03.275071 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2978/5943] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:46:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:03.431640 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6052ded5-c58a-46d7-b7b4-4d025aa9ae59 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.161027 Oct 28 19:46:03.437622 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2966/5944] 10.222.0.44 () {60 vars in 1173 bytes} [Fri Oct 28 19:46:03 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:03.447462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-46fd1d34-2f5d-4942-a776-1bc42cb684e8 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:03.507606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-46fd1d34-2f5d-4942-a776-1bc42cb684e8 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.065391 Oct 28 19:46:03.510023 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2979/5945] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:46:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:03.524735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de6ea504-548a-4c10-9aa9-1d93ea35c6eb tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:03.546378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de6ea504-548a-4c10-9aa9-1d93ea35c6eb tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.027827 Oct 28 19:46:03.547451 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2967/5946] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Oct 28 19:46:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:03.565304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed304710-e890-49b4-8852-f8fa9b40a9a5 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:03.580873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed304710-e890-49b4-8852-f8fa9b40a9a5 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:03.581738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed304710-e890-49b4-8852-f8fa9b40a9a5 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:03.583318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed304710-e890-49b4-8852-f8fa9b40a9a5 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:03.900089 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed304710-e890-49b4-8852-f8fa9b40a9a5 tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.339170 Oct 28 19:46:03.901217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2980/5947] 10.222.0.44 () {60 vars in 1194 bytes} [Fri Oct 28 19:46:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:03.913481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7ba58d42-6b84-491a-a410-8b06fbe109ed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:03.940450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7ba58d42-6b84-491a-a410-8b06fbe109ed tempest-TestAggregatesBasicOps-937021556 tempest-TestAggregatesBasicOps-937021556-project-admin] 10.222.0.44 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.031116 Oct 28 19:46:03.941506 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2968/5948] 10.222.0.44 () {58 vars in 1155 bytes} [Fri Oct 28 19:46:03 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 19:46:07.901181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2985716d-97b3-457c-9c2e-9664f9c008fc req-e35ffb6f-3ed6-4ae4-9529-b3dcb7864f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:07.903188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:07.904558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:07.926077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2985716d-97b3-457c-9c2e-9664f9c008fc req-e35ffb6f-3ed6-4ae4-9529-b3dcb7864f81 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:07.926642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2985716d-97b3-457c-9c2e-9664f9c008fc req-e35ffb6f-3ed6-4ae4-9529-b3dcb7864f81 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:07.927239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2985716d-97b3-457c-9c2e-9664f9c008fc req-e35ffb6f-3ed6-4ae4-9529-b3dcb7864f81 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:07.928886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:07.932429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:07.933431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:07.937177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:07.938064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:07.939363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:07.953687 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2985716d-97b3-457c-9c2e-9664f9c008fc req-e35ffb6f-3ed6-4ae4-9529-b3dcb7864f81 service nova] Creating event network-changed:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:46:07.962569 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2985716d-97b3-457c-9c2e-9664f9c008fc req-e35ffb6f-3ed6-4ae4-9529-b3dcb7864f81 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065341 Oct 28 19:46:07.963759 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2969/5949] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:46:08.042632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:46:08.248370 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-52bfefca-4b6b-418c-867a-3a7cffc58903 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "DELETE /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 204 len: 0 microversion: 2.1 time: 0.347259 Oct 28 19:46:08.249700 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2981/5950] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:46:07 2022] DELETE /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:46:08.262888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:08.267002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:08.275728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:08.278944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:08.281331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:08.283514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:08.285077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:08.287391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:09.068559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:09.096931 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1662d0dd-00d8-4dd6-82b9-dffae3f82ff5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1584 microversion: 2.1 time: 0.841122 Oct 28 19:46:09.097636 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2970/5951] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:08 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1584 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:10.124125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:10.124850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:10.140533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:10.141038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:10.141470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:10.157502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:10.158017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:10.158638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:10.765987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:10.775547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4bf7d0bc-f559-4a29-bd0e-6085b7375795 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1584 microversion: 2.1 time: 0.655802 Oct 28 19:46:10.801920 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2982/5952] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:10 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1584 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:11.808927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:11.810480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:11.831591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:11.832740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:11.833504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:11.834512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:11.835365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:11.836028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:12.235804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1dbde834-da96-47c5-8b49-e98253dd9819 req-35c38ede-c027-466a-bf1f-ee474ce56f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01206e5d-6803-4993-bec4-685c8aeeb5d1", "name": "network-vif-deleted", "tag": "5f802abc-0171-4af8-b731-f22e5ee90e7e"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:46:12.283627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:12.317764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1dbde834-da96-47c5-8b49-e98253dd9819 req-35c38ede-c027-466a-bf1f-ee474ce56f2a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:12.318452 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bee89213-1e9a-4234-bb19-ae1d9fd78efb tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1465 microversion: 2.1 time: 0.513185 Oct 28 19:46:12.321488 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2971/5953] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:11 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1465 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:12.330988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1dbde834-da96-47c5-8b49-e98253dd9819 req-35c38ede-c027-466a-bf1f-ee474ce56f2a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:12.331539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1dbde834-da96-47c5-8b49-e98253dd9819 req-35c38ede-c027-466a-bf1f-ee474ce56f2a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:12.382112 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1dbde834-da96-47c5-8b49-e98253dd9819 req-35c38ede-c027-466a-bf1f-ee474ce56f2a service nova] Creating event network-vif-deleted:5f802abc-0171-4af8-b731-f22e5ee90e7e for instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 on n-h2-862769-3 Oct 28 19:46:12.394329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1dbde834-da96-47c5-8b49-e98253dd9819 req-35c38ede-c027-466a-bf1f-ee474ce56f2a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164882 Oct 28 19:46:12.396305 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2983/5954] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:46:13.352621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:13.353938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:13.356392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:13.369832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:13.371593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:13.372445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:13.373418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:13.374827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:13.376567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:13.522325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:13.531239 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6e54770e-f60f-4e8c-a4f4-392f8e909b2c tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1230 microversion: 2.1 time: 0.185220 Oct 28 19:46:13.543162 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2972/5955] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:13 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1230 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:14.587223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:14.587941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:14.606032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:14.607633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:14.610479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:14.611492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:14.613552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:14.615292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:14.724910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:14.737039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-533d8284-cce0-4b51-a006-c996e44e9196 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1230 microversion: 2.1 time: 0.155442 Oct 28 19:46:14.741935 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2984/5956] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:14 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:15.766080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:15.766735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:15.774137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:15.774637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:15.792904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:15.793677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:15.794170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:15.794624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:16.001561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:16.020648 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-926f9991-7d5d-4ff9-96c2-84dd8fad718d tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1230 microversion: 2.1 time: 0.256921 Oct 28 19:46:16.042378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2973/5957] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:15 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1230 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:17.050425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:17.051102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:17.069955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:17.071038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:17.072376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:17.073409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:17.074112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:17.074842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:17.216432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:17.235301 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee1a795a-e402-4e57-936f-6b2ecfa318a5 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1230 microversion: 2.1 time: 0.189624 Oct 28 19:46:17.236132 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2985/5958] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:17 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1230 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:18.263943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:18.264601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:18.278179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:18.278683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:18.279161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:18.279988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:18.280468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:18.280900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:18.496129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:18.513350 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ff191cd4-04a0-448a-8055-31449d89ccca tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1230 microversion: 2.1 time: 0.257683 Oct 28 19:46:18.527464 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2974/5959] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:18 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1230 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:19.544480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:19.546332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:19.565873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:19.566908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:19.567553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:19.568504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:19.571158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:19.571895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:19.758028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78658b4530542029393f0d81c5d3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f7c611e4c748248588ce42eb648483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:46:19.773241 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc4c0b4f-6871-4aa3-afb4-1f2c4ae1c5e9 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 200 len: 1230 microversion: 2.1 time: 0.235101 Oct 28 19:46:19.774623 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2986/5960] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:19 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 1230 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:46:20.808184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:20.809524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] [instance: 01206e5d-6803-4993-bec4-685c8aeeb5d1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:46:20.823193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:20.830465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:20.831017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:20.831794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:46:20.832277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:46:20.832714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:46:20.893042 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] HTTP exception thrown: Instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 could not be found. Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Request method failure captured: Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 HTTP/1.1 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXC_6bvGf_BD2LQBOKbzWyoy99v0GqMwGHTywYiY1b4rfe8lVFzlh9KJZgFcspC45lf72zDckj1Uv_yfdaq0l3LJVgQSDOoqeyzt-QGA4HMm1UFqrZvKbBWkOQ_lQhuVhyKzHWoE0iYJtG_91WKjBSFN_PaWOT701funAE_pgBanr-os Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 52f7c611e4c748248588ce42eb648483 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBackupRestore-1958483682 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/52f7c611e4c748248588ce42eb648483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_52f7c611e4c748248588ce42eb648483", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/52f7c611e4c748248588ce42eb648483"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/52f7c611e4c748248588ce42eb648483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBackupRestore-1958483682 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 52f7c611e4c748248588ce42eb648483 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1958483682 Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBackupRestore-1958483682-project Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a78658b4530542029393f0d81c5d3d3a Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBackupRestore-1958483682-project Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 could not be found. Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '01206e5d-6803-4993-bec4-685c8aeeb5d1'} Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 could not be found. Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 could not be found. Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:46:20.895308 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 could not be found. Oct 28 19:46:20.900900 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:46:20.922069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Returning 404 to user: Instance 01206e5d-6803-4993-bec4-685c8aeeb5d1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:46:20.924429 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-be725fd5-f499-442b-99c0-034e425fcc76 tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1" status: 404 len: 111 microversion: 2.1 time: 0.120409 Oct 28 19:46:20.927358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2975/5961] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:46:20 2022] GET /compute/v2.1/servers/01206e5d-6803-4993-bec4-685c8aeeb5d1 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:46:21.746848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e4824020-aa73-4674-bd88-a62cf7ecfc5f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] Calling method '.version_select at 0x7f1d77c74ca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:46:21.800620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e4824020-aa73-4674-bd88-a62cf7ecfc5f tempest-TestVolumeBackupRestore-1958483682 tempest-TestVolumeBackupRestore-1958483682-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2114601044" status: 202 len: 0 microversion: 2.1 time: 0.069525 Oct 28 19:46:21.802048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2987/5962] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 19:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2114601044 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:47:02.838569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2068010423", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:47:02.884536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:02.886604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=40 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:02.924605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:47:03.523580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:47:03.524652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:47:03.525417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:47:03.526347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:47:03.527133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:47:03.543148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:03.544405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:03.545188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:03.546713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:03.547642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:03.548458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:03.576324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Getting quotas for project 730f242654c2445ba26689e7f92b513c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:47:03.584769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Getting quotas for user a9b7135d6dd34fdea62596b9ab4ac519 and project 730f242654c2445ba26689e7f92b513c. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:47:03.604987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:47:03.610647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:47:03.693259 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd18f0ac-cbf0-43e7-b8f6-2e0ada9f0e3b tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862265 Oct 28 19:47:03.696567 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2976/5963] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:47:03.720905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:03.723955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:03.733906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82ba6bbb-8b96-484c-b70c-a6129d570a4f tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:03.735269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82ba6bbb-8b96-484c-b70c-a6129d570a4f tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:03.868463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82ba6bbb-8b96-484c-b70c-a6129d570a4f tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:03.891232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82ba6bbb-8b96-484c-b70c-a6129d570a4f tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1215 microversion: 2.1 time: 0.181273 Oct 28 19:47:03.893427 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2988/5964] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:03 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:04.933336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:04.934263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:04.992748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:04.997141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:05.002279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:05.005627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:05.008082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:05.012718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:05.125552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:05.139052 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af2f5ebe-83d7-4b7c-936a-680d0ffc9e81 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1267 microversion: 2.1 time: 0.209621 Oct 28 19:47:05.140828 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2977/5965] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:04 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:06.179238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:06.180104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:06.196118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:06.197040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:06.197755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:06.198897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:06.200402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:06.204160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:06.326128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:06.350364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69040fc0-457a-4f11-822f-f8b6023757c3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1273 microversion: 2.1 time: 0.174590 Oct 28 19:47:06.366737 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2989/5966] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:06 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:07.377849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:07.378853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:07.388224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:07.390328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:07.391186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:07.392648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:07.393494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:07.394449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:07.901362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:07.916033 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3f2b813-8d3f-42e6-8bf9-c9bcf95eb115 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1315 microversion: 2.1 time: 0.542759 Oct 28 19:47:07.917912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2978/5967] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:07 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:08.066814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-114a12ec-b026-4b57-b439-b81623f70601 req-dfd6295c-043e-4fe7-a8b7-b6209732e4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60abe431-9ddf-47c2-8de9-815bb6c46f78", "tag": "abfd608d-16e1-455b-850b-e7ddfa0b08c8"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:47:08.081119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-114a12ec-b026-4b57-b439-b81623f70601 req-dfd6295c-043e-4fe7-a8b7-b6209732e4ce service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:08.081915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-114a12ec-b026-4b57-b439-b81623f70601 req-dfd6295c-043e-4fe7-a8b7-b6209732e4ce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:08.082589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-114a12ec-b026-4b57-b439-b81623f70601 req-dfd6295c-043e-4fe7-a8b7-b6209732e4ce service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:08.096373 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-114a12ec-b026-4b57-b439-b81623f70601 req-dfd6295c-043e-4fe7-a8b7-b6209732e4ce service nova] Creating event network-changed:abfd608d-16e1-455b-850b-e7ddfa0b08c8 for instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 on n-h1-862769-3 Oct 28 19:47:08.103216 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-114a12ec-b026-4b57-b439-b81623f70601 req-dfd6295c-043e-4fe7-a8b7-b6209732e4ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041187 Oct 28 19:47:08.104726 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2990/5968] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:47:08.942115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:08.943405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:08.951216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:08.951714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:08.952154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:08.953141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:08.953607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:08.954035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:09.223271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:09.258986 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0473d34c-d387-477e-ae0b-226c27d42b6c tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1315 microversion: 2.1 time: 0.319998 Oct 28 19:47:09.289328 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2979/5969] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:08 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:47:10.308025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:10.309559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:10.321505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:10.322777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:10.323585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:10.325204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:10.326431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:10.327563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:10.625744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:10.638894 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a311db5e-d510-4b14-94b7-5f3b95c58f3a tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1315 microversion: 2.1 time: 0.339335 Oct 28 19:47:10.641102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2991/5970] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:10 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:11.668872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:11.670108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:11.688588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:11.689792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:11.690259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:11.691097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:11.697263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:11.697912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:12.155708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:12.171032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1c12bc3-a3f8-48ac-8548-18e3f6d375a5 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1315 microversion: 2.1 time: 0.506025 Oct 28 19:47:12.172096 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2980/5971] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:11 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:47:13.199628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:13.200880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:13.213318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:13.214440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:13.215442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:13.217087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:13.218193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:13.219217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:13.473006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:13.497238 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-74ce18e2-2b37-49cf-b448-c640a7a20ea7 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1315 microversion: 2.1 time: 0.304685 Oct 28 19:47:13.498619 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2992/5972] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:13 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:14.000170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b5252948-66b1-4af6-add8-6defb9306478 req-66cae2ac-6d64-4310-9675-6f82c6d0a7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60abe431-9ddf-47c2-8de9-815bb6c46f78", "name": "network-vif-plugged", "status": "completed", "tag": "abfd608d-16e1-455b-850b-e7ddfa0b08c8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:47:14.021150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:14.024617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:14.029737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b5252948-66b1-4af6-add8-6defb9306478 req-66cae2ac-6d64-4310-9675-6f82c6d0a7a4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:14.030989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b5252948-66b1-4af6-add8-6defb9306478 req-66cae2ac-6d64-4310-9675-6f82c6d0a7a4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:14.031966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b5252948-66b1-4af6-add8-6defb9306478 req-66cae2ac-6d64-4310-9675-6f82c6d0a7a4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:14.059915 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b5252948-66b1-4af6-add8-6defb9306478 req-66cae2ac-6d64-4310-9675-6f82c6d0a7a4 service nova] Creating event network-vif-plugged:abfd608d-16e1-455b-850b-e7ddfa0b08c8 for instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 on n-h1-862769-3 Oct 28 19:47:14.070534 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b5252948-66b1-4af6-add8-6defb9306478 req-66cae2ac-6d64-4310-9675-6f82c6d0a7a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077316 Oct 28 19:47:14.072005 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2981/5973] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:47:14.526241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:14.533496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:14.534869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:14.547133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:14.548069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:14.548780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:14.550026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:14.551038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:14.551753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:14.773362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:14.784064 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-81094ccf-bde1-4126-bfe3-eccad1f51db3 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1315 microversion: 2.1 time: 0.258871 Oct 28 19:47:14.785720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2993/5974] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:14 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:15.815689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:15.816298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:15.823385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:15.824012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:15.824634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:15.825626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:15.826243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:15.826872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:16.011627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:16.021852 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b510f11a-1b1c-4618-9bbe-fb486537f303 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1465 microversion: 2.1 time: 0.213581 Oct 28 19:47:16.022497 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2982/5975] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:15 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1465 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:16.080240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:16.080240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:16.087433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:16.088341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:16.089160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:16.090424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:16.092181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:16.093180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:16.131648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:47:16.243152 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2ba7c52-6f83-4741-b6c2-ac9db8d2cbab tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "DELETE /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 204 len: 0 microversion: 2.1 time: 0.166785 Oct 28 19:47:16.244433 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2994/5976] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:47:16 2022] DELETE /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:47:16.257014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:16.258199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:16.269379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:16.269879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:16.270531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:16.271898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:16.274776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:16.275628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:16.476051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:16.486007 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80239b38-cde9-4f9b-838c-77e8e280a897 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1471 microversion: 2.1 time: 0.234463 Oct 28 19:47:16.486889 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2983/5977] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:16 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:17.516476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:17.524309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:17.551652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:17.556860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:17.558135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:17.559794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:17.563932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:17.564827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:17.872251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:17.890206 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75661fbf-76d6-443a-8fc5-a896e66473d4 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1471 microversion: 2.1 time: 0.381888 Oct 28 19:47:17.891823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2995/5978] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:17 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:47:18.636671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b1765d31-218b-40f3-9565-93811e42986e req-3319213f-3d50-451d-996c-cc0941409cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60abe431-9ddf-47c2-8de9-815bb6c46f78", "name": "network-vif-deleted", "tag": "abfd608d-16e1-455b-850b-e7ddfa0b08c8"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:47:18.649491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1765d31-218b-40f3-9565-93811e42986e req-3319213f-3d50-451d-996c-cc0941409cd5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:18.650012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1765d31-218b-40f3-9565-93811e42986e req-3319213f-3d50-451d-996c-cc0941409cd5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:18.650474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1765d31-218b-40f3-9565-93811e42986e req-3319213f-3d50-451d-996c-cc0941409cd5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:18.680819 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b1765d31-218b-40f3-9565-93811e42986e req-3319213f-3d50-451d-996c-cc0941409cd5 service nova] Creating event network-vif-deleted:abfd608d-16e1-455b-850b-e7ddfa0b08c8 for instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 on n-h1-862769-3 Oct 28 19:47:18.686472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b1765d31-218b-40f3-9565-93811e42986e req-3319213f-3d50-451d-996c-cc0941409cd5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054397 Oct 28 19:47:18.687460 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2984/5979] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:47:18.917085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:18.917753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:18.931916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:18.932690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:18.933317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:18.934400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:18.935114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:18.935757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:18.985465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:18.986192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:18.987117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:18.988902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lazy-loading 'fault' on Instance uuid 60abe431-9ddf-47c2-8de9-815bb6c46f78 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:47:19.196514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b7135d6dd34fdea62596b9ab4ac519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730f242654c2445ba26689e7f92b513c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:19.212249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9fc3b6f7-0500-406c-8620-8be2a6c252fc tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 200 len: 1305 microversion: 2.1 time: 0.299958 Oct 28 19:47:19.213192 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2996/5980] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:18 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 1305 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:20.245724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:20.246474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] [instance: 60abe431-9ddf-47c2-8de9-815bb6c46f78] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:20.256104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:20.257062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:20.257948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:20.265688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:20.265688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:20.265688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:20.293602 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] HTTP exception thrown: Instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 could not be found. Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Request method failure captured: Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 HTTP/1.1 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDGzo8XC6VkDsVcNU2wmInZt8ul8j2_mRAAPvErWnBBF-dXnPIg310qVibx_StmOzx-B0_eKXLXPrCFAkqimCOM7e59p8rPvcqe1peO8y0g69gGe9aCFRf4B6pCuLnzD8Ih1wjiRnrvc5JWmH7Vbs-_5Alt4ncfSUWV9uuHVi23mzv8 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 730f242654c2445ba26689e7f92b513c Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesNegativeTest-763081105 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/730f242654c2445ba26689e7f92b513c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_730f242654c2445ba26689e7f92b513c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/730f242654c2445ba26689e7f92b513c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/730f242654c2445ba26689e7f92b513c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesNegativeTest-763081105 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 730f242654c2445ba26689e7f92b513c Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesNegativeTest-763081105 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesNegativeTest-763081105-project Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: a9b7135d6dd34fdea62596b9ab4ac519 Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesNegativeTest-763081105-project Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 could not be found. Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '60abe431-9ddf-47c2-8de9-815bb6c46f78'} Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 could not be found. Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 could not be found. Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:47:20.295536 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 could not be found. Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] Returning 404 to user: Instance 60abe431-9ddf-47c2-8de9-815bb6c46f78 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:47:20.299591 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38c1b737-0877-4624-b993-0520aa45d3d9 tempest-VolumesNegativeTest-763081105 tempest-VolumesNegativeTest-763081105-project] 10.222.0.44 "GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78" status: 404 len: 111 microversion: 2.1 time: 0.058861 Oct 28 19:47:20.301095 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2985/5981] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:20 2022] GET /compute/v2.1/servers/60abe431-9ddf-47c2-8de9-815bb6c46f78 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:47:51.576970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:51.578533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:52.149175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-766dedc8-83e0-463e-b2be-cf6d70211f03 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Action: 'create', calling method: .version_select at 0x7f1d8001bf70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1329380916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLBWWxAZw/6kAVHxJoGGbBKjGv31x4XrWF8+g9deP8R80JbO1mgQGMG1rna1YCI0VWPfB2ZWxKe5X7ifUaJoSnXcsRvlUlceQCTCad2kPo6PCYW7acGMZ8OGubYupLilg=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:47:52.207592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-766dedc8-83e0-463e-b2be-cf6d70211f03 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Getting quotas for project 34882e8be9f1438c97c34eb783f5fc5a. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:47:52.243738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-766dedc8-83e0-463e-b2be-cf6d70211f03 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Getting quotas for user 3aaced2a7ffe439a81455a3d3bbbbc1b and project 34882e8be9f1438c97c34eb783f5fc5a. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:47:52.289591 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-766dedc8-83e0-463e-b2be-cf6d70211f03 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.728101 Oct 28 19:47:52.292924 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2997/5982] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:47:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:47:54.548123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1875924803", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1329380916", "security_groups": [{"name": "tempest-secgroup-smoke-1499762367"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b424e6ad-32d7-456c-84a3-f42936e04042"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:47:54.584564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:54.585818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=44 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:54.946973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] validate_networks() for [('b424e6ad-32d7-456c-84a3-f42936e04042', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:47:56.852678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Getting quotas for project 34882e8be9f1438c97c34eb783f5fc5a. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:47:56.868127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Getting quotas for user 3aaced2a7ffe439a81455a3d3bbbbc1b and project 34882e8be9f1438c97c34eb783f5fc5a. Resources: dict_keys(['metadata_items']) {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:47:56.900606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:47:56.903588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:47:56.904531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:47:56.906510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:47:56.907137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:47:56.930916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:56.931874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:56.932782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:56.934093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:56.935295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:56.935933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:56.989103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Getting quotas for project 34882e8be9f1438c97c34eb783f5fc5a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:47:57.006832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Getting quotas for user 3aaced2a7ffe439a81455a3d3bbbbc1b and project 34882e8be9f1438c97c34eb783f5fc5a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:47:57.037668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:47:57.042026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:47:57.111154 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-55fa5766-0e3b-4118-9250-7607f42b0045 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.569122 Oct 28 19:47:57.112695 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2986/5983] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:47:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:47:57.126953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f71999cc-3c01-4b13-a3e2-54b57a806473 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:57.128549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f71999cc-3c01-4b13-a3e2-54b57a806473 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:57.762273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f71999cc-3c01-4b13-a3e2-54b57a806473 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:57.790243 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f71999cc-3c01-4b13-a3e2-54b57a806473 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1303 microversion: 2.1 time: 0.666928 Oct 28 19:47:57.803744 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2998/5984] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:57 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1303 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:47:58.855104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:47:58.868587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:47:58.885381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:58.886385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:58.899759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:58.901562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:47:58.902630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:47:58.903356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:47:59.000350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:47:59.012386 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9630415e-8880-4f7f-acbf-5f837aaa10fb tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1355 microversion: 2.1 time: 0.174827 Oct 28 19:47:59.012910 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2987/5985] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:47:58 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1355 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:48:00.040450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:00.041167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:00.055849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:00.060597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:00.061802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:00.063766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:00.066469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:00.068409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:00.242308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:00.275541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66a4ccfe-b540-43d3-b222-54927379ce26 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1361 microversion: 2.1 time: 0.239606 Oct 28 19:48:00.295478 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 2999/5986] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:00 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:01.321429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:01.322344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:01.335189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:01.338345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:01.339242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:01.340289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:01.340975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:01.341793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:02.105077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:02.116550 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e29eb0d9-989f-434f-ac23-67be63c5d3ea tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.799520 Oct 28 19:48:02.123912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2988/5987] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:01 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:02.994119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-92985358-0896-44ed-a733-a5b395bc09fa req-32c74755-cdae-4c5f-9603-f4b83fc6ab2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad099c0d-4b7c-4b5d-83f7-640b11238395", "tag": "cbb2fa4e-1add-427d-941a-a5751031c83d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:48:03.007861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-92985358-0896-44ed-a733-a5b395bc09fa req-32c74755-cdae-4c5f-9603-f4b83fc6ab2f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:03.008789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-92985358-0896-44ed-a733-a5b395bc09fa req-32c74755-cdae-4c5f-9603-f4b83fc6ab2f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:03.009391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-92985358-0896-44ed-a733-a5b395bc09fa req-32c74755-cdae-4c5f-9603-f4b83fc6ab2f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:03.023151 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-92985358-0896-44ed-a733-a5b395bc09fa req-32c74755-cdae-4c5f-9603-f4b83fc6ab2f service nova] Creating event network-changed:cbb2fa4e-1add-427d-941a-a5751031c83d for instance ad099c0d-4b7c-4b5d-83f7-640b11238395 on n-h1-862769-3 Oct 28 19:48:03.029115 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-92985358-0896-44ed-a733-a5b395bc09fa req-32c74755-cdae-4c5f-9603-f4b83fc6ab2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039596 Oct 28 19:48:03.029846 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3000/5988] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:48:03.158565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:03.159596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:03.168615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:03.169253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:03.169772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:03.170489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:03.171007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:03.171465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:03.365596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:03.380722 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05879596-cb32-4e09-84ba-d2e97b032e0e tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.226309 Oct 28 19:48:03.382093 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2989/5989] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:03 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:48:04.421701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:04.422453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:04.430303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:04.431332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:04.431865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:04.432852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:04.433338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:04.433800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:04.620945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:04.635237 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b428923-dead-4eb4-92bc-43a545ee59d5 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.219502 Oct 28 19:48:04.635873 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3001/5990] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:04 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:05.660054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:05.661677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:05.681016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:05.681511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:05.681957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:05.682764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:05.683236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:05.683695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:05.892997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:05.901522 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3c6b3e80-0ef0-4eff-b9cb-ae333bf091dc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.246462 Oct 28 19:48:05.902935 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2990/5991] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:05 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:06.926117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:06.926934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:06.934845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:06.935353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:06.935790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:06.936722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:06.937195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:06.937621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:07.273295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:07.284523 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca612e9d-4c3d-483c-84d8-e501e98468aa tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.362659 Oct 28 19:48:07.288858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3002/5992] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:06 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:08.239947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-44388dd9-cf6d-4c71-b1b7-00efd0445731 req-bf97d8ad-46d1-4ca2-81f1-12d2758c66b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad099c0d-4b7c-4b5d-83f7-640b11238395", "name": "network-vif-plugged", "status": "completed", "tag": "cbb2fa4e-1add-427d-941a-a5751031c83d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:48:08.246206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:08.247158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:08.257938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-44388dd9-cf6d-4c71-b1b7-00efd0445731 req-bf97d8ad-46d1-4ca2-81f1-12d2758c66b1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:08.259404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-44388dd9-cf6d-4c71-b1b7-00efd0445731 req-bf97d8ad-46d1-4ca2-81f1-12d2758c66b1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:08.260131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-44388dd9-cf6d-4c71-b1b7-00efd0445731 req-bf97d8ad-46d1-4ca2-81f1-12d2758c66b1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:08.275491 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-44388dd9-cf6d-4c71-b1b7-00efd0445731 req-bf97d8ad-46d1-4ca2-81f1-12d2758c66b1 service nova] Creating event network-vif-plugged:cbb2fa4e-1add-427d-941a-a5751031c83d for instance ad099c0d-4b7c-4b5d-83f7-640b11238395 on n-h1-862769-3 Oct 28 19:48:08.281330 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-44388dd9-cf6d-4c71-b1b7-00efd0445731 req-bf97d8ad-46d1-4ca2-81f1-12d2758c66b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045176 Oct 28 19:48:08.282242 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2991/5993] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:48:08.311958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:08.319787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:08.331839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:08.336531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:08.337336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:08.337983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:08.339997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:08.340741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:08.342203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:08.590447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:08.603578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8047f951-1e4a-4386-8afa-db4daacce156 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.295668 Oct 28 19:48:08.607994 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3003/5994] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:08 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:09.629494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:09.630209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:09.639075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:09.640610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:09.641058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:09.641780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:09.642237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:09.642661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:09.890434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:09.899063 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02d55aa7-bc94-42d3-a27b-fd94db8e0322 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1429 microversion: 2.1 time: 0.274520 Oct 28 19:48:09.899892 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2992/5995] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:09 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1429 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:10.923124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:10.923711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:10.931698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:10.932190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:10.932875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:10.933588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:10.934062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:10.934465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:11.178276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:11.186346 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-90894b02-111f-4bab-a0c4-a58a9a3078e9 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1610 microversion: 2.1 time: 0.268813 Oct 28 19:48:11.187170 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3004/5996] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:10 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1610 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:11.208788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:11.209513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:11.216351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:11.216846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:11.217264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:11.217982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:11.218413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:11.218871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:11.443027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:11.453156 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bd8731b-284c-4d7f-8892-c5598cf49b9f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1610 microversion: 2.1 time: 0.248189 Oct 28 19:48:11.453938 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2993/5997] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:11 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1610 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:11.475186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:11.475789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:11.482337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:11.483268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:11.483885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:11.484938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:11.485543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:11.486123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:11.693946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:48:11.703906 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef91ea47-51e5-42e6-a975-80df8989eb98 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1610 microversion: 2.1 time: 0.232239 Oct 28 19:48:11.716183 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3005/5998] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:48:11 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1610 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:48:14.886319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-41eadb43-76dd-46d2-b7e7-f6200b640413 req-cd514657-2183-42e1-a693-f7e125e99c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad099c0d-4b7c-4b5d-83f7-640b11238395", "tag": "cbb2fa4e-1add-427d-941a-a5751031c83d"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:48:14.902548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-41eadb43-76dd-46d2-b7e7-f6200b640413 req-cd514657-2183-42e1-a693-f7e125e99c13 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:14.903184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-41eadb43-76dd-46d2-b7e7-f6200b640413 req-cd514657-2183-42e1-a693-f7e125e99c13 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:14.904993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-41eadb43-76dd-46d2-b7e7-f6200b640413 req-cd514657-2183-42e1-a693-f7e125e99c13 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:14.919851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-41eadb43-76dd-46d2-b7e7-f6200b640413 req-cd514657-2183-42e1-a693-f7e125e99c13 service nova] Creating event network-changed:cbb2fa4e-1add-427d-941a-a5751031c83d for instance ad099c0d-4b7c-4b5d-83f7-640b11238395 on n-h1-862769-3 Oct 28 19:48:14.928097 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-41eadb43-76dd-46d2-b7e7-f6200b640413 req-cd514657-2183-42e1-a693-f7e125e99c13 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046864 Oct 28 19:48:14.933624 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2994/5999] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:48:50.877737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:48:50.878547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:48:50.880600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:50.881261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=38 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:50.888452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:50.889004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:50.889546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:50.890252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:48:50.890815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:48:50.891136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:48:50.917859 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-79d8a8db-9ca1-40ee-9a6a-3b14a2d5de3f tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046372 Oct 28 19:48:50.918458 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3006/6000] 10.222.0.44 () {58 vars in 1293 bytes} [Fri Oct 28 19:48:50 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395/os-server-password => generated 116 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:49:14.832052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:14.832825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=42 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:14.837883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-44725151", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e7d33a3f-9b0c-409e-a7ba-6a6e1e148adf"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:49:14.896114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] validate_networks() for [('e7d33a3f-9b0c-409e-a7ba-6a6e1e148adf', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:49:15.279195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:49:15.279629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:49:15.280110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:49:15.280530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:49:15.280926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:49:15.291572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:15.292352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:15.292793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:15.293539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:15.293998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:15.294424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:15.313789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Getting quotas for project 5685443c52e64a25b77d76bf389616ac. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:49:15.319560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Getting quotas for user faf555efb21645af95e8bdfd607b3fd1 and project 5685443c52e64a25b77d76bf389616ac. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:49:15.332505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:49:15.334991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:49:15.385309 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d742311d-31ea-4048-b6f2-ff5cd443999e tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556027 Oct 28 19:49:15.386097 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2995/6001] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:49:15.397662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dbbbd22c-97c5-47e9-8d08-8f167b32f0a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:15.398263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dbbbd22c-97c5-47e9-8d08-8f167b32f0a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:15.401400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:15.402098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:15.471024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dbbbd22c-97c5-47e9-8d08-8f167b32f0a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:15.481201 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dbbbd22c-97c5-47e9-8d08-8f167b32f0a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1217 microversion: 2.1 time: 0.086855 Oct 28 19:49:15.482657 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3007/6002] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:15 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:49:16.505998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:16.511648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:16.518412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:16.518937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:16.519381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:16.520127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:16.521140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:16.521564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:16.592482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:16.600918 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-896c3884-fd09-4c57-bcc7-c0c25f14476b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1269 microversion: 2.1 time: 0.099788 Oct 28 19:49:16.616831 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2996/6003] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:16 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:17.626371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:17.627066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:17.635331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:17.635817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:17.636385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:17.636967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:17.637417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:17.637830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:17.797953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:17.807510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6ab2085d-7a96-423b-b69d-e75c121db2af tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.185699 Oct 28 19:49:17.808762 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3008/6004] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:17 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:18.320812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f187d0a6-3124-49b9-923f-977f9d48825c req-6c680edc-ef9f-457a-810e-99bf39d5894e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12d3c2f-d343-48c6-96d7-e8cda0fde6a5", "tag": "4bd0e9f3-fd9e-45d9-ac77-5dfd24f97dba"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:49:18.337719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f187d0a6-3124-49b9-923f-977f9d48825c req-6c680edc-ef9f-457a-810e-99bf39d5894e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:18.338536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f187d0a6-3124-49b9-923f-977f9d48825c req-6c680edc-ef9f-457a-810e-99bf39d5894e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:18.339016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f187d0a6-3124-49b9-923f-977f9d48825c req-6c680edc-ef9f-457a-810e-99bf39d5894e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:18.366598 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f187d0a6-3124-49b9-923f-977f9d48825c req-6c680edc-ef9f-457a-810e-99bf39d5894e service nova] Creating event network-changed:4bd0e9f3-fd9e-45d9-ac77-5dfd24f97dba for instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 on n-h2-862769-3 Oct 28 19:49:18.373205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f187d0a6-3124-49b9-923f-977f9d48825c req-6c680edc-ef9f-457a-810e-99bf39d5894e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061311 Oct 28 19:49:18.374239 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2997/6005] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:49:18.834215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:18.835844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:18.850560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:18.851712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:18.852902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:18.854140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:18.854836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:18.855864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:18.999167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:19.007633 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1350ef4f-b86b-4458-9e80-28b5feb82625 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.178679 Oct 28 19:49:19.008246 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3009/6006] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:18 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:20.032925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:20.033509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:20.040677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:20.041200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:20.041641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:20.042347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:20.042835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:20.043287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:20.196805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:20.205510 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-90030978-66f7-4e71-b3e5-bee0874c918a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.178007 Oct 28 19:49:20.206112 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2998/6007] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:20 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:21.229067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:21.233879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:21.240357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:21.240857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:21.241276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:21.241982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:21.242460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:21.242957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:21.395876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:21.405047 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69246d61-6aae-4ad5-8d7e-881dce4fd475 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.180045 Oct 28 19:49:21.405656 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3010/6008] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:21 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:22.430406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:22.431508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:22.439559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:22.440161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:22.440666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:22.441443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:22.442231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:22.442652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:22.649580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:22.658601 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b25a702f-bee2-4984-8a73-7ef2c317e78a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.232971 Oct 28 19:49:22.659511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 2999/6009] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:22 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:49:23.683442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:23.684207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:23.691882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:23.692473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:23.692955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:23.693757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:23.694310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:23.694855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:23.842385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:23.850522 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f969adf2-aac3-4f9c-b9ac-37db1be8b671 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.172766 Oct 28 19:49:23.851147 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3011/6010] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:23 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:24.603821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-10fb12e4-3959-47b4-8791-4948fb9a1849 req-2cfc6fc4-49d8-4eb8-8dac-45eaaf6471e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12d3c2f-d343-48c6-96d7-e8cda0fde6a5", "name": "network-vif-plugged", "status": "completed", "tag": "4bd0e9f3-fd9e-45d9-ac77-5dfd24f97dba"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:49:24.617202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-10fb12e4-3959-47b4-8791-4948fb9a1849 req-2cfc6fc4-49d8-4eb8-8dac-45eaaf6471e5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:24.617963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-10fb12e4-3959-47b4-8791-4948fb9a1849 req-2cfc6fc4-49d8-4eb8-8dac-45eaaf6471e5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:24.621072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-10fb12e4-3959-47b4-8791-4948fb9a1849 req-2cfc6fc4-49d8-4eb8-8dac-45eaaf6471e5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:24.636510 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-10fb12e4-3959-47b4-8791-4948fb9a1849 req-2cfc6fc4-49d8-4eb8-8dac-45eaaf6471e5 service nova] Creating event network-vif-plugged:4bd0e9f3-fd9e-45d9-ac77-5dfd24f97dba for instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 on n-h2-862769-3 Oct 28 19:49:24.644083 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-10fb12e4-3959-47b4-8791-4948fb9a1849 req-2cfc6fc4-49d8-4eb8-8dac-45eaaf6471e5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044492 Oct 28 19:49:24.644926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3000/6011] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:49:24.874096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:24.874726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:24.882278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:24.882818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:24.883253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:24.884278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:24.884476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:24.884899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:25.026635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:25.035356 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41e5da2a-c7eb-44ae-9a2f-77ed07935290 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1317 microversion: 2.1 time: 0.165347 Oct 28 19:49:25.035982 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3012/6012] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:24 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:26.056686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:26.057559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:26.063277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:49:26.064005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:26.071482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:26.071970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:26.072455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:26.073166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:26.073629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:26.074059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:26.213672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:49:26.222141 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37634fb5-01d4-4315-a07a-6aa34e10df62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1507 microversion: 2.1 time: 0.166386 Oct 28 19:49:26.222955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3001/6013] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:49:26 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:49:43.810094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f3d0a0-c92c-4de3-b37e-023a11c44d11", "device": "/dev/sdb"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:49:43.813644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:49:43.815782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:43.817577 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:49:43.817774 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 19:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5/os-volume_attachments (ip 10.222.0.44) !!! Oct 28 19:49:43.819194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=14 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:43.820240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=30 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:43.833283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:43.833771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:43.834202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:43.834929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:49:43.835376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:49:43.835787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:49:44.150262 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c08cd52e-03ef-4316-8b85-1ee794ee3ee3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "POST /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343942 Oct 28 19:49:44.151353 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3013/6014] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:49:43 2022] POST /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:50:08.624343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:08.625205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:08.630522 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:50:08.630863 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 19:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5/os-volume_attachments/14f3d0a0-c92c-4de3-b37e-023a11c44d11 (ip 10.222.0.44) !!! Oct 28 19:50:08.633784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:08.634961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=30 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:08.649181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:08.649674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:08.650107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:08.650871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:08.651337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:08.651771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:08.752912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lazy-loading 'services' on Instance uuid a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:50:08.847721 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9966798-412e-4348-a332-a89247e6e97c tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5/os-volume_attachments/14f3d0a0-c92c-4de3-b37e-023a11c44d11" status: 202 len: 0 microversion: 2.1 time: 0.234253 Oct 28 19:50:08.848816 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3002/6015] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:50:08 2022] DELETE /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5/os-volume_attachments/14f3d0a0-c92c-4de3-b37e-023a11c44d11 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:50:14.356265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:14.357605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:14.365075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:14.366004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:14.375462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:14.375968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:14.376401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:14.377125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:14.377576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:14.378000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:14.410500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:50:14.513128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ceb42c9a-6c93-4ced-9112-499cadc9604b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 204 len: 0 microversion: 2.1 time: 0.159682 Oct 28 19:50:14.514159 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3014/6016] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:50:14 2022] DELETE /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:50:14.524005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:14.524738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:14.532945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:14.533934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:14.535239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:14.536111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:14.537582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:14.538222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:14.697238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:14.707853 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1b043b1-891a-499f-9e51-832603cca3d9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1513 microversion: 2.1 time: 0.188563 Oct 28 19:50:14.708436 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3003/6017] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:14 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:15.733889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:15.735182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:15.748115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:15.748970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:15.749720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:15.751003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:15.751828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:15.752549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:15.906738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:15.915637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80d35da0-c738-4436-8c61-0af5bc42d204 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1513 microversion: 2.1 time: 0.186377 Oct 28 19:50:15.916325 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3015/6018] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:15 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:16.706117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2b9a6b98-be81-41ef-90b1-f49986c0c977 req-f977c91e-a4d4-469a-9d3e-1419a3c232e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12d3c2f-d343-48c6-96d7-e8cda0fde6a5", "name": "network-vif-deleted", "tag": "4bd0e9f3-fd9e-45d9-ac77-5dfd24f97dba"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:16.722985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2b9a6b98-be81-41ef-90b1-f49986c0c977 req-f977c91e-a4d4-469a-9d3e-1419a3c232e5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:16.723605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2b9a6b98-be81-41ef-90b1-f49986c0c977 req-f977c91e-a4d4-469a-9d3e-1419a3c232e5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:16.724318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2b9a6b98-be81-41ef-90b1-f49986c0c977 req-f977c91e-a4d4-469a-9d3e-1419a3c232e5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:16.737231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2b9a6b98-be81-41ef-90b1-f49986c0c977 req-f977c91e-a4d4-469a-9d3e-1419a3c232e5 service nova] Creating event network-vif-deleted:4bd0e9f3-fd9e-45d9-ac77-5dfd24f97dba for instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 on n-h2-862769-3 Oct 28 19:50:16.743254 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2b9a6b98-be81-41ef-90b1-f49986c0c977 req-f977c91e-a4d4-469a-9d3e-1419a3c232e5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248277 Oct 28 19:50:16.744130 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3004/6019] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:50:16.941657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:16.942654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:16.954222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:16.955040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:16.955763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:16.956923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:16.957684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:16.958378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:17.010856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:17.011703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:17.012406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:17.012950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lazy-loading 'fault' on Instance uuid a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:50:17.061199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:17.071133 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb3ff73c-a62c-486b-9735-7f7b306ae81d tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 200 len: 1307 microversion: 2.1 time: 0.134597 Oct 28 19:50:17.071986 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3016/6020] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:16 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:18.102766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:18.103566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: a12d3c2f-d343-48c6-96d7-e8cda0fde6a5] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:18.111982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:18.112476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:18.112908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:18.113618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:18.114072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:18.114491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:18.129717 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] HTTP exception thrown: Instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 could not be found. Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Request method failure captured: Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 HTTP/1.1 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDH7-M1RYKZZ7LJsqCZ9pg-CJPyDDOVA1lQoyPN8O0P7KqqOc5G88LNvGsf2JGB_0rtOYjDML5XQGwuNQPZLRZ-EJFYNiFNFRUjVzUvzS1LXhavBqn1fY4qwiMMZpD2EEjZDjjUEJSZOfIoX0iptMg3VOlCStk7dxOZykB1hmeAUTGE Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 5685443c52e64a25b77d76bf389616ac Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-VolumesSnapshotTestJSON-567146970 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5685443c52e64a25b77d76bf389616ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5685443c52e64a25b77d76bf389616ac", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5685443c52e64a25b77d76bf389616ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5685443c52e64a25b77d76bf389616ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-VolumesSnapshotTestJSON-567146970 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 5685443c52e64a25b77d76bf389616ac Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-567146970 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-VolumesSnapshotTestJSON-567146970-project Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: faf555efb21645af95e8bdfd607b3fd1 Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-VolumesSnapshotTestJSON-567146970-project Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 could not be found. Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a12d3c2f-d343-48c6-96d7-e8cda0fde6a5'} Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 could not be found. Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 could not be found. Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:50:18.131361 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 could not be found. Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Returning 404 to user: Instance a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d53afbba-84ad-4155-82d8-e1dd7e2fb5ad tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5" status: 404 len: 111 microversion: 2.1 time: 0.040698 Oct 28 19:50:18.142395 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3005/6021] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:18 2022] GET /compute/v2.1/servers/a12d3c2f-d343-48c6-96d7-e8cda0fde6a5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:50:20.616085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68a70902-9892-4aaa-8935-7248e045de59 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Action: 'create', calling method: .version_select at 0x7f1d77f6edc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1202637748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmMVyaIx5e8FBCcEsyzloAeIZ3DBUl7CWcDJpyo1quNgnb/Zf3CcorgQyJu/457BQeSFsGXkXjSXU6p0EeceOSpqCrea6+vmEpRJjF7AQuVbsGukCCZrHz+9wUvFVuJ4g=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:20.633853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-68a70902-9892-4aaa-8935-7248e045de59 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Getting quotas for project 4651b17cc9e04a10a14c76e79b9673f2. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:50:20.642653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-68a70902-9892-4aaa-8935-7248e045de59 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Getting quotas for user 0b46805c61464db49969a5a1a5690588 and project 4651b17cc9e04a10a14c76e79b9673f2. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:50:20.677753 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68a70902-9892-4aaa-8935-7248e045de59 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.254278 Oct 28 19:50:20.686603 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3017/6022] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:50:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:50:25.266304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1429433173", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e7d33a3f-9b0c-409e-a7ba-6a6e1e148adf"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:25.380483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] validate_networks() for [('e7d33a3f-9b0c-409e-a7ba-6a6e1e148adf', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:50:25.906610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:50:25.907110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:50:25.913291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:50:25.913905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:50:25.914409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:50:25.927154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:25.928023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:25.932492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:25.933588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:25.934265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:25.935062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:25.959127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Getting quotas for project 5685443c52e64a25b77d76bf389616ac. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:50:25.967064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Getting quotas for user faf555efb21645af95e8bdfd607b3fd1 and project 5685443c52e64a25b77d76bf389616ac. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:50:25.984749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:50:25.987260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:50:26.052550 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5df61c00-13ed-4365-97fb-2a66e8fd8b99 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799692 Oct 28 19:50:26.053532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3006/6023] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:50:26.066562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64cf0ffe-8237-4ac6-ba55-52437dd41e52 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:26.067341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64cf0ffe-8237-4ac6-ba55-52437dd41e52 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:26.192669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-64cf0ffe-8237-4ac6-ba55-52437dd41e52 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:26.204083 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64cf0ffe-8237-4ac6-ba55-52437dd41e52 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1219 microversion: 2.1 time: 0.142899 Oct 28 19:50:26.224205 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3018/6024] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:26 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:27.230769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:27.235323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:27.253971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:27.254829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:27.256442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:27.257855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:27.258503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:27.259148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:27.342656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:27.354210 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1174084-f1c3-429e-acfd-e4055b96d09a tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1271 microversion: 2.1 time: 0.128754 Oct 28 19:50:27.355276 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3007/6025] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:27 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:28.270193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1011774814-access_point-1434362081", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1021d1cc-fe4d-47bd-9809-a85987b777d6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1202637748", "security_groups": [{"name": "tempest-secgroup_access--1384004876"}, {"name": "tempest-secgroup_general--876908214"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:28.281896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:28.381563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:28.382361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:28.403388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:28.403955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:28.404423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:28.405194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:28.405671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:28.406112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:28.477029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] validate_networks() for [('1021d1cc-fe4d-47bd-9809-a85987b777d6', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:50:28.739116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:28.755749 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ec26a80-2475-423d-8dac-5fea1b6737c7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.378301 Oct 28 19:50:28.756859 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3008/6026] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:28 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:29.184696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:50:29.185425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:50:29.186085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:50:29.186669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:50:29.187312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:50:29.199234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:29.200111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:29.200845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:29.201910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:29.202603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:29.203280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:29.261714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Getting quotas for project 4651b17cc9e04a10a14c76e79b9673f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:50:29.273039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Getting quotas for user 0b46805c61464db49969a5a1a5690588 and project 4651b17cc9e04a10a14c76e79b9673f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:50:29.301379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:50:29.304055 n-d-862769-3 devstack@n-api.service[120629]: WARNING nova.utils [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1011774814-access_point-1434362081 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1011774814-ac Oct 28 19:50:29.305158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:50:29.372384 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e59e577-ee4a-4771-889b-6c89a8356a4b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.106202 Oct 28 19:50:29.374278 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3019/6027] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:50:28 2022] POST /compute/v2.1/servers => generated 457 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:50:29.387426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed2ba49d-5cca-436c-83ed-5510bd7ceec7 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:29.389780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed2ba49d-5cca-436c-83ed-5510bd7ceec7 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:29.489347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ed2ba49d-5cca-436c-83ed-5510bd7ceec7 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:29.501453 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed2ba49d-5cca-436c-83ed-5510bd7ceec7 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1295 microversion: 2.1 time: 0.118999 Oct 28 19:50:29.502385 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3009/6028] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:29 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:29.782872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:29.783890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:29.788168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-bf81865e-c0a1-4a05-a7ab-447faee0b2bf req-d54c44ad-15fb-4065-bbb0-12817d9607d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc29c95-ebbe-494d-98e4-343f1049ac54", "tag": "a840f4fc-cd53-473e-b429-3798266cd5df"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:29.803232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:29.806719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:29.809299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:29.810954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:29.813038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:29.814003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:29.815421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bf81865e-c0a1-4a05-a7ab-447faee0b2bf req-d54c44ad-15fb-4065-bbb0-12817d9607d8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:29.815909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bf81865e-c0a1-4a05-a7ab-447faee0b2bf req-d54c44ad-15fb-4065-bbb0-12817d9607d8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:29.816342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bf81865e-c0a1-4a05-a7ab-447faee0b2bf req-d54c44ad-15fb-4065-bbb0-12817d9607d8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:29.855578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-bf81865e-c0a1-4a05-a7ab-447faee0b2bf req-d54c44ad-15fb-4065-bbb0-12817d9607d8 service nova] Creating event network-changed:a840f4fc-cd53-473e-b429-3798266cd5df for instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 on n-h2-862769-3 Oct 28 19:50:29.873801 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-bf81865e-c0a1-4a05-a7ab-447faee0b2bf req-d54c44ad-15fb-4065-bbb0-12817d9607d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089182 Oct 28 19:50:29.874899 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3010/6029] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:50:30.107560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:30.117319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-552f8339-9fd8-47f0-b46e-9c7f64f1c54b tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.339388 Oct 28 19:50:30.122344 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3020/6030] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:29 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:30.528603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:30.529541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:30.537291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:30.537861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:30.538382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:30.539205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:30.539728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:30.540178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:30.638800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:30.657294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e286757-f75e-4e66-b68a-7710127a716d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1347 microversion: 2.1 time: 0.133824 Oct 28 19:50:30.658734 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3011/6031] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:30 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1347 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:31.149588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:31.153816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:31.165333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:31.165835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:31.166265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:31.167011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:31.167605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:31.167998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:31.350142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:31.358669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef1905f0-d805-4bff-8429-ab48a4f2edc4 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.216607 Oct 28 19:50:31.359492 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3021/6032] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:31 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:31.685404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:31.686777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:31.696865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:31.697557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:31.698114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:31.699355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:31.700100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:31.700792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:31.778177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:31.794587 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-692da9f7-50a8-4f71-8dd8-f4efe2878c8d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1353 microversion: 2.1 time: 0.115484 Oct 28 19:50:31.795782 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3012/6033] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:31 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:32.381957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:32.382615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:32.390725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:32.391265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:32.391698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:32.392666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:32.393116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:32.393716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:32.570330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:32.583897 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b7aee583-0650-48cd-af42-9df8ff12ccca tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.205729 Oct 28 19:50:32.585057 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3022/6034] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:32 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:32.825561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:32.827005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:32.839368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:32.840715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:32.841357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:32.842543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:32.843408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:32.844084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:33.061752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:33.075208 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae5f0fab-aa8d-4d0f-988d-8a17af20ea09 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.256180 Oct 28 19:50:33.076337 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3013/6035] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:32 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:33.504792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9311efe4-b17e-44f6-be81-c1df833acd7f req-148eb9a8-b55b-4cf5-ab9f-3f5cdb008b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b9440-9d9c-43dd-9c78-46fbcbfa600d", "tag": "25355470-c696-4435-b0da-84621bd8fa3f"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:33.520444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9311efe4-b17e-44f6-be81-c1df833acd7f req-148eb9a8-b55b-4cf5-ab9f-3f5cdb008b11 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:33.522645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9311efe4-b17e-44f6-be81-c1df833acd7f req-148eb9a8-b55b-4cf5-ab9f-3f5cdb008b11 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:33.531687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9311efe4-b17e-44f6-be81-c1df833acd7f req-148eb9a8-b55b-4cf5-ab9f-3f5cdb008b11 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:33.545944 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9311efe4-b17e-44f6-be81-c1df833acd7f req-148eb9a8-b55b-4cf5-ab9f-3f5cdb008b11 service nova] Creating event network-changed:25355470-c696-4435-b0da-84621bd8fa3f for instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d on n-h1-862769-3 Oct 28 19:50:33.559279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9311efe4-b17e-44f6-be81-c1df833acd7f req-148eb9a8-b55b-4cf5-ab9f-3f5cdb008b11 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058056 Oct 28 19:50:33.560114 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3023/6036] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:50:33.609760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:33.609920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:33.616622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:33.617101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:33.617609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:33.618536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:33.619027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:33.619480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:33.802131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:33.820376 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd98ca0c-b6c2-407c-8ba4-033ad09254a7 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.215004 Oct 28 19:50:33.821917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3014/6037] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:33 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:34.099706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:34.100445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:34.107192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:34.107695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:34.108132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:34.108854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:34.109317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:34.109750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:34.261653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:34.270297 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b1788cd5-7674-4879-bc6c-58c8a415f827 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.175188 Oct 28 19:50:34.270925 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3024/6038] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:34 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:34.846478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:34.847505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:34.856998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:34.857488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:34.857908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:34.858837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:34.859572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:34.860072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:35.060988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:35.074330 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5b0cf28c-7a2f-4a35-9c04-26719061b7e3 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.231655 Oct 28 19:50:35.075548 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3015/6039] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:34 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:35.096708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-85fc544b-90ea-49e6-91f4-8042b311c089 req-31858754-931b-4c70-a3d1-098b85e458b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc29c95-ebbe-494d-98e4-343f1049ac54", "name": "network-vif-plugged", "status": "completed", "tag": "a840f4fc-cd53-473e-b429-3798266cd5df"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:35.110174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-85fc544b-90ea-49e6-91f4-8042b311c089 req-31858754-931b-4c70-a3d1-098b85e458b0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:35.110973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-85fc544b-90ea-49e6-91f4-8042b311c089 req-31858754-931b-4c70-a3d1-098b85e458b0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:35.111399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-85fc544b-90ea-49e6-91f4-8042b311c089 req-31858754-931b-4c70-a3d1-098b85e458b0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:35.124510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-85fc544b-90ea-49e6-91f4-8042b311c089 req-31858754-931b-4c70-a3d1-098b85e458b0 service nova] Creating event network-vif-plugged:a840f4fc-cd53-473e-b429-3798266cd5df for instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 on n-h2-862769-3 Oct 28 19:50:35.130054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-85fc544b-90ea-49e6-91f4-8042b311c089 req-31858754-931b-4c70-a3d1-098b85e458b0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137036 Oct 28 19:50:35.130670 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3025/6040] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:50:35.295439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:35.296057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:35.302457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:35.302977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:35.303447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:35.304155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:35.304608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:35.305027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:35.499982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:35.511832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77288d78-bd6a-4f9d-962b-f468c0c86329 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.220761 Oct 28 19:50:35.512484 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3016/6041] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:35 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:36.107402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:36.108408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:36.115830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:36.116319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:36.116772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:36.117515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:36.117970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:36.118382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:36.279167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:36.288000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-127103fb-4f96-4feb-882c-8621be254957 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1319 microversion: 2.1 time: 0.188986 Oct 28 19:50:36.288597 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3026/6042] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:36 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:36.535155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:36.535797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:36.539206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:36.545175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:36.545664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:36.546083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:36.546867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:36.547317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:36.547740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:36.700341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:36.708535 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bba073d-2c26-41fd-ac1b-a7ee652e5d13 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.177315 Oct 28 19:50:36.709137 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3017/6043] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:36 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:37.321817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:37.322428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:37.329936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:37.330397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:37.330864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:37.331570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:37.332024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:37.332431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:37.496826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:37.505630 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41be6f04-1027-4d0d-8a45-b653f202ba70 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1508 microversion: 2.1 time: 0.188115 Oct 28 19:50:37.506232 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3027/6044] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:37 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:37.529338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67ea840c-4c70-4ee2-9d90-a11d4c125440", "device": "/dev/sdb"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:37.531833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:37.541542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:37.542253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:37.542477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:37.543236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:37.543682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:37.544103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:37.735288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:37.736271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:37.745902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:37.746564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:37.747150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:37.747944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:37.748459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:37.749089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:37.845632 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-41ca0895-dc01-481b-a9b6-a728797a9b49 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "POST /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319834 Oct 28 19:50:37.847036 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3018/6045] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 19:50:37 2022] POST /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:50:37.972315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:37.980639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e579a5dd-64f5-4dfd-a8a0-4f93462b059f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.251594 Oct 28 19:50:37.981238 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3028/6046] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:37 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:38.987946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6e5ab42c-00f9-4d32-b12c-8e45d40c6d0e req-ffbb11a8-3979-4557-b091-f24a595d8314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9440-9d9c-43dd-9c78-46fbcbfa600d", "name": "network-vif-plugged", "status": "completed", "tag": "25355470-c696-4435-b0da-84621bd8fa3f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:38.999573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:39.014350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:39.016872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:39.042601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e5ab42c-00f9-4d32-b12c-8e45d40c6d0e req-ffbb11a8-3979-4557-b091-f24a595d8314 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:39.043708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e5ab42c-00f9-4d32-b12c-8e45d40c6d0e req-ffbb11a8-3979-4557-b091-f24a595d8314 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:39.044904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6e5ab42c-00f9-4d32-b12c-8e45d40c6d0e req-ffbb11a8-3979-4557-b091-f24a595d8314 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:39.049935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:39.051628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:39.052711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:39.054387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:39.059810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:39.061336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:39.081568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:39.086863 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6e5ab42c-00f9-4d32-b12c-8e45d40c6d0e req-ffbb11a8-3979-4557-b091-f24a595d8314 service nova] Creating event network-vif-plugged:25355470-c696-4435-b0da-84621bd8fa3f for instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d on n-h1-862769-3 Oct 28 19:50:39.098510 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6e5ab42c-00f9-4d32-b12c-8e45d40c6d0e req-ffbb11a8-3979-4557-b091-f24a595d8314 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123188 Oct 28 19:50:39.101078 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3019/6047] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:50:39.226245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:39.295818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:39.298427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:39.306942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-38251c44-c731-4395-9e1d-610670e7765d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.304275 Oct 28 19:50:39.309094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3029/6048] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:39 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:40.332129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:40.332844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:40.336173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:40.344051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:40.344541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:40.344976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:40.345680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:40.346140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:40.346562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:40.547165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:40.560890 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf0641b7-0e35-4e58-b0a9-4299c4162f81 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1472 microversion: 2.1 time: 0.232778 Oct 28 19:50:40.574723 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3020/6049] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:40 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:41.591758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:41.592793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:41.602132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:41.602849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:41.603502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:41.604391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:41.604979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:41.605536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:41.824012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:41.837208 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc2e1e57-c4d0-41e0-a732-87c7b3a8f6b1 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1643 microversion: 2.1 time: 0.249822 Oct 28 19:50:41.837805 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3030/6050] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:41 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1643 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:41.860468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:41.861715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:41.869641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:41.870113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:41.870575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:41.871310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:41.871778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:41.872193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:42.040377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:50:42.049837 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6029d56d-401f-4b60-a501-41b2398f36fe tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1643 microversion: 2.1 time: 0.193323 Oct 28 19:50:42.063122 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3021/6051] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:41 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1643 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:50:42.074476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:50:42.075449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:50:42.082446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:42.082996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:42.083441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:42.084238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:42.084938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:42.085549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:42.457799 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f12820b3-284f-4745-b4c4-6a3086d89900 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1794 microversion: 2.1 time: 0.387760 Oct 28 19:50:42.458391 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3031/6052] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:50:42 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1794 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:50:44.733053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2ff57166-8ee2-458f-afa5-94c456be7681 req-2713e66c-e6e0-4933-9378-c11a543112e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b9440-9d9c-43dd-9c78-46fbcbfa600d", "tag": "25355470-c696-4435-b0da-84621bd8fa3f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:50:44.743862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2ff57166-8ee2-458f-afa5-94c456be7681 req-2713e66c-e6e0-4933-9378-c11a543112e0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:50:44.744557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2ff57166-8ee2-458f-afa5-94c456be7681 req-2713e66c-e6e0-4933-9378-c11a543112e0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:50:44.745007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2ff57166-8ee2-458f-afa5-94c456be7681 req-2713e66c-e6e0-4933-9378-c11a543112e0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:50:44.758057 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2ff57166-8ee2-458f-afa5-94c456be7681 req-2713e66c-e6e0-4933-9378-c11a543112e0 service nova] Creating event network-changed:25355470-c696-4435-b0da-84621bd8fa3f for instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d on n-h1-862769-3 Oct 28 19:50:44.763631 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2ff57166-8ee2-458f-afa5-94c456be7681 req-2713e66c-e6e0-4933-9378-c11a543112e0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122121 Oct 28 19:50:44.767750 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3022/6053] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:51:00.708489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:00.709057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:00.711523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:00.712250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=66 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:00.718937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:00.719738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:00.720169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:00.720862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:00.721305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:00.721721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:00.807681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lazy-loading 'services' on Instance uuid 4fc29c95-ebbe-494d-98e4-343f1049ac54 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:51:00.884875 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8be5d428-b3e9-42fa-a2de-8ed1c5e54bab tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54/os-volume_attachments/67ea840c-4c70-4ee2-9d90-a11d4c125440" status: 202 len: 0 microversion: 2.1 time: 0.179874 Oct 28 19:51:00.885541 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3032/6054] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 19:51:00 2022] DELETE /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54/os-volume_attachments/67ea840c-4c70-4ee2-9d90-a11d4c125440 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:51:06.276301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=7 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:06.277057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=15 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:06.281283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:06.281870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:06.289397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:06.289874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:06.290300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:06.291022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:06.291482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:06.291918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:06.316938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:51:06.393130 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-76cfc9e7-a1d8-488e-815a-3d58a8e1bdb9 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 204 len: 0 microversion: 2.1 time: 0.118542 Oct 28 19:51:06.393686 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3023/6055] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:51:06 2022] DELETE /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:51:06.403611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:06.404324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:06.412109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:06.412614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:06.413049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:06.413747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:06.414203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:06.414629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:06.548155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:06.556674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fef72d13-a308-4736-9bf6-d6145019fc62 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1514 microversion: 2.1 time: 0.157354 Oct 28 19:51:06.557248 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3033/6056] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:06 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:07.581924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:07.582641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:07.590599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:07.591137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:07.591570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:07.592336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:07.593037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:07.594152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:07.750429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:07.758650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-833343f3-0758-47da-888c-f25dc911ec01 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1514 microversion: 2.1 time: 0.181528 Oct 28 19:51:07.759325 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3024/6057] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:07 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:08.414711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b207b2ed-ac2b-4bd2-8693-b9ff73ffa76f req-32338dc9-3ad3-4111-901f-d4cda4200c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc29c95-ebbe-494d-98e4-343f1049ac54", "name": "network-vif-deleted", "tag": "a840f4fc-cd53-473e-b429-3798266cd5df"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:08.425341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b207b2ed-ac2b-4bd2-8693-b9ff73ffa76f req-32338dc9-3ad3-4111-901f-d4cda4200c18 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:08.425820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b207b2ed-ac2b-4bd2-8693-b9ff73ffa76f req-32338dc9-3ad3-4111-901f-d4cda4200c18 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:08.426236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b207b2ed-ac2b-4bd2-8693-b9ff73ffa76f req-32338dc9-3ad3-4111-901f-d4cda4200c18 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:08.438746 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b207b2ed-ac2b-4bd2-8693-b9ff73ffa76f req-32338dc9-3ad3-4111-901f-d4cda4200c18 service nova] Creating event network-vif-deleted:a840f4fc-cd53-473e-b429-3798266cd5df for instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 on n-h2-862769-3 Oct 28 19:51:08.444441 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b207b2ed-ac2b-4bd2-8693-b9ff73ffa76f req-32338dc9-3ad3-4111-901f-d4cda4200c18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033973 Oct 28 19:51:08.445064 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3034/6058] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:51:08.782066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:08.782779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:08.790808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:08.791319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:08.791777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:08.792493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:08.792949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:08.793372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:08.827689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:08.828191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:08.828632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:08.829289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lazy-loading 'fault' on Instance uuid 4fc29c95-ebbe-494d-98e4-343f1049ac54 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:51:08.875188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf555efb21645af95e8bdfd607b3fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685443c52e64a25b77d76bf389616ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:08.883947 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36651785-1b9a-4581-a26c-e1e91c678896 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 200 len: 1309 microversion: 2.1 time: 0.105917 Oct 28 19:51:08.884592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3025/6059] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:08 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:09.910285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:09.911018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] [instance: 4fc29c95-ebbe-494d-98e4-343f1049ac54] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:09.918673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:09.919205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:09.919713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:09.920363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:09.920827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:09.921252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:09.935932 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] HTTP exception thrown: Instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 could not be found. Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Request method failure captured: Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 HTTP/1.1 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDH7-M1RYKZZ7LJsqCZ9pg-CJPyDDOVA1lQoyPN8O0P7KqqOc5G88LNvGsf2JGB_0rtOYjDML5XQGwuNQPZLRZ-EJFYNiFNFRUjVzUvzS1LXhavBqn1fY4qwiMMZpD2EEjZDjjUEJSZOfIoX0iptMg3VOlCStk7dxOZykB1hmeAUTGE Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 5685443c52e64a25b77d76bf389616ac Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-VolumesSnapshotTestJSON-567146970 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5685443c52e64a25b77d76bf389616ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5685443c52e64a25b77d76bf389616ac", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5685443c52e64a25b77d76bf389616ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5685443c52e64a25b77d76bf389616ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-VolumesSnapshotTestJSON-567146970 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 5685443c52e64a25b77d76bf389616ac Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-567146970 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-VolumesSnapshotTestJSON-567146970-project Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: faf555efb21645af95e8bdfd607b3fd1 Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-VolumesSnapshotTestJSON-567146970-project Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 could not be found. Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4fc29c95-ebbe-494d-98e4-343f1049ac54'} Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 could not be found. Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 could not be found. Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:51:09.937621 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 could not be found. Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] Returning 404 to user: Instance 4fc29c95-ebbe-494d-98e4-343f1049ac54 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8cac60c8-6f28-455c-9f15-2f4d71d92198 tempest-VolumesSnapshotTestJSON-567146970 tempest-VolumesSnapshotTestJSON-567146970-project] 10.222.0.44 "GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54" status: 404 len: 111 microversion: 2.1 time: 0.034148 Oct 28 19:51:09.942390 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3035/6060] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:09 2022] GET /compute/v2.1/servers/4fc29c95-ebbe-494d-98e4-343f1049ac54 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:51:27.790522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1725183870", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "8fc368a9-47b6-44bd-932d-db694fa2264d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1202637748", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c18b9440-9d9c-43dd-9c78-46fbcbfa600d"]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:27.871361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:27.873451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:27.926563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] validate_networks() for [('8fc368a9-47b6-44bd-932d-db694fa2264d', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:51:28.401006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:51:28.401443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:51:28.401893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:51:28.402605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:51:28.403054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:51:28.414936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:28.415432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:28.416027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:28.416910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:28.417577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:28.418252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:28.437682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Getting quotas for project 4651b17cc9e04a10a14c76e79b9673f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:51:28.443447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Getting quotas for user 0b46805c61464db49969a5a1a5690588 and project 4651b17cc9e04a10a14c76e79b9673f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:51:28.457292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:51:28.459747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:51:28.537605 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3caa0351-d0b3-4a62-8b3a-7db3ced895c9 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.757339 Oct 28 19:51:28.545895 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3026/6061] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:51:27 2022] POST /compute/v2.1/servers => generated 361 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:51:28.550170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d939a828-12f7-4dac-99cd-385bbd883173 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:28.560546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d939a828-12f7-4dac-99cd-385bbd883173 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:28.576887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:28.579764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:28.685064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d939a828-12f7-4dac-99cd-385bbd883173 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:28.695519 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d939a828-12f7-4dac-99cd-385bbd883173 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1242 microversion: 2.1 time: 0.149172 Oct 28 19:51:28.705287 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3036/6062] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:28 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:51:29.721374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:29.722795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:29.733168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:29.734015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:29.734740 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:29.735712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:29.736399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:29.737023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:29.839535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:29.848406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fca82836-9102-4d73-b527-7da46d77ba0d tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1294 microversion: 2.1 time: 0.132003 Oct 28 19:51:29.850634 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3027/6063] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:29 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:30.874702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:30.875342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:30.888810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:30.889339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:30.889791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:30.890559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:30.894883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:30.895151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:31.013545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:31.026937 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d166a4c-a72e-4787-80a8-365cde3607ea tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.156072 Oct 28 19:51:31.040509 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3037/6064] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:30 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:31.538190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8775aa2a-87d4-49e3-a92e-09fba2a070e6 req-eb3b5e3a-d167-45f8-a3d4-f349a8a8e5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09fbf2c-87ed-4110-80c4-f0c75aebda82", "tag": "4a54bd96-9755-4d2d-9967-62e18c5b76c6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:31.552015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8775aa2a-87d4-49e3-a92e-09fba2a070e6 req-eb3b5e3a-d167-45f8-a3d4-f349a8a8e5f7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:31.552886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8775aa2a-87d4-49e3-a92e-09fba2a070e6 req-eb3b5e3a-d167-45f8-a3d4-f349a8a8e5f7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:31.554140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8775aa2a-87d4-49e3-a92e-09fba2a070e6 req-eb3b5e3a-d167-45f8-a3d4-f349a8a8e5f7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:31.571753 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8775aa2a-87d4-49e3-a92e-09fba2a070e6 req-eb3b5e3a-d167-45f8-a3d4-f349a8a8e5f7 service nova] Creating event network-changed:4a54bd96-9755-4d2d-9967-62e18c5b76c6 for instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 on n-h2-862769-3 Oct 28 19:51:31.578043 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8775aa2a-87d4-49e3-a92e-09fba2a070e6 req-eb3b5e3a-d167-45f8-a3d4-f349a8a8e5f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046895 Oct 28 19:51:31.578673 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3028/6065] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:51:32.052900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:32.054000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:32.069721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:32.070220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:32.070659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:32.071428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:32.072081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:32.072510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:32.162592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:32.171400 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c1d1470-b71d-45ce-abbb-794bcc23ead8 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.122780 Oct 28 19:51:32.172013 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3038/6066] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:32 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:33.197674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:33.199171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:33.207067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:33.207865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:33.208476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:33.209460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:33.210201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:33.210634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:33.330654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:33.342979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f9c7081-4ebc-403a-b568-2a9dc068c977 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.149817 Oct 28 19:51:33.353400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3029/6067] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:33 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:34.367561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:34.368170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:34.375451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:34.375944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:34.376379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:34.377167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:34.377622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:34.378230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:34.465781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:34.474153 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f30f3158-3e87-4b7f-9244-afb01c44cb5e tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.110586 Oct 28 19:51:34.474981 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3039/6068] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:34 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:35.497797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:35.499148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:35.506836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:35.507354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:35.507799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:35.508600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:35.509279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:35.509735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:35.602839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:35.613152 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ab6eea87-f674-4abf-a211-1c45c9c5b529 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.119015 Oct 28 19:51:35.613998 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3030/6069] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:35 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:36.637661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:36.638280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:36.645504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:36.646585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:36.646762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:36.647438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:36.648088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:36.648507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:36.734514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:36.742515 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ad2de6b7-1e93-4d6c-ace0-fecbd4f2cd0b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.109441 Oct 28 19:51:36.743140 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3040/6070] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:36 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:37.291404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-da74a02e-a2c6-4cc4-a18d-8fa837828af9 req-da09cbf5-af49-41c9-8999-f17cc31e7df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09fbf2c-87ed-4110-80c4-f0c75aebda82", "name": "network-vif-plugged", "status": "completed", "tag": "4a54bd96-9755-4d2d-9967-62e18c5b76c6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:37.302015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-da74a02e-a2c6-4cc4-a18d-8fa837828af9 req-da09cbf5-af49-41c9-8999-f17cc31e7df6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:37.302654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-da74a02e-a2c6-4cc4-a18d-8fa837828af9 req-da09cbf5-af49-41c9-8999-f17cc31e7df6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:37.303259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-da74a02e-a2c6-4cc4-a18d-8fa837828af9 req-da09cbf5-af49-41c9-8999-f17cc31e7df6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:37.315748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-da74a02e-a2c6-4cc4-a18d-8fa837828af9 req-da09cbf5-af49-41c9-8999-f17cc31e7df6 service nova] Creating event network-vif-plugged:4a54bd96-9755-4d2d-9967-62e18c5b76c6 for instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 on n-h2-862769-3 Oct 28 19:51:37.321114 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-da74a02e-a2c6-4cc4-a18d-8fa837828af9 req-da09cbf5-af49-41c9-8999-f17cc31e7df6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034229 Oct 28 19:51:37.321745 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3031/6071] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:51:37.765530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:37.766809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:37.774729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:37.775230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:37.775686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:37.776356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:37.776992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:37.777415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:37.871880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:37.880482 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7fcc052f-7ca5-41dc-bf97-6098947d720a tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1300 microversion: 2.1 time: 0.118719 Oct 28 19:51:37.881048 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3041/6072] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:37 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:38.904056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:38.905071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:38.909510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:38.910237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:38.917971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:38.918449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:38.918914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:38.919609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:38.920058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:38.920477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.015843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:39.024830 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c2d87742-a5af-4f41-bb72-0155ff4b3aeb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1472 microversion: 2.1 time: 0.122892 Oct 28 19:51:39.025440 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3032/6073] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:38 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:51:39.048292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:39.049036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:39.051163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:39.058554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.059164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.059666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.060443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.061020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.061610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.151068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:39.160181 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b8fe5a5d-aae2-49a3-8642-2a4baf71ce2f tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1472 microversion: 2.1 time: 0.115741 Oct 28 19:51:39.160752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3042/6074] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:39 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:39.183376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:39.183999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:39.190517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.191051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.191493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.192325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.192784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.193214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.284000 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a013eaa-9c86-4c8a-b3fa-1520d258f8e1 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1623 microversion: 2.1 time: 0.104326 Oct 28 19:51:39.284789 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3033/6075] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:39 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1623 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:39.307502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:39.308125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:39.314615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.315162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.315617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.316338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.316789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.317207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.467545 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f5096498-41c7-4167-a75c-bcc27cece3c6 tempest-TestSecurityGroupsBasicOps-985259352 tempest-TestSecurityGroupsBasicOps-985259352-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1912 microversion: 2.1 time: 0.163795 Oct 28 19:51:39.468315 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3043/6076] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:39 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1912 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:39.536215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:39.536723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:39.545184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.545394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.545674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.546402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.546883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.547597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.577369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:51:39.664672 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2172487a-950c-42e4-be6e-b9adba9b7337 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 204 len: 0 microversion: 2.1 time: 0.132076 Oct 28 19:51:39.666170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3034/6077] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:51:39 2022] DELETE /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:51:39.674681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:39.675369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:39.682012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.682515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.683073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.683790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:39.684244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:39.684670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:39.771670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:39.780318 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2520e2c-93ef-4bb7-8542-d8e0523140e5 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1478 microversion: 2.1 time: 0.109776 Oct 28 19:51:39.781307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3044/6078] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:39 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1478 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:40.806034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:40.806992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:40.814707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:40.815352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:40.815890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:40.816727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:40.817526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:40.818674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:40.914453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:40.931959 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f89f54e4-6e90-4562-9d32-480191759aa0 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 200 len: 1478 microversion: 2.1 time: 0.131233 Oct 28 19:51:40.933758 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3035/6079] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:40 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 1478 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:41.436839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a5e0ee6f-af54-4966-88ee-c97d3f7b4356 req-57f3b7bd-13e0-4aeb-ac70-fa9a36a3cf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09fbf2c-87ed-4110-80c4-f0c75aebda82", "name": "network-vif-deleted", "tag": "4a54bd96-9755-4d2d-9967-62e18c5b76c6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:41.454134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5e0ee6f-af54-4966-88ee-c97d3f7b4356 req-57f3b7bd-13e0-4aeb-ac70-fa9a36a3cf48 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:41.454669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5e0ee6f-af54-4966-88ee-c97d3f7b4356 req-57f3b7bd-13e0-4aeb-ac70-fa9a36a3cf48 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:41.455253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a5e0ee6f-af54-4966-88ee-c97d3f7b4356 req-57f3b7bd-13e0-4aeb-ac70-fa9a36a3cf48 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:41.471095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a5e0ee6f-af54-4966-88ee-c97d3f7b4356 req-57f3b7bd-13e0-4aeb-ac70-fa9a36a3cf48 service nova] Creating event network-vif-deleted:4a54bd96-9755-4d2d-9967-62e18c5b76c6 for instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 on n-h2-862769-3 Oct 28 19:51:41.476658 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a5e0ee6f-af54-4966-88ee-c97d3f7b4356 req-57f3b7bd-13e0-4aeb-ac70-fa9a36a3cf48 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046218 Oct 28 19:51:41.480298 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3045/6080] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:51:41.958213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:41.959559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c09fbf2c-87ed-4110-80c4-f0c75aebda82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:41.967259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:41.967751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:41.968174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:41.968887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:41.969335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:41.969751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:41.986601 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] HTTP exception thrown: Instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 could not be found. Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Request method failure captured: Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 HTTP/1.1 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDJ7EHjjtLiLCQ6VZ9HmyeEF-4rGCfwcoqydwZbT8gxu0sn9T3mrLy_6-I0UqSAcw3W7O7u4VcbkdPrQuHPIbC4XCsPnvuqvlCsLPjFGpuNLF14N1CId8pzeOaLkFV2wmCR_BR2zYFDGH3nyPPsJwSbp_Vp58q7N8k1WHR9aJu_w9Ro Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 4651b17cc9e04a10a14c76e79b9673f2 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1011774814 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4651b17cc9e04a10a14c76e79b9673f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4651b17cc9e04a10a14c76e79b9673f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4651b17cc9e04a10a14c76e79b9673f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4651b17cc9e04a10a14c76e79b9673f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1011774814 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 4651b17cc9e04a10a14c76e79b9673f2 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1011774814 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestSecurityGroupsBasicOps-1011774814-project Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0b46805c61464db49969a5a1a5690588 Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1011774814-project Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 could not be found. Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c09fbf2c-87ed-4110-80c4-f0c75aebda82'} Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 could not be found. Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 could not be found. Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:41.988264 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 could not be found. Oct 28 19:51:41.992899 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:41.994431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Returning 404 to user: Instance c09fbf2c-87ed-4110-80c4-f0c75aebda82 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:51:41.995346 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a2f15f22-7817-49c7-a245-0f0988000874 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82" status: 404 len: 111 microversion: 2.1 time: 0.041348 Oct 28 19:51:41.996103 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3036/6081] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:41 2022] GET /compute/v2.1/servers/c09fbf2c-87ed-4110-80c4-f0c75aebda82 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:51:46.932471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:46.933135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:46.934624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fda81569-a4f3-407c-bf42-cb2782add96c req-79627bd4-5804-4cb8-99b0-cc22b1f36812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b9440-9d9c-43dd-9c78-46fbcbfa600d", "tag": "25355470-c696-4435-b0da-84621bd8fa3f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:46.942058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:46.942677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:46.943271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:46.944081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:46.944656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:46.945621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:46.946656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fda81569-a4f3-407c-bf42-cb2782add96c req-79627bd4-5804-4cb8-99b0-cc22b1f36812 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:46.947376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fda81569-a4f3-407c-bf42-cb2782add96c req-79627bd4-5804-4cb8-99b0-cc22b1f36812 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:46.947817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fda81569-a4f3-407c-bf42-cb2782add96c req-79627bd4-5804-4cb8-99b0-cc22b1f36812 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:46.964275 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fda81569-a4f3-407c-bf42-cb2782add96c req-79627bd4-5804-4cb8-99b0-cc22b1f36812 service nova] Creating event network-changed:25355470-c696-4435-b0da-84621bd8fa3f for instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d on n-h1-862769-3 Oct 28 19:51:46.972065 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fda81569-a4f3-407c-bf42-cb2782add96c req-79627bd4-5804-4cb8-99b0-cc22b1f36812 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041774 Oct 28 19:51:46.973262 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3037/6082] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:51:46.977686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:51:47.087293 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b68a3c91-ced0-407a-90ba-8f65efba891b tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 204 len: 0 microversion: 2.1 time: 0.158764 Oct 28 19:51:47.088329 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3046/6083] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:51:46 2022] DELETE /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:51:47.097815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:47.098928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:47.107346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:47.108332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:47.109163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:47.110171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:47.110882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:47.111523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:47.277872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:47.286492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02fb29fc-084c-46b9-a3bf-e9bbf32dc542 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1767 microversion: 2.1 time: 0.193466 Oct 28 19:51:47.287435 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3038/6084] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:47 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1767 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:48.311553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:48.312505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:48.320206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:48.321033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:48.321718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:48.322819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:48.323471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:48.324218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:48.483319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:48.491527 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68ebb66a-9292-4201-9efe-8e66bc881cf3 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1767 microversion: 2.1 time: 0.184480 Oct 28 19:51:48.492395 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3047/6085] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:48 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1767 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:49.447753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-928d23aa-9aea-4fc4-b073-309b9f60121a req-83cabcf0-8cda-4f33-a949-5f98e1eda5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9440-9d9c-43dd-9c78-46fbcbfa600d", "name": "network-vif-deleted", "tag": "25355470-c696-4435-b0da-84621bd8fa3f"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:51:49.466157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-928d23aa-9aea-4fc4-b073-309b9f60121a req-83cabcf0-8cda-4f33-a949-5f98e1eda5de service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:49.467265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-928d23aa-9aea-4fc4-b073-309b9f60121a req-83cabcf0-8cda-4f33-a949-5f98e1eda5de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:49.468061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-928d23aa-9aea-4fc4-b073-309b9f60121a req-83cabcf0-8cda-4f33-a949-5f98e1eda5de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:49.483258 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-928d23aa-9aea-4fc4-b073-309b9f60121a req-83cabcf0-8cda-4f33-a949-5f98e1eda5de service nova] Creating event network-vif-deleted:25355470-c696-4435-b0da-84621bd8fa3f for instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d on n-h1-862769-3 Oct 28 19:51:49.489778 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-928d23aa-9aea-4fc4-b073-309b9f60121a req-83cabcf0-8cda-4f33-a949-5f98e1eda5de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047023 Oct 28 19:51:49.491736 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3039/6086] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:51:49.516774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:49.518109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:49.526522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:49.527077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:49.527544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:49.528266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:49.528723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:49.529148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:49.668220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b46805c61464db49969a5a1a5690588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4651b17cc9e04a10a14c76e79b9673f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:51:49.680021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c078de4e-db9a-4eb7-99d6-b40a687aca65 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 200 len: 1648 microversion: 2.1 time: 0.167084 Oct 28 19:51:49.681112 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3048/6087] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:49 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 1648 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:51:50.707655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:50.708535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] [instance: c18b9440-9d9c-43dd-9c78-46fbcbfa600d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:51:50.717220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:50.717722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:50.718159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:50.718920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:51:50.719379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:51:50.719809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:51:50.738407 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] HTTP exception thrown: Instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d could not be found. Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Request method failure captured: Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d HTTP/1.1 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDJ7EHjjtLiLCQ6VZ9HmyeEF-4rGCfwcoqydwZbT8gxu0sn9T3mrLy_6-I0UqSAcw3W7O7u4VcbkdPrQuHPIbC4XCsPnvuqvlCsLPjFGpuNLF14N1CId8pzeOaLkFV2wmCR_BR2zYFDGH3nyPPsJwSbp_Vp58q7N8k1WHR9aJu_w9Ro Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 4651b17cc9e04a10a14c76e79b9673f2 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1011774814 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4651b17cc9e04a10a14c76e79b9673f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4651b17cc9e04a10a14c76e79b9673f2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4651b17cc9e04a10a14c76e79b9673f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4651b17cc9e04a10a14c76e79b9673f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1011774814 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 4651b17cc9e04a10a14c76e79b9673f2 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1011774814 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestSecurityGroupsBasicOps-1011774814-project Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 0b46805c61464db49969a5a1a5690588 Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1011774814-project Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d could not be found. Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c18b9440-9d9c-43dd-9c78-46fbcbfa600d'} Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d could not be found. Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d could not be found. Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:50.740222 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d could not be found. Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Returning 404 to user: Instance c18b9440-9d9c-43dd-9c78-46fbcbfa600d could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee7b6b74-1834-4096-b5b7-8aaf4779d0eb tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d" status: 404 len: 111 microversion: 2.1 time: 0.038687 Oct 28 19:51:50.745565 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3040/6088] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:51:50 2022] GET /compute/v2.1/servers/c18b9440-9d9c-43dd-9c78-46fbcbfa600d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:51:54.518303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34ce72e7-8640-4d8c-9fe3-bf79f2726321 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] Calling method '.version_select at 0x7f1d77bcba60>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:51:54.547015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34ce72e7-8640-4d8c-9fe3-bf79f2726321 tempest-TestSecurityGroupsBasicOps-1011774814 tempest-TestSecurityGroupsBasicOps-1011774814-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1202637748" status: 202 len: 0 microversion: 2.1 time: 0.032483 Oct 28 19:51:54.547616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3049/6089] 10.222.0.44 () {58 vars in 1278 bytes} [Fri Oct 28 19:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1202637748 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:52:00.714412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:00.725419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:00.773199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-61795c3f-4e80-476f-85c7-d77df2123887 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: .version_select at 0x7f1d773b8af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1185067104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi3yJEtLZ4RvX97zdYXsmif4hSbOfipQWL65WL3+wB+ooIbjM7dIkWxg4DT5FOLEPyIRklO8vJtsaEFrCEFm8qgoM3KM1ZSBMWTRMOtRIXnMdO6XGINSGo1W7Q5ha9OGQ=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:00.792571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-61795c3f-4e80-476f-85c7-d77df2123887 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:52:00.798149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-61795c3f-4e80-476f-85c7-d77df2123887 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:52:00.837009 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-61795c3f-4e80-476f-85c7-d77df2123887 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.290339 Oct 28 19:52:00.838025 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3041/6090] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:52:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:10.321833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1985860404", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "3b271671-8f0a-47c2-a05e-de71f60aada5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1185067104", "security_groups": [{"name": "tempest-secgroup-smoke-695684150"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:10.367766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:10.368771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:10.506105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] validate_networks() for [('3b271671-8f0a-47c2-a05e-de71f60aada5', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:52:11.134922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:52:11.135754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:52:11.137936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:52:11.138657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:52:11.139270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:52:11.178915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:11.215539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:11.216501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:11.217704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:11.218610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:11.219323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:11.259582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:52:11.266553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:52:11.282247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:52:11.285325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:52:11.386833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8d3c6115-734b-426d-9064-9d431d66976c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.062012 Oct 28 19:52:11.390641 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3050/6091] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:52:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:52:11.413362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9616aa64-b246-4f47-b8a3-2780141fb11c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:11.414074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9616aa64-b246-4f47-b8a3-2780141fb11c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:11.418990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:11.425599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:11.560098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9616aa64-b246-4f47-b8a3-2780141fb11c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:11.583511 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9616aa64-b246-4f47-b8a3-2780141fb11c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1267 microversion: 2.1 time: 0.174441 Oct 28 19:52:11.589197 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3042/6092] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:11 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:12.613581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:12.614380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:12.633733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:12.634707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:12.635408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:12.639579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:12.646380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:12.660845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1168371360", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f9174e72-ccbc-4c1c-bb58-3d5d3aefd5aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:12.667541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:12.798968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:52:12.820998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:12.835085 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03647c95-7c6d-45fe-98e8-82cd106f6cb8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1319 microversion: 2.1 time: 0.225803 Oct 28 19:52:12.837307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3051/6093] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:12 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:13.429356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:52:13.430188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:52:13.430927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:52:13.431638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:52:13.432671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:52:13.447733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:13.448227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:13.448661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:13.449389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:13.449845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:13.450267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:13.476255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:52:13.483887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:52:13.550664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:52:13.552921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9174e72-ccbc-4c1c-bb58-3d5d3aefd5aa',volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:52:13.731681 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f3ebdec-477d-44cd-96f9-963539581cf0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079537 Oct 28 19:52:13.748153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee621b33-fb10-4c33-b94f-1d9071935f9f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:13.749612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee621b33-fb10-4c33-b94f-1d9071935f9f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:13.753419 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3043/6094] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:52:13.836876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee621b33-fb10-4c33-b94f-1d9071935f9f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:13.848976 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee621b33-fb10-4c33-b94f-1d9071935f9f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1057 microversion: 2.1 time: 0.106112 Oct 28 19:52:13.849917 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3052/6095] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:13 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1057 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:13.865797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:13.869478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:13.887142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:13.887640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:13.891971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:13.892897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:13.893401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:13.893845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:13.989532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:13.999001 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-89188bae-033a-4f39-89e0-95cd13c70554 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1325 microversion: 2.1 time: 0.138712 Oct 28 19:52:14.014745 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3044/6096] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:13 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:14.872975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:14.873590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:14.881831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:14.882323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:14.882814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:14.883533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:14.883978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:14.884395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:14.949262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:14.957305 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc089bbb-dd48-4bb0-98f8-73a0a242620c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1155 microversion: 2.1 time: 0.088444 Oct 28 19:52:14.958158 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3053/6097] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:14 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1155 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:14.997390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-730970c5-23ab-4486-b1a6-16342505d185 req-9299aaae-49c6-491f-9558-de835cd2bffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:15.012758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-730970c5-23ab-4486-b1a6-16342505d185 req-9299aaae-49c6-491f-9558-de835cd2bffe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:15.013896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-730970c5-23ab-4486-b1a6-16342505d185 req-9299aaae-49c6-491f-9558-de835cd2bffe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:15.014427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-730970c5-23ab-4486-b1a6-16342505d185 req-9299aaae-49c6-491f-9558-de835cd2bffe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:15.021814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:15.022666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:15.032028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:15.032807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:15.033436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:15.035089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:15.035813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:15.036418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:15.047514 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-730970c5-23ab-4486-b1a6-16342505d185 req-9299aaae-49c6-491f-9558-de835cd2bffe service nova] Creating event network-changed:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h2-862769-3 Oct 28 19:52:15.054490 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-730970c5-23ab-4486-b1a6-16342505d185 req-9299aaae-49c6-491f-9558-de835cd2bffe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059922 Oct 28 19:52:15.064944 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3045/6098] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:15.227731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:15.238248 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f68fb36-3a89-4901-a86e-8d74f186ba0b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.219968 Oct 28 19:52:15.239482 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3054/6099] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:15 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:52:15.981181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:15.981871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:15.989537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:15.990839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:15.991481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:15.993827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:15.995320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:15.995951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:16.075220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:16.083923 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4c1bc8da-1858-42ae-8d67-ec849a1f8b2c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1173 microversion: 2.1 time: 0.106860 Oct 28 19:52:16.084632 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3046/6100] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:15 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1173 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:16.264945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:16.265577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:16.280824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:16.281373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:16.281825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:16.282594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:16.286089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:16.286549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:16.528908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:16.552410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53010dac-5f67-4f20-bff7-7b8049381d8a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.290776 Oct 28 19:52:16.587796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3055/6101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:16 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:17.107935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:17.109375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:17.117104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:17.118073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:17.118787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:17.119796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:17.120516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:17.121203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:17.347574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:17.361871 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70fefe27-8156-4805-a4df-3a0dc4509ea9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1215 microversion: 2.1 time: 0.257899 Oct 28 19:52:17.363631 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3047/6102] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:17 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:17.536580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ddbf1dd5-8c3f-4541-b5da-c166e1c9d414 req-ac0f3012-c09d-4c8e-8f09-b68f1830e565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124", "tag": "78106997-b8e5-4cac-af0f-c0e80a978751"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:17.560604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ddbf1dd5-8c3f-4541-b5da-c166e1c9d414 req-ac0f3012-c09d-4c8e-8f09-b68f1830e565 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:17.564343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ddbf1dd5-8c3f-4541-b5da-c166e1c9d414 req-ac0f3012-c09d-4c8e-8f09-b68f1830e565 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:17.565963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ddbf1dd5-8c3f-4541-b5da-c166e1c9d414 req-ac0f3012-c09d-4c8e-8f09-b68f1830e565 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:17.586822 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ddbf1dd5-8c3f-4541-b5da-c166e1c9d414 req-ac0f3012-c09d-4c8e-8f09-b68f1830e565 service nova] Creating event network-changed:78106997-b8e5-4cac-af0f-c0e80a978751 for instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 on n-h1-862769-3 Oct 28 19:52:17.592997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:17.593739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:17.594618 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ddbf1dd5-8c3f-4541-b5da-c166e1c9d414 req-ac0f3012-c09d-4c8e-8f09-b68f1830e565 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073265 Oct 28 19:52:17.596689 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3056/6103] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:17.600657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:17.601393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:17.602029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:17.602924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:17.603537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:17.604254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:17.808332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:17.818960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25b66a42-88f9-4452-9137-5f732811d8ab tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.229811 Oct 28 19:52:17.820195 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3048/6104] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:17 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:52:18.386797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:18.387515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:18.397045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:18.397927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:18.398447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:18.399216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:18.399899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:18.400328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:18.554643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:18.564072 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a133b4d4-0a6f-4d0b-9bee-2bf3cce05d6c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1215 microversion: 2.1 time: 0.181938 Oct 28 19:52:18.564749 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3057/6105] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:18 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:18.841975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:18.842663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:18.849777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:18.850296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:18.850723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:18.851454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:18.851904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:18.852331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:19.006918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:19.025797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7da423e2-9222-43fb-b3a3-c8e899f66afa tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.187864 Oct 28 19:52:19.026417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3049/6106] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:18 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:19.588123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:19.589552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:19.599230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:19.600478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:19.601797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:19.602817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:19.603902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:19.604520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:19.758571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:19.767915 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c6fafd8-0213-411a-a7f8-e9c86a2b08b8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1215 microversion: 2.1 time: 0.183767 Oct 28 19:52:19.768860 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3058/6107] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:19 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:20.049833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:20.050411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:20.058962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:20.059904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:20.060457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:20.061263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:20.061748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:20.062162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:20.199987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:20.208756 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e869bba-121f-4c57-875b-43b7987aab65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.163071 Oct 28 19:52:20.209364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3050/6108] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:20 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:20.792301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:20.792958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:20.799640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:20.800150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:20.800585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:20.801308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:20.801763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:20.802178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:20.959765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:20.968786 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c318f02-303f-4a27-86b6-1824b262a641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1215 microversion: 2.1 time: 0.181935 Oct 28 19:52:20.969667 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3059/6109] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:20 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:21.232229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:21.232850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:21.240533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:21.241000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:21.241430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:21.242136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:21.242630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:21.243086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:21.382956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:21.391049 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c459933e-2393-4833-ace7-ed29d0d24a34 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.162753 Oct 28 19:52:21.392001 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3051/6110] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:21 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:21.485299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-390db573-4265-4874-a504-4880a7e5b71a req-b53a3fc4-9858-4931-aab7-492fb896e950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "name": "network-vif-plugged", "status": "completed", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:21.491437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:21.499250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-390db573-4265-4874-a504-4880a7e5b71a req-b53a3fc4-9858-4931-aab7-492fb896e950 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:21.499731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-390db573-4265-4874-a504-4880a7e5b71a req-b53a3fc4-9858-4931-aab7-492fb896e950 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:21.500157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-390db573-4265-4874-a504-4880a7e5b71a req-b53a3fc4-9858-4931-aab7-492fb896e950 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:21.511913 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-390db573-4265-4874-a504-4880a7e5b71a req-b53a3fc4-9858-4931-aab7-492fb896e950 service nova] Creating event network-vif-plugged:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h2-862769-3 Oct 28 19:52:21.517780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-390db573-4265-4874-a504-4880a7e5b71a req-b53a3fc4-9858-4931-aab7-492fb896e950 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036364 Oct 28 19:52:21.518382 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3060/6111] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:21.992396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:21.993011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:21.999684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:22.000176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:22.000628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:22.001306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:22.001766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:22.002190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:22.138276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:22.146879 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d902d0c-6f49-4860-9228-1ecc46f7a2d0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.158441 Oct 28 19:52:22.147477 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3052/6112] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:21 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:22.415273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:22.415874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:22.423533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:22.424021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:22.424448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:22.425119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:22.425588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:22.426006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:22.566349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:22.574512 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7138279a-7fa0-41b4-87dc-b57f97a422fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1392 microversion: 2.1 time: 0.164155 Oct 28 19:52:22.579945 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3061/6113] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:22 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:23.171489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:23.172208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:23.179750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:23.180237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:23.180669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:23.181380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:23.181829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:23.182253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:23.320326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:23.328563 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-05c8d978-f50a-47a1-8cc1-3aa377ea9515 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.161081 Oct 28 19:52:23.329143 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3053/6114] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:23 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:23.598235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:23.599048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:23.606470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:23.607003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:23.607415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:23.608391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:23.608845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:23.609263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:23.750597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:23.759918 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b499256-a94c-4b4a-b173-3ca6dbf4ae2f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1564 microversion: 2.1 time: 0.166021 Oct 28 19:52:23.760499 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3062/6115] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:23 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:23.782887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:23.783500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:23.785489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:23.786162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:23.792592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:23.793072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:23.793504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:23.794197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:23.794645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:23.795090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:23.942377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:23.951198 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-725ed2e8-56ce-4c21-8001-86f5e706a374 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1564 microversion: 2.1 time: 0.172194 Oct 28 19:52:23.951796 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3054/6116] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:23 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:24.352237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:24.352863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:24.354992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:24.361150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:24.361895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:24.362503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:24.363298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:24.363759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:24.364427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:24.607769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:24.618489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dc837c04-8a96-410d-9207-5ca01c25995b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.270234 Oct 28 19:52:24.621153 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3063/6117] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:24 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:25.644116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:25.644715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:25.652505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:25.652995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:25.653420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:25.654122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:25.654579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:25.655035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:25.758259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:25.759671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:25.767628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:25.768670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:25.769095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:25.769799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:25.770422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:25.770882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:25.851660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:25.859845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f45b25d9-237c-4678-9e61-325ced88a3f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.219741 Oct 28 19:52:25.860629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3055/6118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:25 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:25.865831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0437fb8a-6224-470d-9758-03677652ff62 req-cf9d0b6f-630a-474e-bff4-fc07fa13dbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:25.876886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0437fb8a-6224-470d-9758-03677652ff62 req-cf9d0b6f-630a-474e-bff4-fc07fa13dbe9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:25.877843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0437fb8a-6224-470d-9758-03677652ff62 req-cf9d0b6f-630a-474e-bff4-fc07fa13dbe9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:25.878499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0437fb8a-6224-470d-9758-03677652ff62 req-cf9d0b6f-630a-474e-bff4-fc07fa13dbe9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:25.892576 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0437fb8a-6224-470d-9758-03677652ff62 req-cf9d0b6f-630a-474e-bff4-fc07fa13dbe9 service nova] Creating event network-changed:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h2-862769-3 Oct 28 19:52:25.898933 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0437fb8a-6224-470d-9758-03677652ff62 req-cf9d0b6f-630a-474e-bff4-fc07fa13dbe9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036655 Oct 28 19:52:25.899909 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3056/6119] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:25.957604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:25.966269 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c26803a-b602-43bb-b742-9ad9419146e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1564 microversion: 2.1 time: 0.212663 Oct 28 19:52:25.967296 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3064/6120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:25 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1564 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:26.889158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:26.889922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:26.896654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:26.897152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:26.897668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:26.898490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:26.898981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:26.899410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:27.052739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:27.062251 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d60a6db-5845-45aa-b027-2349cc45ce6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.178366 Oct 28 19:52:27.062903 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3057/6121] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:26 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:28.087476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:28.088136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:28.096720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:28.097960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:28.098435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:28.099662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:28.100136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:28.100562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:28.250183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:28.262655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2595370d-fad3-41dd-af76-9a0307782ec7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.179158 Oct 28 19:52:28.263343 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3065/6122] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:28 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:29.287017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:29.288627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:29.299204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:29.300034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:29.300570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:29.301492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:29.302276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:29.302852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:29.474119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:29.484849 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6564f032-af2c-446c-bdee-3bff4dbce088 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.202772 Oct 28 19:52:29.486046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3058/6123] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:29 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:30.510050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:30.510647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:30.518813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:30.519418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:30.519903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:30.520928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:30.521509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:30.521932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:30.670496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:30.681014 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd989d42-edac-4457-9bac-307126f9b21e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.175115 Oct 28 19:52:30.681695 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3066/6124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:30 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:31.497753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-59ab6050-c345-4f9c-a307-ff3c25931c9d req-af903d8c-3b7e-45e5-9b1e-a203ea7bf660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124", "name": "network-vif-plugged", "status": "completed", "tag": "78106997-b8e5-4cac-af0f-c0e80a978751"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:31.508659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59ab6050-c345-4f9c-a307-ff3c25931c9d req-af903d8c-3b7e-45e5-9b1e-a203ea7bf660 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:31.509144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59ab6050-c345-4f9c-a307-ff3c25931c9d req-af903d8c-3b7e-45e5-9b1e-a203ea7bf660 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:31.509600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-59ab6050-c345-4f9c-a307-ff3c25931c9d req-af903d8c-3b7e-45e5-9b1e-a203ea7bf660 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:31.521300 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-59ab6050-c345-4f9c-a307-ff3c25931c9d req-af903d8c-3b7e-45e5-9b1e-a203ea7bf660 service nova] Creating event network-vif-plugged:78106997-b8e5-4cac-af0f-c0e80a978751 for instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 on n-h1-862769-3 Oct 28 19:52:31.526459 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-59ab6050-c345-4f9c-a307-ff3c25931c9d req-af903d8c-3b7e-45e5-9b1e-a203ea7bf660 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Oct 28 19:52:31.527118 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3059/6125] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:31.707541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:31.708169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:31.715740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:31.716244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:31.716763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:31.717391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:31.717841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:31.718264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:31.856239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:31.864301 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-91b804aa-4a9b-45e7-a7f3-5f1b4376c699 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1203 microversion: 2.1 time: 0.160802 Oct 28 19:52:31.864930 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3067/6126] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:31 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:32.888966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:32.889688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:32.896576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:32.897063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:32.897497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:32.898201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:32.898644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:32.899107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.038660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:33.047159 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc4add26-1e73-450e-867b-1c8b48300fb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1390 microversion: 2.1 time: 0.163377 Oct 28 19:52:33.047693 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3060/6127] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:32 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:33.069673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:33.070315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:33.078001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.078515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.078959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.079696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.080161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.080583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.511123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:33.519565 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e979099-0bcf-4a16-a126-2590ef3b03b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1390 microversion: 2.1 time: 0.454072 Oct 28 19:52:33.520146 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3068/6128] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:33 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1390 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:33.542442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:33.543092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:33.549644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.550132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.550568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.551291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.551753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.552164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.687716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:33.696227 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b4e8899-bf2e-4816-85f2-99946875494a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1390 microversion: 2.1 time: 0.157773 Oct 28 19:52:33.696809 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3061/6129] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:33 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:33.718568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:33.718999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:33.725349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.725829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.726257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.726972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.727418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.727855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.746187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:33.753483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:52:33.834423 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a23b8778-530d-402e-a3f2-cb1f156da5fb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 204 len: 0 microversion: 2.1 time: 0.119461 Oct 28 19:52:33.835164 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3069/6130] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:52:33 2022] DELETE /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:52:33.843937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:33.844561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:33.851053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.851549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.851988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.852693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:33.853148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:33.853572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:33.857960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:33.987059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:33.995447 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75b424b1-a6ea-4977-80bb-803d01fae7da tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1396 microversion: 2.1 time: 0.155661 Oct 28 19:52:33.996028 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3062/6131] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:33 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1396 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:52:35.019632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:35.020320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:35.027985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:35.028464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:35.028890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:35.029578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:35.030026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:35.030444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:35.168760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:35.176874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b073f68-b163-4129-a048-8b7c062ea544 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1396 microversion: 2.1 time: 0.161651 Oct 28 19:52:35.177530 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3070/6132] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:35 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:35.930746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ee3fd39b-4a42-4990-ad27-89ec4330cf4e req-cbb6676b-5cd3-4ad2-baf9-94645e1e246c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124", "name": "network-vif-deleted", "tag": "78106997-b8e5-4cac-af0f-c0e80a978751"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:35.942276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ee3fd39b-4a42-4990-ad27-89ec4330cf4e req-cbb6676b-5cd3-4ad2-baf9-94645e1e246c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:35.942789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ee3fd39b-4a42-4990-ad27-89ec4330cf4e req-cbb6676b-5cd3-4ad2-baf9-94645e1e246c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:35.943510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ee3fd39b-4a42-4990-ad27-89ec4330cf4e req-cbb6676b-5cd3-4ad2-baf9-94645e1e246c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:35.955990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ee3fd39b-4a42-4990-ad27-89ec4330cf4e req-cbb6676b-5cd3-4ad2-baf9-94645e1e246c service nova] Creating event network-vif-deleted:78106997-b8e5-4cac-af0f-c0e80a978751 for instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 on n-h1-862769-3 Oct 28 19:52:35.961292 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ee3fd39b-4a42-4990-ad27-89ec4330cf4e req-cbb6676b-5cd3-4ad2-baf9-94645e1e246c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 Oct 28 19:52:35.961969 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3063/6133] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:36.200384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:36.201012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:36.208434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:36.209337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:36.209996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:36.211063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:36.211719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:36.212313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:36.291060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:36.300764 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-497a2b25-5fb2-4efc-bfcb-4f2e598af307 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1188 microversion: 2.1 time: 0.104401 Oct 28 19:52:36.301356 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3071/6134] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:36 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1188 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:37.325381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:37.326888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:37.333711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:37.334202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:37.334632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:37.335405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:37.335863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:37.336279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:37.399312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:37.408038 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c4212347-6532-400a-8803-a0e987b1ce4c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1188 microversion: 2.1 time: 0.087863 Oct 28 19:52:37.408736 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3064/6135] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:37 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:38.432595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:38.433156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:38.440663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:38.441245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:38.441678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:38.442385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:38.442913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:38.443378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:38.510009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:38.518181 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5ac499da-a6e3-4124-9ee3-6441126bb334 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1188 microversion: 2.1 time: 0.089761 Oct 28 19:52:38.518823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3072/6136] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:38 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:39.541087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:39.541712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:39.548993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:39.549501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:39.549957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:39.550823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:39.551309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:39.551764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:39.619364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:39.627787 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1128290f-ce8b-4555-8811-3dcdd4ad522b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 200 len: 1188 microversion: 2.1 time: 0.091382 Oct 28 19:52:39.628380 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3065/6137] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:39 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:40.652598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:40.653289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:40.656489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:40.662815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:40.663339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:40.663762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:40.664472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:40.664932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:40.665359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:40.681418 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 could not be found. Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 HTTP/1.1 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 could not be found. Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124'} Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 could not be found. Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 could not be found. Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:52:40.683149 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 could not be found. Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56b098a1-8204-4dd2-b5ec-8744a779d2dd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124" status: 404 len: 111 microversion: 2.1 time: 0.036894 Oct 28 19:52:40.688634 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3073/6138] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:40 2022] GET /compute/v2.1/servers/8269c5fd-cbf4-4222-b6b2-bbf1a9b0a124 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:52:45.704868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-25138632", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7f06ca8c-b341-4789-9169-819b966826c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:45.716363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:45.769558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:52:46.155153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:52:46.155579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:52:46.156078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:52:46.156486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:52:46.156906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:52:46.167011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:46.167509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:46.167944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:46.168675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:46.169137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:46.169565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:46.187238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:52:46.192636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:52:46.255810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:52:46.257882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f06ca8c-b341-4789-9169-819b966826c3',volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:52:46.394591 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4ab5ea21-9fc6-432e-aabb-16cddf4c7696 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693661 Oct 28 19:52:46.395310 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3066/6139] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:52:46.406877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e62dca77-e493-452b-aa62-98e5dd947d43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:46.407449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e62dca77-e493-452b-aa62-98e5dd947d43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:46.468100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e62dca77-e493-452b-aa62-98e5dd947d43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:46.476021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e62dca77-e493-452b-aa62-98e5dd947d43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1055 microversion: 2.1 time: 0.073195 Oct 28 19:52:46.476635 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3074/6140] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:46 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1055 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:47.229690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:47.232062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:47.240972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:47.241637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:47.242073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:47.242847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:47.243301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:47.243717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:47.295960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1ff8e983-bcc7-49f2-84aa-bc93064dfd69 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action" status: 200 len: 24564 microversion: 2.1 time: 0.070243 Oct 28 19:52:47.296759 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3067/6141] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:52:47 2022] POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action => generated 24564 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:52:47.498412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:47.499027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:47.509854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:47.510353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:47.510812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:47.511509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:47.511960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:47.512392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:47.579172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:47.590032 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-667279ae-12cb-40fe-96eb-5f0e5047a17f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1161 microversion: 2.1 time: 0.095745 Oct 28 19:52:47.592086 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3075/6142] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:47 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1161 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:48.616604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:48.617982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:48.627727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:48.628523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:48.629145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:48.630025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:48.630748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:48.631167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:48.950819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:48.960374 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c81ce849-9add-43af-9558-e6408e165143 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1213 microversion: 2.1 time: 0.348786 Oct 28 19:52:48.961373 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3068/6143] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:48 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1213 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:49.078973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-2a631b42-10ee-49e6-bbef-125518b9f0c6 req-275c443e-55cf-4301-bec1-74b0e80991dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396784ef-2b9c-414c-90d6-fa9a47b8b0ee", "tag": "1ba578ec-1b4d-4c39-850e-dd8bc4d3f9ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:49.116928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2a631b42-10ee-49e6-bbef-125518b9f0c6 req-275c443e-55cf-4301-bec1-74b0e80991dd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:49.117420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2a631b42-10ee-49e6-bbef-125518b9f0c6 req-275c443e-55cf-4301-bec1-74b0e80991dd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:49.117848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-2a631b42-10ee-49e6-bbef-125518b9f0c6 req-275c443e-55cf-4301-bec1-74b0e80991dd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:49.131186 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-2a631b42-10ee-49e6-bbef-125518b9f0c6 req-275c443e-55cf-4301-bec1-74b0e80991dd service nova] Creating event network-changed:1ba578ec-1b4d-4c39-850e-dd8bc4d3f9ef for instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee on n-h1-862769-3 Oct 28 19:52:49.136540 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-2a631b42-10ee-49e6-bbef-125518b9f0c6 req-275c443e-55cf-4301-bec1-74b0e80991dd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070073 Oct 28 19:52:49.137234 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3076/6144] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:49.985744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:49.986380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:49.995149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:49.995659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:49.996099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:49.996804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:49.997251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:49.997917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:50.159563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:50.169349 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c33db8c-0812-407f-a4c3-d71612e7a319 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1213 microversion: 2.1 time: 0.187632 Oct 28 19:52:50.169962 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3069/6145] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:49 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:51.193209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:51.193968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:51.201043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:51.201527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:51.201952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:51.202652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:51.203133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:51.203544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:51.341821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:51.350621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6615463-9d1c-49d5-b4d4-606b5e2945f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1213 microversion: 2.1 time: 0.162789 Oct 28 19:52:51.351262 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3077/6146] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:51 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:52.373824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:52.374454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:52.382126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:52.382630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:52.383123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:52.383844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:52.384306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:52.384735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:52.527300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:52.536071 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-801e7df1-6e2a-4ffe-855b-2591d7af8bdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1213 microversion: 2.1 time: 0.166138 Oct 28 19:52:52.536685 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3070/6147] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:52 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:53.559808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:53.560374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:53.568331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:53.569096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:53.569767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:53.570574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:53.571127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:53.571552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:53.657418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:53.658017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:53.667115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:53.667626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:53.668072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:53.668808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:53.669269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:53.669691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:53.719910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:53.727957 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03fa97f5-6136-4123-910e-6d3bbe1d9ed6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.172253 Oct 28 19:52:53.728539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3078/6148] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:53 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:53.909180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-94d4bf38-71e6-4dea-89d3-6e78bcfa2fdf tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1834 microversion: 2.1 time: 0.255641 Oct 28 19:52:53.909888 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3071/6149] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:53 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1834 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:53.933312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:53.933953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:53.940200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:53.940679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:53.941133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:53.941808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:53.942262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:53.942682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.074676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:54.082818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92b0e125-79d0-449c-a7ae-d2b781298649 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1683 microversion: 2.1 time: 0.153476 Oct 28 19:52:54.083547 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3079/6150] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:53 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:54.191464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:54.193853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:54.200748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.201237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.201726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.202400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.202909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.203327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.266620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-acd00bed-0ddb-4c92-b16a-38078d292c53 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action" status: 200 len: 32639 microversion: 2.1 time: 0.079299 Oct 28 19:52:54.267342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3072/6151] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:52:54 2022] POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action => generated 32639 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:52:54.477810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:54.478300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:54.484974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.485462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.485896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.486587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.487077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.487499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.528201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '711a8a39426a4971a9522b46299e56d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a79251a244f6f9a042d630280f6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:54.528829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] flavor_id is None. Assuming migration. {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 19:52:54.529328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:52:54.703775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:54.704494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:54.712263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.712748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.713178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.713901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.714321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.714794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.740738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:52:54.780048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bebae9f5-243e-4f78-8fb6-6a200b954e66 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action" status: 202 len: 0 microversion: 2.1 time: 0.306253 Oct 28 19:52:54.781312 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3080/6152] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:52:54 2022] POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:52:54.786728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:54.787711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:54.795383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.796246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.796470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.797003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.797613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.797985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.833815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f339c960-3200-4ada-980f-e7cf4abef49d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 204 len: 0 microversion: 2.1 time: 0.305740 Oct 28 19:52:54.834614 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3073/6153] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:52:54 2022] DELETE /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:52:54.842570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:54.843483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:54.850383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.850923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.851357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.852060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.852798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.853215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.945737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:54.957713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c07a2ea2-35d6-4483-ab58-a4985d51b99b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.174623 Oct 28 19:52:54.958363 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3081/6154] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:54 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:54.965377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:54.965980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:54.972818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.973311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.973767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:54.974510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:54.974990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:54.975416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:55.153029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:55.161982 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5e7ac2ac-b1b3-42d6-a3d5-c74a0b740b9c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1692 microversion: 2.1 time: 0.324047 Oct 28 19:52:55.163490 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3074/6155] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:54 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1692 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:55.168272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:55.181354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d8024dac-2b75-416f-9cb5-77e32806faf1 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1734 microversion: 2.1 time: 0.220199 Oct 28 19:52:55.181981 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3082/6156] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:54 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:55.982726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:55.983367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:55.992408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:55.993026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:55.993966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:55.994534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:55.994898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:55.995397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:56.132390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:56.140511 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc4f57ce-d6f7-4604-86d6-19c59353efab tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.161789 Oct 28 19:52:56.141120 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3075/6157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:55 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:56.186841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:56.187659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:56.195273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:56.195761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:56.196194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:56.196910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:56.197344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:56.197766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:56.204511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:56.205123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:56.208327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:56.209359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:56.213684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:56.214172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:56.214600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:56.215314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:56.215767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:56.216187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:56.410400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:56.419991 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c223133-2c12-4761-8e6e-94b7a4cb96c4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1692 microversion: 2.1 time: 0.237103 Oct 28 19:52:56.421094 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3083/6158] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:56 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:56.437765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:56.445952 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b24ee7a-7ab9-4a59-9ac1-e40d1494cf1d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1734 microversion: 2.1 time: 0.245227 Oct 28 19:52:56.446532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3076/6159] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:56 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:57.165756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:57.166510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:57.168736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:57.174793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.175278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.175697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.176420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.176870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.177505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.324450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:57.333947 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5b0bab13-158c-44bc-93e9-3501cafdc83e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.172673 Oct 28 19:52:57.334559 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3084/6160] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:57 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:57.447238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:57.449244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:57.463316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.463913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.469830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:57.470578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:57.474079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.477661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.478770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.479584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.480090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.482838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.483372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.484188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.487506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.488050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.492994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:57.721196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:57.729166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:57.730202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8ad62074-c25f-48a7-a27c-f186a48b5e8d tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1666 microversion: 2.1 time: 0.264673 Oct 28 19:52:57.734739 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3085/6161] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:57 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1666 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:57.738397 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8e0f5de-341d-468a-a6d3-b7b402ce39fc tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1692 microversion: 2.1 time: 0.298065 Oct 28 19:52:57.751152 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3077/6162] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:57 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1692 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:57.894128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7cf926fa-fbcb-488f-95f3-178cad062e78 req-e1b31c6c-de2d-4b7d-aca1-959141ec5288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad099c0d-4b7c-4b5d-83f7-640b11238395", "name": "network-vif-deleted", "tag": "cbb2fa4e-1add-427d-941a-a5751031c83d"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:52:57.906909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7cf926fa-fbcb-488f-95f3-178cad062e78 req-e1b31c6c-de2d-4b7d-aca1-959141ec5288 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:57.907827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7cf926fa-fbcb-488f-95f3-178cad062e78 req-e1b31c6c-de2d-4b7d-aca1-959141ec5288 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:57.908336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7cf926fa-fbcb-488f-95f3-178cad062e78 req-e1b31c6c-de2d-4b7d-aca1-959141ec5288 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:57.921615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7cf926fa-fbcb-488f-95f3-178cad062e78 req-e1b31c6c-de2d-4b7d-aca1-959141ec5288 service nova] Creating event network-vif-deleted:cbb2fa4e-1add-427d-941a-a5751031c83d for instance ad099c0d-4b7c-4b5d-83f7-640b11238395 on n-h1-862769-3 Oct 28 19:52:57.927458 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7cf926fa-fbcb-488f-95f3-178cad062e78 req-e1b31c6c-de2d-4b7d-aca1-959141ec5288 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037094 Oct 28 19:52:57.928628 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3086/6163] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:52:58.361521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:58.362349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:58.369040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.369620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.370119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.370866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.371323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.371754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.518039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:58.526604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-64c388b6-3a0d-4391-bb48-7bc7d5e3b18c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.169118 Oct 28 19:52:58.527339 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3078/6164] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:58 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:58.764459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:58.765202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:58.770791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:58.771902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.772094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:58.772382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.773052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.773753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.774210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.774625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.780254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.781112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.782040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.783299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.784103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.784817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.790482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:58.825099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:58.825629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:58.826070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:58.826548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lazy-loading 'fault' on Instance uuid ad099c0d-4b7c-4b5d-83f7-640b11238395 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:52:58.916441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aaced2a7ffe439a81455a3d3bbbbc1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34882e8be9f1438c97c34eb783f5fc5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:58.931004 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cb0c37bd-7c4f-488f-b5d1-9eaf3ec338e6 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 200 len: 1389 microversion: 2.1 time: 0.164725 Oct 28 19:52:58.931563 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3079/6165] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:58 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:52:58.975370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:58.983523 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42418e37-ba3f-4563-88a7-4ecbe35144be tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.224401 Oct 28 19:52:58.984105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3087/6166] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:58 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:59.550101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:59.550837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:59.558045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:59.558535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:59.558999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:59.559698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:59.560151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:59.560573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:59.697116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:52:59.706977 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8fad084-9bb0-4e5e-b8f6-d548f5a27341 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.161004 Oct 28 19:52:59.707543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3080/6167] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:59 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:52:59.957487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:52:59.958221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:52:59.965535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:59.966049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:59.966520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:59.967300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:52:59.967775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:52:59.968166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:52:59.981938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] HTTP exception thrown: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Request method failure captured: Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 HTTP/1.1 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDHct08InO2S-8nlgGF7G4wyxm-lEb_GFMbdq1Qq-iSMvNp5rJTuQMFeSo2gJWmDhvdoU92F7hlGTKPF39iEe5CUUs5tnZ0nmwXxBTAlqI2MQAbsj_fyAM9fahdvmJcuFOsFvKz1kVQwH8l5Xr3hSNxN24_-_A0nh5mXLAnFaL43ZB8 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 34882e8be9f1438c97c34eb783f5fc5a Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestServerBasicOps-2114010356 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34882e8be9f1438c97c34eb783f5fc5a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestServerBasicOps-2114010356 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 34882e8be9f1438c97c34eb783f5fc5a Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestServerBasicOps-2114010356 Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestServerBasicOps-2114010356-project Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3aaced2a7ffe439a81455a3d3bbbbc1b Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestServerBasicOps-2114010356-project Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ad099c0d-4b7c-4b5d-83f7-640b11238395'} Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:52:59.983614 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Returning 404 to user: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed95c515-f34f-4476-ae16-229f0faa3320 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 404 len: 111 microversion: 2.1 time: 0.031683 Oct 28 19:52:59.988439 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3088/6168] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:52:59 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:00.009128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:00.010033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:00.017028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.017519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.017956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.018682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.019177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.019600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.159025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:00.167445 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0fcf7972-a30e-4979-826c-1375a22df413 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.162522 Oct 28 19:53:00.168035 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3081/6169] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:00 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:00.451989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:00.452493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:00.458848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.459347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.459780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.460487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.460938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.461359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.476244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] HTTP exception thrown: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Request method failure captured: Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 HTTP/1.1 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDHct08InO2S-8nlgGF7G4wyxm-lEb_GFMbdq1Qq-iSMvNp5rJTuQMFeSo2gJWmDhvdoU92F7hlGTKPF39iEe5CUUs5tnZ0nmwXxBTAlqI2MQAbsj_fyAM9fahdvmJcuFOsFvKz1kVQwH8l5Xr3hSNxN24_-_A0nh5mXLAnFaL43ZB8 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 34882e8be9f1438c97c34eb783f5fc5a Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestServerBasicOps-2114010356 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34882e8be9f1438c97c34eb783f5fc5a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestServerBasicOps-2114010356 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 34882e8be9f1438c97c34eb783f5fc5a Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestServerBasicOps-2114010356 Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestServerBasicOps-2114010356-project Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 3aaced2a7ffe439a81455a3d3bbbbc1b Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestServerBasicOps-2114010356-project Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ad099c0d-4b7c-4b5d-83f7-640b11238395'} Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:53:00.477847 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Returning 404 to user: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca6e1b78-5bb6-4271-9913-fd40af9e3944 tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 404 len: 111 microversion: 2.1 time: 0.031470 Oct 28 19:53:00.483076 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3089/6170] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:53:00 2022] DELETE /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:00.488471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:00.489093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] [instance: ad099c0d-4b7c-4b5d-83f7-640b11238395] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:00.495473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.495963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.496394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.497098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.497552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.497997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.512588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] HTTP exception thrown: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Request method failure captured: Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 HTTP/1.1 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDHct08InO2S-8nlgGF7G4wyxm-lEb_GFMbdq1Qq-iSMvNp5rJTuQMFeSo2gJWmDhvdoU92F7hlGTKPF39iEe5CUUs5tnZ0nmwXxBTAlqI2MQAbsj_fyAM9fahdvmJcuFOsFvKz1kVQwH8l5Xr3hSNxN24_-_A0nh5mXLAnFaL43ZB8 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 34882e8be9f1438c97c34eb783f5fc5a Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestServerBasicOps-2114010356 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34882e8be9f1438c97c34eb783f5fc5a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34882e8be9f1438c97c34eb783f5fc5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestServerBasicOps-2114010356 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 34882e8be9f1438c97c34eb783f5fc5a Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestServerBasicOps-2114010356 Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestServerBasicOps-2114010356-project Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 3aaced2a7ffe439a81455a3d3bbbbc1b Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestServerBasicOps-2114010356-project Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'ad099c0d-4b7c-4b5d-83f7-640b11238395'} Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:00.514282 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Returning 404 to user: Instance ad099c0d-4b7c-4b5d-83f7-640b11238395 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b347d2ee-b1c0-415a-97e7-1dee654792ec tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395" status: 404 len: 111 microversion: 2.1 time: 0.031326 Oct 28 19:53:00.522594 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3082/6171] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:00 2022] GET /compute/v2.1/servers/ad099c0d-4b7c-4b5d-83f7-640b11238395 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:00.688483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0f25f11-b278-4c28-96d8-96b31026c8cc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] Calling method '.version_select at 0x7f1d771d53a0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:00.711623 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0f25f11-b278-4c28-96d8-96b31026c8cc tempest-TestServerBasicOps-2114010356 tempest-TestServerBasicOps-2114010356-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1329380916" status: 202 len: 0 microversion: 2.1 time: 0.026930 Oct 28 19:53:00.712166 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3090/6172] 10.222.0.44 () {58 vars in 1254 bytes} [Fri Oct 28 19:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1329380916 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:53:00.729885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:00.731115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:00.738661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.739204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.739687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.740416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:00.740878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:00.741309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:00.937981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:00.946445 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6c4af0d-bce6-4846-a74b-35f5cbc831e5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.220421 Oct 28 19:53:00.947073 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3083/6173] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:00 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:01.192236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:01.193012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:01.201273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:01.201773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:01.202211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:01.202976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:01.203441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:01.203922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:01.573242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:01.582620 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3924a5eb-4621-4af4-bcf3-71b3a09ae575 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.395263 Oct 28 19:53:01.583840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3091/6174] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:01 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:01.969875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:01.971426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:01.979197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:01.979815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:01.980150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:01.980848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:01.981296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:01.981719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:02.167982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:02.177098 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15b92151-6583-4aac-9766-258fd7f8d7ac tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.211100 Oct 28 19:53:02.177704 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3084/6175] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:01 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:02.607310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:02.608081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:02.617942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:02.618775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:02.619403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:02.620308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:02.620933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:02.621519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:02.864634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:02.878014 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c797e270-0635-4a93-8022-8c209e9b60e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.275006 Oct 28 19:53:02.894853 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3092/6176] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:02 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:03.202430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:03.205235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:03.213761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:03.214318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:03.214855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:03.217048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:03.217932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:03.219498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:03.453907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:03.462535 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c70f1983-d5d7-4832-9e52-fd5a52a54ac3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.265754 Oct 28 19:53:03.463286 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3085/6177] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:03 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:03.678941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bd227ee2-eba1-4602-8ab7-0b86df96867f req-7b121f8e-fbee-41dd-bd3c-3d41c022a661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396784ef-2b9c-414c-90d6-fa9a47b8b0ee", "name": "network-vif-plugged", "status": "completed", "tag": "1ba578ec-1b4d-4c39-850e-dd8bc4d3f9ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:03.694634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bd227ee2-eba1-4602-8ab7-0b86df96867f req-7b121f8e-fbee-41dd-bd3c-3d41c022a661 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:03.695509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bd227ee2-eba1-4602-8ab7-0b86df96867f req-7b121f8e-fbee-41dd-bd3c-3d41c022a661 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:03.696012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bd227ee2-eba1-4602-8ab7-0b86df96867f req-7b121f8e-fbee-41dd-bd3c-3d41c022a661 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:03.710181 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bd227ee2-eba1-4602-8ab7-0b86df96867f req-7b121f8e-fbee-41dd-bd3c-3d41c022a661 service nova] Creating event network-vif-plugged:1ba578ec-1b4d-4c39-850e-dd8bc4d3f9ef for instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee on n-h1-862769-3 Oct 28 19:53:03.716124 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bd227ee2-eba1-4602-8ab7-0b86df96867f req-7b121f8e-fbee-41dd-bd3c-3d41c022a661 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041519 Oct 28 19:53:03.716740 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3093/6178] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:03.902472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:03.903543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:03.910671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:03.911090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:03.911721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:03.913045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:03.913832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:03.914273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:04.107660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:04.117546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-182220ef-94d4-43fa-86f4-76b903abee7f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.219656 Oct 28 19:53:04.131124 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3086/6179] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:03 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:04.486384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:04.487718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:04.503518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:04.503926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:04.504380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:04.505174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:04.505628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:04.506055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:04.667996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:04.677179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f3a1df5e-0353-4d34-9bd0-f247b98ca0b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1201 microversion: 2.1 time: 0.195045 Oct 28 19:53:04.677846 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3094/6180] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:04 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1201 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:05.143273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:05.143887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:05.152406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:05.153233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:05.153881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:05.154920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:05.155636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:05.156554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:05.386884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:05.395171 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d8ebd47-1ed0-4e0a-a5af-e58b13d0c8f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.256776 Oct 28 19:53:05.395858 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3087/6181] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:05 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:05.701011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:05.701663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:05.709130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:05.709627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:05.710112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:05.711100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:05.711554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:05.711981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:05.953485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:05.964046 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-172606d3-cea1-4692-b878-5f9fecf86008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1387 microversion: 2.1 time: 0.267127 Oct 28 19:53:05.964626 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3095/6182] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:05 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1387 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:05.986834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:05.987354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:05.994253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:05.994782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:05.995415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:05.996145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:05.996600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:05.997236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.419673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:06.420401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:06.427191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:06.427837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:06.428369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.429223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:06.429901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:06.430341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.558206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:06.567531 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5aca4d82-ae97-48ba-8b75-2a49cbe74a59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1387 microversion: 2.1 time: 0.584527 Oct 28 19:53:06.568209 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3088/6183] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:05 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1387 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:06.595166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:06.595939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:06.603752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:06.604256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:06.604697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.605529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:06.606080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:06.606801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.737765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:06.746337 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5f67f360-9722-4da9-9ae4-0b75b4b21566 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.330848 Oct 28 19:53:06.760439 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3096/6184] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:06 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:06.846362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:06.855407 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-40a5b4ce-9e62-4a05-b32f-8fef7fa92dd2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1387 microversion: 2.1 time: 0.267399 Oct 28 19:53:06.856612 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3089/6185] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:06 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1387 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:06.878345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:06.878882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:06.885292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:06.885789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:06.886222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.886952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:06.887408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:06.887827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:06.915248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:53:07.002756 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1c35fa9-e8da-42a8-a5bd-d795b74886f8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 204 len: 0 microversion: 2.1 time: 0.127667 Oct 28 19:53:07.003971 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3097/6186] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:53:06 2022] DELETE /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:53:07.018023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:07.018650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:07.025440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:07.026085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:07.026530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:07.027333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:07.027787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:07.028210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:07.191015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:07.200554 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-890eb6b4-a92d-4447-aec4-4caceba5f67b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1393 microversion: 2.1 time: 0.192253 Oct 28 19:53:07.201417 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3090/6187] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:07 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:07.770343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:07.771428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:07.779099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:07.779735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:07.780262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:07.781096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:07.781650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:07.782152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:07.945864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:07.954394 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9f2d8d2d-9a0e-4320-b73d-b2265f836b08 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.188290 Oct 28 19:53:07.967804 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3098/6188] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:07 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:08.232770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:08.233476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:08.240864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:08.241653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:08.242300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:08.243275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:08.244387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:08.245019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:08.401218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:08.409465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-72787491-720e-4670-a6af-1131c1220899 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1393 microversion: 2.1 time: 0.184957 Oct 28 19:53:08.410267 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3091/6189] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:08 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:08.978746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:08.979323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:08.987257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:08.987832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:08.988344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:08.989052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:08.989582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:08.990022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:09.159025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c4b4575d-5abf-4517-ac8c-fee0644be63e req-c73ee7e2-53dd-4799-9126-6fd6009361fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396784ef-2b9c-414c-90d6-fa9a47b8b0ee", "name": "network-vif-deleted", "tag": "1ba578ec-1b4d-4c39-850e-dd8bc4d3f9ef"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:09.174552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c4b4575d-5abf-4517-ac8c-fee0644be63e req-c73ee7e2-53dd-4799-9126-6fd6009361fb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:09.177622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:09.186253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c4b4575d-5abf-4517-ac8c-fee0644be63e req-c73ee7e2-53dd-4799-9126-6fd6009361fb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:09.187019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c4b4575d-5abf-4517-ac8c-fee0644be63e req-c73ee7e2-53dd-4799-9126-6fd6009361fb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:09.190352 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c25bd9fc-d6e3-483b-ae4d-03387f5fc3b9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.215508 Oct 28 19:53:09.204558 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3099/6190] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:08 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:09.205318 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c4b4575d-5abf-4517-ac8c-fee0644be63e req-c73ee7e2-53dd-4799-9126-6fd6009361fb service nova] Creating event network-vif-deleted:1ba578ec-1b4d-4c39-850e-dd8bc4d3f9ef for instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee on n-h1-862769-3 Oct 28 19:53:09.211178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c4b4575d-5abf-4517-ac8c-fee0644be63e req-c73ee7e2-53dd-4799-9126-6fd6009361fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056975 Oct 28 19:53:09.214792 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3092/6191] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:09.448047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:09.448772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:09.458708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:09.459288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:09.459925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:09.460633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:09.461750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:09.462320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:09.537596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:09.545713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f38761c7-4e15-4409-ab0f-9520e7d8df2f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1186 microversion: 2.1 time: 0.102445 Oct 28 19:53:09.546307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3100/6192] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:09 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:10.219978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:10.220698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:10.228224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:10.228945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:10.229561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:10.230654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:10.231794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:10.232227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:10.390263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:10.405177 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07a813e9-eaa6-4b92-bb16-6780c4d67a1e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.190864 Oct 28 19:53:10.406742 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3093/6193] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:10 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:10.570314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:10.571901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:10.581844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:10.582887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:10.583558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:10.584820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:10.585813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:10.586384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:10.657419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:10.668812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1466596-b9bd-459c-8516-c0a26e4c38c3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1186 microversion: 2.1 time: 0.104548 Oct 28 19:53:10.670161 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3101/6194] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:10 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:11.432809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:11.436792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:11.449294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:11.450059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:11.450724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:11.451760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:11.452381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:11.452970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:11.693612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:11.694374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:11.698493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:11.719667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:11.725595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:11.726756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:11.727839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:11.728333 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25e54618-124b-4658-b9e5-e9ba44b46b52 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.302201 Oct 28 19:53:11.728847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:11.728975 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3094/6195] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:11 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:11.729770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:11.730780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:11.830447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:11.841322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a0d6172-6a1a-46cd-b8f0-5df611f166ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1186 microversion: 2.1 time: 0.152068 Oct 28 19:53:11.842582 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3102/6196] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:11 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1186 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:12.758286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:12.759782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:12.768641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:12.769573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:12.770100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:12.771323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:12.772095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:12.772845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:12.867610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:12.869973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:12.880351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:12.881490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:12.882163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:12.884598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:12.885357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:12.886267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:12.979675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:12.984736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:12.990367 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d6965cd-18d5-4d87-878c-19e133803885 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1186 microversion: 2.1 time: 0.128679 Oct 28 19:53:12.990658 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3103/6197] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:12 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1186 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:13.025858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:13.042899 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-db6fabf2-5519-40b6-a008-cba15505997e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.287968 Oct 28 19:53:13.055942 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3095/6198] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:12 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:14.014130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:14.015749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:14.024732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:14.025178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:14.026067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:14.027496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:14.028801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:14.029631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:14.068182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:14.068671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:14.069306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:14.069934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lazy-loading 'fault' on Instance uuid 396784ef-2b9c-414c-90d6-fa9a47b8b0ee {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:53:14.073835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:14.075894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:14.086189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:14.086885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:14.087370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:14.088084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:14.088547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:14.088974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:14.127071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:14.139008 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29193af7-3765-46c4-bbc4-78b677bc75bc tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 200 len: 1191 microversion: 2.1 time: 0.128853 Oct 28 19:53:14.140370 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3104/6199] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:14 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 1191 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:14.356552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:14.360438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:14.368354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53d61c9d-c8ac-4dac-ae30-452084d8822e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1697 microversion: 2.1 time: 0.303096 Oct 28 19:53:14.378728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3096/6200] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:14 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1697 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:15.179228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:15.182230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 396784ef-2b9c-414c-90d6-fa9a47b8b0ee] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:15.204760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:15.205259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:15.208221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:15.208986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:15.209483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:15.209904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:15.243280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee could not be found. Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee HTTP/1.1 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee could not be found. Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '396784ef-2b9c-414c-90d6-fa9a47b8b0ee'} Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee could not be found. Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee could not be found. Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:15.244982 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee could not be found. Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 396784ef-2b9c-414c-90d6-fa9a47b8b0ee could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2a9efa48-36eb-4640-a9b8-ac320ec44fbb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee" status: 404 len: 111 microversion: 2.1 time: 0.082938 Oct 28 19:53:15.252054 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3105/6201] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:15 2022] GET /compute/v2.1/servers/396784ef-2b9c-414c-90d6-fa9a47b8b0ee => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:15.398906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:15.399541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:15.413834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:15.414405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:15.414888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:15.415779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:15.416106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:15.420923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:15.691051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:15.700173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da24f478-e990-47b2-b456-96b1847b49cd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1696 microversion: 2.1 time: 0.308184 Oct 28 19:53:15.700766 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3097/6202] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:15 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1696 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:16.111386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "name": "network-vif-unplugged", "status": "completed", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:16.125585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:16.126385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:16.128553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:16.152211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] Creating event network-vif-unplugged:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h1-862769-3 Oct 28 19:53:16.161094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:53:16.175408 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c5f2afe1-e951-4dc6-ad86-14a368e024ed req-2ec4b05e-5bcc-4280-a98e-67b56fc11326 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067717 Oct 28 19:53:16.176975 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3106/6203] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:53:16.733523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:16.734479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:16.737686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:16.749005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:16.749685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:16.751241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:16.752657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:16.753657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:16.754949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:16.932160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:16.957095 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf73695c-7b96-4856-9f1a-c3ceeed8fc12 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1696 microversion: 2.1 time: 0.226781 Oct 28 19:53:16.958066 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3098/6204] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:16 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1696 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:17.985474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:17.986131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:18.004521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:18.008130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:18.008818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:18.009765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:18.010875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:18.014515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:18.249021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:18.260242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:18.260749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:18.261189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:18.287102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] Creating event network-changed:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h1-862769-3 Oct 28 19:53:18.293767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:53:18.303618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:18.313436 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b896166f-7663-483d-aae1-79e8b2b77366 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1696 microversion: 2.1 time: 0.334734 Oct 28 19:53:18.319771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3107/6205] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:17 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1696 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:18.323003 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-84ef0cd1-4947-4f57-b222-3b133e9ce69f req-07e68fca-7f61-4651-b3e7-d3e5d91223a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077722 Oct 28 19:53:18.330069 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3099/6206] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:53:19.341976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:19.343207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:19.353485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:19.356306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:19.358462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:19.359430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:19.363801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:19.364593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:19.662119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:19.678812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7aa967e5-1007-4eef-8b7e-aaa6e2ad6521 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1694 microversion: 2.1 time: 0.341002 Oct 28 19:53:19.679772 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3108/6207] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:19 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1694 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:20.704639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:20.705996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:20.723057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:20.723934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:20.725492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:20.729291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:20.729951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:20.730558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:21.116464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:21.135506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-81e532ac-945a-4620-9c4d-70595eef973f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1691 microversion: 2.1 time: 0.435889 Oct 28 19:53:21.136129 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3100/6208] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:20 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1691 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:21.165119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:21.165671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:21.178656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:21.189540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:21.190001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:21.190790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:21.191245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:21.191666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:21.400586 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ca40502-5be4-4e90-ac61-b3854cb68d96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action" status: 204 len: 0 microversion: 2.1 time: 0.241323 Oct 28 19:53:21.401896 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3109/6209] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:53:21 2022] POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:53:21.410051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:21.411241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:21.427007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:21.427893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:21.429092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:21.430056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:21.433184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:21.433950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:22.238046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:22.252426 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ac6e32c9-fe74-47ca-a4ef-5471edbed632 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1691 microversion: 2.1 time: 0.845863 Oct 28 19:53:22.275668 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3101/6210] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:21 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1691 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:23.281297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:23.283348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:23.306478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:23.308890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:23.310379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:23.313493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:23.318272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:23.319097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:23.717127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:23.729125 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78dd11c6-34cd-4920-a7c8-7185895b9de1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1691 microversion: 2.1 time: 0.455069 Oct 28 19:53:23.730253 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3110/6211] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:23 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1691 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:24.261043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:24.263343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:24.263825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:24.264262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:24.265061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:24.265507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:24.265916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:24.296784 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2310ecd8-86b6-43b2-a498-cba520ef43cf tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.207979 Oct 28 19:53:24.297558 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3102/6212] 10.222.0.44 () {58 vars in 1185 bytes} [Fri Oct 28 19:53:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:24.426497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1169710714", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "availability_zone": "nova:n-h2-862769-3", "networks": [{"uuid": "fc26f132-bde7-4265-a26e-f956b891db31"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:24.493158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] validate_networks() for [('fc26f132-bde7-4265-a26e-f956b891db31', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:53:24.755474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:24.756800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:24.782524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:24.783146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:24.783591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:24.784316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:24.784768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:24.785205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:24.991999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:53:24.992723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:53:24.993447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:53:24.995438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:53:24.996297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:53:25.007072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:25.007562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:25.008209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:25.008931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:25.009540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:25.010109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:25.027230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:25.035142 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68e1ebab-8175-4979-af27-e01cb9a1f6e8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1683 microversion: 2.1 time: 0.284076 Oct 28 19:53:25.037896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Getting quotas for project 38299448f3a84a34a6e9063bf2cba9a3. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:53:25.038978 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3103/6213] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:24 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1683 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:25.044688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Getting quotas for user 99a6340901a048359d8f572c6496c033 and project 38299448f3a84a34a6e9063bf2cba9a3. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:53:25.078556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:53:25.081067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:53:25.161365 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af97672e-2a79-42ae-bdc6-b6728f16ac6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738549 Oct 28 19:53:25.162755 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3111/6214] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:53:25.173649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8867f1fe-ea8e-4e26-91f7-04776d14ff7e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:25.174262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8867f1fe-ea8e-4e26-91f7-04776d14ff7e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:25.314775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8867f1fe-ea8e-4e26-91f7-04776d14ff7e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1329 microversion: 2.1 time: 0.144487 Oct 28 19:53:25.315778 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3104/6215] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:25 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:26.046721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-09c1a936-cf9f-48db-896e-d13760512575 req-70b44543-b1a4-4acd-a55b-37ac7f04db84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "name": "network-vif-plugged", "status": "completed", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:26.072148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-09c1a936-cf9f-48db-896e-d13760512575 req-70b44543-b1a4-4acd-a55b-37ac7f04db84 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:26.072922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-09c1a936-cf9f-48db-896e-d13760512575 req-70b44543-b1a4-4acd-a55b-37ac7f04db84 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:26.073553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-09c1a936-cf9f-48db-896e-d13760512575 req-70b44543-b1a4-4acd-a55b-37ac7f04db84 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:26.088326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-09c1a936-cf9f-48db-896e-d13760512575 req-70b44543-b1a4-4acd-a55b-37ac7f04db84 service nova] Creating event network-vif-plugged:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h1-862769-3 Oct 28 19:53:26.099678 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-09c1a936-cf9f-48db-896e-d13760512575 req-70b44543-b1a4-4acd-a55b-37ac7f04db84 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056189 Oct 28 19:53:26.101314 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3112/6216] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:26.338490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:26.339145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:26.347374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:26.348326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:26.348861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:26.349595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:26.350199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:26.350634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:26.431437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75711982-73a6-4f83-aa46-a5c5de12c38c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1416 microversion: 2.1 time: 0.097213 Oct 28 19:53:26.443791 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3105/6217] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:26 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1416 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:27.464113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:27.470339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:27.496272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:27.497152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:27.497902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:27.499411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:27.499928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:27.500601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:27.762819 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8da420c0-b995-4cd9-9316-8bc8cecb7b3b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.309985 Oct 28 19:53:27.763588 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3113/6218] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:27 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:28.221344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-cae17d98-7bf5-4dd5-8f12-30bbace27f7e req-b3a8763f-9b15-4a73-b83a-53510f229c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019d7738-8090-4e13-a470-b8c16aa936df", "tag": "41884485-8e5f-4b46-a7e9-85b5bc09f0e2"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:28.245713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cae17d98-7bf5-4dd5-8f12-30bbace27f7e req-b3a8763f-9b15-4a73-b83a-53510f229c20 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:28.246295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cae17d98-7bf5-4dd5-8f12-30bbace27f7e req-b3a8763f-9b15-4a73-b83a-53510f229c20 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:28.247096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-cae17d98-7bf5-4dd5-8f12-30bbace27f7e req-b3a8763f-9b15-4a73-b83a-53510f229c20 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:28.261501 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-cae17d98-7bf5-4dd5-8f12-30bbace27f7e req-b3a8763f-9b15-4a73-b83a-53510f229c20 service nova] Creating event network-changed:41884485-8e5f-4b46-a7e9-85b5bc09f0e2 for instance 019d7738-8090-4e13-a470-b8c16aa936df on n-h2-862769-3 Oct 28 19:53:28.268766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-cae17d98-7bf5-4dd5-8f12-30bbace27f7e req-b3a8763f-9b15-4a73-b83a-53510f229c20 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051230 Oct 28 19:53:28.270307 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3106/6219] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:28.786158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:28.787999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:28.796133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:28.796689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:28.797204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:28.797919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:28.798376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:28.798828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:28.937614 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-245540d2-a00e-480e-ac42-fa25f9e8c6f9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.155765 Oct 28 19:53:28.938231 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3114/6220] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:28 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:29.963314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:29.964046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:29.972609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:29.973105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:29.973708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:29.974654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:29.975001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:29.975579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:30.125257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d06283c-2a99-4539-8cf3-1e7c7c1a5d1b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.167918 Oct 28 19:53:30.126046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3107/6221] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:29 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:31.150103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:31.150825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:31.159859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:31.160374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:31.160918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:31.161645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:31.162102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:31.162859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:31.304501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bf840082-97d8-4686-8607-a7929785faf2 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.159142 Oct 28 19:53:31.305263 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3115/6222] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:31 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:32.328335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:32.328963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:32.337025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:32.337822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:32.338307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:32.339828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:32.339828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:32.340292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:32.483246 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4aa02b5a-cb55-41ef-a571-9551f9e9ec5b tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.158521 Oct 28 19:53:32.484308 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3108/6223] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:32 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:33.509586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:33.510117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:33.517635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:33.518134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:33.518572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:33.519454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:33.519722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:33.520360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:33.666951 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-865b7332-94dd-4f31-ae22-a66d70dceb37 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.154916 Oct 28 19:53:33.671900 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3116/6224] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:33 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:33.819511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-01e2cbb6-0288-49b1-a948-6891ed3daf2d req-3a9075e9-035b-4684-a223-bbd45fa7f0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019d7738-8090-4e13-a470-b8c16aa936df", "name": "network-vif-plugged", "status": "completed", "tag": "41884485-8e5f-4b46-a7e9-85b5bc09f0e2"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:33.831169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-01e2cbb6-0288-49b1-a948-6891ed3daf2d req-3a9075e9-035b-4684-a223-bbd45fa7f0c1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:33.831883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-01e2cbb6-0288-49b1-a948-6891ed3daf2d req-3a9075e9-035b-4684-a223-bbd45fa7f0c1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:33.832292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-01e2cbb6-0288-49b1-a948-6891ed3daf2d req-3a9075e9-035b-4684-a223-bbd45fa7f0c1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:33.851624 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-01e2cbb6-0288-49b1-a948-6891ed3daf2d req-3a9075e9-035b-4684-a223-bbd45fa7f0c1 service nova] Creating event network-vif-plugged:41884485-8e5f-4b46-a7e9-85b5bc09f0e2 for instance 019d7738-8090-4e13-a470-b8c16aa936df on n-h2-862769-3 Oct 28 19:53:33.857023 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-01e2cbb6-0288-49b1-a948-6891ed3daf2d req-3a9075e9-035b-4684-a223-bbd45fa7f0c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041453 Oct 28 19:53:33.857647 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3109/6225] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:53:34.684412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:34.685018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:34.692465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:34.692962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:34.693405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:34.694105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:34.694545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:34.695037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:34.829286 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fd13a50-da15-4e96-8cfa-08ba27b33f2f tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1464 microversion: 2.1 time: 0.148546 Oct 28 19:53:34.829799 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3117/6226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:34 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:35.853534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:35.854339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:35.856617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:35.857969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:35.864606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:35.865093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:35.865522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:35.866218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:35.866779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:35.867108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:36.333019 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79c3227a-7615-4905-b1a7-2a3b792c1a2c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1648 microversion: 2.1 time: 0.483559 Oct 28 19:53:36.333727 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3110/6227] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:35 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1648 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:36.357051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:36.357730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:36.363571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:36.364599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:36.367263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:36.368463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:36.368463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:36.369133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:36.369637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:36.370241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:36.505594 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6420c617-7489-4372-941a-1a27d2c34061 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1648 microversion: 2.1 time: 0.152162 Oct 28 19:53:36.509613 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3118/6228] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:36 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1648 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:36.527284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:36.527886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:36.534284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:36.534826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:36.535259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:36.536027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:36.536478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:36.536900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:36.677235 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e502612a-9677-446a-a131-9574e9660fec tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1648 microversion: 2.1 time: 0.153603 Oct 28 19:53:36.677840 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3111/6229] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:36 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1648 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:36.742261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1945938274", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "availability_zone": "nova:n-h1-862769-3", "networks": [{"uuid": "fc26f132-bde7-4265-a26e-f956b891db31"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:36.803748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] validate_networks() for [('fc26f132-bde7-4265-a26e-f956b891db31', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:53:37.183241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:53:37.183658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:53:37.184119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:53:37.184533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:53:37.184925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:53:37.195059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:37.195616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:37.196047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:37.196773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:37.197230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:37.197806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:37.215169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Getting quotas for project 38299448f3a84a34a6e9063bf2cba9a3. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:53:37.220866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Getting quotas for user 99a6340901a048359d8f572c6496c033 and project 38299448f3a84a34a6e9063bf2cba9a3. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:53:37.234479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:53:37.236962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:53:37.286826 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f76954a-e6ab-4c65-92df-4e58b1ab107d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548090 Oct 28 19:53:37.294124 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3119/6230] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:53:37.299980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a78b978f-33ba-4f99-ac46-14d10ed230e4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:37.300662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a78b978f-33ba-4f99-ac46-14d10ed230e4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:37.367882 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a78b978f-33ba-4f99-ac46-14d10ed230e4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1329 microversion: 2.1 time: 0.072185 Oct 28 19:53:37.368476 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3112/6231] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:37 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1329 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:38.395923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:38.396457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:38.403555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:38.404034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:38.404484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:38.405177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:38.405619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:38.406030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:38.482354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-549ed15e-6e8c-4cbf-a60e-9c2e1d265b6e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1416 microversion: 2.1 time: 0.090664 Oct 28 19:53:38.483220 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3120/6232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:38 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1416 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:39.505461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:39.506252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:39.514823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:39.515319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:39.515750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:39.516467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:39.516913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:39.517328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:39.655642 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24cc4d78-7b3d-4ef0-bf57-48ebb2122d60 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.153908 Oct 28 19:53:39.656230 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3113/6233] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:39 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:39.869529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-1c200106-3055-4d6c-bd4b-7d793155e022 req-39faf05d-4c47-4221-aecd-6a845f88ab3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12548b2a-0587-46e5-9d6f-a2d475feac7c", "tag": "df8a3d2a-e917-46c8-92e9-95b629fe2561"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:39.884267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1c200106-3055-4d6c-bd4b-7d793155e022 req-39faf05d-4c47-4221-aecd-6a845f88ab3e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:39.884751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1c200106-3055-4d6c-bd4b-7d793155e022 req-39faf05d-4c47-4221-aecd-6a845f88ab3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:39.885156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-1c200106-3055-4d6c-bd4b-7d793155e022 req-39faf05d-4c47-4221-aecd-6a845f88ab3e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:39.897846 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-1c200106-3055-4d6c-bd4b-7d793155e022 req-39faf05d-4c47-4221-aecd-6a845f88ab3e service nova] Creating event network-changed:df8a3d2a-e917-46c8-92e9-95b629fe2561 for instance 12548b2a-0587-46e5-9d6f-a2d475feac7c on n-h1-862769-3 Oct 28 19:53:39.903648 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-1c200106-3055-4d6c-bd4b-7d793155e022 req-39faf05d-4c47-4221-aecd-6a845f88ab3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037875 Oct 28 19:53:39.904580 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3121/6234] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:40.680158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:40.680869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:40.687814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:40.688408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:40.688912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:40.689724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:40.690631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:40.691169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:40.840324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a08e78cf-3fb8-4f70-8672-adcccd90d300 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.164039 Oct 28 19:53:40.840929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3114/6235] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:40 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:41.866207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:41.867889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:41.872541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:41.880373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:41.880870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:41.881305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:41.882016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:41.882469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:41.882923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:42.012787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:42.021639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5ec3901-75f8-4f2f-90f2-f4fbe7feffdd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.161483 Oct 28 19:53:42.022224 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3122/6236] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:41 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:42.522240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1889858960", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "072edaf3-26a7-4973-8fa2-9087ee03daf2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:42.619152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:53:43.045264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:43.045871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:43.054226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:43.054647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:43.055107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:43.055803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:43.056253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:43.056674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:43.152392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:53:43.153260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:53:43.153837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:53:43.154397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:53:43.155060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:53:43.165422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:43.166012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:43.166511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:43.167472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:43.167990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:43.168473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:43.186717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:53:43.192262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:53:43.205729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:53:43.208041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='072edaf3-26a7-4973-8fa2-9087ee03daf2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:53:43.214562 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cb1f9b5c-1879-4e7b-87d2-5e292f6bae6d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.173136 Oct 28 19:53:43.215593 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3123/6237] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:43 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:43.299231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb909a6e-8da0-422c-af38-cef9dd90fc87 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780833 Oct 28 19:53:43.299904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3115/6238] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:53:43.312069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76d3bdb1-4674-42d2-8bd7-4b75096b4c23 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:43.312636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-76d3bdb1-4674-42d2-8bd7-4b75096b4c23 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:43.372549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-76d3bdb1-4674-42d2-8bd7-4b75096b4c23 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:43.380307 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76d3bdb1-4674-42d2-8bd7-4b75096b4c23 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1057 microversion: 2.1 time: 0.072391 Oct 28 19:53:43.380907 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3124/6239] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:43 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1057 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:44.239461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:44.240106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:44.247385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:44.247884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:44.248294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:44.249001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:44.249484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:44.249946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:44.403661 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-46ef8e61-c3d9-41c3-9c06-169faa749dae tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.168693 Oct 28 19:53:44.404783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:44.405291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3116/6240] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:44 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:44.405400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:44.414514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:44.415197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:44.415637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:44.425311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:44.425860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:44.426327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:44.499275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:44.508246 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-514e3d72-f189-414d-b14e-7ce77ce0ccdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1117 microversion: 2.1 time: 0.108954 Oct 28 19:53:44.518745 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3125/6241] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:44 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1117 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:45.428658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:45.429303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:45.437573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:45.438061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:45.438504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:45.439346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:45.439706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:45.440136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:45.443112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=91 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:45.533382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:45.534012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:45.556606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:45.556929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:45.557488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:45.564222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:45.564893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:45.568198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:45.609328 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ac332b16-c188-4512-acd5-d810de39907d tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.183891 Oct 28 19:53:45.610305 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3117/6242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:45 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:45.765910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:45.781317 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4ff9d85-bc78-49f7-affa-d505b919678b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.252843 Oct 28 19:53:45.782816 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3126/6243] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:45 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:45.943602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-15dc2d52-1d92-4009-b96a-c2472b41de9b req-6029b6bc-da61-4e70-918a-ede00e802398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12548b2a-0587-46e5-9d6f-a2d475feac7c", "name": "network-vif-plugged", "status": "completed", "tag": "df8a3d2a-e917-46c8-92e9-95b629fe2561"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:45.962887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-15dc2d52-1d92-4009-b96a-c2472b41de9b req-6029b6bc-da61-4e70-918a-ede00e802398 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:45.964445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-15dc2d52-1d92-4009-b96a-c2472b41de9b req-6029b6bc-da61-4e70-918a-ede00e802398 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:45.965140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-15dc2d52-1d92-4009-b96a-c2472b41de9b req-6029b6bc-da61-4e70-918a-ede00e802398 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:45.981341 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-15dc2d52-1d92-4009-b96a-c2472b41de9b req-6029b6bc-da61-4e70-918a-ede00e802398 service nova] Creating event network-vif-plugged:df8a3d2a-e917-46c8-92e9-95b629fe2561 for instance 12548b2a-0587-46e5-9d6f-a2d475feac7c on n-h1-862769-3 Oct 28 19:53:45.989396 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-15dc2d52-1d92-4009-b96a-c2472b41de9b req-6029b6bc-da61-4e70-918a-ede00e802398 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072358 Oct 28 19:53:45.990216 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3118/6244] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:46.271840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0166baee-ba31-48e4-a3af-c7abd7931c3a req-5140d446-d87c-4d2c-a0eb-0fb3fd2771a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fdd04f5-bcd5-46fa-b829-8034bedeb98c", "tag": "b84bb676-a222-43eb-b0a1-9c852d0ad928"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:46.290157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0166baee-ba31-48e4-a3af-c7abd7931c3a req-5140d446-d87c-4d2c-a0eb-0fb3fd2771a6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:46.291315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0166baee-ba31-48e4-a3af-c7abd7931c3a req-5140d446-d87c-4d2c-a0eb-0fb3fd2771a6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:46.292246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0166baee-ba31-48e4-a3af-c7abd7931c3a req-5140d446-d87c-4d2c-a0eb-0fb3fd2771a6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:46.310271 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0166baee-ba31-48e4-a3af-c7abd7931c3a req-5140d446-d87c-4d2c-a0eb-0fb3fd2771a6 service nova] Creating event network-changed:b84bb676-a222-43eb-b0a1-9c852d0ad928 for instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c on n-h2-862769-3 Oct 28 19:53:46.317218 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0166baee-ba31-48e4-a3af-c7abd7931c3a req-5140d446-d87c-4d2c-a0eb-0fb3fd2771a6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054548 Oct 28 19:53:46.318529 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3127/6245] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:46.634201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:46.635502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:46.643846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:46.644357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:46.645114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:46.645858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:46.646320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:46.646984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:46.804506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8298feeb-d51f-4fe4-83b6-bdc429303fa9 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1464 microversion: 2.1 time: 0.175458 Oct 28 19:53:46.805391 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3119/6246] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:46 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:46.809704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:46.811022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:46.823671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:46.824175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:46.824631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:46.825499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:46.826069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:46.826665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:46.996749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:47.005173 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea7de13a-1645-4954-9195-0d07509a6692 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.202398 Oct 28 19:53:47.006027 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3128/6247] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:46 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:47.300706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:47.303745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:47.305909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:47.311639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:47.312149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:47.312589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:47.313312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:47.313773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:47.314206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:47.377014 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f9ebabd-48a1-4645-a2a8-ff0d4a276763 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action" status: 200 len: 24577 microversion: 2.1 time: 0.080961 Oct 28 19:53:47.378179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3120/6248] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:53:47 2022] POST /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1/action => generated 24577 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:53:47.827957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:47.828531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:47.830594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:47.836964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:47.837434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:47.837863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:47.838570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:47.839152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:47.839599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:47.970719 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b3efeaa-c249-4ec8-9b76-f314d0a43372 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1648 microversion: 2.1 time: 0.146509 Oct 28 19:53:47.971318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3129/6249] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:47 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1648 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:47.994476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:47.995707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:48.004030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.004542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.005118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.006000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.006461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.006924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.028642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:48.029320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:48.036323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.036954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.037814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.038608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.039194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.039705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.226794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:48.229238 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2f7db6c-0529-463e-af78-44e93be1b1fc tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1648 microversion: 2.1 time: 0.238566 Oct 28 19:53:48.230407 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3121/6250] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:47 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1648 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:48.243140 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-135de90b-4972-4ae0-b9da-637a1fede00c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.218231 Oct 28 19:53:48.244854 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3130/6251] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:48 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:48.269667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:48.271549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:48.280720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.281425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.281999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.283363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.284161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.284888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.480461 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38078a97-d29b-4049-9fe1-275986b845d7 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1648 microversion: 2.1 time: 0.215541 Oct 28 19:53:48.481065 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3122/6252] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:48 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1648 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:48.519607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:48.520147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:48.527416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.528241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.528683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.529498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.529940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.530358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.570421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:53:48.697624 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d4d8314-d61e-4bb9-86c9-8b2c537da06c tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "DELETE /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 204 len: 0 microversion: 2.1 time: 0.183677 Oct 28 19:53:48.698454 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3131/6253] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:53:48 2022] DELETE /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:53:48.719504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:48.720196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:48.727427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.727928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.728350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.730614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:48.731318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:48.731755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:48.903511 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd41cae8-846d-4dc1-98bb-1e1bb5a15e85 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1654 microversion: 2.1 time: 0.192076 Oct 28 19:53:48.904175 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3123/6254] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:48 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1654 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:49.284288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:49.285568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:49.295230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:49.295791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:49.296516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:49.297314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:49.297994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:49.298432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:49.501994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:49.513507 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73d8e67d-157e-4ece-a28f-900de8c26f6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.236062 Oct 28 19:53:49.535465 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3132/6255] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:49 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:49.932139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:49.932938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:49.943466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:49.943466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:49.944001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:49.944802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:49.945252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:49.945676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:50.232888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0afdb8bd-a011-48fe-9c0c-18e281e8dfcd tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1654 microversion: 2.1 time: 0.306463 Oct 28 19:53:50.253785 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3124/6256] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:49 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1654 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:50.545928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:50.546544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:50.565226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:50.566031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:50.566729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:50.567604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:50.568068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:50.568492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:50.802559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:50.848898 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99ca6de2-805b-4059-97c7-aac92d7f65b6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.302301 Oct 28 19:53:50.850442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3133/6257] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:50 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:50.978765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a89faa83-5444-409d-a360-80ccd20c64a6 req-823f9947-c958-4593-b547-50c2de3c9472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12548b2a-0587-46e5-9d6f-a2d475feac7c", "name": "network-vif-deleted", "tag": "df8a3d2a-e917-46c8-92e9-95b629fe2561"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:51.003517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a89faa83-5444-409d-a360-80ccd20c64a6 req-823f9947-c958-4593-b547-50c2de3c9472 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:51.004242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a89faa83-5444-409d-a360-80ccd20c64a6 req-823f9947-c958-4593-b547-50c2de3c9472 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:51.009066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a89faa83-5444-409d-a360-80ccd20c64a6 req-823f9947-c958-4593-b547-50c2de3c9472 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:51.027631 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a89faa83-5444-409d-a360-80ccd20c64a6 req-823f9947-c958-4593-b547-50c2de3c9472 service nova] Creating event network-vif-deleted:df8a3d2a-e917-46c8-92e9-95b629fe2561 for instance 12548b2a-0587-46e5-9d6f-a2d475feac7c on n-h1-862769-3 Oct 28 19:53:51.034815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a89faa83-5444-409d-a360-80ccd20c64a6 req-823f9947-c958-4593-b547-50c2de3c9472 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061340 Oct 28 19:53:51.040864 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3125/6258] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:53:51.261340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:51.262299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:51.272232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:51.272779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:51.273316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:51.274336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:51.275047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:51.275915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:51.315983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:51.316522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:51.316948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:51.317415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lazy-loading 'fault' on Instance uuid 12548b2a-0587-46e5-9d6f-a2d475feac7c {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:53:51.383579 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-acbf44ce-614e-4144-bf59-511609122443 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 200 len: 1454 microversion: 2.1 time: 0.126531 Oct 28 19:53:51.384327 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3134/6259] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:51 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:53:51.890729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:51.891455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:51.898527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:51.899093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:51.899572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:51.900271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:51.900747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:51.901215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.093955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:52.102437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1be8de9b-3b0f-437d-96b7-356ba112acd8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.216721 Oct 28 19:53:52.103153 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3126/6260] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:51 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:52.408275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:52.408876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 12548b2a-0587-46e5-9d6f-a2d475feac7c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:52.417197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:52.417802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:52.418275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.419014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:52.419503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:52.419899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.435557 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] HTTP exception thrown: Instance 12548b2a-0587-46e5-9d6f-a2d475feac7c could not be found. Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Request method failure captured: Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c HTTP/1.1 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDMz7Cl4vmC0IiAuYkeB2qkq62IhsP79BnB6j7rmRTDtF3NjSxv7JqEphZcKxa0uYdWurAVP45jc-GY7piLtnki-FYT6Arpk0OZgHEMcErDQmt8cFBjBeeHn_lcHet2yTK96TFBsKGHdxgewWmIKEKWGrkaQwK6i3yVbFqznewe_Q9Y Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 38299448f3a84a34a6e9063bf2cba9a3 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestServerMultinode-2116315306 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/38299448f3a84a34a6e9063bf2cba9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_38299448f3a84a34a6e9063bf2cba9a3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/38299448f3a84a34a6e9063bf2cba9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/38299448f3a84a34a6e9063bf2cba9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestServerMultinode-2116315306 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 38299448f3a84a34a6e9063bf2cba9a3 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestServerMultinode-2116315306 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestServerMultinode-2116315306-project-admin Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 99a6340901a048359d8f572c6496c033 Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestServerMultinode-2116315306-project-admin Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 12548b2a-0587-46e5-9d6f-a2d475feac7c could not be found. Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '12548b2a-0587-46e5-9d6f-a2d475feac7c'} Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12548b2a-0587-46e5-9d6f-a2d475feac7c could not be found. Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12548b2a-0587-46e5-9d6f-a2d475feac7c could not be found. Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:52.437327 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12548b2a-0587-46e5-9d6f-a2d475feac7c could not be found. Oct 28 19:53:52.440894 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:53:52.442415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Returning 404 to user: Instance 12548b2a-0587-46e5-9d6f-a2d475feac7c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:53:52.443328 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-530c8d6e-6f78-44f3-83eb-e601060a11d4 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c" status: 404 len: 111 microversion: 2.1 time: 0.039261 Oct 28 19:53:52.448769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3135/6261] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:52 2022] GET /compute/v2.1/servers/12548b2a-0587-46e5-9d6f-a2d475feac7c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:52.453825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:52.454327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:52.461174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:52.461792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:52.462532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.463368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:52.463913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:52.465064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.493187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:53:52.588275 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c28f811f-6ddf-404c-b3c5-8c4bb4653662 tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "DELETE /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 204 len: 0 microversion: 2.1 time: 0.136668 Oct 28 19:53:52.589033 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3127/6262] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:53:52 2022] DELETE /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:53:52.597854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:52.598614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:52.604981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:52.605605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:52.606139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.606955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:52.607506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:52.608018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:52.747589 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bd4d0d28-779e-4c78-ba2b-8f2d7122523e tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1654 microversion: 2.1 time: 0.153569 Oct 28 19:53:52.748166 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3136/6263] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:52 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:53.127242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:53.128043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:53.136152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:53.136609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:53.137219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:53.137974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:53.138442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:53.138915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:53.174717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:53.199727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:53.293070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:53.313922 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bfaa8c99-dbb5-4140-bbfe-5130bbc2366d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.190911 Oct 28 19:53:53.314934 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3128/6264] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:53 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:53.771500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:53.772212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:53.774326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:53.781257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:53.781744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:53.782179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:53.782919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:53.783371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:53.783785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:53.803357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:53.804039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:53.810529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:53.811135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:53.811631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:53.812404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:53.812909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:53.813399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:53.965577 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8a77679-32b0-4e5b-88c8-d3fb38dd459a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 200 len: 1654 microversion: 2.1 time: 0.197947 Oct 28 19:53:53.966368 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3137/6265] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:53 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 1654 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:53.992920 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d6cda32-0f2d-45bd-8904-bfd3128c3c11 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1834 microversion: 2.1 time: 0.193255 Oct 28 19:53:53.993343 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3129/6266] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:53 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1834 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:54.345708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:54.346832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:54.369855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:54.370782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:54.371429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:54.372410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:54.373065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:54.373704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:54.409286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f4c919f9-1714-41b5-b97d-01c3297f1724 req-388ff304-6773-409b-b56c-756b88df4d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019d7738-8090-4e13-a470-b8c16aa936df", "name": "network-vif-deleted", "tag": "41884485-8e5f-4b46-a7e9-85b5bc09f0e2"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:54.429560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f4c919f9-1714-41b5-b97d-01c3297f1724 req-388ff304-6773-409b-b56c-756b88df4d02 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:54.430379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f4c919f9-1714-41b5-b97d-01c3297f1724 req-388ff304-6773-409b-b56c-756b88df4d02 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:54.434263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f4c919f9-1714-41b5-b97d-01c3297f1724 req-388ff304-6773-409b-b56c-756b88df4d02 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:54.447650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f4c919f9-1714-41b5-b97d-01c3297f1724 req-388ff304-6773-409b-b56c-756b88df4d02 service nova] Creating event network-vif-deleted:41884485-8e5f-4b46-a7e9-85b5bc09f0e2 for instance 019d7738-8090-4e13-a470-b8c16aa936df on n-h2-862769-3 Oct 28 19:53:54.454153 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f4c919f9-1714-41b5-b97d-01c3297f1724 req-388ff304-6773-409b-b56c-756b88df4d02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048808 Oct 28 19:53:54.455444 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3130/6267] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:54.684291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:54.692390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0f135a73-46ea-4c5c-b090-71c808f6c438 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.357361 Oct 28 19:53:54.703119 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3138/6268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:54 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:54.990129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:54.991257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] [instance: 019d7738-8090-4e13-a470-b8c16aa936df] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:55.002598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.003415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.004123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.005174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.005849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.006495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.034827 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] HTTP exception thrown: Instance 019d7738-8090-4e13-a470-b8c16aa936df could not be found. Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Request method failure captured: Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df HTTP/1.1 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDMz7Cl4vmC0IiAuYkeB2qkq62IhsP79BnB6j7rmRTDtF3NjSxv7JqEphZcKxa0uYdWurAVP45jc-GY7piLtnki-FYT6Arpk0OZgHEMcErDQmt8cFBjBeeHn_lcHet2yTK96TFBsKGHdxgewWmIKEKWGrkaQwK6i3yVbFqznewe_Q9Y Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 38299448f3a84a34a6e9063bf2cba9a3 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestServerMultinode-2116315306 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/38299448f3a84a34a6e9063bf2cba9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_38299448f3a84a34a6e9063bf2cba9a3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/38299448f3a84a34a6e9063bf2cba9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/38299448f3a84a34a6e9063bf2cba9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestServerMultinode-2116315306 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 38299448f3a84a34a6e9063bf2cba9a3 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestServerMultinode-2116315306 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestServerMultinode-2116315306-project-admin Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 99a6340901a048359d8f572c6496c033 Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestServerMultinode-2116315306-project-admin Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 019d7738-8090-4e13-a470-b8c16aa936df could not be found. Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '019d7738-8090-4e13-a470-b8c16aa936df'} Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019d7738-8090-4e13-a470-b8c16aa936df could not be found. Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019d7738-8090-4e13-a470-b8c16aa936df could not be found. Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:55.037156 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019d7738-8090-4e13-a470-b8c16aa936df could not be found. Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] Returning 404 to user: Instance 019d7738-8090-4e13-a470-b8c16aa936df could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2c94b2f4-aded-4374-9c66-5fa03018a28a tempest-TestServerMultinode-2116315306 tempest-TestServerMultinode-2116315306-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df" status: 404 len: 111 microversion: 2.1 time: 0.053696 Oct 28 19:53:55.040664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3131/6269] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:54 2022] GET /compute/v2.1/servers/019d7738-8090-4e13-a470-b8c16aa936df => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:55.149212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:55.151075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:55.158954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.159981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.160600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.161461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.162048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.162955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.181866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fcf14d80-53c6-489b-9d3a-00e17c6a0aa9 req-25a225ea-9337-4dfa-a2c9-b596363ca54d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:55.195348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fcf14d80-53c6-489b-9d3a-00e17c6a0aa9 req-25a225ea-9337-4dfa-a2c9-b596363ca54d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.195820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fcf14d80-53c6-489b-9d3a-00e17c6a0aa9 req-25a225ea-9337-4dfa-a2c9-b596363ca54d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.196250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fcf14d80-53c6-489b-9d3a-00e17c6a0aa9 req-25a225ea-9337-4dfa-a2c9-b596363ca54d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.235088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:53:55.237431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:55.244013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fcf14d80-53c6-489b-9d3a-00e17c6a0aa9 req-25a225ea-9337-4dfa-a2c9-b596363ca54d service nova] Creating event network-changed:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h1-862769-3 Oct 28 19:53:55.261994 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fcf14d80-53c6-489b-9d3a-00e17c6a0aa9 req-25a225ea-9337-4dfa-a2c9-b596363ca54d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083132 Oct 28 19:53:55.262891 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3132/6270] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:53:55.363073 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-497946e9-497a-4167-9e2d-ec501c7607b2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 204 len: 0 microversion: 2.1 time: 0.217818 Oct 28 19:53:55.364168 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3139/6271] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:53:55 2022] DELETE /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:53:55.375074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:55.375838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:55.384420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.385166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.385882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.386860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.387490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.388066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.654891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:55.669102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c068a98a-c21b-4924-81c4-073ef9894e5c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1689 microversion: 2.1 time: 0.298937 Oct 28 19:53:55.687532 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3133/6272] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:55 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1689 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:55.716656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:55.717650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:55.724690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.725433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.726042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:55.726985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:55.727601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:55.728372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:56.222756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:56.235340 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89cf030f-de0c-44bb-a096-ff0e0d855c4b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.523109 Oct 28 19:53:56.236105 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3140/6273] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:55 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:56.694335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:56.694992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:56.704511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:56.705527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:56.706343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:56.707383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:56.708043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:56.708697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:57.127239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:57.140828 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2eaa399-0325-409a-a39b-262c670c5e68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 200 len: 1689 microversion: 2.1 time: 0.450806 Oct 28 19:53:57.142338 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3134/6274] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:56 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 1689 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:57.258981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:57.259594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:57.270249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:57.275824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:57.276551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:57.277504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:57.278129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:57.278778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:57.470414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6c79bd4e-b7d1-496c-806b-91a78cd95dc5 req-b821dd75-4d32-4a36-9d30-cddb1b014892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea27411d-2a53-4263-9443-dbc191f5e4f1", "name": "network-vif-deleted", "tag": "02b2fc96-c5b9-4c54-9039-3b11cd61ca53"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:53:57.490977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6c79bd4e-b7d1-496c-806b-91a78cd95dc5 req-b821dd75-4d32-4a36-9d30-cddb1b014892 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:57.491473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6c79bd4e-b7d1-496c-806b-91a78cd95dc5 req-b821dd75-4d32-4a36-9d30-cddb1b014892 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:57.492159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6c79bd4e-b7d1-496c-806b-91a78cd95dc5 req-b821dd75-4d32-4a36-9d30-cddb1b014892 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:57.515307 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6c79bd4e-b7d1-496c-806b-91a78cd95dc5 req-b821dd75-4d32-4a36-9d30-cddb1b014892 service nova] Creating event network-vif-deleted:02b2fc96-c5b9-4c54-9039-3b11cd61ca53 for instance ea27411d-2a53-4263-9443-dbc191f5e4f1 on n-h1-862769-3 Oct 28 19:53:57.521364 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6c79bd4e-b7d1-496c-806b-91a78cd95dc5 req-b821dd75-4d32-4a36-9d30-cddb1b014892 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055114 Oct 28 19:53:57.523770 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3135/6275] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:53:57.655095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:57.672333 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7994404-018a-44be-b059-59e79bd947a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.417240 Oct 28 19:53:57.674940 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3141/6276] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:57 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:53:58.167175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:58.167962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: ea27411d-2a53-4263-9443-dbc191f5e4f1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:58.195684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:58.196855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:58.198754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:58.200904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:58.201972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:58.203137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:58.236083 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] HTTP exception thrown: Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 could not be found. Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Request method failure captured: Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 HTTP/1.1 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLf2SUK5pk2HYFYPh8e0kO2E1AoFfhQqkDjDHUWP_zNOiNBS3OUpg1dBeg2jIFq4ATaGoXzBw46cnqWTEaVETmyc_16D2RZzRnAZ58MBG89ru0eG0OwyYodxPYz5zfLDX7iRpxbdHlgejMR_bY_y8pfaXzKOyfSvHXVbRnsXcinIe4 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_67e38d5748ae407e80a353dc2150b848", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 06cf5d4bbcb042c4bd32f1788c6dbcd9 Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 could not be found. Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'ea27411d-2a53-4263-9443-dbc191f5e4f1'} Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 could not be found. Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 could not be found. Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:58.242136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 could not be found. Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:53:58.245747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Returning 404 to user: Instance ea27411d-2a53-4263-9443-dbc191f5e4f1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:53:58.246612 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b7396e8-cdb6-4c85-8e7e-8e944e568808 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1" status: 404 len: 111 microversion: 2.1 time: 0.084453 Oct 28 19:53:58.248632 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3136/6277] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:58 2022] GET /compute/v2.1/servers/ea27411d-2a53-4263-9443-dbc191f5e4f1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:53:58.696009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:53:58.696730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:53:58.713441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:58.714010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:58.714458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:58.715237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:53:58.718261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:53:58.718745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:53:59.082508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:53:59.093360 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a4b7a54c-8675-409f-8cf8-53bff56fab86 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.401054 Oct 28 19:53:59.094130 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3142/6278] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:53:58 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:00.117034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:00.117815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:00.125515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:00.126308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:00.126968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:00.127894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:00.128778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:00.129401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:00.164982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:00.361416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:00.375766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-76251484-46ae-462a-bc24-b097cfdb220c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1169 microversion: 2.1 time: 0.261755 Oct 28 19:54:00.377897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3137/6279] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:00 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1169 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:01.404154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:01.405446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:01.417513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:01.420803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:01.422767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:01.425184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:01.427127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:01.427752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:01.839926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:01.860995 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0eba0639-bc8f-45e2-a67d-716a2c970ba7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.461978 Oct 28 19:54:01.866782 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3143/6280] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:01 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:02.889498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:02.890110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:02.898406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:02.899000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:02.899431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:02.900135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:02.900580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:02.901698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:03.157845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:03.173067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a9f5eb5d-1730-4096-b0c3-2e82b71c3db5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.288480 Oct 28 19:54:03.174051 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3138/6281] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:02 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:03.343536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a217c72-3e7c-4341-83db-ae212ea05667 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '.version_select at 0x7f1d7ff9a040>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:03.367289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a217c72-3e7c-4341-83db-ae212ea05667 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1185067104" status: 202 len: 0 microversion: 2.1 time: 0.027681 Oct 28 19:54:03.367947 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3144/6282] 10.222.0.44 () {58 vars in 1284 bytes} [Fri Oct 28 19:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1185067104 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:54:03.402306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f9566a62-b1bc-42fb-821f-f3c5bdde9bdb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: .version_select at 0x7f1d769c2310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1752312038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV/fEkGqli4LG7o628gHPyqOp2MJd05oMm1SiitqxPM7VmhLqTmjhAmGoE3e9ZtgS+gUjkM7uynthr9yFfrSqMb+x/P6wiSjNeOjF0vjrkY0BM45wTGzTf2vy9KxTej+Q=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:03.426654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f9566a62-b1bc-42fb-821f-f3c5bdde9bdb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:54:03.432885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-f9566a62-b1bc-42fb-821f-f3c5bdde9bdb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:54:03.459815 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f9566a62-b1bc-42fb-821f-f3c5bdde9bdb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063463 Oct 28 19:54:03.460628 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3139/6283] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:54:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:54:04.201396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:04.205883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:04.227124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:04.236697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:04.238312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:04.240753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:04.241446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:04.242128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:04.511983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:04.522040 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24341bda-f0a7-4c31-b66d-e6389f74b213 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.324863 Oct 28 19:54:04.537187 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3145/6284] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:04 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:05.549755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:05.550572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:05.560001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:05.561220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:05.561922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:05.563134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:05.563701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:05.564409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:05.710126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:05.731828 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0a1cc6b-a9e8-4baf-992c-a4cde39412bb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.186759 Oct 28 19:54:05.732549 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3140/6285] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:05 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:06.755971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:06.756596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:06.763346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:06.763837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:06.764270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:06.764980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:06.765444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:06.765855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:06.908514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:06.920730 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d9ab4567-e344-4a65-b1fa-d841c9be5064 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.169118 Oct 28 19:54:06.922016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3146/6286] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:06 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:07.944478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:07.945908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:07.953802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:07.954675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:07.955366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:07.956302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:07.956959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:07.957708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:08.209689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:08.225771 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a177060a-23f9-4ec3-ac41-58a3d3a2cea1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.285129 Oct 28 19:54:08.226486 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3141/6287] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:07 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:09.257104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:09.258311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:09.276663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:09.277169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:09.277599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:09.282590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:09.283153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:09.283600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:09.599132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:09.612412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df1a932b-5667-4c5c-8f83-6c5ac0d7881c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.367577 Oct 28 19:54:09.623230 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3147/6288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:09 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:10.014123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8c589a87-63fc-4a01-9da7-a3e3649de5f1 req-a8e44d6e-f384-4db0-baf7-24c31ac813e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fdd04f5-bcd5-46fa-b829-8034bedeb98c", "name": "network-vif-plugged", "status": "completed", "tag": "b84bb676-a222-43eb-b0a1-9c852d0ad928"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:10.027889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c589a87-63fc-4a01-9da7-a3e3649de5f1 req-a8e44d6e-f384-4db0-baf7-24c31ac813e4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:10.029908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c589a87-63fc-4a01-9da7-a3e3649de5f1 req-a8e44d6e-f384-4db0-baf7-24c31ac813e4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:10.030565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8c589a87-63fc-4a01-9da7-a3e3649de5f1 req-a8e44d6e-f384-4db0-baf7-24c31ac813e4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:10.045709 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8c589a87-63fc-4a01-9da7-a3e3649de5f1 req-a8e44d6e-f384-4db0-baf7-24c31ac813e4 service nova] Creating event network-vif-plugged:b84bb676-a222-43eb-b0a1-9c852d0ad928 for instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c on n-h2-862769-3 Oct 28 19:54:10.054180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8c589a87-63fc-4a01-9da7-a3e3649de5f1 req-a8e44d6e-f384-4db0-baf7-24c31ac813e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043681 Oct 28 19:54:10.055475 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3142/6289] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:54:10.280655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1498934606", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "bdb0e0ad-5255-4947-a690-ac01e99c4361"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1752312038", "security_groups": [{"name": "tempest-secgroup-smoke-236476546"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:10.391035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] validate_networks() for [('bdb0e0ad-5255-4947-a690-ac01e99c4361', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:54:10.641266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:10.649092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:10.670552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:10.671418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:10.672020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:10.673193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:10.673662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:10.674094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:10.951022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:10.963750 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ed00d6e-daac-44d2-b2b7-678e304257ef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1203 microversion: 2.1 time: 0.329563 Oct 28 19:54:10.964905 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3143/6290] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:10 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:54:11.257022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:54:11.257445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:54:11.257977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:54:11.258778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:54:11.259626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:54:11.271581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:11.272195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:11.272745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:11.274051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:11.274608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:11.275203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:11.307757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:54:11.313980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:54:11.328042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:54:11.330722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:54:11.388386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3408f645-aea8-45ee-a59d-a2e869303ac9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.111758 Oct 28 19:54:11.389059 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3148/6291] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:54:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:54:11.401774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a38c4b6b-73e4-4573-99fc-cdc79baa7aa9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:11.403055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a38c4b6b-73e4-4573-99fc-cdc79baa7aa9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:11.469658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a38c4b6b-73e4-4573-99fc-cdc79baa7aa9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:11.476911 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a38c4b6b-73e4-4573-99fc-cdc79baa7aa9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1267 microversion: 2.1 time: 0.080189 Oct 28 19:54:11.479570 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3144/6292] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:11 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:11.986645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:11.987297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:11.989533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:11.995087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:11.995572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:11.995995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:11.996678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:11.997138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:11.997534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.144228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:12.152299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba3af83b-fbb2-4d25-8370-4e95e7d72c09 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1389 microversion: 2.1 time: 0.169583 Oct 28 19:54:12.153096 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3149/6293] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:11 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:12.175191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:12.176150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:12.184567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.185089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.185488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.186850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.187842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.187982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.328816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:12.337017 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-562cdc06-1a30-4c70-b3a2-0feb33a1ad45 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1389 microversion: 2.1 time: 0.165756 Oct 28 19:54:12.337593 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3145/6294] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:12 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:12.359295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:12.360036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:12.367758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.368970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.369480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.370264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.370832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.371262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.502070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:12.503993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:12.514944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.515718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.516518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.517505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.518052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.518666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.541646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:12.552383 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04f74eb9-b5af-4849-a362-199591a70a40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1389 microversion: 2.1 time: 0.197278 Oct 28 19:54:12.554434 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3150/6295] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:12 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1389 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:12.617442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:12.628593 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8967f23-b887-4980-afda-23365b0c2a8e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1319 microversion: 2.1 time: 0.131495 Oct 28 19:54:12.644161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3146/6296] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:12 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:54:12.655207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:12.655970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:12.665564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.666064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.667804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.668547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.669009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.670052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.702565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:54:12.811497 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3d6e7eb-da8c-40e8-9ea8-306a47768641 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 204 len: 0 microversion: 2.1 time: 0.159892 Oct 28 19:54:12.814827 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3151/6297] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:54:12 2022] DELETE /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:54:12.821944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:12.822629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:12.829194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.829685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.830285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:12.831040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:12.831526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:12.831984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:13.050341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:13.059205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00a5af5e-6705-4ce7-9647-9490918eb493 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1395 microversion: 2.1 time: 0.241765 Oct 28 19:54:13.059793 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3147/6298] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:12 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1395 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:13.654825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:13.656352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:13.665185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:13.666116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:13.666646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:13.667447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:13.668273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:13.668774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:13.965928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:13.974312 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7930e1f3-954d-4734-923a-77ba0425a332 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.324891 Oct 28 19:54:13.975264 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3152/6299] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:13 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:14.082222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:14.083100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:14.091215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:14.091742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:14.092286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:14.092995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:14.093448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:14.093873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:14.334612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:14.343597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ad87a2b-c7e1-487a-ad8a-36f29ca632c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1395 microversion: 2.1 time: 0.265549 Oct 28 19:54:14.344283 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3148/6300] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:14 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1395 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:14.485840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b8f1e4c2-9e42-4d9e-bf47-de834f639732 req-a465b6b9-efd3-4059-bfd6-824d330f749e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:14.497324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b8f1e4c2-9e42-4d9e-bf47-de834f639732 req-a465b6b9-efd3-4059-bfd6-824d330f749e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:14.498190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b8f1e4c2-9e42-4d9e-bf47-de834f639732 req-a465b6b9-efd3-4059-bfd6-824d330f749e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:14.498854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b8f1e4c2-9e42-4d9e-bf47-de834f639732 req-a465b6b9-efd3-4059-bfd6-824d330f749e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:14.512252 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b8f1e4c2-9e42-4d9e-bf47-de834f639732 req-a465b6b9-efd3-4059-bfd6-824d330f749e service nova] Creating event network-changed:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:54:14.517319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b8f1e4c2-9e42-4d9e-bf47-de834f639732 req-a465b6b9-efd3-4059-bfd6-824d330f749e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035472 Oct 28 19:54:14.517946 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3153/6301] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:54:14.760771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-abd66255-efe9-4b91-a4b5-776eb53d8a72 req-788ac1c3-57e3-40db-8302-aa0a4898f81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fdd04f5-bcd5-46fa-b829-8034bedeb98c", "name": "network-vif-deleted", "tag": "b84bb676-a222-43eb-b0a1-9c852d0ad928"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:14.774497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-abd66255-efe9-4b91-a4b5-776eb53d8a72 req-788ac1c3-57e3-40db-8302-aa0a4898f81c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:14.775954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-abd66255-efe9-4b91-a4b5-776eb53d8a72 req-788ac1c3-57e3-40db-8302-aa0a4898f81c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:14.776595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-abd66255-efe9-4b91-a4b5-776eb53d8a72 req-788ac1c3-57e3-40db-8302-aa0a4898f81c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:14.792680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-abd66255-efe9-4b91-a4b5-776eb53d8a72 req-788ac1c3-57e3-40db-8302-aa0a4898f81c service nova] Creating event network-vif-deleted:b84bb676-a222-43eb-b0a1-9c852d0ad928 for instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c on n-h2-862769-3 Oct 28 19:54:14.798888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-abd66255-efe9-4b91-a4b5-776eb53d8a72 req-788ac1c3-57e3-40db-8302-aa0a4898f81c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041863 Oct 28 19:54:14.799970 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3149/6302] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:54:15.000981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:15.001739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:15.009755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:15.010245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:15.010680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:15.011541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:15.011999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:15.012493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:15.153327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:15.161449 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-62693c74-8b13-4256-8efb-d346de46bcb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.167349 Oct 28 19:54:15.162027 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3154/6303] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:14 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:15.368915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:15.369557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:15.376491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:15.376983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:15.377422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:15.378120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:15.378905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:15.379331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:15.450372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:15.458991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b037612e-ddf6-419d-ab59-59e8b38eb671 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1188 microversion: 2.1 time: 0.095315 Oct 28 19:54:15.459629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3150/6304] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:15 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:16.185686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:16.186319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:16.195500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:16.195500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:16.195500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:16.195852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:16.196254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:16.196685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:16.212886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:16.415717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:16.424363 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c651fe69-b5a8-4959-b8fd-e158ada3cc50 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.242678 Oct 28 19:54:16.425089 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3155/6305] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:16 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:16.482060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:16.482757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:16.491227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:16.492051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:16.492472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:16.493358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:16.493817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:16.494256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:16.571696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:16.580862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-686dc7ff-ed8f-4bb2-b705-d18ecab92a37 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1188 microversion: 2.1 time: 0.102819 Oct 28 19:54:16.581511 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3151/6306] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:16 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:17.448180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:17.448852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:17.457807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:17.458292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:17.458731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:17.459451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:17.459903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:17.460315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:17.598518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:17.603909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:17.604510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:17.607315 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f42bf06b-a92c-4ad8-a2af-be49cc1d21e9 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.163083 Oct 28 19:54:17.608122 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3156/6307] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:17 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:17.611364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:17.612806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:17.613411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:17.613859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:17.614639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:17.615125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:17.615586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:17.685104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:17.693389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-898d722e-7f8f-46cb-a0aa-23f96d693f9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1188 microversion: 2.1 time: 0.093263 Oct 28 19:54:17.694016 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3152/6308] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:17 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:54:18.633810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:18.634424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:18.641835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:18.642247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:18.642744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:18.643409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:18.643915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:18.644398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:18.716196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:18.717089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:18.724635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:18.725419 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:18.726334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:18.727874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:18.728422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:18.728921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:18.813366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:18.815744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:18.821975 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a60fd42f-8d77-4136-bb6a-a9b9a26f15e4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.192125 Oct 28 19:54:18.823405 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3157/6309] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:18 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:18.824185 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc248dd5-19b3-4192-9858-716789d6dd43 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 200 len: 1188 microversion: 2.1 time: 0.111943 Oct 28 19:54:18.824741 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3153/6310] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:18 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:19.845866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:19.846619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:19.854303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:19.854794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:19.855156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:19.855591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:19.856128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:19.856360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:19.856548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:19.856997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:19.863342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:19.863821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:19.864255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:19.864951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:19.865423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:19.865850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:19.881190 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c HTTP/1.1 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '4fdd04f5-bcd5-46fa-b829-8034bedeb98c'} Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:54:19.882929 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23a518bb-988e-4345-b698-8fa3cf026ab1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 404 len: 111 microversion: 2.1 time: 0.033065 Oct 28 19:54:19.889857 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3154/6311] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:19 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:54:20.009919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:20.019724 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dfb97e28-f260-4e91-95b0-84922b07a9ff tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.177912 Oct 28 19:54:20.020550 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3158/6312] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:19 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:20.058220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f7d41ed2-d607-4e69-b52e-0236c6ce2f7d req-a7bdedaf-4c8e-4c88-8bca-0e8d8a203a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "name": "network-vif-plugged", "status": "completed", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:20.069377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f7d41ed2-d607-4e69-b52e-0236c6ce2f7d req-a7bdedaf-4c8e-4c88-8bca-0e8d8a203a49 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:20.069931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f7d41ed2-d607-4e69-b52e-0236c6ce2f7d req-a7bdedaf-4c8e-4c88-8bca-0e8d8a203a49 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:20.070431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f7d41ed2-d607-4e69-b52e-0236c6ce2f7d req-a7bdedaf-4c8e-4c88-8bca-0e8d8a203a49 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:20.084714 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f7d41ed2-d607-4e69-b52e-0236c6ce2f7d req-a7bdedaf-4c8e-4c88-8bca-0e8d8a203a49 service nova] Creating event network-vif-plugged:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:54:20.089862 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f7d41ed2-d607-4e69-b52e-0236c6ce2f7d req-a7bdedaf-4c8e-4c88-8bca-0e8d8a203a49 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035786 Oct 28 19:54:20.090676 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3155/6313] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:54:21.044003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:21.044578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:21.051848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:21.052335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:21.052761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:21.053452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:21.053902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:21.054313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:21.189507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:21.198161 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6dac3a41-c610-480a-a87c-01ade3804423 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1392 microversion: 2.1 time: 0.158442 Oct 28 19:54:21.198812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3159/6314] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:21 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:22.052663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:22.057403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:22.057953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:22.064951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.065441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.065982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.066675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.067155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.067570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.081354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c HTTP/1.1 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '4fdd04f5-bcd5-46fa-b829-8034bedeb98c'} Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:54:22.083058 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99154887-dbcd-40ee-a6ed-edf288bae097 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 404 len: 111 microversion: 2.1 time: 0.033637 Oct 28 19:54:22.086430 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3156/6315] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:54:22 2022] DELETE /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:54:22.093673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:22.094283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 4fdd04f5-bcd5-46fa-b829-8034bedeb98c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:22.096305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:22.097494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:22.104440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.104966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.105398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.106089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.106541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.106983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.120536 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c HTTP/1.1 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '4fdd04f5-bcd5-46fa-b829-8034bedeb98c'} Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:54:22.122193 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 4fdd04f5-bcd5-46fa-b829-8034bedeb98c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:54:22.126082 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-267dc4e5-eba6-463a-a841-8b88b81b8af4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c" status: 404 len: 111 microversion: 2.1 time: 0.033965 Oct 28 19:54:22.126849 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3160/6316] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:22 2022] GET /compute/v2.1/servers/4fdd04f5-bcd5-46fa-b829-8034bedeb98c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:54:22.221720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:22.222618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:22.229488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.230143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.230961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.231543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.232093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.232592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.392965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:22.403729 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c66b416-cd53-4336-9a8d-8905e9a3d042 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1564 microversion: 2.1 time: 0.186275 Oct 28 19:54:22.416051 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3157/6317] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:22 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:22.429696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:22.430305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:22.437291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.437774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.438429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.439293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:22.439879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:22.440436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:22.586463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:22.595208 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9eea7fcc-0416-4789-8106-3707fa5be976 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1564 microversion: 2.1 time: 0.170972 Oct 28 19:54:22.595994 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3161/6318] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:22 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:24.317560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:24.319100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:24.320396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-03ce913e-fd29-4d8d-9b82-6f0444463518 req-8f129dde-06cd-4bf9-8ed5-29a666a4ffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:24.326852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:24.327800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:24.328383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:24.329319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:24.330043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:24.330676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:24.333569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-03ce913e-fd29-4d8d-9b82-6f0444463518 req-8f129dde-06cd-4bf9-8ed5-29a666a4ffb0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:24.334239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-03ce913e-fd29-4d8d-9b82-6f0444463518 req-8f129dde-06cd-4bf9-8ed5-29a666a4ffb0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:24.334943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-03ce913e-fd29-4d8d-9b82-6f0444463518 req-8f129dde-06cd-4bf9-8ed5-29a666a4ffb0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:24.354023 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-03ce913e-fd29-4d8d-9b82-6f0444463518 req-8f129dde-06cd-4bf9-8ed5-29a666a4ffb0 service nova] Creating event network-changed:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:54:24.373015 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-03ce913e-fd29-4d8d-9b82-6f0444463518 req-8f129dde-06cd-4bf9-8ed5-29a666a4ffb0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056886 Oct 28 19:54:24.374250 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3162/6319] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:54:24.602459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:24.615144 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f75d060-2a2e-4496-81e1-9bf3977187fe tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1564 microversion: 2.1 time: 0.301917 Oct 28 19:54:24.617122 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3158/6320] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:24 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1564 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:43.022518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:43.023309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=37 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:43.028245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-734266401", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f022e8fe-20dc-4348-811d-83e7caddc5a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:43.098849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:54:43.486995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:54:43.487435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:54:43.488188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:54:43.488766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:54:43.489423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:54:43.505004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:43.505833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:43.506552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:43.507759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:43.508451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:43.509169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:43.530941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:54:43.536539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:54:43.597701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:54:43.600069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f022e8fe-20dc-4348-811d-83e7caddc5a8',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:54:43.742639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-924cd77d-2f4f-4bf9-91a4-209b3aa41ab5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722488 Oct 28 19:54:43.743384 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3163/6321] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:54:43.755346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aa99c6c8-b7a2-41e7-8592-dc298edea448 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:43.756108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aa99c6c8-b7a2-41e7-8592-dc298edea448 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:43.758989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=13 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:43.760062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=99 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:43.819736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aa99c6c8-b7a2-41e7-8592-dc298edea448 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:43.827759 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aa99c6c8-b7a2-41e7-8592-dc298edea448 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1070 microversion: 2.1 time: 0.077026 Oct 28 19:54:43.828437 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3159/6322] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:43 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1070 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:44.853101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:44.853852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:44.861277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:44.861807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:44.862233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:44.863083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:44.863488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:44.864010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:44.930056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:44.938119 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c397fcfa-6240-4035-8f91-cc5dc12a719a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1168 microversion: 2.1 time: 0.090694 Oct 28 19:54:44.938739 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3164/6323] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:44 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1168 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:45.965394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:45.966641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:45.984411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:45.985044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:45.985936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:45.986925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:45.987705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:45.988710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:46.141255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:46.150573 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1828d299-67d2-4d81-a5f0-add81eb3e9c5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1228 microversion: 2.1 time: 0.191784 Oct 28 19:54:46.151734 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3160/6324] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:45 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1228 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:46.489701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-afb151bf-dfaa-4517-a598-d3daa151e24d req-34ae75d7-7515-4fb7-821d-94c8b394d6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57990618-bdf0-4d8e-a280-1da8c6950f82", "tag": "06ebd8b1-3fcc-4188-91d3-caf2a56b5c4c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:46.506679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-afb151bf-dfaa-4517-a598-d3daa151e24d req-34ae75d7-7515-4fb7-821d-94c8b394d6d0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:46.508849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-afb151bf-dfaa-4517-a598-d3daa151e24d req-34ae75d7-7515-4fb7-821d-94c8b394d6d0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:46.509842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-afb151bf-dfaa-4517-a598-d3daa151e24d req-34ae75d7-7515-4fb7-821d-94c8b394d6d0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:46.524279 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-afb151bf-dfaa-4517-a598-d3daa151e24d req-34ae75d7-7515-4fb7-821d-94c8b394d6d0 service nova] Creating event network-changed:06ebd8b1-3fcc-4188-91d3-caf2a56b5c4c for instance 57990618-bdf0-4d8e-a280-1da8c6950f82 on n-h2-862769-3 Oct 28 19:54:46.535186 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-afb151bf-dfaa-4517-a598-d3daa151e24d req-34ae75d7-7515-4fb7-821d-94c8b394d6d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052678 Oct 28 19:54:46.537754 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3165/6325] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:54:47.176207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:47.176790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:47.183839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:47.184403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:47.184916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:47.185844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:47.186264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:47.186772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:47.332114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:47.341065 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f089b622-4f9d-43c7-9c72-8fdc046dc3f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1228 microversion: 2.1 time: 0.169079 Oct 28 19:54:47.341669 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3161/6326] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:47 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:47.939026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:47.941309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:47.948535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:47.949023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:47.949459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:47.950166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:47.950619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:47.951074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:48.012718 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59fe9a13-cf0f-42fd-b6f5-ac03c0baa3bb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action" status: 200 len: 24565 microversion: 2.1 time: 0.078220 Oct 28 19:54:48.013388 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3166/6327] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:54:47 2022] POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action => generated 24565 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:54:48.365918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:48.366491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:48.374162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:48.374644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:48.375091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:48.375781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:48.376243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:48.376657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:48.514916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:48.523636 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1efe93fd-5a4b-4cc6-ac4f-74bdb3e0f3af tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1228 microversion: 2.1 time: 0.161243 Oct 28 19:54:48.523802 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3162/6328] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:48 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:49.547507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:49.548080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:49.556655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:49.557120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:49.557543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:49.558251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:49.558712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:49.559159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:49.702978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:49.711555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f6fbb538-749f-4786-818a-a5de36ddc289 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1228 microversion: 2.1 time: 0.168705 Oct 28 19:54:49.712358 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3167/6329] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:49 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:50.735438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:50.736549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:50.746973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:50.746973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:50.746973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:50.746973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:50.746973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:50.747548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:50.887258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:50.895751 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-57548cfc-c16a-4650-a1d0-acdfa40dd373 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.164342 Oct 28 19:54:50.896258 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3163/6330] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:50 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:51.921963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:51.922775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:51.933621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:51.934296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:51.934981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:51.935935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:51.936562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:51.937110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:52.070610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:52.079676 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1554a43b-9061-48b5-8210-e1c218aa3a6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.163180 Oct 28 19:54:52.080285 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3168/6331] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:51 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:53.104090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:53.104676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:53.112230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:53.112720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:53.113154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:53.113958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:53.114414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:53.114874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:53.263733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:53.272374 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-19ba3943-86b2-4cc5-a904-a9b75ed8924f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.172336 Oct 28 19:54:53.272954 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3164/6332] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:53 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:54.295705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:54.296322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:54.299232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:54.299995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:54.307943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:54.308739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:54.309185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:54.309895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:54.310357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:54.310803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:54.456552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:54.468327 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb2c839a-3fc9-415a-aa7e-129edfe557ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.176579 Oct 28 19:54:54.469102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3169/6333] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:54 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:55.492795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:55.493345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:55.495250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:54:55.501832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:55.502309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:55.502723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:55.503445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:55.503897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:55.504311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:55.644250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:55.653831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-29d91622-1828-4df8-be00-3b7a9c47c94a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.164777 Oct 28 19:54:55.654647 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3165/6334] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:55 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:56.682463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:56.683251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:56.693266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:56.693745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:56.694186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:56.694921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:56.695366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:56.695787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:56.839191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:56.850815 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55482b1b-772b-4c5f-bbc0-85f49650912d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.173805 Oct 28 19:54:56.851539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3170/6335] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:56 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:57.880906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:57.881594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:57.889383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:57.889869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:57.890299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:57.891064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:57.891521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:57.891934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:58.046656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:58.055219 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5114399f-bb2e-44d6-ac4a-d9a1134d624d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.180095 Oct 28 19:54:58.055826 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3166/6336] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:57 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:58.962416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:58.963135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:58.970964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:58.971451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:58.971885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:58.972595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:58.973046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:58.973463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.077665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:59.078236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:59.085786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.086266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.086710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.087427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.087867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.088283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.117115 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9da9a1c0-88f6-46c6-9e79-1874861df3bc tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1834 microversion: 2.1 time: 0.158809 Oct 28 19:54:59.117669 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3171/6337] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:58 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1834 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:59.139692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:54:59.140289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:59.146436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.146943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.147370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.148110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.148552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.148965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.265177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:59.273886 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d632e871-b6f2-415f-a0c3-7961c159d179 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.200135 Oct 28 19:54:59.274477 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3167/6338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:59 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:54:59.622659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:54:59.631534 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac5172ee-af00-4cc6-af4d-8b0335bcd167 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1683 microversion: 2.1 time: 0.495590 Oct 28 19:54:59.632593 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3172/6339] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:54:59 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1683 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:54:59.744203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:59.746580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:59.753495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.753986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.754422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.755157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.755584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.756043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.810873 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ed8b29f-2286-4d7a-8029-e93b7b5f2bda tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action" status: 200 len: 32635 microversion: 2.1 time: 0.070708 Oct 28 19:54:59.811527 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3168/6340] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:54:59 2022] POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:54:59.988539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:54:59.989071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:54:59.996649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.997135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.997569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:54:59.998804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:54:59.998804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:54:59.999129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:00.027396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '711a8a39426a4971a9522b46299e56d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a79251a244f6f9a042d630280f6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:00.027973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] flavor_id is None. Assuming migration. {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 19:55:00.028403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:55:00.150798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac9a0545-c01c-43bf-9e1e-257eab754601 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action" status: 202 len: 0 microversion: 2.1 time: 0.166053 Oct 28 19:55:00.151532 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3173/6341] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:54:59 2022] POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:55:00.161855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:00.162983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:00.170438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:00.170957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:00.171434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:00.172140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:00.172590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:00.173010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:00.190105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-95a74f20-5d5d-4a02-a08c-cbb7f4f2ca1d req-750ee4f3-ddbd-40c3-bf3e-26efd07edbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57990618-bdf0-4d8e-a280-1da8c6950f82", "name": "network-vif-plugged", "status": "completed", "tag": "06ebd8b1-3fcc-4188-91d3-caf2a56b5c4c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:00.201434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-95a74f20-5d5d-4a02-a08c-cbb7f4f2ca1d req-750ee4f3-ddbd-40c3-bf3e-26efd07edbf0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:00.202229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-95a74f20-5d5d-4a02-a08c-cbb7f4f2ca1d req-750ee4f3-ddbd-40c3-bf3e-26efd07edbf0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:00.202947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-95a74f20-5d5d-4a02-a08c-cbb7f4f2ca1d req-750ee4f3-ddbd-40c3-bf3e-26efd07edbf0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:00.214105 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-95a74f20-5d5d-4a02-a08c-cbb7f4f2ca1d req-750ee4f3-ddbd-40c3-bf3e-26efd07edbf0 service nova] Creating event network-vif-plugged:06ebd8b1-3fcc-4188-91d3-caf2a56b5c4c for instance 57990618-bdf0-4d8e-a280-1da8c6950f82 on n-h2-862769-3 Oct 28 19:55:00.226828 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-95a74f20-5d5d-4a02-a08c-cbb7f4f2ca1d req-750ee4f3-ddbd-40c3-bf3e-26efd07edbf0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040735 Oct 28 19:55:00.228163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3174/6342] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:55:00.297736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:00.298449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:00.310018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:00.310957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:00.312752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:00.313694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:00.314732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:00.316454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:00.341804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:00.350205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-71e6d1f2-4a25-4329-b3d3-dbe9ca5a8939 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1692 microversion: 2.1 time: 0.193805 Oct 28 19:55:00.351040 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3169/6343] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:00 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:00.480985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:00.491048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18f83fdd-49ff-4e77-affb-e6518c324af0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.197717 Oct 28 19:55:00.507608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3175/6344] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:00 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:01.374374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:01.375021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:01.383910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:01.384376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:01.384833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:01.385553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:01.385980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:01.386427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:01.515282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:01.516754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:01.524827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:01.525421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:01.526012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:01.526941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:01.527722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:01.528152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:01.534932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:01.543714 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75885057-0424-47a2-b684-00291b06f26d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1692 microversion: 2.1 time: 0.173579 Oct 28 19:55:01.552883 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3170/6345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:01 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:01.673760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:01.682168 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-393bea38-6a23-43cb-8b5e-6eb035d7b106 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1216 microversion: 2.1 time: 0.171275 Oct 28 19:55:01.682771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3176/6346] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:01 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:02.568030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:02.568837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:02.576386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:02.577165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:02.577548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:02.578279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:02.578832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:02.579344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:02.705382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:02.706038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:02.713986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:02.715173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:02.715614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:02.716324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:02.716779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:02.717205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:02.820831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:02.829648 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dba14567-1e4c-48ed-a071-27d12a141308 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1692 microversion: 2.1 time: 0.265531 Oct 28 19:55:02.830245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3171/6347] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:02 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1692 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:02.897022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:02.907369 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cebd81b6-7a86-4774-81cd-e059b5e4e83c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1402 microversion: 2.1 time: 0.206034 Oct 28 19:55:02.907970 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3177/6348] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:02 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1402 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:02.930556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:02.931205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:02.937375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:02.937835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:02.938253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:02.938956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:02.939442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:02.939867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:03.074166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:03.083582 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6ce7a21-9947-44b2-86b1-d67a46fa179b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1402 microversion: 2.1 time: 0.157124 Oct 28 19:55:03.084182 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3172/6349] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:02 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:03.112166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1492418582"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:03.114514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:03.121250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:03.121748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:03.122174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:03.122909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:03.123362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:03.123782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:03.217720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Attempting to quiesce instance before volume snapshot. Oct 28 19:55:03.284833 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 28 19:55:03.302345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:03.369297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Creating snapshot from volume f022e8fe-20dc-4348-811d-83e7caddc5a8. {{(pid=120629) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 28 19:55:03.853994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:03.854792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:03.861918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:03.862454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:03.863019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:03.863891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:03.864347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:03.864768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:04.013893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:04.021858 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-706f88b9-3cf5-40a1-834c-cee5507a38c0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.172234 Oct 28 19:55:04.022439 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3173/6350] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:03 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:04.250988 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-810524f1-139c-47ee-92fe-01b22ea4d0a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82/action" status: 202 len: 0 microversion: 2.1 time: 1.142681 Oct 28 19:55:04.251682 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3178/6351] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:55:03 2022] POST /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82/action => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:55:05.046095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:05.046741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:05.054190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:05.054679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:05.055258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:05.056013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:05.056477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:05.056900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:05.196121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:05.205265 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-af63288b-5116-461f-a265-589777a7bcc2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.163271 Oct 28 19:55:05.205839 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3174/6352] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:05 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:05.424187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1956654578", "imageRef": "8fa25f3d-bf87-4551-a8b6-754c52b4ee5f", "flavorRef": "452", "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:05.493810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:55:05.898176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:55:05.898601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:55:05.899225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:55:05.899635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:55:05.900064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:55:05.910358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:05.910915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:05.911361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:05.912112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:05.912892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:05.913318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:05.931542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:55:05.937157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:55:05.949844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:55:05.952527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9cebe40c-e387-4f56-b938-e59d1a51badf',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:55:06.032654 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6d635bdf-ccb9-449e-a8aa-13d78a426621 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614238 Oct 28 19:55:06.033318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3179/6353] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:55:06.044937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1787cef0-5089-46cd-9e6d-da1235a0584c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:06.045593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1787cef0-5089-46cd-9e6d-da1235a0584c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:06.101225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1787cef0-5089-46cd-9e6d-da1235a0584c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:06.108588 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1787cef0-5089-46cd-9e6d-da1235a0584c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1230 microversion: 2.1 time: 0.067544 Oct 28 19:55:06.109170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3175/6354] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:06 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1230 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:06.229149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:06.229785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:06.236433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:06.236930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:06.237380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:06.238093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:06.238556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:06.239025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:06.383591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:06.392037 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c1a01ed-6edd-41b0-a1d6-4cb7d7f2bc54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.166886 Oct 28 19:55:06.392893 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3180/6355] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:06 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:07.131877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:07.132615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:07.140676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:07.141435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:07.141872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:07.142735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:07.143288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:07.143754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:07.252229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:07.260169 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dbd442e1-be73-4e1b-9abc-7fe88da0dfdf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1290 microversion: 2.1 time: 0.132537 Oct 28 19:55:07.261527 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3176/6356] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:07 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1290 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:07.416806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:07.418031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:07.425297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:07.425994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:07.426438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:07.427179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:07.427865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:07.428229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:07.669358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:07.684304 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af8f0439-6924-4cd1-b999-fb92dcc8de65 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.271790 Oct 28 19:55:07.685932 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3181/6357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:07 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:08.286801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:08.287905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:08.296266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:08.296983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:08.297506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:08.298284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:08.298983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:08.299472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:08.526030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:08.530646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=100 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:08.538198 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf4b2322-0cd9-42ce-a875-492135ba248c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.255068 Oct 28 19:55:08.539151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3177/6358] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:08 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:08.709551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:08.711367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:08.719895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:08.720689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:08.721189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:08.721911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:08.723200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:08.723637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:08.937811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:08.946252 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73082951-4115-4e98-9e38-5f169912db2e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.240659 Oct 28 19:55:08.961404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3182/6359] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:08 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:08.981562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-61acabdc-686a-4a47-8c4a-a10d3645a849 req-417dcf31-0b82-41a9-bb08-d903ce87430f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80c324b-6461-47e9-b614-7eb3d1725569", "tag": "30290a78-46ac-4a47-9b0f-41387098ee2c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:08.994050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61acabdc-686a-4a47-8c4a-a10d3645a849 req-417dcf31-0b82-41a9-bb08-d903ce87430f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:08.995145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61acabdc-686a-4a47-8c4a-a10d3645a849 req-417dcf31-0b82-41a9-bb08-d903ce87430f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:08.995783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61acabdc-686a-4a47-8c4a-a10d3645a849 req-417dcf31-0b82-41a9-bb08-d903ce87430f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:09.019614 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-61acabdc-686a-4a47-8c4a-a10d3645a849 req-417dcf31-0b82-41a9-bb08-d903ce87430f service nova] Creating event network-changed:30290a78-46ac-4a47-9b0f-41387098ee2c for instance e80c324b-6461-47e9-b614-7eb3d1725569 on n-h1-862769-3 Oct 28 19:55:09.026133 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-61acabdc-686a-4a47-8c4a-a10d3645a849 req-417dcf31-0b82-41a9-bb08-d903ce87430f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049664 Oct 28 19:55:09.027273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3178/6360] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:09.562461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:09.563273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:09.571074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:09.571808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:09.572509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:09.573570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:09.574020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:09.574446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:09.806005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:09.814579 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3e36936-a9cd-4ffe-af01-95c169aeef81 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.256289 Oct 28 19:55:09.815178 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3183/6361] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:09 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:09.973540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:09.974427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:09.981539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:09.982027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:09.982471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:09.983209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:09.983657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:09.984796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:10.136936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:10.145381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b65b6949-601a-47af-ada0-c527b7c4aba3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.177230 Oct 28 19:55:10.145940 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3179/6362] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:09 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:10.839654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:10.840167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:10.847798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:10.848512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:10.848949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:10.849689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:10.850175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:10.850712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:11.007176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:11.018987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4a93529-2fff-4f13-8e92-8a7a3ae7e9cf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.184420 Oct 28 19:55:11.019806 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3184/6363] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:10 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:11.171580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:11.172331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:11.182865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:11.183368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:11.183828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:11.184541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:11.184992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:11.186098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:11.350901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:11.366855 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a985679f-da1c-472b-969a-c8b5b736786e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.200026 Oct 28 19:55:11.370349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3180/6364] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:11 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:12.046034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:12.049422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:12.055418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:12.056215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:12.057743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:12.057743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:12.057922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:12.058354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:12.279069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:12.292839 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5643302e-95dc-483b-9de4-21b15f71beef tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.252794 Oct 28 19:55:12.293910 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3185/6365] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:12 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:12.398966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:12.400187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:12.410519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:12.411045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:12.411631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:12.411631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:12.413393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:12.413820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:12.611176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:12.623583 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d35122e5-574b-4f8d-9ee6-0ca8fab95018 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.230495 Oct 28 19:55:12.624539 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3181/6366] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:12 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:13.321833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:13.322729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:13.332823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:13.335765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:13.336357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:13.337234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:13.339183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:13.339654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:13.340173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:13.546293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:13.555373 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4d57116-a28a-4f2a-afde-d0d2f7cc80a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.238772 Oct 28 19:55:13.558731 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3186/6367] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:13 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:13.650167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:13.651553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:13.660277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:13.660760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:13.661198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:13.663219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:13.663860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:13.664296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:13.821339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:13.835741 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c38b5a3-a4da-4b8c-ba36-62090ab81655 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.189715 Oct 28 19:55:13.836520 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3182/6368] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:13 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:14.595260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:14.596515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:14.603948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:14.604444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:14.604876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:14.605578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:14.606052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:14.606548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:14.752734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:14.761366 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ad976e97-c1a6-4b3b-8f28-8e61824e515c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.169604 Oct 28 19:55:14.762261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3187/6369] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:14 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:14.859845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:14.860367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:14.864534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=53 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:14.869920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:14.870830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:14.871226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:14.871992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:14.872417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:14.872829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:15.011737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:15.020293 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2c18a00-d1fd-4fc0-b874-955033d43083 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.164368 Oct 28 19:55:15.020757 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3183/6370] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:14 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:15.785317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:15.785863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:15.793952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:15.794444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:15.794932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:15.795630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:15.796090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:15.796515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:15.921395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:15.942757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:15.944984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:15.952739 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67f73043-682c-4b9c-8924-b57a1d28d646 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.171405 Oct 28 19:55:15.953388 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3188/6371] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:15 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:16.045637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:16.046156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:16.053709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:16.054229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:16.054660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:16.055397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:16.055888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:16.056312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:16.106069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:16.195041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:16.203366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b6a73e5-dcb9-4ea2-9ac8-0e69041610f7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.161762 Oct 28 19:55:16.203949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3184/6372] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:16 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:16.977328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:16.977985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:16.985359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:16.985855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:16.986293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:16.987032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:16.987494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:16.987924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:17.128002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:17.135836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2398b79-baf8-41e4-8e97-1cc6a9a81cc5 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.162566 Oct 28 19:55:17.136515 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3189/6373] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:16 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:17.227814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:17.228508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:17.236000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:17.236494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:17.236895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:17.237825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:17.238270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:17.238729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:17.381896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:17.390193 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-985e3140-bc31-4d4a-bc0a-e47382a703f1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.166324 Oct 28 19:55:17.391390 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3185/6374] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:17 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:18.159489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:18.160036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:18.168050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:18.168565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:18.169093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:18.169933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:18.170444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:18.170878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:18.311529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:18.319712 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1878cca1-b34e-45fe-b4f4-d495263bc23b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.164470 Oct 28 19:55:18.320303 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3190/6375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:18 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:18.414362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:18.414997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:18.422534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:18.423062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:18.423503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:18.424188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:18.424648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:18.425073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:18.572561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:18.582465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ddc2c19-1334-4333-8702-4ee0a9fbd84e tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.172425 Oct 28 19:55:18.583189 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3186/6376] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:18 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:19.344579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:19.345179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:19.352796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:19.353314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:19.353766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:19.354516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:19.354982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:19.355444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:19.500968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:19.508951 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fda87cb-f57a-451a-ac96-bb4ae560194f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.168429 Oct 28 19:55:19.509593 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3191/6377] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:19 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:19.607549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:19.608270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:19.615463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:19.615952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:19.616383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:19.617081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:19.617532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:19.617959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:19.763522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:19.772315 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1dbbecd9-1d70-4d88-8440-13ad71df025b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1697 microversion: 2.1 time: 0.168786 Oct 28 19:55:19.772979 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3187/6378] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:19 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:20.533310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:20.533833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:20.541905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:20.542408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:20.542883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:20.543604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:20.544075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:20.544531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:20.701451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:20.710141 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2cc30678-cd14-499e-98cc-5a6778f0467c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.181128 Oct 28 19:55:20.710789 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3192/6379] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:20 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:20.797835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:20.798372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:20.807850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:20.808450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:20.808985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:20.809729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:20.810179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:20.810619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:20.954530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:20.963213 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1e16e9fb-b31c-4184-9011-7e150e638a68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1696 microversion: 2.1 time: 0.169450 Oct 28 19:55:20.963856 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3188/6380] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:20 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:21.205922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "name": "network-vif-unplugged", "status": "completed", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:21.216614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:21.217173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:21.217836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:21.230946 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] Creating event network-vif-unplugged:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h2-862769-3 Oct 28 19:55:21.236936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:55:21.248611 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-10d904ec-ece8-4fb5-9534-c8bc515bf6e6 req-ef72b7c2-9cb1-4ea9-9249-a531fc9f5441 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.267841 Oct 28 19:55:21.249467 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3193/6381] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:21.734149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:21.734772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:21.741519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:21.742049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:21.742486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:21.743234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:21.743690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:21.744112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:21.882590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:21.891265 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d948c37-494b-44fa-803e-e361e03fc2a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1342 microversion: 2.1 time: 0.161512 Oct 28 19:55:21.892216 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3189/6382] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:21 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:21.992981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:21.993688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:22.002117 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:22.002901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:22.003347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:22.004056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:22.004515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:22.004955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:22.162113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:22.171979 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-edb88ad9-b2b3-4be0-a9b0-bcbb8cb410c5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1696 microversion: 2.1 time: 0.183953 Oct 28 19:55:22.172769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3194/6383] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:21 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:22.915371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:22.915995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:22.924129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:22.924629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:22.925064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:22.925775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:22.926224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:22.926647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:23.068280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:23.076592 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6da30c9e-98f8-48a1-a261-782a090d766a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.165706 Oct 28 19:55:23.077204 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3190/6384] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:22 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:23.197993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:23.198526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:23.206138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:23.206638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:23.207116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:23.207834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:23.208329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:23.208759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:23.266658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:23.278390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:23.279096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:23.279525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:23.296886 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] Creating event network-changed:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h2-862769-3 Oct 28 19:55:23.303003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:55:23.314480 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-99d3e221-6621-450e-b286-47b865b45e4a req-712cda8f-7163-4b54-b629-22071fc88d84 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052645 Oct 28 19:55:23.315280 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3191/6385] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:23.371852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:23.375083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:23.383390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dabad768-4e31-421c-8e55-70ee2713284a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1694 microversion: 2.1 time: 0.189505 Oct 28 19:55:23.384184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3195/6386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:23 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:24.101915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:24.102601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:24.109357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.109851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.110404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.111025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.111474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.111890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.344421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:24.353610 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf443ebd-5134-4842-aa28-ffcf609f42ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.256598 Oct 28 19:55:24.363556 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3192/6387] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:24 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:24.409570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:24.410217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:24.417856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.418536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.419075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.419907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.420661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.421145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.558894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:24.567044 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec6ddf4b-a248-4c19-b5bf-b61bf9f72daf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1691 microversion: 2.1 time: 0.163438 Oct 28 19:55:24.567668 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3196/6388] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:24 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:24.591186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:24.591841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:24.598453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.599053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.599485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.600281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.600783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.601213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.704811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:24.724990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f0a962e1-8e16-472c-9df1-d755ceb798b3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action" status: 202 len: 0 microversion: 2.1 time: 0.137403 Oct 28 19:55:24.725621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3193/6389] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:55:24 2022] POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:55:24.735573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:24.736212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:24.742761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.743419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.743866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.744629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:24.745047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:24.745722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:24.905457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:24.914322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66fc8509-df33-4239-9990-9a4775592182 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1690 microversion: 2.1 time: 0.183321 Oct 28 19:55:24.914979 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3197/6390] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:24 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:25.378945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:25.379783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:25.388547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:25.389109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:25.389651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:25.390411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:25.390983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:25.391412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:25.545242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:25.555436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3d18565b-a9d0-4a7f-9b97-75439666ae48 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.181530 Oct 28 19:55:25.556142 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3194/6391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:25 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:25.940080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:25.941056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:25.952261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:25.952878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:25.953336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:25.954055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:25.954516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:25.955127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:26.108325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:26.117108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29101874-22d0-4ab4-8a9c-a4fcc8d3892b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1690 microversion: 2.1 time: 0.182451 Oct 28 19:55:26.117715 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3198/6392] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:25 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:26.358587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "name": "network-vif-plugged", "status": "completed", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:26.371744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:26.372523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:26.373081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:26.387704 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] Creating event network-vif-plugged:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h2-862769-3 Oct 28 19:55:26.394467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:55:26.405819 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b6975e2b-019f-4d8c-8018-17bbf2607b80 req-f3063841-7930-4f2d-bc5f-e09e8eb60180 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051235 Oct 28 19:55:26.406579 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3195/6393] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:26.581014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:26.581943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:26.590214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:26.590871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:26.591341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:26.592331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:26.592865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:26.593338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:26.745192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:26.755668 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e3793ff-fb53-43da-8b5b-42c69e3377b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.179173 Oct 28 19:55:26.756492 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3199/6394] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:26 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:27.142658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:27.143468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:27.152500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:27.152997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:27.153510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:27.154330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:27.154932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:27.155339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:27.303153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:27.312243 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba6e26fb-a636-49ef-8e90-68e84d3bf81a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1690 microversion: 2.1 time: 0.174751 Oct 28 19:55:27.312847 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3196/6395] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:27 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:27.784471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:27.785298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:27.793276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:27.793872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:27.794376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:27.795091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:27.795693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:27.796131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:28.021386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:28.030467 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-46b5e138-32ab-4417-bb02-b908705196a2 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.250335 Oct 28 19:55:28.031126 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3200/6396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:27 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:28.099410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "name": "network-vif-unplugged", "status": "completed", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:28.113734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:28.114367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:28.115149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:28.132041 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] Creating event network-vif-unplugged:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:55:28.139572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:55:28.153154 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d6616074-da4e-4955-ab50-0e82398f1528 req-7058cc96-527d-49ae-9f20-f72fd30b0cfe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059687 Oct 28 19:55:28.153970 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3197/6397] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:28.337595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:28.338448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:28.345387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:28.346297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:28.346915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:28.347914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:28.348557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:28.349182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:28.562433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:28.571408 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44c1eefb-7709-482d-a0de-261ff6ae0f15 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1690 microversion: 2.1 time: 0.237867 Oct 28 19:55:28.587205 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3201/6398] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:28 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:29.056924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:29.057786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:29.064354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:29.064859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:29.065327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:29.066019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:29.066471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:29.066926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:29.285896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:29.296369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3616c54f-7329-40b3-a49c-734423220681 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.243761 Oct 28 19:55:29.297110 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3198/6399] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:29 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:29.596182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:29.596827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:29.606139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:29.606643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:29.607132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:29.607854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:29.608346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:29.608772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:29.764698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:29.775179 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee280d47-a7f1-44ff-84e1-0c0b00d02155 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1690 microversion: 2.1 time: 0.183080 Oct 28 19:55:29.776019 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3202/6400] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:29 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:30.179897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:30.191066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:30.191508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:30.191925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:30.204324 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] Creating event network-changed:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:55:30.210378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:55:30.222416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-793cf453-caf4-4c78-97c7-c25fd977da65 req-0292895f-4f65-4cc4-b808-d1cb2b6c3a04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 Oct 28 19:55:30.223543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3199/6401] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:30.328773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:30.329816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:30.336547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:30.337285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:30.337694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:30.338456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:30.339069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:30.339516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:30.521515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:30.533807 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5190bf66-95c7-4027-a0f0-7f519a9d4c0a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.209233 Oct 28 19:55:30.534873 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3203/6402] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:30 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:30.802774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:30.804248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:30.811527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:30.812125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:30.812755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:30.813680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:30.814280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:30.815392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:31.016551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:31.027557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-04bc2e3c-9172-436b-8821-eac9cc306381 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1690 microversion: 2.1 time: 0.229861 Oct 28 19:55:31.028403 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3200/6403] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:30 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:31.560431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:31.561058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:31.568955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:31.569483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:31.569949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:31.570679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:31.571235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:31.571629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:31.725448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:31.734024 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3c1edff-dbfb-4cb0-98a1-341e2d1bea31 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.177625 Oct 28 19:55:31.734598 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3204/6404] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:31 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:32.057069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:32.057699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:32.065220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:32.065700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:32.066129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:32.066853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:32.067303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:32.067721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:32.219430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:32.228866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ceba979b-19ac-4a44-b0d8-71a155927281 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1683 microversion: 2.1 time: 0.176386 Oct 28 19:55:32.242904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3201/6405] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:32 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:32.523234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bc10affb-8e6c-496e-a389-583fdceef23a req-b6a212fb-c03d-495f-8b73-348693765bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80c324b-6461-47e9-b614-7eb3d1725569", "name": "network-vif-plugged", "status": "completed", "tag": "30290a78-46ac-4a47-9b0f-41387098ee2c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:32.535363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bc10affb-8e6c-496e-a389-583fdceef23a req-b6a212fb-c03d-495f-8b73-348693765bd1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:32.536205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bc10affb-8e6c-496e-a389-583fdceef23a req-b6a212fb-c03d-495f-8b73-348693765bd1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:32.536829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bc10affb-8e6c-496e-a389-583fdceef23a req-b6a212fb-c03d-495f-8b73-348693765bd1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:32.556209 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bc10affb-8e6c-496e-a389-583fdceef23a req-b6a212fb-c03d-495f-8b73-348693765bd1 service nova] Creating event network-vif-plugged:30290a78-46ac-4a47-9b0f-41387098ee2c for instance e80c324b-6461-47e9-b614-7eb3d1725569 on n-h1-862769-3 Oct 28 19:55:32.563855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bc10affb-8e6c-496e-a389-583fdceef23a req-b6a212fb-c03d-495f-8b73-348693765bd1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043826 Oct 28 19:55:32.564809 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3205/6406] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:32.758977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:32.759620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:32.766250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:32.766763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:32.767324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:32.768021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:32.768473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:32.768962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:32.910108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:32.918434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68c51111-9410-4844-bc83-f6fc6dfef9e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1376 microversion: 2.1 time: 0.163554 Oct 28 19:55:32.919235 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3202/6407] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:32 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:33.942757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:33.943465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:33.950848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:33.951342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:33.951826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:33.952655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:33.953165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:33.953595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.106467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:34.115710 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b86ffaf3-0e68-4903-b999-0af2adfc223a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1562 microversion: 2.1 time: 0.177743 Oct 28 19:55:34.116353 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3206/6408] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:33 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:34.139619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:34.140382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:34.149507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.150075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.150572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.151574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.152193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.152632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.313724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:34.322381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7e467076-0f8d-44e9-bf14-cb66b2949c83 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1562 microversion: 2.1 time: 0.186823 Oct 28 19:55:34.332633 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3203/6409] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:34 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:34.432063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:34.432582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:34.439072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.439578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.440025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.440772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.441241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.441742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.468977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:55:34.558381 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac7c855b-8d20-4e2f-8237-10e268ed462f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 204 len: 0 microversion: 2.1 time: 0.129991 Oct 28 19:55:34.559026 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3207/6410] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:55:34 2022] DELETE /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:55:34.569781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:34.570595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:34.578238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.578899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.579576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.580294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.580730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.580964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a47eda29-9b44-4a03-bd0c-8eaae68d1bef req-94111867-303e-4c64-9a93-0574f252df3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "name": "network-vif-plugged", "status": "completed", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:34.581190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.591723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a47eda29-9b44-4a03-bd0c-8eaae68d1bef req-94111867-303e-4c64-9a93-0574f252df3c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:34.592201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a47eda29-9b44-4a03-bd0c-8eaae68d1bef req-94111867-303e-4c64-9a93-0574f252df3c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:34.592719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a47eda29-9b44-4a03-bd0c-8eaae68d1bef req-94111867-303e-4c64-9a93-0574f252df3c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:34.605311 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a47eda29-9b44-4a03-bd0c-8eaae68d1bef req-94111867-303e-4c64-9a93-0574f252df3c service nova] Creating event network-vif-plugged:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:55:34.610676 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a47eda29-9b44-4a03-bd0c-8eaae68d1bef req-94111867-303e-4c64-9a93-0574f252df3c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034331 Oct 28 19:55:34.611323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3208/6411] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:34.731903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:34.740771 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-90f807bd-576c-4b56-90dd-ab73a806e8a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1568 microversion: 2.1 time: 0.175647 Oct 28 19:55:34.741392 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3204/6412] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:34 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:35.768420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:35.769136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:35.775906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:35.776403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:35.776847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:35.777553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:35.778013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:35.778443 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:35.921823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:35.930122 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-844c78ff-76d6-475d-b188-fbaee0000312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1568 microversion: 2.1 time: 0.167114 Oct 28 19:55:35.930719 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3209/6413] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:35 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:36.938798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-dbc74a8d-79fa-4c84-9b79-33428b7f345c req-cce72e99-668b-42d3-ab06-8bb1a61a8dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80c324b-6461-47e9-b614-7eb3d1725569", "name": "network-vif-deleted", "tag": "30290a78-46ac-4a47-9b0f-41387098ee2c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:36.949837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dbc74a8d-79fa-4c84-9b79-33428b7f345c req-cce72e99-668b-42d3-ab06-8bb1a61a8dbc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:36.950128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dbc74a8d-79fa-4c84-9b79-33428b7f345c req-cce72e99-668b-42d3-ab06-8bb1a61a8dbc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:36.950565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dbc74a8d-79fa-4c84-9b79-33428b7f345c req-cce72e99-668b-42d3-ab06-8bb1a61a8dbc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:36.955785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:36.956395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:36.964738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:36.965319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:36.965664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-dbc74a8d-79fa-4c84-9b79-33428b7f345c req-cce72e99-668b-42d3-ab06-8bb1a61a8dbc service nova] Creating event network-vif-deleted:30290a78-46ac-4a47-9b0f-41387098ee2c for instance e80c324b-6461-47e9-b614-7eb3d1725569 on n-h1-862769-3 Oct 28 19:55:36.965793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:36.966495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:36.966997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:36.967436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:36.971390 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-dbc74a8d-79fa-4c84-9b79-33428b7f345c req-cce72e99-668b-42d3-ab06-8bb1a61a8dbc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036472 Oct 28 19:55:36.972190 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3205/6414] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:37.034586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:37.043583 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8353d722-9ff9-442c-aca7-f884ffe04c59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1526 microversion: 2.1 time: 0.091959 Oct 28 19:55:37.044173 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3210/6415] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:36 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1526 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:38.069208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:38.069911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:38.076633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:38.077121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:38.077555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:38.078239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:38.078676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:38.079146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:38.144616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:38.153257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-77d29af5-f45d-4fbd-aa13-21343b0804e0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1361 microversion: 2.1 time: 0.089307 Oct 28 19:55:38.153843 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3206/6416] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:38 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:39.177200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:39.177847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:39.185122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:39.185613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:39.186051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:39.186792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:39.187254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:39.187869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:39.257837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:39.266010 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a9438a8-623a-4114-9b49-67bb7e368184 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1361 microversion: 2.1 time: 0.093398 Oct 28 19:55:39.266608 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3211/6417] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:39 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:40.289040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:40.289840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:40.297440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:40.297934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:40.298470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:40.299916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:40.300286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:40.300683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:40.368363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:40.377488 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-436dafc5-cf59-4e4d-9579-21f34a707dc8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1361 microversion: 2.1 time: 0.092736 Oct 28 19:55:40.378082 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3207/6418] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:40 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:41.400767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:41.401967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:41.409774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:41.410273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:41.410717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:41.411802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:41.412869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:41.413309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:41.416308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:41.461666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:41.462178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:41.462805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:41.463324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lazy-loading 'fault' on Instance uuid e80c324b-6461-47e9-b614-7eb3d1725569 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:55:41.510392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:41.518529 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a5ed072-4fae-418b-91e3-f4283cae2476 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 200 len: 1366 microversion: 2.1 time: 0.121662 Oct 28 19:55:41.519137 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3212/6419] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:41 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:55:42.542383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:42.542974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:42.550447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:42.550976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:42.551406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:42.552149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:42.552600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:42.553019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:42.567960 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 HTTP/1.1 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e80c324b-6461-47e9-b614-7eb3d1725569'} Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:42.569808 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8295385-9dee-457e-8551-f3f9ad4fa196 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 404 len: 111 microversion: 2.1 time: 0.033295 Oct 28 19:55:42.577557 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3208/6420] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:42 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:46.907262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:46.907785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:46.910826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:46.917501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:46.918012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:46.918460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:46.919220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:46.919671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:46.920118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:46.946744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:55:47.028419 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7bb1a032-7b64-4b9a-97a5-caf0722e513f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 204 len: 0 microversion: 2.1 time: 0.125571 Oct 28 19:55:47.029056 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3213/6421] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:55:46 2022] DELETE /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:55:47.038042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:47.038765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:47.042156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=56 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:47.049126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:47.049863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:47.050649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:47.051618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:47.052157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:47.052584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:47.198588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:47.206792 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b314be87-1fe4-46b0-b1d8-e684282ca1f6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1408 microversion: 2.1 time: 0.173209 Oct 28 19:55:47.207418 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3209/6422] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:47 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:48.230839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:48.231943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:48.240430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:48.240928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:48.241472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:48.242084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:48.242519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:48.242974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:48.385463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:48.393948 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5e23783b-f469-4a7e-934e-798f91429cbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1408 microversion: 2.1 time: 0.167745 Oct 28 19:55:48.394531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3214/6423] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:48 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:49.200891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-55a0a5bc-7c0e-4a24-9bfb-dfd741f71e79 req-0d2cb7e0-24f7-4acc-a192-f4c0bc42b7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57990618-bdf0-4d8e-a280-1da8c6950f82", "name": "network-vif-deleted", "tag": "06ebd8b1-3fcc-4188-91d3-caf2a56b5c4c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:49.213991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-55a0a5bc-7c0e-4a24-9bfb-dfd741f71e79 req-0d2cb7e0-24f7-4acc-a192-f4c0bc42b7e7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:49.214890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-55a0a5bc-7c0e-4a24-9bfb-dfd741f71e79 req-0d2cb7e0-24f7-4acc-a192-f4c0bc42b7e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:49.215283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-55a0a5bc-7c0e-4a24-9bfb-dfd741f71e79 req-0d2cb7e0-24f7-4acc-a192-f4c0bc42b7e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:49.229775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-55a0a5bc-7c0e-4a24-9bfb-dfd741f71e79 req-0d2cb7e0-24f7-4acc-a192-f4c0bc42b7e7 service nova] Creating event network-vif-deleted:06ebd8b1-3fcc-4188-91d3-caf2a56b5c4c for instance 57990618-bdf0-4d8e-a280-1da8c6950f82 on n-h2-862769-3 Oct 28 19:55:49.236330 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-55a0a5bc-7c0e-4a24-9bfb-dfd741f71e79 req-0d2cb7e0-24f7-4acc-a192-f4c0bc42b7e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039499 Oct 28 19:55:49.237211 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3210/6424] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:49.417176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:49.417859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:49.425399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:49.426019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:49.426637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:49.427399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:49.427936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:49.428461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:49.505719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:49.514384 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48c88438-f773-42c5-92ae-9e9a8197d9b4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1201 microversion: 2.1 time: 0.101639 Oct 28 19:55:49.515064 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3215/6425] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:49 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:50.538764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:50.539418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:50.546943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:50.547364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:50.547851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:50.548588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:50.549042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:50.549458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:50.623485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:50.631999 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c91b5e74-c59f-48b5-afbf-1f5c14f6d9c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1201 microversion: 2.1 time: 0.098008 Oct 28 19:55:50.632574 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3211/6426] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:50 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:51.655927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:51.656528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:51.664762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:51.665269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:51.665906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:51.666632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:51.667278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:51.667709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:51.754485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:51.762987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1eb95a76-7fb4-4c49-91c7-b91cba07249b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1201 microversion: 2.1 time: 0.110891 Oct 28 19:55:51.763796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3216/6427] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:51 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1201 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:52.786755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:52.788366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:52.796144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:52.796832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:52.797424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:52.798416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:52.799053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:52.799926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:52.869791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:55:52.878508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-800ce14a-8b43-49c8-814e-82165a847371 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 200 len: 1201 microversion: 2.1 time: 0.096008 Oct 28 19:55:52.879460 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3212/6428] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:52 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:55:53.903236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:53.904779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:53.919712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:53.920219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:53.920670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:53.922937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:53.923459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:53.923933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:53.942256 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 HTTP/1.1 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '57990618-bdf0-4d8e-a280-1da8c6950f82'} Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:53.944215 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:53.948879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:55:53.950061 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6af2db40-0989-4a85-943e-d56e223a94c0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 404 len: 111 microversion: 2.1 time: 0.052032 Oct 28 19:55:53.951215 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3217/6429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:53 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:57.156300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:57.156823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:57.164506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.165003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.165433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.166125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.166563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.167005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.169815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:57.183578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 HTTP/1.1 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e80c324b-6461-47e9-b614-7eb3d1725569'} Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:55:57.185532 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:55:57.188857 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb14734d-013c-4f74-ab32-8448b738c7c7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 404 len: 111 microversion: 2.1 time: 0.034340 Oct 28 19:55:57.190673 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3213/6430] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:55:57 2022] DELETE /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:57.195982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:57.196760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e80c324b-6461-47e9-b614-7eb3d1725569] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:57.204060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.204933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.205486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.206259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.206841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.207336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.225816 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 HTTP/1.1 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e80c324b-6461-47e9-b614-7eb3d1725569'} Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.227678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance e80c324b-6461-47e9-b614-7eb3d1725569 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e6002ffb-5f83-49e8-804c-5e3600c41d9e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569" status: 404 len: 111 microversion: 2.1 time: 0.036783 Oct 28 19:55:57.231324 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3218/6431] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:57 2022] GET /compute/v2.1/servers/e80c324b-6461-47e9-b614-7eb3d1725569 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:57.608528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:57.609029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:57.615508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.616030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.616469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.617169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.617826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.618040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.633156 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 HTTP/1.1 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '57990618-bdf0-4d8e-a280-1da8c6950f82'} Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:55:57.634474 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a189626-3f3d-42fb-b7cc-f80d73170b51 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 404 len: 111 microversion: 2.1 time: 0.031337 Oct 28 19:55:57.637994 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3214/6432] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:55:57 2022] DELETE /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:57.644887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:55:57.645517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 57990618-bdf0-4d8e-a280-1da8c6950f82] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:57.651996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.652486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.652928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.653622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:57.654084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:57.654512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:57.668453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 HTTP/1.1 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '57990618-bdf0-4d8e-a280-1da8c6950f82'} Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:55:57.669980 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 57990618-bdf0-4d8e-a280-1da8c6950f82 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3e67bf27-88ee-4da1-aa24-88b6009536ff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82" status: 404 len: 111 microversion: 2.1 time: 0.030472 Oct 28 19:55:57.674798 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3219/6433] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:55:57 2022] GET /compute/v2.1/servers/57990618-bdf0-4d8e-a280-1da8c6950f82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:57.746565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eec01077-2d20-4c05-92df-03af802b961b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: .version_select at 0x7f1d76996d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1427589248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgLNvORwhwBSQd/TTdOas1pUo04+nvjRQdM3REOLAJyK+KYbTY3gyCmAPoTzfSB7wjQ0noxGc+JpznGfjFGDV28MQ2TQ5lMhE4BCnrMEhslr4YewFfSU7pPvUhwzA2q5w=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:57.763591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-eec01077-2d20-4c05-92df-03af802b961b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:55:57.769844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-eec01077-2d20-4c05-92df-03af802b961b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:55:57.798129 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eec01077-2d20-4c05-92df-03af802b961b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055459 Oct 28 19:55:57.798755 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3215/6434] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:55:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:55:58.469860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:55:58.472282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:55:58.479722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:58.480489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:58.480960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:58.481717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:55:58.482301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:55:58.482760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:55:58.548021 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43078797-d64f-4861-8762-f46a0c9a767d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action" status: 200 len: 63085 microversion: 2.1 time: 0.083399 Oct 28 19:55:58.548979 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3220/6435] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:55:58 2022] POST /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532/action => generated 63085 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:56:04.893823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:04.894431 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:04.901993 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:04.902489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:04.904058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:04.904788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:04.905244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:04.905684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:05.045573 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fafeb9d5-a393-4ad3-91bd-60382248b1a1 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1834 microversion: 2.1 time: 0.157007 Oct 28 19:56:05.046157 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3216/6436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:04 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1834 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:05.951972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:05.953184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:05.961752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:05.962348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:05.962904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:05.963872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:05.964564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:05.965352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:06.002967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:56:06.059183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-37d24fb6-5ec3-4c4e-836e-7a054fb230c5 req-59c4a98e-4d3b-49ef-b626-f26b4b46d893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:06.070733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-37d24fb6-5ec3-4c4e-836e-7a054fb230c5 req-59c4a98e-4d3b-49ef-b626-f26b4b46d893 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:06.071486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-37d24fb6-5ec3-4c4e-836e-7a054fb230c5 req-59c4a98e-4d3b-49ef-b626-f26b4b46d893 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:06.072092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-37d24fb6-5ec3-4c4e-836e-7a054fb230c5 req-59c4a98e-4d3b-49ef-b626-f26b4b46d893 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:06.091461 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-37d24fb6-5ec3-4c4e-836e-7a054fb230c5 req-59c4a98e-4d3b-49ef-b626-f26b4b46d893 service nova] Creating event network-changed:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:56:06.098657 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-37d24fb6-5ec3-4c4e-836e-7a054fb230c5 req-59c4a98e-4d3b-49ef-b626-f26b4b46d893 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147439 Oct 28 19:56:06.100222 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3217/6437] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:06.115288 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88ec6166-e351-45ee-9db6-9d062061c128 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 204 len: 0 microversion: 2.1 time: 0.167232 Oct 28 19:56:06.116404 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3221/6438] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:56:05 2022] DELETE /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:56:06.125555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:06.126266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:06.133055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:06.133856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:06.134308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:06.135021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:06.135648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:06.136226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:06.281210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:06.290412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1a6160a-c5c0-4123-bd8f-2cc15b5bd053 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1689 microversion: 2.1 time: 0.168859 Oct 28 19:56:06.291728 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3218/6439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:06 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:56:07.316581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:07.317882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:07.326290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:07.327226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:07.327640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:07.328352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:07.328810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:07.329273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:07.501706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:07.510108 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b3d4310-3f1c-4302-b55d-263935f7f661 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1689 microversion: 2.1 time: 0.197908 Oct 28 19:56:07.527148 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3222/6440] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:07 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:08.082400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2c826e9a-2926-4954-98c1-f41781dd38c2 req-460e31c1-d9bf-4eb1-9fba-61b6b47b08bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfb8fd2-1309-4b04-9fd1-76fc02043532", "name": "network-vif-deleted", "tag": "c6b8a709-2209-4123-8204-66ea06dddede"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:08.089877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:08.096006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2c826e9a-2926-4954-98c1-f41781dd38c2 req-460e31c1-d9bf-4eb1-9fba-61b6b47b08bf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:08.096503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2c826e9a-2926-4954-98c1-f41781dd38c2 req-460e31c1-d9bf-4eb1-9fba-61b6b47b08bf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:08.097058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2c826e9a-2926-4954-98c1-f41781dd38c2 req-460e31c1-d9bf-4eb1-9fba-61b6b47b08bf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:08.109260 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2c826e9a-2926-4954-98c1-f41781dd38c2 req-460e31c1-d9bf-4eb1-9fba-61b6b47b08bf service nova] Creating event network-vif-deleted:c6b8a709-2209-4123-8204-66ea06dddede for instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 on n-h1-862769-3 Oct 28 19:56:08.114788 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2c826e9a-2926-4954-98c1-f41781dd38c2 req-460e31c1-d9bf-4eb1-9fba-61b6b47b08bf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036461 Oct 28 19:56:08.115432 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3219/6441] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:08.536160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:08.537934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:08.545484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:08.546301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:08.547110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:08.548217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:08.548595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:08.549325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:08.587998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:08.589405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:08.589850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:08.590837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lazy-loading 'fault' on Instance uuid dbfb8fd2-1309-4b04-9fd1-76fc02043532 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:56:08.643683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:08.652581 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-269db493-bee6-4137-8abc-a810d47b8f37 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 200 len: 1357 microversion: 2.1 time: 0.121089 Oct 28 19:56:08.654342 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3223/6442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:08 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 1357 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:09.679384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:09.680070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: dbfb8fd2-1309-4b04-9fd1-76fc02043532] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:09.687072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:09.687487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:09.687920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:09.688612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:09.689113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:09.689484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:09.703353 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] HTTP exception thrown: Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 could not be found. Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Request method failure captured: Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 HTTP/1.1 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLf2SUK5pk2HYFYPh8e0kO2E1AoFfhQqkDjDHUWP_zNOiNBS3OUpg1dBeg2jIFq4ATaGoXzBw46cnqWTEaVETmyc_16D2RZzRnAZ58MBG89ru0eG0OwyYodxPYz5zfLDX7iRpxbdHlgejMR_bY_y8pfaXzKOyfSvHXVbRnsXcinIe4 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_67e38d5748ae407e80a353dc2150b848", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 06cf5d4bbcb042c4bd32f1788c6dbcd9 Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 could not be found. Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'dbfb8fd2-1309-4b04-9fd1-76fc02043532'} Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 could not be found. Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 could not be found. Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:56:09.705052 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 could not be found. Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Returning 404 to user: Instance dbfb8fd2-1309-4b04-9fd1-76fc02043532 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-23c5f257-cc4b-4c1f-8c66-b4b347b4fd3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532" status: 404 len: 111 microversion: 2.1 time: 0.032461 Oct 28 19:56:09.708831 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3220/6443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:09 2022] GET /compute/v2.1/servers/dbfb8fd2-1309-4b04-9fd1-76fc02043532 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:56:13.518978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1c21a331-4be0-4a1f-b0af-5d26431c6926 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '.version_select at 0x7f1d7689ae50>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:13.574574 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1c21a331-4be0-4a1f-b0af-5d26431c6926 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1752312038" status: 202 len: 0 microversion: 2.1 time: 0.060854 Oct 28 19:56:13.575567 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3224/6444] 10.222.0.44 () {58 vars in 1284 bytes} [Fri Oct 28 19:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1752312038 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:56:13.613989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9c7918eb-3208-40ac-8a30-e29734318035 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: .version_select at 0x7f1d76a09550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-900606113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS44XMJmNlAE+bASrcGyvy3qBlgeaY9Y+agqCoMhLybRyzAxFZt+fQ7CMrSslLz9FWXp0318Vf4Vv6QlwissfxezhzDv0UQ+dmqxHQGoX8zq185AcBWu/L0Rpk4iXP+UA=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:13.637402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9c7918eb-3208-40ac-8a30-e29734318035 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:56:13.643957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9c7918eb-3208-40ac-8a30-e29734318035 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:56:13.678465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9c7918eb-3208-40ac-8a30-e29734318035 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.068325 Oct 28 19:56:13.687534 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3221/6445] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:56:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:15.308348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1266397085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1427589248", "security_groups": [{"name": "tempest-secgroup-smoke-615129487"}], "block_device_mapping_v2": [{"uuid": "c050e2e8-7c59-441f-bfdb-af65cd721b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:15.476037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:56:16.291496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:56:16.292051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:56:16.292564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:56:16.292978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:56:16.293546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:56:16.304198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:16.304705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:16.305141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:16.305877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:16.306339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:16.306799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:16.313223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:16.328624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:56:16.334063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:56:16.394023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:56:16.396229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c050e2e8-7c59-441f-bfdb-af65cd721b5d',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:56:16.532358 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ef01d02-73e1-4dd1-a667-f388ed32c5f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.228053 Oct 28 19:56:16.533583 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3225/6446] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:56:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:56:16.544986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-917b628d-93c9-497f-bf62-2c306b76143f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:16.546472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-917b628d-93c9-497f-bf62-2c306b76143f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:16.964457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-917b628d-93c9-497f-bf62-2c306b76143f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:16.972526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-917b628d-93c9-497f-bf62-2c306b76143f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1095 microversion: 2.1 time: 0.431344 Oct 28 19:56:16.973671 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3222/6447] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:16 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1095 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:18.000020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:18.000818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:18.002923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:18.009191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:18.009913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:18.010650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:18.011776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:18.012449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:18.013090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:18.146400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:18.155224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a26d2a54-1a06-4342-8a56-4571d168a317 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1211 microversion: 2.1 time: 0.161278 Oct 28 19:56:18.155812 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3226/6448] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:17 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:56:19.180228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:19.182335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:19.187410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:19.205617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:19.209249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:19.209822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:19.210678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:19.213264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:19.213824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:19.699184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:19.709681 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09821d16-1f2b-4ae3-9238-fb0a4ed35008 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1278 microversion: 2.1 time: 0.533902 Oct 28 19:56:19.714623 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3223/6449] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:19 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1278 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:20.086218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ffc8e7a0-eb62-422a-a7f9-532a3deed45b req-035f3666-4400-464e-a71e-42a539427c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d69b96-065c-4f6c-aab1-af3617d76968", "tag": "ec0398ec-032c-4e32-ac6c-99e92c355221"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:20.109609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ffc8e7a0-eb62-422a-a7f9-532a3deed45b req-035f3666-4400-464e-a71e-42a539427c5d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:20.110600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ffc8e7a0-eb62-422a-a7f9-532a3deed45b req-035f3666-4400-464e-a71e-42a539427c5d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:20.111437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ffc8e7a0-eb62-422a-a7f9-532a3deed45b req-035f3666-4400-464e-a71e-42a539427c5d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:20.144364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ffc8e7a0-eb62-422a-a7f9-532a3deed45b req-035f3666-4400-464e-a71e-42a539427c5d service nova] Creating event network-changed:ec0398ec-032c-4e32-ac6c-99e92c355221 for instance e5d69b96-065c-4f6c-aab1-af3617d76968 on n-h1-862769-3 Oct 28 19:56:20.163057 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ffc8e7a0-eb62-422a-a7f9-532a3deed45b req-035f3666-4400-464e-a71e-42a539427c5d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080165 Oct 28 19:56:20.164002 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3227/6450] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:20.740484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:20.742255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:20.762885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:20.763869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:20.764519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:20.765570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:20.766283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:20.767338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:21.003364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:21.016978 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e6818479-08fc-4916-9b19-f4ef60391963 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1278 microversion: 2.1 time: 0.281371 Oct 28 19:56:21.030121 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3224/6451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:20 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:21.813224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1379209066", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e32c5b65-64e1-4e36-a4dc-d4d5bb650fd8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-900606113", "security_groups": [{"name": "tempest-secgroup-smoke-1485849222"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:21.937576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] validate_networks() for [('e32c5b65-64e1-4e36-a4dc-d4d5bb650fd8', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:56:22.045317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:22.049897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:22.060547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:22.061353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:22.061972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:22.063319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:22.064151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:22.064745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:22.319765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:22.334880 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-168c2f66-af1b-4a9d-bb56-df45d189edbf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1278 microversion: 2.1 time: 0.295687 Oct 28 19:56:22.335489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3225/6452] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:22 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:22.464583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:56:22.465072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:56:22.465725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:56:22.466322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:56:22.466929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:56:22.484913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:22.485740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:22.486350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:22.487532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:22.488211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:22.488802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:22.510396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:56:22.517133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:56:22.534237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:56:22.537650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:56:22.618770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-39325f31-2a1d-48df-b470-3c25132e1586 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811080 Oct 28 19:56:22.619464 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3228/6453] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:56:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:56:22.631266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11b418a6-152c-43a3-9dcb-97037e46b0e1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:22.632315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11b418a6-152c-43a3-9dcb-97037e46b0e1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:22.747709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-11b418a6-152c-43a3-9dcb-97037e46b0e1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:22.763946 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11b418a6-152c-43a3-9dcb-97037e46b0e1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1266 microversion: 2.1 time: 0.136889 Oct 28 19:56:22.769046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3226/6454] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:22 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:23.365279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:23.366580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:23.377672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:23.378666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:23.379337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:23.380212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:23.380856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:23.381488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:23.560543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:23.570863 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8d8d112-66a6-440d-bec3-9803314a91c1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1278 microversion: 2.1 time: 0.212973 Oct 28 19:56:23.574781 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3229/6455] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:23 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:23.792738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:23.793420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:23.802859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:23.803571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:23.804330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:23.805231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:23.805841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:23.806278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:23.877992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:23.886436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f06f6001-8854-469e-b48f-a0fc73b97518 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1318 microversion: 2.1 time: 0.098000 Oct 28 19:56:23.887064 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3227/6456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:23 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:24.594904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:24.597042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:24.603408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:24.603965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:24.604413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:24.605177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:24.605823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:24.606256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:24.765833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:24.775871 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34612a37-9087-40c3-b0d2-1007ce536205 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.186042 Oct 28 19:56:24.794631 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3230/6457] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:24 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:24.912688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:24.913443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:24.921156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:24.922110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:24.922630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:24.923962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:24.924767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:24.925405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:25.109180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:25.118289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b379096b-8c9a-48c6-94ee-c4d0e98ca3cb tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1392 microversion: 2.1 time: 0.212237 Oct 28 19:56:25.119247 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3228/6458] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:24 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1392 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:25.686574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-91336721-85ae-48f1-bd66-65a9bd483276 req-57cf45d0-f830-402e-b452-df839c2effda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:25.702736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-91336721-85ae-48f1-bd66-65a9bd483276 req-57cf45d0-f830-402e-b452-df839c2effda service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:25.703423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-91336721-85ae-48f1-bd66-65a9bd483276 req-57cf45d0-f830-402e-b452-df839c2effda service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:25.704223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-91336721-85ae-48f1-bd66-65a9bd483276 req-57cf45d0-f830-402e-b452-df839c2effda service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:25.719116 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-91336721-85ae-48f1-bd66-65a9bd483276 req-57cf45d0-f830-402e-b452-df839c2effda service nova] Creating event network-changed:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h2-862769-3 Oct 28 19:56:25.725205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-91336721-85ae-48f1-bd66-65a9bd483276 req-57cf45d0-f830-402e-b452-df839c2effda service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042925 Oct 28 19:56:25.725810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3231/6459] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:25.802113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:25.802749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:25.809951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:25.810453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:25.810947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:25.811667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:25.812121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:25.812548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:25.950858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:25.959703 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-24b26749-6f2c-450d-a7ff-9a2e846901a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.162187 Oct 28 19:56:25.960291 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3229/6460] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:25 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:26.149299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:26.150524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:26.159132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:26.159608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:26.160054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:26.160795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:26.161252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:26.161680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:26.311867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:26.321033 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-23526d29-8734-4636-ac09-9b0d1b49b38b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1392 microversion: 2.1 time: 0.180423 Oct 28 19:56:26.321617 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3232/6461] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:26 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:26.983111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:26.983702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:26.991152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:26.991647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:26.992117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:26.992824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:26.993322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:26.993737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:27.135241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:27.144072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae4680b0-f40e-44ec-8040-0fabe84ac0a7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.164712 Oct 28 19:56:27.144684 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3230/6462] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:26 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:27.344918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:27.345549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:27.353115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:27.353633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:27.354052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:27.355041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:27.356392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:27.356392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:27.500860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:27.509093 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b9af246c-797f-4a8c-87a8-91d371c069e3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1392 microversion: 2.1 time: 0.168561 Oct 28 19:56:27.509712 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3233/6463] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:27 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:28.170835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:28.171700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:28.180631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:28.181113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:28.181543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:28.182224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:28.182674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:28.183152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:28.185734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=64 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:28.329393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:28.337492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a592af53-4afd-4b38-bc96-33dc25b911d9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.172533 Oct 28 19:56:28.338122 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3231/6464] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:28 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:28.532598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:28.533398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:28.541834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:28.542606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:28.543167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:28.543909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:28.544404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:28.544832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:28.695284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:28.704131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5774facf-c319-4a68-98a0-f3be65b98b38 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1392 microversion: 2.1 time: 0.175915 Oct 28 19:56:28.704711 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3234/6465] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:28 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:29.360811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:29.361634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:29.369193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:29.369689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:29.370125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:29.370871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:29.371512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:29.371934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:29.516407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:29.525598 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ad9820e-eb17-4da1-9354-d48e2c5bd4ce tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.168889 Oct 28 19:56:29.526177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3232/6466] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:29 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:29.728063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:29.728620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:29.736221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:29.736718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:29.737181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:29.737864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:29.738336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:29.738790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:29.889458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:29.898152 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-776b4405-e146-4dde-98a0-306c5f05350c tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1392 microversion: 2.1 time: 0.174190 Oct 28 19:56:29.898795 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3235/6467] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:29 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:30.552029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:30.552702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:30.560458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:30.560949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:30.561382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:30.562114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:30.562567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:30.563015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:30.697789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-83a503b3-3f84-48f0-bedd-2809ea9c2eb6 req-a31ffbb0-3857-4819-b18e-5cd18c381daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "name": "network-vif-plugged", "status": "completed", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:30.707650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-83a503b3-3f84-48f0-bedd-2809ea9c2eb6 req-a31ffbb0-3857-4819-b18e-5cd18c381daf service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:30.708152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-83a503b3-3f84-48f0-bedd-2809ea9c2eb6 req-a31ffbb0-3857-4819-b18e-5cd18c381daf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:30.708613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-83a503b3-3f84-48f0-bedd-2809ea9c2eb6 req-a31ffbb0-3857-4819-b18e-5cd18c381daf service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:30.726287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:30.727679 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-83a503b3-3f84-48f0-bedd-2809ea9c2eb6 req-a31ffbb0-3857-4819-b18e-5cd18c381daf service nova] Creating event network-vif-plugged:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h2-862769-3 Oct 28 19:56:30.733550 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-83a503b3-3f84-48f0-bedd-2809ea9c2eb6 req-a31ffbb0-3857-4819-b18e-5cd18c381daf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120504 Oct 28 19:56:30.734619 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3236/6468] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:56:30.734943 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9571983-2671-412a-ae04-9d67a3627c6d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.190206 Oct 28 19:56:30.735732 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3233/6469] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:30 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:30.922563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:30.923340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:30.930856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:30.931663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:30.932120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:30.932834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:30.933301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:30.933759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:31.078342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:31.086952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-86722a03-2f20-4efa-8356-c69ade813e96 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1392 microversion: 2.1 time: 0.168736 Oct 28 19:56:31.087508 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3237/6470] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:30 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:31.761393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:31.761971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:31.769547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:31.770037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:31.770471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:31.771218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:31.771723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:31.772150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:31.919422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:31.928202 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-36aee86d-1787-4fda-89ff-aa67ea96bc40 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.170856 Oct 28 19:56:31.929022 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3234/6471] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:31 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:32.110012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:32.110604 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:32.118272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:32.118799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:32.119234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:32.119970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:32.120407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:32.120842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:32.265240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:32.273188 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c75c31da-3c00-4836-9d96-4a9990433bb7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1564 microversion: 2.1 time: 0.167208 Oct 28 19:56:32.273777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3238/6472] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:32 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:32.297839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:32.298508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:32.305933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:32.306451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:32.306918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:32.307623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:32.308070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:32.308488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:32.445677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:32.453936 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9707a10b-bd37-47f8-85db-1696fca2fb63 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1564 microversion: 2.1 time: 0.160255 Oct 28 19:56:32.454555 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3235/6473] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:32 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:56:32.951327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:32.951867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:32.953967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:32.954653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:32.960833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:32.961333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:32.961797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:32.962516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:32.963649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:32.964087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:33.117868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:33.126600 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-95e30e1c-ecee-4aca-ab7b-12cf078ee4fa tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.179446 Oct 28 19:56:33.131181 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3239/6474] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:32 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:34.150316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:34.150925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:34.152863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:34.159576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:34.160084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:34.160519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:34.161236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:34.161691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:34.162140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:34.302502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:34.310454 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0376c86e-0f71-4aba-aabf-b6a5b9227ff9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.164552 Oct 28 19:56:34.311076 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3236/6475] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:34 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:34.441116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fb13f899-8617-4e32-8643-8891e6025980 req-e0036140-c339-4541-b11a-11f1b9a3fc32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:34.444347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:34.445534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:34.460271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:34.462473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fb13f899-8617-4e32-8643-8891e6025980 req-e0036140-c339-4541-b11a-11f1b9a3fc32 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:34.463317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:34.464007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:34.464966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:34.465751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fb13f899-8617-4e32-8643-8891e6025980 req-e0036140-c339-4541-b11a-11f1b9a3fc32 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:34.466447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:34.467119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fb13f899-8617-4e32-8643-8891e6025980 req-e0036140-c339-4541-b11a-11f1b9a3fc32 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:34.467759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:34.485937 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fb13f899-8617-4e32-8643-8891e6025980 req-e0036140-c339-4541-b11a-11f1b9a3fc32 service nova] Creating event network-changed:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h2-862769-3 Oct 28 19:56:34.502851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fb13f899-8617-4e32-8643-8891e6025980 req-e0036140-c339-4541-b11a-11f1b9a3fc32 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065037 Oct 28 19:56:34.505183 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3237/6476] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:34.615268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a26caf29-0f78-4308-b94f-9a1dafaecc17 req-7d14449d-1869-4ec2-ae33-a95ad1e06393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69b96-065c-4f6c-aab1-af3617d76968", "name": "network-vif-plugged", "status": "completed", "tag": "ec0398ec-032c-4e32-ac6c-99e92c355221"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:34.638197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a26caf29-0f78-4308-b94f-9a1dafaecc17 req-7d14449d-1869-4ec2-ae33-a95ad1e06393 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:34.638900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a26caf29-0f78-4308-b94f-9a1dafaecc17 req-7d14449d-1869-4ec2-ae33-a95ad1e06393 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:34.639352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a26caf29-0f78-4308-b94f-9a1dafaecc17 req-7d14449d-1869-4ec2-ae33-a95ad1e06393 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:34.660978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:34.671433 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a59d7905-9d63-4fa8-9659-b7d65c03d203 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1564 microversion: 2.1 time: 0.237465 Oct 28 19:56:34.672670 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3240/6477] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:34 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:34.692022 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a26caf29-0f78-4308-b94f-9a1dafaecc17 req-7d14449d-1869-4ec2-ae33-a95ad1e06393 service nova] Creating event network-vif-plugged:ec0398ec-032c-4e32-ac6c-99e92c355221 for instance e5d69b96-065c-4f6c-aab1-af3617d76968 on n-h1-862769-3 Oct 28 19:56:34.697871 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a26caf29-0f78-4308-b94f-9a1dafaecc17 req-7d14449d-1869-4ec2-ae33-a95ad1e06393 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087719 Oct 28 19:56:34.699254 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3238/6478] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:56:35.335409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:35.336036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:35.342398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:35.343191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:35.343637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:35.344351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:35.344809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:35.345239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:35.503534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:35.515772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f38a454d-b11c-4d66-a45c-a5c5dea336f1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1266 microversion: 2.1 time: 0.184378 Oct 28 19:56:35.516711 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3241/6479] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:35 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:36.541389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:36.541969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:36.549360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:36.549711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:36.550147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:36.550886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:36.551349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:36.551773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:36.693662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:36.701942 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-475986ad-ea8b-4a79-b8e5-b08948b3224f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1453 microversion: 2.1 time: 0.166299 Oct 28 19:56:36.702525 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3239/6480] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:36 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:36.725166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:56:36.725790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:36.731937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:36.732428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:36.732874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:36.733578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:36.734039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:36.734465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:36.878033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:56:36.886857 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c213fd82-67a5-4421-b6ca-e162c15fe387 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1453 microversion: 2.1 time: 0.166364 Oct 28 19:56:36.887444 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3242/6481] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:56:36 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:56:38.889944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-39266419-f8cf-4b9d-9eea-14901ef042ac req-8e33fa65-73b2-493c-a8ac-68207d3d22fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d69b96-065c-4f6c-aab1-af3617d76968", "tag": "ec0398ec-032c-4e32-ac6c-99e92c355221"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:38.900916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-39266419-f8cf-4b9d-9eea-14901ef042ac req-8e33fa65-73b2-493c-a8ac-68207d3d22fb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:38.901391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-39266419-f8cf-4b9d-9eea-14901ef042ac req-8e33fa65-73b2-493c-a8ac-68207d3d22fb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:38.901817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-39266419-f8cf-4b9d-9eea-14901ef042ac req-8e33fa65-73b2-493c-a8ac-68207d3d22fb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:38.915592 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-39266419-f8cf-4b9d-9eea-14901ef042ac req-8e33fa65-73b2-493c-a8ac-68207d3d22fb service nova] Creating event network-changed:ec0398ec-032c-4e32-ac6c-99e92c355221 for instance e5d69b96-065c-4f6c-aab1-af3617d76968 on n-h1-862769-3 Oct 28 19:56:38.920739 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-39266419-f8cf-4b9d-9eea-14901ef042ac req-8e33fa65-73b2-493c-a8ac-68207d3d22fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034756 Oct 28 19:56:38.921600 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3240/6482] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:56:55.968561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:56:55.970849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:56:55.973593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:55.974270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=87 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:55.980083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:55.980610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:55.981047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:55.981751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:56:55.982208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:56:55.982634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:56:56.034801 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa816505-0187-4897-b060-3284f53b0cd0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action" status: 200 len: 24564 microversion: 2.1 time: 0.070199 Oct 28 19:56:56.035694 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3243/6483] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:56:55 2022] POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action => generated 24564 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:57:07.086346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=37 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:07.087123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=47 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:07.088132 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:57:07.088375 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 19:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd (ip 10.222.0.44) !!! Oct 28 19:57:07.148980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:07.149698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:07.156439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.156976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.157413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.158139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.158651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.159100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.298496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:07.307078 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7f1e5b88-ff82-4d02-b8b2-5e0341e620c7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1682 microversion: 2.1 time: 0.223559 Oct 28 19:57:07.307647 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3241/6484] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:07 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:07.411551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:07.414235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:07.416981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:07.417654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:07.424526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.425027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.425468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.426182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.426664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.427119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.487171 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2936a77-0ff9-4474-be8b-25b927096288 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action" status: 200 len: 32629 microversion: 2.1 time: 0.079720 Oct 28 19:57:07.487909 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3244/6485] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:57:07 2022] POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action => generated 32629 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:57:07.762323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:07.763031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:07.770226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.770747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.771195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.772063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.772620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.773171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.918434 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0d24bab2-21af-45c5-b7e0-6097bee1b4b6 tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1833 microversion: 2.1 time: 0.274872 Oct 28 19:57:07.919107 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3242/6486] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:07 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1833 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:07.949542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:07.952183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:07.959732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.960230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.960672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.961374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:07.961839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:07.962266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:07.988200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lazy-loading 'flavor' on Instance uuid 217e84c6-6e89-4fda-a984-eec16d8c91bd {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:57:08.000850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Going to try to live migrate instance to another host {{(pid=120629) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 19:57:09.456757 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6392b888-f74b-4319-a262-e39b1002031e tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action" status: 202 len: 0 microversion: 2.1 time: 1.511531 Oct 28 19:57:09.457534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3245/6487] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:57:07 2022] POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action => generated 0 bytes in 1513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:57:09.470539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:09.471821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:09.485754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:09.486312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:09.486791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:09.487462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:09.487940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:09.488397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:09.644079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:09.652492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec52590c-24ef-4e93-8d22-a28c0b57183d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.188177 Oct 28 19:57:09.653103 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3243/6488] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:09 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:57:10.559206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-ba01b17f-a5c2-4e83-9489-aa0eb9686cb6 req-a4da9acd-e9f6-4e25-9184-1e6a16af7f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "name": "network-vif-unplugged", "status": "completed", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:10.570426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ba01b17f-a5c2-4e83-9489-aa0eb9686cb6 req-a4da9acd-e9f6-4e25-9184-1e6a16af7f51 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:10.571091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ba01b17f-a5c2-4e83-9489-aa0eb9686cb6 req-a4da9acd-e9f6-4e25-9184-1e6a16af7f51 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:10.571528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-ba01b17f-a5c2-4e83-9489-aa0eb9686cb6 req-a4da9acd-e9f6-4e25-9184-1e6a16af7f51 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:10.586081 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-ba01b17f-a5c2-4e83-9489-aa0eb9686cb6 req-a4da9acd-e9f6-4e25-9184-1e6a16af7f51 service nova] Creating event network-vif-unplugged:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h2-862769-3 Oct 28 19:57:10.592095 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-ba01b17f-a5c2-4e83-9489-aa0eb9686cb6 req-a4da9acd-e9f6-4e25-9184-1e6a16af7f51 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036636 Oct 28 19:57:10.592904 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3246/6489] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:10.678020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:10.678760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:10.686493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:10.687052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:10.687516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:10.688224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:10.688970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:10.689407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:10.850618 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:10.859991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-abf38820-0156-4ee1-8b02-c6097ad2d933 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.186306 Oct 28 19:57:10.860641 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3244/6490] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:10 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:11.886644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:11.887468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:11.895287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:11.895788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:11.896232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:11.896942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:11.897643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:11.898107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:12.037595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:12.045599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b16efa9-dae0-4850-9232-08221eb83ab8 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.163533 Oct 28 19:57:12.046207 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3247/6491] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:11 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:12.921576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-2cd4ffb1-a8c0-4b9a-8702-bccafc36c3b0 req-00d1fddc-bb7e-45cd-bc6e-8fd9c6dcf6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:12.932711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2cd4ffb1-a8c0-4b9a-8702-bccafc36c3b0 req-00d1fddc-bb7e-45cd-bc6e-8fd9c6dcf6b8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:12.933151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2cd4ffb1-a8c0-4b9a-8702-bccafc36c3b0 req-00d1fddc-bb7e-45cd-bc6e-8fd9c6dcf6b8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:12.933610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-2cd4ffb1-a8c0-4b9a-8702-bccafc36c3b0 req-00d1fddc-bb7e-45cd-bc6e-8fd9c6dcf6b8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:12.945180 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-2cd4ffb1-a8c0-4b9a-8702-bccafc36c3b0 req-00d1fddc-bb7e-45cd-bc6e-8fd9c6dcf6b8 service nova] Creating event network-changed:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h2-862769-3 Oct 28 19:57:12.951090 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-2cd4ffb1-a8c0-4b9a-8702-bccafc36c3b0 req-00d1fddc-bb7e-45cd-bc6e-8fd9c6dcf6b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Oct 28 19:57:12.951687 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3245/6492] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:13.070552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:13.071287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:13.078380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:13.079086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:13.079726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:13.080572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:13.081080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:13.081698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:13.233659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:13.242489 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88d680d8-322c-4c41-b705-dc0dde12dadf tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.176537 Oct 28 19:57:13.243310 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3248/6493] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:13 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:14.271393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:14.272134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:14.279779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:14.280273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:14.280712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:14.281416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:14.281877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:14.282303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:14.424468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:14.432629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9482c16-3d06-4313-b778-b8249f3e8561 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.167750 Oct 28 19:57:14.433211 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3246/6494] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:14 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:15.455605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:15.456222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:15.463676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:15.464176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:15.464625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:15.465338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:15.465797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:15.466237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:15.606129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:15.617774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c56e1693-ed46-4f52-a16a-0bf4bb88e4a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.166091 Oct 28 19:57:15.618402 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3249/6495] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:15 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:16.642797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:16.643946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:16.656731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:16.657661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:16.658474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:16.659829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:16.660675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:16.661491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:16.875364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:16.890448 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4206333c-ffa5-4e19-a136-5ba63908840a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.252130 Oct 28 19:57:16.891464 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3247/6496] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:16 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:57:17.934062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:17.935010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:17.944570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:17.945231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:17.945864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:17.946656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:17.947458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:17.948213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:18.127284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:18.140323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f1aa070f-0431-4e02-9a7a-50bd6bb79883 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1692 microversion: 2.1 time: 0.213891 Oct 28 19:57:18.141074 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3250/6497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:17 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1692 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:19.164930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:19.165767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:19.173117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:19.173587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:19.174021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:19.174748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:19.175203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:19.175614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:19.361957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:19.370867 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b59725b-79d4-4820-b6d5-32cb444d967d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1682 microversion: 2.1 time: 0.210401 Oct 28 19:57:19.371602 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3248/6498] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:19 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:19.395680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:19.396303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:19.404185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:19.404683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:19.405148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:19.405870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:19.406329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:19.406783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:19.911882 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-90c23820-c737-4641-a147-bd969b25594f tempest-TestNetworkAdvancedServerOps-1702393741 tempest-TestNetworkAdvancedServerOps-1702393741-project-admin] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1833 microversion: 2.1 time: 0.520332 Oct 28 19:57:19.912933 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3251/6499] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:19 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1833 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:19.937134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:19.937732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:19.944620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:19.945119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:19.945558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:19.946293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:19.946792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:19.947216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:20.105073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:20.114122 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fdc4990a-920c-4dc5-b4a2-d608c20fa4d7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1682 microversion: 2.1 time: 0.180919 Oct 28 19:57:20.114752 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3249/6500] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:19 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:22.237978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:22.240815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:22.249157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:22.249674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:22.250112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:22.250950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:22.251409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:22.251864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:22.320836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7fbe69e5-70c8-48d4-9c31-358795371c3b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action" status: 200 len: 38667 microversion: 2.1 time: 0.087380 Oct 28 19:57:22.322016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3252/6501] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:57:22 2022] POST /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd/action => generated 38667 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:57:23.485202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:23.486423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:23.488474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0ede37f2-0d20-4d44-96c7-761840a8aa74 req-5c0e31b9-09ad-45b9-8600-f32fb25f7a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:23.500466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:23.501737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:23.502829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:23.504038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:23.505100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:23.505894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:23.512340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ede37f2-0d20-4d44-96c7-761840a8aa74 req-5c0e31b9-09ad-45b9-8600-f32fb25f7a17 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:23.512953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ede37f2-0d20-4d44-96c7-761840a8aa74 req-5c0e31b9-09ad-45b9-8600-f32fb25f7a17 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:23.514292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0ede37f2-0d20-4d44-96c7-761840a8aa74 req-5c0e31b9-09ad-45b9-8600-f32fb25f7a17 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:23.528296 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0ede37f2-0d20-4d44-96c7-761840a8aa74 req-5c0e31b9-09ad-45b9-8600-f32fb25f7a17 service nova] Creating event network-changed:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h1-862769-3 Oct 28 19:57:23.536138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0ede37f2-0d20-4d44-96c7-761840a8aa74 req-5c0e31b9-09ad-45b9-8600-f32fb25f7a17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055226 Oct 28 19:57:23.538682 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3253/6502] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:57:23.559706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:57:23.692928 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3126eca5-6f03-439c-b440-553336028659 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 204 len: 0 microversion: 2.1 time: 0.214896 Oct 28 19:57:23.693645 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3250/6503] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:57:23 2022] DELETE /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:57:23.703845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:23.704623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:23.712884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:23.713883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:23.714526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:23.715564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:23.716244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:23.716878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:23.923269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:23.939454 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ecf9cb27-1e42-4240-8be1-42a4d357dc28 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1688 microversion: 2.1 time: 0.239911 Oct 28 19:57:23.941000 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3254/6504] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:23 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:24.984953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:24.985846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:24.995122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:24.995675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:24.996225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:24.997017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:24.997647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:24.998118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:25.038867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:25.039359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:25.039807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:25.040265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lazy-loading 'fault' on Instance uuid 217e84c6-6e89-4fda-a984-eec16d8c91bd {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:57:25.097232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:25.112196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e80781ad-3de4-44bb-975e-d46c222d4fea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 200 len: 1356 microversion: 2.1 time: 0.133106 Oct 28 19:57:25.113289 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3251/6505] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:24 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 1356 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:25.552852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-da7318bc-5cf4-4997-b5d7-9d91fc5092c2 req-c7483d1f-739d-4cc3-b877-d82bda6296b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217e84c6-6e89-4fda-a984-eec16d8c91bd", "name": "network-vif-deleted", "tag": "8185ff9d-0504-4070-8f19-c92be6ba8425"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:25.565057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-da7318bc-5cf4-4997-b5d7-9d91fc5092c2 req-c7483d1f-739d-4cc3-b877-d82bda6296b5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:25.565537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-da7318bc-5cf4-4997-b5d7-9d91fc5092c2 req-c7483d1f-739d-4cc3-b877-d82bda6296b5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:25.565987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-da7318bc-5cf4-4997-b5d7-9d91fc5092c2 req-c7483d1f-739d-4cc3-b877-d82bda6296b5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:25.582400 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-da7318bc-5cf4-4997-b5d7-9d91fc5092c2 req-c7483d1f-739d-4cc3-b877-d82bda6296b5 service nova] Creating event network-vif-deleted:8185ff9d-0504-4070-8f19-c92be6ba8425 for instance 217e84c6-6e89-4fda-a984-eec16d8c91bd on n-h1-862769-3 Oct 28 19:57:25.588615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-da7318bc-5cf4-4997-b5d7-9d91fc5092c2 req-c7483d1f-739d-4cc3-b877-d82bda6296b5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 Oct 28 19:57:25.589593 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3255/6506] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:26.150370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:26.151264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 217e84c6-6e89-4fda-a984-eec16d8c91bd] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:26.159242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:26.159761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:26.160207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:26.160936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:26.161399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:26.161866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:26.178611 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] HTTP exception thrown: Instance 217e84c6-6e89-4fda-a984-eec16d8c91bd could not be found. Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Request method failure captured: Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd HTTP/1.1 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLf2SUK5pk2HYFYPh8e0kO2E1AoFfhQqkDjDHUWP_zNOiNBS3OUpg1dBeg2jIFq4ATaGoXzBw46cnqWTEaVETmyc_16D2RZzRnAZ58MBG89ru0eG0OwyYodxPYz5zfLDX7iRpxbdHlgejMR_bY_y8pfaXzKOyfSvHXVbRnsXcinIe4 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_67e38d5748ae407e80a353dc2150b848", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 06cf5d4bbcb042c4bd32f1788c6dbcd9 Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 217e84c6-6e89-4fda-a984-eec16d8c91bd could not be found. Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '217e84c6-6e89-4fda-a984-eec16d8c91bd'} Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217e84c6-6e89-4fda-a984-eec16d8c91bd could not be found. Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217e84c6-6e89-4fda-a984-eec16d8c91bd could not be found. Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:57:26.180611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217e84c6-6e89-4fda-a984-eec16d8c91bd could not be found. Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Returning 404 to user: Instance 217e84c6-6e89-4fda-a984-eec16d8c91bd could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1379ff5b-1ca5-4ab1-8735-bb7a1049e7b4 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd" status: 404 len: 111 microversion: 2.1 time: 0.035801 Oct 28 19:57:26.187230 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3252/6507] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:26 2022] GET /compute/v2.1/servers/217e84c6-6e89-4fda-a984-eec16d8c91bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:57:30.725705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b9101b37-b9f1-4d21-b742-ced09d20777b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '.version_select at 0x7f1d769cd160>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:30.771930 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b9101b37-b9f1-4d21-b742-ced09d20777b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-900606113" status: 202 len: 0 microversion: 2.1 time: 0.052613 Oct 28 19:57:30.772654 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3256/6508] 10.222.0.44 () {58 vars in 1281 bytes} [Fri Oct 28 19:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-900606113 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:57:30.811810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28c27366-e69c-45fb-b026-e3f989f0106d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: .version_select at 0x7f1d76899670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-454216992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEFplQQnz8/M0p64aaXCjbf4HDLg6+egO3UeyE0vg9aG7uTe7b7RcY1PAAb0ridYygz3zlRnEtCcZjm4hskP0DYEqhJdx6urao0gcKc8FegQw/fWpCeyZJdzw95+fn8Tw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:30.833075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-28c27366-e69c-45fb-b026-e3f989f0106d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:57:30.840967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-28c27366-e69c-45fb-b026-e3f989f0106d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:57:30.873166 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28c27366-e69c-45fb-b026-e3f989f0106d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065195 Oct 28 19:57:30.873920 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3253/6509] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 19:57:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:38.210168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2069423695", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "45a8363b-7e3b-4dbe-8791-a98869bca02c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-454216992", "security_groups": [{"name": "tempest-secgroup-smoke-913190592"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:38.228729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:38.229657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:38.374811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] validate_networks() for [('45a8363b-7e3b-4dbe-8791-a98869bca02c', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:57:38.871555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:57:38.872145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:57:38.872645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:57:38.873239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:57:38.873820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:57:38.885623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:38.886262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:38.887003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:38.888252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:38.889090 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:38.889856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:38.922291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:57:38.932767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Getting quotas for user 06cf5d4bbcb042c4bd32f1788c6dbcd9 and project 67e38d5748ae407e80a353dc2150b848. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:57:38.959720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:57:38.964878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:57:39.046453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5c3a18f3-6f90-4db0-8b8e-12d167dd9316 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.841130 Oct 28 19:57:39.047326 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3257/6510] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:57:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:57:39.076816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-96801b1f-3897-482f-b13d-c09ccc0c0d36 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:39.078868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-96801b1f-3897-482f-b13d-c09ccc0c0d36 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:39.083815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:39.085582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:39.153872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-96801b1f-3897-482f-b13d-c09ccc0c0d36 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:39.166264 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-96801b1f-3897-482f-b13d-c09ccc0c0d36 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1266 microversion: 2.1 time: 0.109647 Oct 28 19:57:39.167560 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3254/6511] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:39 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:40.192756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:40.193947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:40.202300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:40.203151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:40.206218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:40.206218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:40.206218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:40.206218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:40.283048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:40.293103 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c74f9e99-26ae-49ee-a4c3-7e1d9599328a tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1318 microversion: 2.1 time: 0.105779 Oct 28 19:57:40.293797 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3258/6512] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:40 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:41.319753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:41.320884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:41.335131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:41.336040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:41.336844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:41.338182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:41.339379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:41.340155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:41.699799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:41.712102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1eb1d59a-13f5-4ed1-80e4-b02c5c0ba6a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1391 microversion: 2.1 time: 0.398041 Oct 28 19:57:41.713332 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3255/6513] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:41 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:42.652354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-043cb9f1-d134-47e2-bebb-0efe4e11833a req-a94490c6-85de-4b89-b3d0-b3d54cc3d600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:42.669659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-043cb9f1-d134-47e2-bebb-0efe4e11833a req-a94490c6-85de-4b89-b3d0-b3d54cc3d600 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:42.670312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-043cb9f1-d134-47e2-bebb-0efe4e11833a req-a94490c6-85de-4b89-b3d0-b3d54cc3d600 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:42.670920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-043cb9f1-d134-47e2-bebb-0efe4e11833a req-a94490c6-85de-4b89-b3d0-b3d54cc3d600 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:42.689909 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-043cb9f1-d134-47e2-bebb-0efe4e11833a req-a94490c6-85de-4b89-b3d0-b3d54cc3d600 service nova] Creating event network-changed:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:57:42.699701 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-043cb9f1-d134-47e2-bebb-0efe4e11833a req-a94490c6-85de-4b89-b3d0-b3d54cc3d600 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053721 Oct 28 19:57:42.701090 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3259/6514] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:42.752878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:42.754016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:42.764206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:42.765123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:42.766193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:42.767735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:42.768653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:42.769758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:42.968458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:42.977979 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84c8ba0f-c965-4ecf-8fad-37732ba26f68 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1391 microversion: 2.1 time: 0.229411 Oct 28 19:57:42.978929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3256/6515] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:42 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:57:44.021299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:44.022478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:44.033242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:44.034123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:44.034933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:44.036227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:44.037691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:44.038448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:44.264722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:44.274305 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3fe3c37-907d-41fc-b9fb-42d96d5f7e8b tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1391 microversion: 2.1 time: 0.262659 Oct 28 19:57:44.274869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3260/6516] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:44 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:45.300208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:45.301024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:45.313132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:45.313904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:45.314655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:45.316025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:45.316827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:45.317570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:45.498390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:45.507418 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8a3652f-3f4e-430d-ba92-27bf9128df06 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1391 microversion: 2.1 time: 0.211820 Oct 28 19:57:45.508030 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3257/6517] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:45 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:46.533421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:46.534031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:46.542343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:46.542912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:46.543367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:46.544113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:46.544586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:46.545024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:46.701996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:46.710721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-66ce612e-5659-4f4b-b6fb-bee8d3b9a3a6 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1391 microversion: 2.1 time: 0.181843 Oct 28 19:57:46.711349 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3261/6518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:46 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:47.035541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-dd0f8d3b-c5ba-429f-976b-defa1304a8da req-cb0ccce4-58ca-43ab-abfd-78e4a885ffc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "name": "network-vif-plugged", "status": "completed", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:47.055428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dd0f8d3b-c5ba-429f-976b-defa1304a8da req-cb0ccce4-58ca-43ab-abfd-78e4a885ffc0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:47.056162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dd0f8d3b-c5ba-429f-976b-defa1304a8da req-cb0ccce4-58ca-43ab-abfd-78e4a885ffc0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:47.056927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dd0f8d3b-c5ba-429f-976b-defa1304a8da req-cb0ccce4-58ca-43ab-abfd-78e4a885ffc0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:47.079239 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-dd0f8d3b-c5ba-429f-976b-defa1304a8da req-cb0ccce4-58ca-43ab-abfd-78e4a885ffc0 service nova] Creating event network-vif-plugged:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:57:47.088046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-dd0f8d3b-c5ba-429f-976b-defa1304a8da req-cb0ccce4-58ca-43ab-abfd-78e4a885ffc0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060129 Oct 28 19:57:47.088913 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3258/6519] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:47.735696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:47.736305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:47.744311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:47.744819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:47.745263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:47.746132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:47.746603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:47.747107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:47.908096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:47.917629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99a0a2f4-1667-4f20-9abe-a1be66dee971 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1391 microversion: 2.1 time: 0.186688 Oct 28 19:57:47.918310 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3262/6520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:47 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:48.944199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:48.944917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:48.952533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:48.953028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:48.953458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:48.954202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:48.954657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:48.955106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:49.115892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:49.124768 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1df6cbb8-b919-4191-96bd-2c1b73f17244 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1564 microversion: 2.1 time: 0.186105 Oct 28 19:57:49.125472 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3259/6521] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:48 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:49.150199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:49.150978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:49.154463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:49.155506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:49.163532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:49.164083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:49.164528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:49.165475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:49.165998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:49.166440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:49.384836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:49.394298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-20aca39f-f10f-4fb0-9bde-69e0a3740f54 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1564 microversion: 2.1 time: 0.248751 Oct 28 19:57:49.395038 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3263/6522] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:49 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:57:51.987232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:57:51.996106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-cc6e322d-72d4-4f09-a4e2-2f9b0ac42c2a req-93976ff1-437b-4d04-aa1e-7093ef90411c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:57:52.003584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:57:52.006960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:52.019071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:52.019721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:52.020358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:52.021275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:52.021942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:52.022510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:52.028012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cc6e322d-72d4-4f09-a4e2-2f9b0ac42c2a req-93976ff1-437b-4d04-aa1e-7093ef90411c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:57:52.028732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cc6e322d-72d4-4f09-a4e2-2f9b0ac42c2a req-93976ff1-437b-4d04-aa1e-7093ef90411c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:57:52.029518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cc6e322d-72d4-4f09-a4e2-2f9b0ac42c2a req-93976ff1-437b-4d04-aa1e-7093ef90411c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:57:52.057837 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-cc6e322d-72d4-4f09-a4e2-2f9b0ac42c2a req-93976ff1-437b-4d04-aa1e-7093ef90411c service nova] Creating event network-changed:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:57:52.065788 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-cc6e322d-72d4-4f09-a4e2-2f9b0ac42c2a req-93976ff1-437b-4d04-aa1e-7093ef90411c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075122 Oct 28 19:57:52.067230 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3264/6523] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:57:52.268693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:57:52.285112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-03999199-1fe7-4257-be7a-653241de1e89 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1564 microversion: 2.1 time: 0.304210 Oct 28 19:57:52.286240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3260/6524] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:57:51 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1564 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:13.684764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:13.685688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:13.691020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:13.693868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:13.703224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:13.703739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:13.704338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:13.705071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:13.705555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:13.705995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:13.760117 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aba7c120-6e83-49ca-bd28-9d932d241962 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8/action" status: 200 len: 24571 microversion: 2.1 time: 0.077519 Oct 28 19:58:13.761101 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3265/6525] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:58:13 2022] POST /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:58:20.173223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:20.176202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:20.178659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=15 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:20.179478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=32 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:20.186170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:20.186652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:20.187123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:20.187835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:20.188294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:20.188723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:20.577972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:58:20.578737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:58:20.579578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:58:20.580277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:58:20.580949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:58:20.689885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:20.699253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:20.700024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:20.700689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:20.701623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:20.702242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:20.703473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:20.752737 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5865bbad-41cc-47ed-8318-c85e5d3233b7 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8/action" status: 202 len: 1139 microversion: 2.1 time: 0.583153 Oct 28 19:58:20.753892 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3261/6526] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:58:20 2022] POST /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8/action => generated 1139 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 19:58:20.787653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:20.788407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:20.797422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:20.798039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:20.798499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:20.799353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:20.799878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:20.800404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:21.062811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:21.078844 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cda63782-1c84-4ca9-bc8d-733e4bf631a1 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.296293 Oct 28 19:58:21.080268 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3266/6527] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:20 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:22.104851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:22.105596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:22.113198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:22.113786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:22.114223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:22.114976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:22.115436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:22.115858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:22.281436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:22.291825 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5fc94d91-0492-40db-a783-c4bc0edbdaea tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.191051 Oct 28 19:58:22.292450 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3262/6528] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:22 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:58:23.330410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:23.331152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:23.339966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:23.340481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:23.340932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:23.341660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:23.342141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:23.342574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:23.514900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:23.524539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e21c5bc-d6b2-4244-9b68-863476bcd700 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.198078 Oct 28 19:58:23.525258 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3267/6529] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:23 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:24.549751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:24.550345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:24.557907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:24.558398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:24.558874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:24.559590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:24.560047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:24.560462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:24.714739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:24.729514 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-45950f64-4316-43e0-8e3e-1e87bb39f966 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.183586 Oct 28 19:58:24.730580 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3263/6530] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:24 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:25.766750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:25.767397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:25.775419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:25.776060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:25.776606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:25.777422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:25.777978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:25.778496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:25.939436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:25.954671 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-baed8061-bb02-447d-b908-00aea179ee01 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.191271 Oct 28 19:58:25.955814 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3268/6531] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:25 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:58:26.979758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:26.980391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:26.987505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:26.987992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:26.988433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:26.989133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:26.989653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:26.990131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:27.148233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:27.156845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-360479de-35e7-4142-8301-2273385994b5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.180994 Oct 28 19:58:27.157462 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3264/6532] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:26 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:28.181694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:28.182335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:28.190729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:28.191235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:28.191847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:28.192637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:28.193107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:28.193540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:28.350087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:28.360454 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c40c9af-396f-4935-a720-5148154783dd tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.182893 Oct 28 19:58:28.361470 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3269/6533] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:28 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:29.389255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:29.390503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:29.409481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:29.409986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:29.410648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:29.411231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:29.411695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:29.412487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:29.602472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:29.617456 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12b04766-c7c3-4153-897d-6d4bfe73d1e2 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.236638 Oct 28 19:58:29.618100 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3265/6534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:29 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:30.642519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:30.643640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:30.651953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:30.652488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:30.652903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:30.654015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:30.654501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:30.654999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:30.842760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:30.852249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83f52545-dc07-470e-a76d-7700a3602e2d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.214473 Oct 28 19:58:30.852919 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3270/6535] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:30 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:31.876743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:31.877632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:31.885207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:31.885704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:31.886140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:31.886977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:31.887438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:31.887862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:32.084470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:32.093086 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0e920271-5035-47c7-bc68-ad7040e35a14 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1692 microversion: 2.1 time: 0.220331 Oct 28 19:58:32.093696 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3266/6536] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:31 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:33.118562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:33.119234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:33.127050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:33.127596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:33.128046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:33.128772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:33.129260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:33.129689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:33.300307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:33.315418 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6dc66847-e867-4609-8b53-08cded0dbcc3 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1698 microversion: 2.1 time: 0.200372 Oct 28 19:58:33.316869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3271/6537] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:33 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:34.343549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:34.344699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:34.357922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:34.359295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:34.359676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:34.360983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:34.361860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:34.362660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:34.586938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:34.595985 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-889998b4-9ed8-4c0b-9759-d78a4976a0e5 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1698 microversion: 2.1 time: 0.258385 Oct 28 19:58:34.596834 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3267/6538] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:34 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1698 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:35.295837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4471544e-8979-4687-8b1e-0215b41f2e9b req-29b60598-2ecf-4112-b172-0121d7778ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:35.311835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4471544e-8979-4687-8b1e-0215b41f2e9b req-29b60598-2ecf-4112-b172-0121d7778ab7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:35.312428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4471544e-8979-4687-8b1e-0215b41f2e9b req-29b60598-2ecf-4112-b172-0121d7778ab7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:35.313011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4471544e-8979-4687-8b1e-0215b41f2e9b req-29b60598-2ecf-4112-b172-0121d7778ab7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:35.326751 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4471544e-8979-4687-8b1e-0215b41f2e9b req-29b60598-2ecf-4112-b172-0121d7778ab7 service nova] Creating event network-vif-unplugged:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:58:35.332270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4471544e-8979-4687-8b1e-0215b41f2e9b req-29b60598-2ecf-4112-b172-0121d7778ab7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041574 Oct 28 19:58:35.332902 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3272/6539] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:35.621890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:35.622493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:35.631303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:35.631803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:35.632237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:35.632956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:35.633414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:35.633839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:35.797507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:35.806866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b0e7ce44-d432-47b9-b891-131758792265 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1683 microversion: 2.1 time: 0.189581 Oct 28 19:58:35.807480 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3268/6540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:35 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:36.650071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:36.650680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:36.657591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:36.658091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:36.658531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:36.659275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:36.659743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:36.660175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:36.688452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:58:36.778981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e684baf-e1d2-41a4-8b76-6ba42fd3e7a1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 204 len: 0 microversion: 2.1 time: 0.205162 Oct 28 19:58:36.779643 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3273/6541] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:58:36 2022] DELETE /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:58:36.789908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:36.790524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:36.799196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:36.799800 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:36.800301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:36.801113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:36.802194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:36.802314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:36.959593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:36.969361 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-83ea2f9a-18d5-4378-ba02-1c813e15fc22 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1577 microversion: 2.1 time: 0.183847 Oct 28 19:58:36.970512 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3269/6542] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:36 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:37.368373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-878e45f0-91ae-4b10-9629-8fc254a93354 req-59e4ea55-987c-41d7-ac06-3292281b5c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "name": "network-vif-plugged", "status": "completed", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:37.378485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-878e45f0-91ae-4b10-9629-8fc254a93354 req-59e4ea55-987c-41d7-ac06-3292281b5c2f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:37.379008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-878e45f0-91ae-4b10-9629-8fc254a93354 req-59e4ea55-987c-41d7-ac06-3292281b5c2f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:37.379463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-878e45f0-91ae-4b10-9629-8fc254a93354 req-59e4ea55-987c-41d7-ac06-3292281b5c2f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:37.391364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-878e45f0-91ae-4b10-9629-8fc254a93354 req-59e4ea55-987c-41d7-ac06-3292281b5c2f service nova] Creating event network-vif-plugged:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:58:37.396701 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-878e45f0-91ae-4b10-9629-8fc254a93354 req-59e4ea55-987c-41d7-ac06-3292281b5c2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032664 Oct 28 19:58:37.397361 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3274/6543] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:38.002069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:38.002656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:38.011624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:38.012167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:38.012661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:38.013425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:38.013985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:38.014413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:38.164059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:38.172106 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a965ddb3-4221-478d-88cb-7a64b9eb12c9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1577 microversion: 2.1 time: 0.174201 Oct 28 19:58:38.172706 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3270/6544] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:37 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:39.197476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:39.198318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:39.206322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:39.206984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:39.207501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:39.208232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:39.208713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:39.209144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:39.289476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:39.297683 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9773b2a2-b79e-4e5c-83f7-d6b863750e39 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1510 microversion: 2.1 time: 0.105747 Oct 28 19:58:39.298245 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3275/6545] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:39 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1510 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:58:39.617762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d4293200-444b-49b1-af15-28a08f1d0f96 req-0e5cf1e6-49f6-432a-a310-de5c0e8904b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d69b96-065c-4f6c-aab1-af3617d76968", "name": "network-vif-deleted", "tag": "ec0398ec-032c-4e32-ac6c-99e92c355221"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:39.631018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d4293200-444b-49b1-af15-28a08f1d0f96 req-0e5cf1e6-49f6-432a-a310-de5c0e8904b8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:39.631666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d4293200-444b-49b1-af15-28a08f1d0f96 req-0e5cf1e6-49f6-432a-a310-de5c0e8904b8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:39.633642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d4293200-444b-49b1-af15-28a08f1d0f96 req-0e5cf1e6-49f6-432a-a310-de5c0e8904b8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:39.647977 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d4293200-444b-49b1-af15-28a08f1d0f96 req-0e5cf1e6-49f6-432a-a310-de5c0e8904b8 service nova] Creating event network-vif-deleted:ec0398ec-032c-4e32-ac6c-99e92c355221 for instance e5d69b96-065c-4f6c-aab1-af3617d76968 on n-h1-862769-3 Oct 28 19:58:39.654334 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d4293200-444b-49b1-af15-28a08f1d0f96 req-0e5cf1e6-49f6-432a-a310-de5c0e8904b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040174 Oct 28 19:58:39.655758 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3271/6546] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:40.322453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:40.323841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:40.332636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:40.333631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:40.334345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:40.335587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:40.336174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:40.336879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:40.459127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:40.474418 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-215d8ee4-6795-4ec3-841a-c98300f8b07d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1226 microversion: 2.1 time: 0.156315 Oct 28 19:58:40.475747 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3276/6547] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:40 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:41.510284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:41.511203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:41.519134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:41.519645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:41.520084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:41.520802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:41.521261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:41.521769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:41.595184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:41.605629 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-33759e23-d142-487a-a6f5-bc90a97d0763 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1226 microversion: 2.1 time: 0.099654 Oct 28 19:58:41.606391 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3272/6548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:41 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:42.631158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:42.631814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:42.639467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:42.639968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:42.640408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:42.641277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:42.641743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:42.642269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:42.709844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:42.719926 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-21657419-ed8d-48a2-bf75-025c0841acff tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1226 microversion: 2.1 time: 0.092970 Oct 28 19:58:42.720531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3277/6549] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:42 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:43.747591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:43.748487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:43.759293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:43.760086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:43.760843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:43.762086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:43.762939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:43.763913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:43.839047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:43.848845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6112dd6-c1cb-4f60-bdeb-845e0ff43e82 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 200 len: 1226 microversion: 2.1 time: 0.107078 Oct 28 19:58:43.849451 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3273/6550] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:43 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:44.880572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:44.881305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:44.884385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:44.891546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:44.892062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:44.892508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:44.893232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:44.893700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:44.894131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:44.898134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:44.912385 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 HTTP/1.1 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e5d69b96-065c-4f6c-aab1-af3617d76968'} Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:58:44.914274 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88995dd3-8a80-4b89-b6e7-0d7bea2b0ef1 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 404 len: 111 microversion: 2.1 time: 0.039324 Oct 28 19:58:44.918720 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3278/6551] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:44 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:58:44.975303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1195359429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1427589248", "security_groups": [{"name": "tempest-secgroup-smoke-615129487"}], "block_device_mapping_v2": [{"uuid": "c050e2e8-7c59-441f-bfdb-af65cd721b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:45.123644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:58:45.605309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:58:45.605847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:58:45.606350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:58:45.606786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:58:45.607201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:58:45.616790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:45.617277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:45.617716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:45.618451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:45.618941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:45.619365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:45.638049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:58:45.643705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:58:45.707062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:58:45.709274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c050e2e8-7c59-441f-bfdb-af65cd721b5d',volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:58:45.861713 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd88d429-0424-44cc-9a7c-dd9a2ec10208 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.890664 Oct 28 19:58:45.862357 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3274/6552] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 19:58:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:58:45.875681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c1e001ad-a931-4842-8210-306476267778 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:45.876333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c1e001ad-a931-4842-8210-306476267778 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:45.948041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c1e001ad-a931-4842-8210-306476267778 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:45.960194 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c1e001ad-a931-4842-8210-306476267778 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1095 microversion: 2.1 time: 0.088419 Oct 28 19:58:45.961064 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3279/6553] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:45 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:58:46.985655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:46.986207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:46.992834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:46.993329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:46.993760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:46.994469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:46.994944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:46.995368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:47.077874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:47.087175 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2164f065-3122-4fa1-8130-9d2b3c256e2a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1193 microversion: 2.1 time: 0.106320 Oct 28 19:58:47.088069 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3275/6554] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:46 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:48.113536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:48.114600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:48.124030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:48.124874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:48.125771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:48.126637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:48.127253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:48.128170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:48.389246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:48.402803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b26dc6bc-16e6-4b84-813b-8beeb729ea2d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1278 microversion: 2.1 time: 0.295353 Oct 28 19:58:48.403745 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3280/6555] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:48 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:48.737767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-61504cf0-48d2-449c-be2f-255397d3d5ba req-eef4168d-3e94-4137-899d-91d99f6cd732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81059d0-acd5-414c-96e2-d242f8443f85", "tag": "1d348ae5-7af7-46da-9e76-7e1e0e23eb92"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:58:48.762330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61504cf0-48d2-449c-be2f-255397d3d5ba req-eef4168d-3e94-4137-899d-91d99f6cd732 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:48.762888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61504cf0-48d2-449c-be2f-255397d3d5ba req-eef4168d-3e94-4137-899d-91d99f6cd732 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:48.763434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-61504cf0-48d2-449c-be2f-255397d3d5ba req-eef4168d-3e94-4137-899d-91d99f6cd732 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:48.783822 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-61504cf0-48d2-449c-be2f-255397d3d5ba req-eef4168d-3e94-4137-899d-91d99f6cd732 service nova] Creating event network-changed:1d348ae5-7af7-46da-9e76-7e1e0e23eb92 for instance a81059d0-acd5-414c-96e2-d242f8443f85 on n-h1-862769-3 Oct 28 19:58:48.796079 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-61504cf0-48d2-449c-be2f-255397d3d5ba req-eef4168d-3e94-4137-899d-91d99f6cd732 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061953 Oct 28 19:58:48.796966 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3276/6556] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:58:49.434486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:49.435835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:49.451406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:49.452346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:49.453237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:49.454800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:49.455790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:49.456673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:50.058653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:50.067138 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c2bb66c-8036-42c5-81cd-1669eefc3b93 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1278 microversion: 2.1 time: 0.640134 Oct 28 19:58:50.068500 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3281/6557] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:49 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1278 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:51.092364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:51.093345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:51.096370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:51.104325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:51.104940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:51.105426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:51.106207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:51.106730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:51.107325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:51.112098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:51.276679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:51.285416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15f1269a-ab47-4d0d-844f-21382298657f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1278 microversion: 2.1 time: 0.198821 Oct 28 19:58:51.286088 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3277/6558] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:51 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:52.310158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:52.310828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:52.319251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:52.319750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:52.320353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:52.321150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:52.321817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:52.322399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:52.479530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:52.491539 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-58e00c7f-3613-48e9-b2ca-b3d022591743 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1278 microversion: 2.1 time: 0.186116 Oct 28 19:58:52.492151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3282/6559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:52 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:53.521229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:53.521913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:53.529620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:53.530110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:53.530552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:53.531284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:53.531741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:53.532162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:53.680406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:53.689547 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b9ee60b5-5ed1-4625-9e04-7220802a1c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.174234 Oct 28 19:58:53.690138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3278/6560] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:53 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:54.713839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:54.714469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:54.723919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:54.724906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:54.725798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:54.727083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:54.727889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:54.728718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:54.896927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:54.908356 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-68605f31-96bc-4cdd-b684-963573775717 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.198172 Oct 28 19:58:54.908976 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3283/6561] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:54 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:55.937779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:55.938417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:55.941522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:55.942758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:55.949073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:55.949583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:55.950023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:55.950769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:55.951231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:55.951656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:56.120900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:56.130567 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd40233a-9995-4cd6-b0c7-b35ec93e0580 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.196700 Oct 28 19:58:56.135519 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3279/6562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:55 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:57.154154 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:57.154803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:57.157656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:57.163877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:57.164378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:57.164817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:57.165529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:57.165991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:57.166417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:57.320717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:57.329657 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-350efa6a-9da9-422b-9f55-93942280b0c8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.179441 Oct 28 19:58:57.330287 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3284/6563] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:57 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:58.352969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:58.353581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:58.361663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:58.362165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:58.362613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:58.363400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:58.363870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:58.364289 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:58.511182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:58.519845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5e2386b-6101-4ddf-a0c7-9859f0252a72 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.171080 Oct 28 19:58:58.520478 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3280/6564] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:58 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:58:59.543927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:58:59.544609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:58:59.555084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:59.556034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:59.557111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:59.558258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:58:59.559134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:58:59.559937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:58:59.740854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:58:59.746807 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88b527ba-32f6-4819-bb11-1253fda46622 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.206708 Oct 28 19:58:59.754815 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3285/6565] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:58:59 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:00.044252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:00.047036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:00.054387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:00.055063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:00.055640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:00.056359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:00.056815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:00.057231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:00.115010 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eafd7ab0-8627-43ae-8553-47a23c12d9df tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "POST /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8/action" status: 200 len: 24560 microversion: 2.1 time: 0.074428 Oct 28 19:59:00.115692 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3281/6566] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 19:59:00 2022] POST /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8/action => generated 24560 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:59:00.778010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:00.778672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:00.786173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:00.786675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:00.787510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:00.788246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:00.788712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:00.789138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:00.943498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:59:00.954556 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e353de3-d7a0-4633-b126-9a9232851397 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.180869 Oct 28 19:59:00.955189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3286/6567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:00 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:01.198276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-da5ec8df-bedd-486f-b915-68b7659a3abd req-0e5df0da-28c0-42c4-8e7a-5184e975ff5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81059d0-acd5-414c-96e2-d242f8443f85", "name": "network-vif-plugged", "status": "completed", "tag": "1d348ae5-7af7-46da-9e76-7e1e0e23eb92"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:01.210109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-da5ec8df-bedd-486f-b915-68b7659a3abd req-0e5df0da-28c0-42c4-8e7a-5184e975ff5d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:01.210669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-da5ec8df-bedd-486f-b915-68b7659a3abd req-0e5df0da-28c0-42c4-8e7a-5184e975ff5d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:01.211140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-da5ec8df-bedd-486f-b915-68b7659a3abd req-0e5df0da-28c0-42c4-8e7a-5184e975ff5d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:01.234291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-da5ec8df-bedd-486f-b915-68b7659a3abd req-0e5df0da-28c0-42c4-8e7a-5184e975ff5d service nova] Creating event network-vif-plugged:1d348ae5-7af7-46da-9e76-7e1e0e23eb92 for instance a81059d0-acd5-414c-96e2-d242f8443f85 on n-h1-862769-3 Oct 28 19:59:01.241762 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-da5ec8df-bedd-486f-b915-68b7659a3abd req-0e5df0da-28c0-42c4-8e7a-5184e975ff5d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047848 Oct 28 19:59:01.242482 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3282/6568] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:01.978244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:01.979056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:01.986981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:01.987563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:01.988031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:01.988767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:01.989305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:01.989798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:02.154319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:59:02.163560 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17f9e2f5-ea8a-4d30-bce5-7dd53191f1a8 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1266 microversion: 2.1 time: 0.189353 Oct 28 19:59:02.164383 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3287/6569] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:01 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:03.189487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:03.190320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:03.196911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:03.197400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:03.197829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:03.198528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:03.199332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:03.199456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:03.335779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:59:03.346475 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e9faf855-ffa7-4e10-9d80-bad5e5950631 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1453 microversion: 2.1 time: 0.161934 Oct 28 19:59:03.347134 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3283/6570] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:03 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:03.370759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:03.371391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:03.378781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:03.379287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:03.379739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:03.380453 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:03.380907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:03.381349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:03.535011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:59:03.545608 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67add95d-3f20-4ae9-a4c7-d6dc8000cbeb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1453 microversion: 2.1 time: 0.178782 Oct 28 19:59:03.546184 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3288/6571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:03 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:05.424087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-23c4a1e6-3a67-400d-8f29-53a600fb3934 req-97e339a7-66bb-4d04-8b8a-02704159381c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81059d0-acd5-414c-96e2-d242f8443f85", "tag": "1d348ae5-7af7-46da-9e76-7e1e0e23eb92"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:05.436033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-23c4a1e6-3a67-400d-8f29-53a600fb3934 req-97e339a7-66bb-4d04-8b8a-02704159381c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:05.436827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-23c4a1e6-3a67-400d-8f29-53a600fb3934 req-97e339a7-66bb-4d04-8b8a-02704159381c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:05.437185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-23c4a1e6-3a67-400d-8f29-53a600fb3934 req-97e339a7-66bb-4d04-8b8a-02704159381c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:05.457068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-23c4a1e6-3a67-400d-8f29-53a600fb3934 req-97e339a7-66bb-4d04-8b8a-02704159381c service nova] Creating event network-changed:1d348ae5-7af7-46da-9e76-7e1e0e23eb92 for instance a81059d0-acd5-414c-96e2-d242f8443f85 on n-h1-862769-3 Oct 28 19:59:05.463048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-23c4a1e6-3a67-400d-8f29-53a600fb3934 req-97e339a7-66bb-4d04-8b8a-02704159381c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042937 Oct 28 19:59:05.464318 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3284/6572] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:12.480259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:12.480870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:12.482885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-91ed7cd0-0f16-4d01-9743-893068260f08 req-7e42ce43-246f-444a-864f-223a2c0ac469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:12.489373 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:12.489892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:12.490351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:12.491183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:12.492019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:12.492662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:12.496660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-91ed7cd0-0f16-4d01-9743-893068260f08 req-7e42ce43-246f-444a-864f-223a2c0ac469 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:12.497277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-91ed7cd0-0f16-4d01-9743-893068260f08 req-7e42ce43-246f-444a-864f-223a2c0ac469 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:12.497825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-91ed7cd0-0f16-4d01-9743-893068260f08 req-7e42ce43-246f-444a-864f-223a2c0ac469 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:12.510213 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-91ed7cd0-0f16-4d01-9743-893068260f08 req-7e42ce43-246f-444a-864f-223a2c0ac469 service nova] Creating event network-changed:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:59:12.516416 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-91ed7cd0-0f16-4d01-9743-893068260f08 req-7e42ce43-246f-444a-864f-223a2c0ac469 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038273 Oct 28 19:59:12.517366 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3285/6573] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:12.522575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:59:12.623547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e54583f9-54bd-4f09-86e5-d649a5726f58 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 204 len: 0 microversion: 2.1 time: 0.147842 Oct 28 19:59:12.624217 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3289/6574] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 19:59:12 2022] DELETE /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:59:12.633894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:12.634767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:12.642649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:12.643207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:12.644309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:12.645107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:12.645571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:12.646002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:12.811095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:59:12.820469 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-977db0fb-eaab-4291-8334-d4a4864355b0 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1689 microversion: 2.1 time: 0.191148 Oct 28 19:59:12.821002 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3286/6575] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:12 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:13.850024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:13.851464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:13.864159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:13.865114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:13.865925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:13.867324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:13.868204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:13.868943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:14.068559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cf5d4bbcb042c4bd32f1788c6dbcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e38d5748ae407e80a353dc2150b848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:59:14.080908 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5a021e64-402b-48b9-a1b0-bc88de6e316d tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 200 len: 1689 microversion: 2.1 time: 0.238547 Oct 28 19:59:14.083151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3290/6576] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:13 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:59:14.575434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b9d49bc8-738f-4155-b703-f6207e2241b1 req-91c768d3-9170-4213-bb61-8560f02728f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308cd112-ceff-4d10-bc04-bbc9aa5f5ed8", "name": "network-vif-deleted", "tag": "01a86369-41f3-4db6-9f81-6e0e663b6b95"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:59:14.588654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b9d49bc8-738f-4155-b703-f6207e2241b1 req-91c768d3-9170-4213-bb61-8560f02728f4 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:14.589126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b9d49bc8-738f-4155-b703-f6207e2241b1 req-91c768d3-9170-4213-bb61-8560f02728f4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:14.589592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b9d49bc8-738f-4155-b703-f6207e2241b1 req-91c768d3-9170-4213-bb61-8560f02728f4 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:14.604383 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b9d49bc8-738f-4155-b703-f6207e2241b1 req-91c768d3-9170-4213-bb61-8560f02728f4 service nova] Creating event network-vif-deleted:01a86369-41f3-4db6-9f81-6e0e663b6b95 for instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 on n-h2-862769-3 Oct 28 19:59:14.611944 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b9d49bc8-738f-4155-b703-f6207e2241b1 req-91c768d3-9170-4213-bb61-8560f02728f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043478 Oct 28 19:59:14.612585 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3287/6577] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 19:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:59:15.105969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:15.106509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] [instance: 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:59:15.109470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:15.116058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:15.116575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:15.117029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:15.118034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:59:15.118643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:59:15.119126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:59:15.135448 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] HTTP exception thrown: Instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 could not be found. Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Request method failure captured: Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 HTTP/1.1 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLf2SUK5pk2HYFYPh8e0kO2E1AoFfhQqkDjDHUWP_zNOiNBS3OUpg1dBeg2jIFq4ATaGoXzBw46cnqWTEaVETmyc_16D2RZzRnAZ58MBG89ru0eG0OwyYodxPYz5zfLDX7iRpxbdHlgejMR_bY_y8pfaXzKOyfSvHXVbRnsXcinIe4 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_67e38d5748ae407e80a353dc2150b848", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67e38d5748ae407e80a353dc2150b848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 67e38d5748ae407e80a353dc2150b848 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-974314904 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 06cf5d4bbcb042c4bd32f1788c6dbcd9 Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestNetworkAdvancedServerOps-974314904-project Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 could not be found. Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '308cd112-ceff-4d10-bc04-bbc9aa5f5ed8'} Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 could not be found. Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 could not be found. Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:59:15.137120 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 could not be found. Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Returning 404 to user: Instance 308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-76e16fb6-b3b8-4ee0-9a4d-a3ffc96ce16f tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8" status: 404 len: 111 microversion: 2.1 time: 0.037051 Oct 28 19:59:15.142964 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3291/6578] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 19:59:15 2022] GET /compute/v2.1/servers/308cd112-ceff-4d10-bc04-bbc9aa5f5ed8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:59:18.611587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad2a83ec-51ad-4144-be1d-a3718beffa24 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] Calling method '.version_select at 0x7f1d76908940>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:59:18.640232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad2a83ec-51ad-4144-be1d-a3718beffa24 tempest-TestNetworkAdvancedServerOps-974314904 tempest-TestNetworkAdvancedServerOps-974314904-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-454216992" status: 202 len: 0 microversion: 2.1 time: 0.033209 Oct 28 19:59:18.644931 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3288/6579] 10.222.0.44 () {58 vars in 1281 bytes} [Fri Oct 28 19:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-454216992 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:00:49.712376 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:00:49.712916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:49.713705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:49.714498 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:00:49.714719 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Oct 28 20:00:49.715585 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:00:49.715879 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Oct 28 20:00:49.721433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1142444987", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1427589248", "security_groups": [{"name": "tempest-secgroup-smoke-615129487"}], "block_device_mapping_v2": [{"uuid": "86a99e29-6aa6-4cce-9579-6f0eda2642c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79895686-fe2e-4a10-bc6d-94f58ebaa7b4"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:00:49.872444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] validate_networks() for [('79895686-fe2e-4a10-bc6d-94f58ebaa7b4', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:00:50.278566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:00:50.279107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:00:50.279700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:00:50.280121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:00:50.280556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:00:50.290295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:50.290824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:50.291274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:50.292012 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:50.292478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:50.292911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:50.309997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:00:50.315550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Getting quotas for user 815471a57e6c4bffbc49a8d65806ec8e and project e4485aaa95b34f02aa6a4f38ae3fa2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:00:50.376617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:00:50.378848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86a99e29-6aa6-4cce-9579-6f0eda2642c4',volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:00:50.521681 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5071f283-5981-4115-ae37-233fec3b95df tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811477 Oct 28 20:00:50.522607 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3292/6580] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:00:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:00:50.532811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=47 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:50.533684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:50.535809 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 20:00:50.540450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca710b90-9f8c-4a1c-a22b-c5c11e981e8a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:50.541858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca710b90-9f8c-4a1c-a22b-c5c11e981e8a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:50.607794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca710b90-9f8c-4a1c-a22b-c5c11e981e8a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:50.616429 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca710b90-9f8c-4a1c-a22b-c5c11e981e8a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1095 microversion: 2.1 time: 0.085804 Oct 28 20:00:50.617040 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3289/6581] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:50 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:51.641977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-94b352e3-01b7-4d90-a892-e42a48b27f58 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:51.642644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-94b352e3-01b7-4d90-a892-e42a48b27f58 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:51.653727 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 37110. Oct 28 20:00:51.706092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-94b352e3-01b7-4d90-a892-e42a48b27f58 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:51.715487 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-94b352e3-01b7-4d90-a892-e42a48b27f58 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1095 microversion: 2.1 time: 0.078321 Oct 28 20:00:51.716562 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3293/6582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:51 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:52.740332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0b85fc95-d069-4971-bffd-bb77803561db tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:52.740942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0b85fc95-d069-4971-bffd-bb77803561db tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:52.803078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0b85fc95-d069-4971-bffd-bb77803561db tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:52.810668 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0b85fc95-d069-4971-bffd-bb77803561db tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1095 microversion: 2.1 time: 0.074692 Oct 28 20:00:52.811262 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3290/6583] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:52 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:53.835214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:53.835913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:53.844937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:53.845437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:53.845884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:53.846606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:53.847127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:53.847555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:53.916787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:53.924941 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c7cd9623-9f46-4e53-bdae-7450eb9d8b70 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1145 microversion: 2.1 time: 0.094584 Oct 28 20:00:53.925526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3294/6584] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:53 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:54.948780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:54.949465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:54.957879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:54.958361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:54.958850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:54.959586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:54.960064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:54.960491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:55.027084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:55.035586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-92620907-ec81-45b9-ad23-4579179e25ed tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1193 microversion: 2.1 time: 0.090827 Oct 28 20:00:55.036208 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3291/6585] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:54 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:56.060702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:56.061363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:56.069435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:56.069943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:56.070388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:56.071217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:56.071618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:56.072059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:56.335970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:56.350623 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-70406899-feed-4329-abf4-2c45245ac237 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1278 microversion: 2.1 time: 0.292706 Oct 28 20:00:56.354777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3295/6586] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:56 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:57.385575 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:57.387164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:57.395415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:57.396303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:57.396985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:57.397969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:57.398663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:57.399333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:57.413978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-04480bda-63fe-44d7-b7ab-25297d819493 req-3b07bcda-8b05-4dac-8ffd-dce15fc01ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9c820f-e8ef-44a4-9692-fe31dd303937", "tag": "299a9ca6-7c59-453a-b163-35af78393497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:00:57.428677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04480bda-63fe-44d7-b7ab-25297d819493 req-3b07bcda-8b05-4dac-8ffd-dce15fc01ee3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:57.428677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04480bda-63fe-44d7-b7ab-25297d819493 req-3b07bcda-8b05-4dac-8ffd-dce15fc01ee3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:57.429149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-04480bda-63fe-44d7-b7ab-25297d819493 req-3b07bcda-8b05-4dac-8ffd-dce15fc01ee3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:57.442338 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-04480bda-63fe-44d7-b7ab-25297d819493 req-3b07bcda-8b05-4dac-8ffd-dce15fc01ee3 service nova] Creating event network-changed:299a9ca6-7c59-453a-b163-35af78393497 for instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 on n-h2-862769-3 Oct 28 20:00:57.449762 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-04480bda-63fe-44d7-b7ab-25297d819493 req-3b07bcda-8b05-4dac-8ffd-dce15fc01ee3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196439 Oct 28 20:00:57.451086 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3292/6587] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:00:57.593594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:57.603329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb63aa2e-e5f3-41a0-a2b0-9a8e5a4cc0d6 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1278 microversion: 2.1 time: 0.221686 Oct 28 20:00:57.604012 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3296/6588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:57 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:58.647946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:58.648867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:58.657208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:58.657794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:58.658316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:58.659126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:58.659669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:58.660331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:58.820819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:00:58.828057 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efb8a4d5-d6cf-4ad8-9f40-0993e9050faf tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1278 microversion: 2.1 time: 0.192663 Oct 28 20:00:58.828781 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3293/6589] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:58 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:00:59.852124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:00:59.852853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:00:59.862170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:59.862880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:59.863651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:00:59.864744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:00:59.865216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:00:59.865651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:00.078986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:00.087464 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-79eefaae-546e-43eb-9e2b-39bfbf5235f4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1278 microversion: 2.1 time: 0.239436 Oct 28 20:01:00.088150 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3297/6590] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:00:59 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:01.112397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:01.113057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:01.120103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:01.120580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:01.121017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:01.121697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:01.122138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:01.122551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:01.276639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:01.286058 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-55120f7e-be0e-4f67-84bd-48bc89971c6b tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.177554 Oct 28 20:01:01.287254 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3294/6591] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:01 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:02.311765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:02.312456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:02.314815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:02.316607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:02.323172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:02.323693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:02.324198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:02.324885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:02.325359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:02.325800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:02.501145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:02.514039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e93b3d29-86f7-4595-affe-ac948eb8b00f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.206574 Oct 28 20:01:02.514631 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3298/6592] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:02 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:03.538197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:03.538752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:03.550148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:03.556824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:03.557314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:03.557771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:03.558473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:03.559104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:03.559516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:03.735196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:03.746244 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd5ece07-0a75-41d4-bc45-42afe1d93b3e tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.212272 Oct 28 20:01:03.747135 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3295/6593] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:03 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:04.775637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:04.776254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:04.785714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:04.786209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:04.787056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:04.787794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:04.788255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:04.788710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:04.943952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:04.952564 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aaab14f5-671b-4e2b-80fd-f78fc999f361 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.182627 Oct 28 20:01:04.953155 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3299/6594] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:04 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:05.977015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:05.977624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:05.984874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:05.985363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:05.985801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:05.986533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:05.987034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:05.987454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:06.129541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:06.138049 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21a0509e-3a17-4e26-9a24-a44f7f7c39a3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.164914 Oct 28 20:01:06.138617 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3296/6595] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:05 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:07.162590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:07.163283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:07.171314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:07.171822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:07.172433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:07.173138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:07.173627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:07.174062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:07.327439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:07.336195 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fe427568-2a27-4bcc-9426-3831073c5921 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.178157 Oct 28 20:01:07.336799 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3300/6596] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:07 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:08.366360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:08.367001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:08.374190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:08.374678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:08.375150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:08.375866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:08.376331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:08.376750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:08.515703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:08.524350 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ea7c9730-04e0-4dfd-b90a-56b5050ece9c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.162267 Oct 28 20:01:08.524955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3297/6597] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:08 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:09.551128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:09.551769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:09.559477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:09.560036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:09.560497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:09.561240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:09.561702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:09.562133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:09.705471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:09.713792 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f2df890-f555-4937-a95e-0d0a8aeb7926 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.167327 Oct 28 20:01:09.714349 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3301/6598] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:09 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:09.981261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-acff2a1d-926c-4f0a-b582-21f194ec32f2 req-c552eced-f1fa-456a-89f4-c9989602ccca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9c820f-e8ef-44a4-9692-fe31dd303937", "name": "network-vif-plugged", "status": "completed", "tag": "299a9ca6-7c59-453a-b163-35af78393497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:01:09.996132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-acff2a1d-926c-4f0a-b582-21f194ec32f2 req-c552eced-f1fa-456a-89f4-c9989602ccca service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:09.997006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-acff2a1d-926c-4f0a-b582-21f194ec32f2 req-c552eced-f1fa-456a-89f4-c9989602ccca service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:09.997838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-acff2a1d-926c-4f0a-b582-21f194ec32f2 req-c552eced-f1fa-456a-89f4-c9989602ccca service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:10.015605 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-acff2a1d-926c-4f0a-b582-21f194ec32f2 req-c552eced-f1fa-456a-89f4-c9989602ccca service nova] Creating event network-vif-plugged:299a9ca6-7c59-453a-b163-35af78393497 for instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 on n-h2-862769-3 Oct 28 20:01:10.024953 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-acff2a1d-926c-4f0a-b582-21f194ec32f2 req-c552eced-f1fa-456a-89f4-c9989602ccca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046933 Oct 28 20:01:10.026073 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3298/6599] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:01:10.737350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:10.737967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:10.744897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:10.745390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:10.745829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:10.746551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:10.747064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:10.747522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:10.899847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:10.908412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c8043e4-140e-41bb-953d-08df6ddec971 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1266 microversion: 2.1 time: 0.174991 Oct 28 20:01:10.908935 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3302/6600] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:10 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:11.933738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:11.934430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:11.941739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:11.942234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:11.942663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:11.943398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:11.943852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:11.944272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:12.107636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:12.117513 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5233dcc8-e033-4ed7-adb0-e5d8beb4cf59 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1452 microversion: 2.1 time: 0.188955 Oct 28 20:01:12.118117 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3299/6601] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:11 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:01:12.153734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:01:12.154330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:01:12.162839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:12.163343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:12.163788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:12.164521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:12.164984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:12.165415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:12.334987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:01:12.343555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-982bd472-ec2f-4fea-a741-dc3d399d2312 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1452 microversion: 2.1 time: 0.193912 Oct 28 20:01:12.344140 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3303/6602] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:01:12 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:01:14.180785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fe3dc003-6f59-4c4a-890e-69dbfbb15b5b req-5c12f082-801a-45d1-bf7d-15e47d3edd4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9c820f-e8ef-44a4-9692-fe31dd303937", "tag": "299a9ca6-7c59-453a-b163-35af78393497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:01:14.191196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fe3dc003-6f59-4c4a-890e-69dbfbb15b5b req-5c12f082-801a-45d1-bf7d-15e47d3edd4b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:01:14.192269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fe3dc003-6f59-4c4a-890e-69dbfbb15b5b req-5c12f082-801a-45d1-bf7d-15e47d3edd4b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:01:14.192701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fe3dc003-6f59-4c4a-890e-69dbfbb15b5b req-5c12f082-801a-45d1-bf7d-15e47d3edd4b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:01:14.206910 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fe3dc003-6f59-4c4a-890e-69dbfbb15b5b req-5c12f082-801a-45d1-bf7d-15e47d3edd4b service nova] Creating event network-changed:299a9ca6-7c59-453a-b163-35af78393497 for instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 on n-h2-862769-3 Oct 28 20:01:14.212838 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fe3dc003-6f59-4c4a-890e-69dbfbb15b5b req-5c12f082-801a-45d1-bf7d-15e47d3edd4b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106276 Oct 28 20:01:14.213851 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3300/6603] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:02:42.534615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:42.536044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=62 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:42.537404 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:02:42.537989 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:02:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 (ip 10.222.0.44) !!! Oct 28 20:02:42.541924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=28 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:42.543677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=48 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:42.546805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:42.547337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:42.547767 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:02:42.548285 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:02:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:02:42.555981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:42.556494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:42.556944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:42.557718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:42.557882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d33a7739-ed0d-43c3-af45-770b0c24b84a req-f3f52ff8-0e0b-478b-bd21-0949f51c08ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9c820f-e8ef-44a4-9692-fe31dd303937", "tag": "299a9ca6-7c59-453a-b163-35af78393497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:02:42.558357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:42.558858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:42.574721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d33a7739-ed0d-43c3-af45-770b0c24b84a req-f3f52ff8-0e0b-478b-bd21-0949f51c08ed service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:42.575367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d33a7739-ed0d-43c3-af45-770b0c24b84a req-f3f52ff8-0e0b-478b-bd21-0949f51c08ed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:42.575801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d33a7739-ed0d-43c3-af45-770b0c24b84a req-f3f52ff8-0e0b-478b-bd21-0949f51c08ed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:42.591499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:02:42.592989 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d33a7739-ed0d-43c3-af45-770b0c24b84a req-f3f52ff8-0e0b-478b-bd21-0949f51c08ed service nova] Creating event network-changed:299a9ca6-7c59-453a-b163-35af78393497 for instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 on n-h2-862769-3 Oct 28 20:02:42.599318 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d33a7739-ed0d-43c3-af45-770b0c24b84a req-f3f52ff8-0e0b-478b-bd21-0949f51c08ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062794 Oct 28 20:02:42.599795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3301/6604] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:02:42.692316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3427863c-ed5e-4750-8d5b-7f4cf677f0ad tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 204 len: 0 microversion: 2.1 time: 0.159765 Oct 28 20:02:42.693806 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3304/6605] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:02:42 2022] DELETE /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:02:42.703656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:42.704479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:42.711863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:42.712429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:42.713089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:42.714072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:42.714609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:42.715122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:42.884826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:42.893404 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4b8812f6-cd8a-41d0-b714-89d64a7cb175 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1577 microversion: 2.1 time: 0.194858 Oct 28 20:02:42.906911 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3302/6606] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:42 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:02:43.921384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:43.922954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:43.936873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:43.937803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:43.938617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:43.939990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:43.940858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:43.941673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:44.112045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:44.121709 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d110b3e-4dfc-42fb-bfb4-78cc3ddeaacd tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1577 microversion: 2.1 time: 0.207111 Oct 28 20:02:44.122308 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3305/6607] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:43 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:02:44.800989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-184d7400-7c26-4970-a6cc-96cbcf7ea05f req-0522d076-aebe-49a9-8126-61b198f9426c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9c820f-e8ef-44a4-9692-fe31dd303937", "name": "network-vif-deleted", "tag": "299a9ca6-7c59-453a-b163-35af78393497"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:02:44.817183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-184d7400-7c26-4970-a6cc-96cbcf7ea05f req-0522d076-aebe-49a9-8126-61b198f9426c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:44.817670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-184d7400-7c26-4970-a6cc-96cbcf7ea05f req-0522d076-aebe-49a9-8126-61b198f9426c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:44.818101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-184d7400-7c26-4970-a6cc-96cbcf7ea05f req-0522d076-aebe-49a9-8126-61b198f9426c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:44.839389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-184d7400-7c26-4970-a6cc-96cbcf7ea05f req-0522d076-aebe-49a9-8126-61b198f9426c service nova] Creating event network-vif-deleted:299a9ca6-7c59-453a-b163-35af78393497 for instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 on n-h2-862769-3 Oct 28 20:02:44.848487 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-184d7400-7c26-4970-a6cc-96cbcf7ea05f req-0522d076-aebe-49a9-8126-61b198f9426c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053977 Oct 28 20:02:44.850428 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3303/6608] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:02:45.147791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:45.148616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:45.156840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:45.157359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:45.157805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:45.158554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:45.159063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:45.159501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:45.231053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:45.249402 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f8cd3ee6-8c9b-4f1a-8aff-b1e77bceea3c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1226 microversion: 2.1 time: 0.105218 Oct 28 20:02:45.250858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3306/6609] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:45 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:02:46.286889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:46.287761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:46.295573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:46.296101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:46.296850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:46.297647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:46.298241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:46.298796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:46.371411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:46.381281 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-31c296d2-9ab3-4942-a2bf-8473e1df689c tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1226 microversion: 2.1 time: 0.099115 Oct 28 20:02:46.381929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3304/6610] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:46 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:02:47.410243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:47.411794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:47.423781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:47.424680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:47.425463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:47.426812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:47.427595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:47.428338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:47.531710 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:47.547580 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aedee5ce-e76b-4944-b4bb-c17889dadcf7 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1226 microversion: 2.1 time: 0.144844 Oct 28 20:02:47.548617 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3307/6611] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:47 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:02:48.587131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:48.588367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:48.596908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:48.597391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:48.598222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:48.599214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:48.599683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:48.600107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:48.674164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:48.682967 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a727772b-cefb-4bbc-82cb-8b21c37730e9 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 200 len: 1226 microversion: 2.1 time: 0.101750 Oct 28 20:02:48.683576 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3305/6612] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:48 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:02:49.710952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:49.712298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: 9d9c820f-e8ef-44a4-9692-fe31dd303937] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:49.721300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:49.721805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:49.722922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:49.723052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:49.723459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:49.723893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:49.738766 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 could not be found. Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 HTTP/1.1 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 could not be found. Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '9d9c820f-e8ef-44a4-9692-fe31dd303937'} Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 could not be found. Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 could not be found. Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:02:49.740477 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 could not be found. Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance 9d9c820f-e8ef-44a4-9692-fe31dd303937 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:02:49.744985 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-97f03eac-a5a6-4111-8424-8054effb047d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937" status: 404 len: 111 microversion: 2.1 time: 0.037958 Oct 28 20:02:49.746047 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3308/6613] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:49 2022] GET /compute/v2.1/servers/9d9c820f-e8ef-44a4-9692-fe31dd303937 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:02:56.479913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:56.480874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:56.485235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-36053911-b256-48ac-b7c4-de5f7f58d369 req-3c93e76e-c628-4d1d-bb4a-6407b77e15f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81059d0-acd5-414c-96e2-d242f8443f85", "tag": "1d348ae5-7af7-46da-9e76-7e1e0e23eb92"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:02:56.490185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:56.490979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:56.491924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:56.492872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:56.493517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:56.494552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:56.506095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-36053911-b256-48ac-b7c4-de5f7f58d369 req-3c93e76e-c628-4d1d-bb4a-6407b77e15f6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:56.506982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-36053911-b256-48ac-b7c4-de5f7f58d369 req-3c93e76e-c628-4d1d-bb4a-6407b77e15f6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:56.507745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-36053911-b256-48ac-b7c4-de5f7f58d369 req-3c93e76e-c628-4d1d-bb4a-6407b77e15f6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:56.528771 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-36053911-b256-48ac-b7c4-de5f7f58d369 req-3c93e76e-c628-4d1d-bb4a-6407b77e15f6 service nova] Creating event network-changed:1d348ae5-7af7-46da-9e76-7e1e0e23eb92 for instance a81059d0-acd5-414c-96e2-d242f8443f85 on n-h1-862769-3 Oct 28 20:02:56.530765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:02:56.535878 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-36053911-b256-48ac-b7c4-de5f7f58d369 req-3c93e76e-c628-4d1d-bb4a-6407b77e15f6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057672 Oct 28 20:02:56.537615 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3309/6614] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:02:56.658761 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a3da638e-4b56-49ac-adb9-93870c12adf3 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 204 len: 0 microversion: 2.1 time: 0.183042 Oct 28 20:02:56.665533 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3306/6615] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:02:56 2022] DELETE /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:02:56.675653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:56.677296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:56.686916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:56.687883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:56.688529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:56.689749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:56.690470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:56.691255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:56.901758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:56.912484 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10e3af93-f6af-4c64-89e4-a623628fc628 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1578 microversion: 2.1 time: 0.244427 Oct 28 20:02:56.913269 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3310/6616] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:56 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:02:57.941521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:57.942259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:57.950262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:57.950799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:57.951954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:57.951954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:57.952463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:57.952889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:58.159327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:58.167913 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4d3aa0ec-b536-498e-a156-dbb77587e0c4 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1578 microversion: 2.1 time: 0.230844 Oct 28 20:02:58.168663 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3307/6617] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:57 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:02:59.192344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:02:59.192954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:02:59.200857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:59.201759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:59.202216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:59.203210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:59.203688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:59.204111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:59.207138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e8aa8153-f341-47bf-bac6-b973403676b5 req-bc558c08-d94e-4b1d-98ac-310593541d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81059d0-acd5-414c-96e2-d242f8443f85", "name": "network-vif-deleted", "tag": "1d348ae5-7af7-46da-9e76-7e1e0e23eb92"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:02:59.221981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e8aa8153-f341-47bf-bac6-b973403676b5 req-bc558c08-d94e-4b1d-98ac-310593541d6a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:02:59.222496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e8aa8153-f341-47bf-bac6-b973403676b5 req-bc558c08-d94e-4b1d-98ac-310593541d6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:02:59.223067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e8aa8153-f341-47bf-bac6-b973403676b5 req-bc558c08-d94e-4b1d-98ac-310593541d6a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:02:59.239932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e8aa8153-f341-47bf-bac6-b973403676b5 req-bc558c08-d94e-4b1d-98ac-310593541d6a service nova] Creating event network-vif-deleted:1d348ae5-7af7-46da-9e76-7e1e0e23eb92 for instance a81059d0-acd5-414c-96e2-d242f8443f85 on n-h1-862769-3 Oct 28 20:02:59.245932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e8aa8153-f341-47bf-bac6-b973403676b5 req-bc558c08-d94e-4b1d-98ac-310593541d6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043881 Oct 28 20:02:59.246340 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3308/6618] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:02:59.278662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:02:59.289578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ede66e29-ccbd-4d2a-b8ae-327ae5f7345f tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1392 microversion: 2.1 time: 0.101098 Oct 28 20:02:59.290245 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3311/6619] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:02:59 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1392 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:00.320221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:00.321080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:00.332519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:00.333434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:00.334092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:00.335301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:00.335819 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:00.336636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:00.438559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:00.447457 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c224f347-72b7-42db-87af-e422dcef67b0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1226 microversion: 2.1 time: 0.137199 Oct 28 20:03:00.448067 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3309/6620] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:00 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:01.472037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:01.472854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:01.480834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:01.481626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:01.482087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:01.482965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:01.483512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:01.484042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:01.556437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:01.565583 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09e21bc3-60c0-4444-b87b-a4294184cfb0 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1226 microversion: 2.1 time: 0.097676 Oct 28 20:03:01.566189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3312/6621] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:01 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:02.594170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:02.595151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:02.605974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:02.606474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:02.606965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:02.608104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:02.608104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:02.609054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:02.675759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:02.684165 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09a488c5-2445-4622-96ae-df40bd6d0e00 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1226 microversion: 2.1 time: 0.098265 Oct 28 20:03:02.684988 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3310/6622] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:02 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:03.709990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:03.710544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:03.718081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:03.718623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:03.719110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:03.719850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:03.720323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:03.720764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:03.756626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:03.757164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:03.757663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:03.758176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lazy-loading 'fault' on Instance uuid a81059d0-acd5-414c-96e2-d242f8443f85 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:03:03.806343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815471a57e6c4bffbc49a8d65806ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4485aaa95b34f02aa6a4f38ae3fa2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:03.815637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae546296-feeb-4956-9855-2edf390bd93a tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 200 len: 1231 microversion: 2.1 time: 0.111456 Oct 28 20:03:03.816221 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3313/6623] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:03 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:04.839471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:04.840184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: a81059d0-acd5-414c-96e2-d242f8443f85] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:04.849187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:04.849959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:04.850565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:04.851664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:04.852407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:04.853049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:04.870196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance a81059d0-acd5-414c-96e2-d242f8443f85 could not be found. Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 HTTP/1.1 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance a81059d0-acd5-414c-96e2-d242f8443f85 could not be found. Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'a81059d0-acd5-414c-96e2-d242f8443f85'} Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81059d0-acd5-414c-96e2-d242f8443f85 could not be found. Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81059d0-acd5-414c-96e2-d242f8443f85 could not be found. Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:04.872767 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81059d0-acd5-414c-96e2-d242f8443f85 could not be found. Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance a81059d0-acd5-414c-96e2-d242f8443f85 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c5df0cde-f28d-4b3d-a96e-08053e1f1a0d tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85" status: 404 len: 111 microversion: 2.1 time: 0.038809 Oct 28 20:03:04.876884 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3311/6624] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:04 2022] GET /compute/v2.1/servers/a81059d0-acd5-414c-96e2-d242f8443f85 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 20:03:05.412768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:05.413457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:05.424876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:05.426213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:05.427764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:05.429430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:05.431042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:05.431674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:05.449675 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 HTTP/1.1 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e5d69b96-065c-4f6c-aab1-af3617d76968'} Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:03:05.451451 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-33ebc5e9-427c-4a55-b717-e79a003ca4cb tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 404 len: 111 microversion: 2.1 time: 0.050960 Oct 28 20:03:05.456466 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3314/6625] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:03:05 2022] DELETE /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:03:05.466554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:05.467857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] [instance: e5d69b96-065c-4f6c-aab1-af3617d76968] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:05.478535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:05.479471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:05.480257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:05.481495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:05.482357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:05.483151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:05.502468 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] HTTP exception thrown: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Request method failure captured: Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 HTTP/1.1 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDLiv9fzb1tnOOCKOudtKC11cU7Oitu4oWL3eqglNYc1EDmVGEjr8-miBnW79kXl-_B_q-Hmm2tgWgickqILCERx7ccKx3eaehsPN6V98SoPHg6wnDh8wlUAPUZH27ivFfFFEAlrnaKbT0Vu6pRckZTL0sXddraHmdEeVmkFDZLu2Uc Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e4485aaa95b34f02aa6a4f38ae3fa2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e4485aaa95b34f02aa6a4f38ae3fa2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: e4485aaa95b34f02aa6a4f38ae3fa2d2 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1093493208 Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 815471a57e6c4bffbc49a8d65806ec8e Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestVolumeBootPattern-1093493208-project Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'e5d69b96-065c-4f6c-aab1-af3617d76968'} Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:05.504104 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Returning 404 to user: Instance e5d69b96-065c-4f6c-aab1-af3617d76968 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1431a4a3-171a-4442-8764-defed4d6d218 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968" status: 404 len: 111 microversion: 2.1 time: 0.046240 Oct 28 20:03:05.510846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3312/6626] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:05 2022] GET /compute/v2.1/servers/e5d69b96-065c-4f6c-aab1-af3617d76968 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:03:09.034918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bcdafb43-404b-48c0-8677-b95b4baa7846 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] Calling method '.version_select at 0x7f1d7c18baf0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:09.082098 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bcdafb43-404b-48c0-8677-b95b4baa7846 tempest-TestVolumeBootPattern-1093493208 tempest-TestVolumeBootPattern-1093493208-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1427589248" status: 202 len: 0 microversion: 2.1 time: 0.050870 Oct 28 20:03:09.086043 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3315/6627] 10.222.0.44 () {58 vars in 1263 bytes} [Fri Oct 28 20:03:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1427589248 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:03:30.091931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:30.092714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:30.248533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-856946046", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:30.440235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] validate_networks() for None {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:03:30.671866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:03:30.672287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:03:30.672863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:03:30.673268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:03:30.673764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:03:30.683923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:30.684411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:30.684851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:30.685594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:30.686038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:30.686455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:30.705654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Getting quotas for project 34cbbbad4c6845a9b9e9375750d93174. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:03:30.711724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Getting quotas for user 648512b4cffd4588a3133ac4ad9c7bb4 and project 34cbbbad4c6845a9b9e9375750d93174. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:03:30.726302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:03:30.728589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:03:30.775692 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [71f22fd6-515a-4810-9ef3-1140c046b896] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:03:31.785355 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [71f22fd6-515a-4810-9ef3-1140c046b896] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 37398. Oct 28 20:03:31.790817 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9574efb2-1b2b-4bda-8f7d-da6c7e4bdefd tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704252 Oct 28 20:03:31.791660 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3313/6628] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:03:31.809343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:31.811715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:31.818529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d3c69ea-e6d3-4215-ab5e-709ac97067d1 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:31.819198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3d3c69ea-e6d3-4215-ab5e-709ac97067d1 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:32.007273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3d3c69ea-e6d3-4215-ab5e-709ac97067d1 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:32.015485 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d3c69ea-e6d3-4215-ab5e-709ac97067d1 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1221 microversion: 2.1 time: 0.209525 Oct 28 20:03:32.017253 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3316/6629] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:31 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:03:33.045409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-39a22893-337e-4394-97fc-5c216789dbd9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:33.046932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-39a22893-337e-4394-97fc-5c216789dbd9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:33.106636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-39a22893-337e-4394-97fc-5c216789dbd9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:33.114796 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-39a22893-337e-4394-97fc-5c216789dbd9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1221 microversion: 2.1 time: 0.078843 Oct 28 20:03:33.115428 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3314/6630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:33 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:34.138139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-58aacf79-44b4-4530-b7fc-fa96d324e4ad tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:34.138848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-58aacf79-44b4-4530-b7fc-fa96d324e4ad tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:34.196147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-58aacf79-44b4-4530-b7fc-fa96d324e4ad tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:34.203772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-58aacf79-44b4-4530-b7fc-fa96d324e4ad tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1221 microversion: 2.1 time: 0.069736 Oct 28 20:03:34.204581 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3317/6631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:34 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:35.231242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3c1caaf4-6017-4180-835a-5609b13ac03b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:35.232323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3c1caaf4-6017-4180-835a-5609b13ac03b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:35.304744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3c1caaf4-6017-4180-835a-5609b13ac03b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:35.312565 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3c1caaf4-6017-4180-835a-5609b13ac03b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1221 microversion: 2.1 time: 0.087450 Oct 28 20:03:35.313166 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3315/6632] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:35 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:36.342008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:36.342658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:36.351016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:36.351536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:36.352018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:36.352821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:36.353309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:36.353752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:36.432479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:36.449787 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-02a129a1-6472-45d3-8f05-6f5246139209 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1225 microversion: 2.1 time: 0.111706 Oct 28 20:03:36.451430 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3318/6633] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:36 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:37.488644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:37.489218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:37.497518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:37.497999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:37.498443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:37.499202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:37.499668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:37.500103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:37.569467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:37.578194 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11c6f231-4a0d-40ef-9951-af7c47c8e8f9 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1279 microversion: 2.1 time: 0.094074 Oct 28 20:03:37.578955 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3316/6634] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:37 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:38.609997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:38.612017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:38.623064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:38.623601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:38.624175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:38.624950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:38.625436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:38.625882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:38.800752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:38.810292 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a830745d-af6a-4934-9cfa-a911fb722686 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.207310 Oct 28 20:03:38.811443 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3319/6635] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:38 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:39.721453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-749c126e-92fb-4e4f-8490-844115e38ef8 req-5f8c0d16-d96f-4ebe-93c7-8057c776804b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d", "tag": "e3559e01-6ccf-4f2f-97f3-5656898dff5c"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:39.737829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-749c126e-92fb-4e4f-8490-844115e38ef8 req-5f8c0d16-d96f-4ebe-93c7-8057c776804b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:39.738576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-749c126e-92fb-4e4f-8490-844115e38ef8 req-5f8c0d16-d96f-4ebe-93c7-8057c776804b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:39.739798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-749c126e-92fb-4e4f-8490-844115e38ef8 req-5f8c0d16-d96f-4ebe-93c7-8057c776804b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:39.752517 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-749c126e-92fb-4e4f-8490-844115e38ef8 req-5f8c0d16-d96f-4ebe-93c7-8057c776804b service nova] Creating event network-changed:e3559e01-6ccf-4f2f-97f3-5656898dff5c for instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d on n-h2-862769-3 Oct 28 20:03:39.757490 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-749c126e-92fb-4e4f-8490-844115e38ef8 req-5f8c0d16-d96f-4ebe-93c7-8057c776804b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041874 Oct 28 20:03:39.758113 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3317/6636] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:39.848599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:39.849218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:39.857990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:39.858568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:39.859081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:39.859886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:39.860388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:39.860912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:40.047498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:40.065997 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-85be67cc-c253-40b1-979f-d5b61c886250 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.220992 Oct 28 20:03:40.067566 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3320/6637] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:39 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:41.087497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:41.093341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:41.094079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:41.101860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:41.102381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:41.102844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:41.103571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:41.104053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:41.104461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:41.262673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:41.271235 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49fa240f-3cd9-4bc1-825e-c2a6efe1d6e0 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.184645 Oct 28 20:03:41.271832 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3318/6638] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:41 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:42.295920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:42.296728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:42.304950 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:42.305435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:42.305906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:42.306644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:42.307216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:42.307655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:42.464170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:42.473044 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41305066-9f97-48d9-ae08-25bb07206076 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.181515 Oct 28 20:03:42.473810 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3321/6639] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:42 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:43.497282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:43.497875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:43.506884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:43.507475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:43.507932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:43.508693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:43.509216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:43.509696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:43.680294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:43.688878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a383112-8f06-4575-a010-5bd5a8b6935c tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.195712 Oct 28 20:03:43.689498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3319/6640] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:43 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:03:44.717106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:44.718151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:44.723160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:44.733803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:44.734656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:44.735479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:44.736739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:44.737601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:44.738386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:44.926151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:44.940748 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f486601f-fe06-4c45-8b49-00ccbc93dc5d tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.230542 Oct 28 20:03:44.941858 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3322/6641] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:44 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:45.968615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:45.969355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:45.972418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:45.978773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:45.979285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:45.979737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:45.980446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:45.980903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:45.981325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:46.163660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:46.178326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6534f491-99af-4109-832a-87ad698a3baf tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.213381 Oct 28 20:03:46.179440 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3320/6642] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:45 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:03:46.788293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-829301fc-486a-4094-827a-67672b81e29e req-825f2e54-957c-4595-b191-cb9516ca072c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d", "name": "network-vif-plugged", "status": "completed", "tag": "e3559e01-6ccf-4f2f-97f3-5656898dff5c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:46.798862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-829301fc-486a-4094-827a-67672b81e29e req-825f2e54-957c-4595-b191-cb9516ca072c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:46.799374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-829301fc-486a-4094-827a-67672b81e29e req-825f2e54-957c-4595-b191-cb9516ca072c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:46.799814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-829301fc-486a-4094-827a-67672b81e29e req-825f2e54-957c-4595-b191-cb9516ca072c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:46.812498 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-829301fc-486a-4094-827a-67672b81e29e req-825f2e54-957c-4595-b191-cb9516ca072c service nova] Creating event network-vif-plugged:e3559e01-6ccf-4f2f-97f3-5656898dff5c for instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d on n-h2-862769-3 Oct 28 20:03:46.818804 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-829301fc-486a-4094-827a-67672b81e29e req-825f2e54-957c-4595-b191-cb9516ca072c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146041 Oct 28 20:03:46.819452 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3323/6643] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:47.215008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:47.215632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:47.223822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:47.224328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:47.224775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:47.225510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:47.225976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:47.226406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:47.378287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:47.387178 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-14cb81bf-1566-4a52-b168-240fbc26e52b tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1321 microversion: 2.1 time: 0.176629 Oct 28 20:03:47.387795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3321/6644] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:47 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:48.415450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:48.416227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:48.424234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:48.424736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:48.425169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:48.425910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:48.426366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:48.426846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:48.586197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:48.596802 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41dab781-24a8-407f-897c-e5ca9ad1c864 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1471 microversion: 2.1 time: 0.188924 Oct 28 20:03:48.597678 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3324/6645] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:48 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:48.687628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-263a9a19-70bd-4d7c-97cc-83f6d3de8272 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Calling method '.version_select at 0x7f1d768d5e50>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:48.765468 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-263a9a19-70bd-4d7c-97cc-83f6d3de8272 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/a94809ad6a4546988117190016914907" status: 200 len: 371 microversion: 2.1 time: 0.143588 Oct 28 20:03:48.766072 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3322/6646] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 20:03:48 2022] GET /compute/v2.1/os-quota-sets/a94809ad6a4546988117190016914907 => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:48.779140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-119ea732-5afd-4f3a-b146-e2dfd3359fc3 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-476875023", "id": 701538268, "os-flavor-access:is_public": "True"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:48.802291 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-119ea732-5afd-4f3a-b146-e2dfd3359fc3 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.027449 Oct 28 20:03:48.803113 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3325/6647] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:03:48 2022] POST /compute/v2.1/flavors => generated 434 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:48.816727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "701538268"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:48.819253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:48.826236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:48.827076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:48.827526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:48.828271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:48.828735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:48.829286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:48.993001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ec2628fbb59b402597fa5f4b8482021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94809ad6a4546988117190016914907', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:49.003860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-476875023 {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:03:49.017081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.018007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.018818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.020123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.020872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.021522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.058246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Getting quotas for project 34cbbbad4c6845a9b9e9375750d93174. Resources: {'cores', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:03:49.068593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Getting quotas for user 648512b4cffd4588a3133ac4ad9c7bb4 and project 34cbbbad4c6845a9b9e9375750d93174. Resources: {'cores', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:03:49.091366 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.compute.api [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] ram quota exceeded for a94809ad6a4546988117190016914907, tried to resize instance. Oct 28 20:03:49.092175 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Request method failure captured: Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d/action HTTP/1.1 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 38 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDWRjbpbGj7P06OAufCGeZG2zMbLOBOIiTpyF2QZwFoYi8OBn1IGInPi1USyLUaqkJDWeyvzn7Yk95ODahq-0OnguKtgMy1g0qsZ41r-dsPrxNyKGPYNVOGB94uHUJGwyKtcTrP87nc3ogWjbSWIwnw-5Y72Y4zG8c1CToxbD3MQw8E Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: a94809ad6a4546988117190016914907 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-790498959 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Role: reader,member,admin Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: reader,member,admin Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a94809ad6a4546988117190016914907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a94809ad6a4546988117190016914907", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a94809ad6a4546988117190016914907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a94809ad6a4546988117190016914907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminNegativeTestJSON-790498959 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: a94809ad6a4546988117190016914907 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-790498959 Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminNegativeTestJSON-790498959-project-admin Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: ec2628fbb59b402597fa5f4b8482021b Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminNegativeTestJSON-790498959-project-admin Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: {"resize": {"flavorRef": "701538268"}} Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d', 'body': {'resize': {'flavorRef': '701538268'}}} Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:03:49.095101 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2831886c-e3cf-4581-a240-d0bef455eda6 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d/action" status: 403 len: 118 microversion: 2.1 time: 0.284233 Oct 28 20:03:49.099615 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3323/6648] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:03:48 2022] POST /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d/action => generated 118 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:03:49.111011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24f2ce36-44bf-41e5-9536-a6e4d5c2acb0 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:49.137036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24f2ce36-44bf-41e5-9536-a6e4d5c2acb0 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/701538268" status: 202 len: 0 microversion: 2.1 time: 0.032091 Oct 28 20:03:49.138102 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3326/6649] 10.222.0.44 () {58 vars in 1158 bytes} [Fri Oct 28 20:03:49 2022] DELETE /compute/v2.1/flavors/701538268 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:03:49.147553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf6d5edc-4f42-4df0-875d-0f537a008f4b tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:49.170484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf6d5edc-4f42-4df0-875d-0f537a008f4b tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026922 Oct 28 20:03:49.171140 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3324/6650] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 20:03:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:49.196392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48b76e0a-4415-4983-8909-b126fab3cfca tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Calling method '.version_select at 0x7f1d76a7eca0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:49.307800 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48b76e0a-4415-4983-8909-b126fab3cfca tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "GET /compute/v2.1/os-quota-sets/a94809ad6a4546988117190016914907" status: 200 len: 371 microversion: 2.1 time: 0.117681 Oct 28 20:03:49.309002 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3327/6651] 10.222.0.44 () {58 vars in 1242 bytes} [Fri Oct 28 20:03:49 2022] GET /compute/v2.1/os-quota-sets/a94809ad6a4546988117190016914907 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:49.322546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bd17129-6a39-4ee0-a72f-5df4511b537d tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1200670385", "id": 1021854333, "os-flavor-access:is_public": "True"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:49.345499 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bd17129-6a39-4ee0-a72f-5df4511b537d tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.027335 Oct 28 20:03:49.346235 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3325/6652] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:03:49 2022] POST /compute/v2.1/flavors => generated 437 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:49.359479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1021854333"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:49.362238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:49.369413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.369930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.370384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.371185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.371659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.372095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.528880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ec2628fbb59b402597fa5f4b8482021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94809ad6a4546988117190016914907', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:49.536474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1200670385 {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:03:49.544966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.545461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.545906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.546717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.547787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.547787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.574100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Getting quotas for project 34cbbbad4c6845a9b9e9375750d93174. Resources: {'cores', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:03:49.580499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Getting quotas for user 648512b4cffd4588a3133ac4ad9c7bb4 and project 34cbbbad4c6845a9b9e9375750d93174. Resources: {'cores', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:03:49.599158 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] cores quota exceeded for a94809ad6a4546988117190016914907, tried to resize instance. Oct 28 20:03:49.599719 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Request method failure captured: Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d/action HTTP/1.1 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 39 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDWRjbpbGj7P06OAufCGeZG2zMbLOBOIiTpyF2QZwFoYi8OBn1IGInPi1USyLUaqkJDWeyvzn7Yk95ODahq-0OnguKtgMy1g0qsZ41r-dsPrxNyKGPYNVOGB94uHUJGwyKtcTrP87nc3ogWjbSWIwnw-5Y72Y4zG8c1CToxbD3MQw8E Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: a94809ad6a4546988117190016914907 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-790498959 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Role: reader,member,admin Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: reader,member,admin Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a94809ad6a4546988117190016914907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a94809ad6a4546988117190016914907", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a94809ad6a4546988117190016914907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a94809ad6a4546988117190016914907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersAdminNegativeTestJSON-790498959 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: a94809ad6a4546988117190016914907 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-790498959 Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersAdminNegativeTestJSON-790498959-project-admin Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: ec2628fbb59b402597fa5f4b8482021b Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersAdminNegativeTestJSON-790498959-project-admin Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: {"resize": {"flavorRef": "1021854333"}} Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d', 'body': {'resize': {'flavorRef': '1021854333'}}} Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:03:49.601854 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c1144c5-7730-4ffb-85ae-0098a6e02886 tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "POST /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d/action" status: 403 len: 113 microversion: 2.1 time: 0.248122 Oct 28 20:03:49.606818 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3328/6653] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:03:49 2022] POST /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d/action => generated 113 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:03:49.613372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bcb879b1-4998-4992-b526-47e3666a7ffe tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:49.634888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bcb879b1-4998-4992-b526-47e3666a7ffe tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "DELETE /compute/v2.1/flavors/1021854333" status: 202 len: 0 microversion: 2.1 time: 0.025454 Oct 28 20:03:49.636104 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3326/6654] 10.222.0.44 () {58 vars in 1161 bytes} [Fri Oct 28 20:03:49 2022] DELETE /compute/v2.1/flavors/1021854333 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:03:49.645989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a22326ee-5a34-43c6-b74b-d1166feb3e2e tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:49.667062 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a22326ee-5a34-43c6-b74b-d1166feb3e2e tempest-ServersAdminNegativeTestJSON-790498959 tempest-ServersAdminNegativeTestJSON-790498959-project-admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025089 Oct 28 20:03:49.667683 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3329/6655] 10.222.0.44 () {58 vars in 1146 bytes} [Fri Oct 28 20:03:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:03:49.708952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:49.709868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:49.725828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.726583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.727395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:49.728451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:49.729099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:49.729698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:50.074566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:03:50.164381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-570b0992-dd10-4ef0-a11c-1428d13b8028 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "DELETE /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 204 len: 0 microversion: 2.1 time: 0.463140 Oct 28 20:03:50.165172 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3327/6656] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:03:49 2022] DELETE /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:03:50.174729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:50.175419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:50.182312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:50.182740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:50.183200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:50.183915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:50.184369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:50.184812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:50.354297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:50.363802 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0ddcc1db-361f-4cff-8745-1a5e6d89e4f6 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1477 microversion: 2.1 time: 0.193474 Oct 28 20:03:50.364434 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3330/6657] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:50 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:03:51.389362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:51.390045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:51.397762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:51.398261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:51.398781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:51.399438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:51.399894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:51.400321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:51.585261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648512b4cffd4588a3133ac4ad9c7bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cbbbad4c6845a9b9e9375750d93174', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:03:51.601020 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ead08ebc-3c87-47e3-87bf-b001b009c6b7 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 200 len: 1477 microversion: 2.1 time: 0.215905 Oct 28 20:03:51.602059 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3328/6658] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:51 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:03:52.042877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d69c0fc8-cabd-437b-910b-d2ae53dfb418 req-b8ccda9d-fa3b-4a24-b55d-1294c7ddc424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d", "name": "network-vif-deleted", "tag": "e3559e01-6ccf-4f2f-97f3-5656898dff5c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:03:52.070265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d69c0fc8-cabd-437b-910b-d2ae53dfb418 req-b8ccda9d-fa3b-4a24-b55d-1294c7ddc424 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:52.071215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d69c0fc8-cabd-437b-910b-d2ae53dfb418 req-b8ccda9d-fa3b-4a24-b55d-1294c7ddc424 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:52.072035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d69c0fc8-cabd-437b-910b-d2ae53dfb418 req-b8ccda9d-fa3b-4a24-b55d-1294c7ddc424 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:52.097236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d69c0fc8-cabd-437b-910b-d2ae53dfb418 req-b8ccda9d-fa3b-4a24-b55d-1294c7ddc424 service nova] Creating event network-vif-deleted:e3559e01-6ccf-4f2f-97f3-5656898dff5c for instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d on n-h2-862769-3 Oct 28 20:03:52.108255 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d69c0fc8-cabd-437b-910b-d2ae53dfb418 req-b8ccda9d-fa3b-4a24-b55d-1294c7ddc424 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077275 Oct 28 20:03:52.109382 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3331/6659] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:03:52.641783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:03:52.643159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] [instance: 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:03:52.652123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:52.652575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:52.653098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:52.653884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:03:52.654352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:03:52.654812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:03:52.671149 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] HTTP exception thrown: Instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d could not be found. Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Request method failure captured: Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d HTTP/1.1 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDWRZ6LyEpH3jm2_R6e0cpsKiyyZ2gNMSWXdzpQ8dkacaMdZUUqF-6MjKafcxlSstssMUS7LrOiYjwGIeGALxITR3Wm2zz5YI-nubKxwk686r3pvgJZJPXs8HmXxYdgRBLhbhv3NyqdbatCUgD3mWB-dOudRqTWGlcHao8dv2iWyHTY Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 34cbbbad4c6845a9b9e9375750d93174 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-306131221 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34cbbbad4c6845a9b9e9375750d93174"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34cbbbad4c6845a9b9e9375750d93174", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34cbbbad4c6845a9b9e9375750d93174"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34cbbbad4c6845a9b9e9375750d93174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersAdminNegativeTestJSON-306131221 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 34cbbbad4c6845a9b9e9375750d93174 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-306131221 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersAdminNegativeTestJSON-306131221-project Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 648512b4cffd4588a3133ac4ad9c7bb4 Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersAdminNegativeTestJSON-306131221-project Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d could not be found. Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d'} Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d could not be found. Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d could not be found. Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:52.673121 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d could not be found. Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] Returning 404 to user: Instance 021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1e7afda-051f-44a4-9e2c-c491f1d09909 tempest-ServersAdminNegativeTestJSON-306131221 tempest-ServersAdminNegativeTestJSON-306131221-project] 10.222.0.44 "GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d" status: 404 len: 111 microversion: 2.1 time: 0.039309 Oct 28 20:03:52.677599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3329/6660] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:03:52 2022] GET /compute/v2.1/servers/021fc7ce-5f64-4c72-905e-f8fb7bb8eb0d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:04:00.395384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:00.396197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:00.678478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1912404429", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "4dce6840-63bc-46f3-bbd2-7a4bc963e1bc"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:00.739961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] validate_networks() for [('4dce6840-63bc-46f3-bbd2-7a4bc963e1bc', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:04:01.193889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:04:01.194756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:04:01.195444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:04:01.195816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:04:01.196417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:04:01.206340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:01.223000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:01.223000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:01.223000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:01.223000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:01.223000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:01.252893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Getting quotas for project 1c1c1cb2518a4e5bb023f110f5a82d15. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:04:01.263833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Getting quotas for user cb3a12e9c1ac4be9b7c2475ef694f77f and project 1c1c1cb2518a4e5bb023f110f5a82d15. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:04:01.289690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:04:01.294385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:04:01.371975 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [8e6d532d-8564-4b04-9bce-9b38b6e194e1] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:04:02.380391 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [8e6d532d-8564-4b04-9bce-9b38b6e194e1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 37570. Oct 28 20:04:02.385590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a2ae6ea-7d77-4525-853e-358a0de8ad96 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992056 Oct 28 20:04:02.386271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3332/6661] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:04:02.401625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-490a86c8-3332-4ca9-9c39-cc9dd9ee6664 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:02.403201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-490a86c8-3332-4ca9-9c39-cc9dd9ee6664 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:02.407996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:02.408996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:02.410254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:02.486050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-490a86c8-3332-4ca9-9c39-cc9dd9ee6664 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:02.496015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-490a86c8-3332-4ca9-9c39-cc9dd9ee6664 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1215 microversion: 2.1 time: 0.099406 Oct 28 20:04:02.496859 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3330/6662] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:02 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:03.521365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:03.522024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:03.524308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:03.530652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:03.531310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:03.531756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:03.532734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:03.533201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:03.533665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:03.538740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=62 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:03.624530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:03.646005 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82bb3716-3769-4125-a43a-9304fb291c8e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1267 microversion: 2.1 time: 0.130009 Oct 28 20:04:03.646771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3333/6663] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:03 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:04.671803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:04.672811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:04.676590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:04.684448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:04.684996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:04.685403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:04.686386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:04.687059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:04.687496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:04.883182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:04.892283 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe211cbf-bc70-4cb7-85bf-1d3f85d3c798 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.224553 Oct 28 20:04:04.893007 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3331/6664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:04 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:04:05.417653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-11b04ab3-fa1e-4f08-9f31-17570c9922e5 req-d0438f7e-9400-4bc3-bd16-924b6b70a776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fffe5036-4515-440d-ab9e-73ee4be43f9c", "tag": "57c154f1-16a6-4dfb-9785-1fed8d1bdfb6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:05.431807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-11b04ab3-fa1e-4f08-9f31-17570c9922e5 req-d0438f7e-9400-4bc3-bd16-924b6b70a776 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:05.433413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-11b04ab3-fa1e-4f08-9f31-17570c9922e5 req-d0438f7e-9400-4bc3-bd16-924b6b70a776 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:05.433876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-11b04ab3-fa1e-4f08-9f31-17570c9922e5 req-d0438f7e-9400-4bc3-bd16-924b6b70a776 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:05.452941 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-11b04ab3-fa1e-4f08-9f31-17570c9922e5 req-d0438f7e-9400-4bc3-bd16-924b6b70a776 service nova] Creating event network-changed:57c154f1-16a6-4dfb-9785-1fed8d1bdfb6 for instance fffe5036-4515-440d-ab9e-73ee4be43f9c on n-h1-862769-3 Oct 28 20:04:05.458900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-11b04ab3-fa1e-4f08-9f31-17570c9922e5 req-d0438f7e-9400-4bc3-bd16-924b6b70a776 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045287 Oct 28 20:04:05.459493 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3334/6665] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:04:05.917036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:05.917683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:05.925321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:05.925860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:05.926330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:05.926944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:05.927397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:05.927856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:06.072676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:06.082924 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf06f239-5113-48ce-957c-36961d671436 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.169921 Oct 28 20:04:06.083512 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3332/6666] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:05 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:07.109601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:07.110727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:07.118389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:07.118908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:07.119362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:07.120092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:07.120555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:07.120989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:07.269971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:07.281612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4763eed-f729-4f01-b58e-97561460443a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.178475 Oct 28 20:04:07.282536 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3335/6667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:07 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:08.307317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:08.308317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:08.316084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:08.316790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:08.317393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:08.318408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:08.319013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:08.319535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:08.477322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:08.487233 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6958e0a3-47db-4bff-a703-7cd6ab085c3c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.185148 Oct 28 20:04:08.487770 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3333/6668] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:08 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:09.511387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:09.512088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:09.520423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:09.520923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:09.521410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:09.522253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:09.522780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:09.523247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:09.682401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:09.690768 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f9e9ed25-ba9e-4a95-bbfb-2beca120594c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.183905 Oct 28 20:04:09.691530 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3336/6669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:09 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:10.636305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-092c5d84-8774-45d7-97ad-487c452aad12 req-eee56e9c-87c4-413c-ac81-138d4ac27f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffe5036-4515-440d-ab9e-73ee4be43f9c", "name": "network-vif-plugged", "status": "completed", "tag": "57c154f1-16a6-4dfb-9785-1fed8d1bdfb6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:10.647299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-092c5d84-8774-45d7-97ad-487c452aad12 req-eee56e9c-87c4-413c-ac81-138d4ac27f6d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:10.647980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-092c5d84-8774-45d7-97ad-487c452aad12 req-eee56e9c-87c4-413c-ac81-138d4ac27f6d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:10.648215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-092c5d84-8774-45d7-97ad-487c452aad12 req-eee56e9c-87c4-413c-ac81-138d4ac27f6d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:10.661760 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-092c5d84-8774-45d7-97ad-487c452aad12 req-eee56e9c-87c4-413c-ac81-138d4ac27f6d service nova] Creating event network-vif-plugged:57c154f1-16a6-4dfb-9785-1fed8d1bdfb6 for instance fffe5036-4515-440d-ab9e-73ee4be43f9c on n-h1-862769-3 Oct 28 20:04:10.670199 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-092c5d84-8774-45d7-97ad-487c452aad12 req-eee56e9c-87c4-413c-ac81-138d4ac27f6d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037773 Oct 28 20:04:10.671131 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3334/6670] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:04:10.715661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:10.716600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:10.727286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:10.727286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:10.727485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:10.728196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:10.728682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:10.729113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:10.882071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:10.890435 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-906eb22e-7fbd-415c-80dc-491cfe995522 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.180600 Oct 28 20:04:10.891067 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3337/6671] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:10 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:11.915635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:11.916331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:11.923734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:11.924225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:11.924647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:11.925365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:11.925834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:11.926232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:12.068144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:12.078777 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-99d0c94c-9368-40fb-a5db-f6d8eecf5e8d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1315 microversion: 2.1 time: 0.168519 Oct 28 20:04:12.079386 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3335/6672] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:11 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:13.102598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:13.103257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:13.105366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:13.106045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:13.113727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:13.114248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:13.114725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:13.115422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:13.115880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:13.116308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:13.257192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:13.265298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd652cd4-350e-4f49-8f53-4a2f9fda8355 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1501 microversion: 2.1 time: 0.166674 Oct 28 20:04:13.265908 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3338/6673] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:13 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:13.300232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:13.302516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:13.304731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:13.311020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:13.311512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:13.311933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:13.312642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:13.313199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:13.313627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:13.343098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:13.349182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:04:13.356095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:04:13.356450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:04:13.356960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:04:13.357372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:04:13.357783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:04:13.441816 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ae982740-dd8d-4324-a153-6b30e9f2efc8 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "POST /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c/action" status: 202 len: 0 microversion: 2.1 time: 0.146071 Oct 28 20:04:13.442487 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3336/6674] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:04:13 2022] POST /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:04:13.451083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:13.451964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:13.458935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:13.459532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:13.460006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:13.460725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:13.461206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:13.461613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:13.604412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:13.612794 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-974497f2-ae4a-4efd-82bf-0da4882b90f9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1510 microversion: 2.1 time: 0.165739 Oct 28 20:04:13.613370 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3339/6675] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:13 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:14.638761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:14.640708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:14.649996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:14.650498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:14.650967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:14.651700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:14.652158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:14.652581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:14.796030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:14.804906 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80b20e76-a8c0-4329-a59e-93c7b99d6ed3 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1510 microversion: 2.1 time: 0.172842 Oct 28 20:04:14.805801 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3337/6676] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:14 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:15.831401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:15.832177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:15.839208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:15.839705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:15.840145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:15.841029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:15.841494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:15.841923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:16.000508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:16.009175 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a798d5b1-b013-474a-8c27-4430d3d9a1d5 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1510 microversion: 2.1 time: 0.182507 Oct 28 20:04:16.009764 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3340/6677] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:15 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:04:17.034335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:17.034995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:17.042531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:17.043073 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:17.043511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:17.044234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:17.044693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:17.045118 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:17.188967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:17.197234 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12e0fe67-54e6-4204-ac9b-73c37ee6bdf0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.167912 Oct 28 20:04:17.197845 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3338/6678] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:17 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:18.222282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:18.223132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:18.230101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:18.230581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:18.231045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:18.231765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:18.232227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:18.232654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:18.396791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:18.405761 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-34d2bfdd-00cd-4bc0-9763-d3a9508f7c54 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.188302 Oct 28 20:04:18.406363 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3341/6679] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:18 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:19.433124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:19.434339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:19.443750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:19.444377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:19.444866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:19.445678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:19.446225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:19.446748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:19.623446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:19.632610 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-21ca65f7-0a1e-474e-92bd-fe7524a938d1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.205731 Oct 28 20:04:19.633315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3339/6680] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:19 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:20.677147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:20.678282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:20.690940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:20.691820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:20.692586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:20.693853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:20.694489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:20.695288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:20.893513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:20.903135 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2e91e94d-aa55-41e3-bafd-6d018136164a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.233292 Oct 28 20:04:20.903747 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3342/6681] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:20 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:21.942078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:21.942753 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:21.950655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:21.951218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:21.951661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:21.952436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:21.952924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:21.953373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:22.105541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:22.113845 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d4deb243-0b29-4375-af0b-0be1cde28472 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.175791 Oct 28 20:04:22.114443 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3340/6682] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:21 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:23.137971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:23.138728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:23.146253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:23.146792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:23.147277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:23.147985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:23.148449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:23.148853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:23.296224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:23.308467 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44faf511-1bb6-4542-a61c-1a73d7bb9a28 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.174114 Oct 28 20:04:23.309497 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3343/6683] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:23 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:24.334423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:24.335214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:24.343706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:24.344344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:24.344784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:24.345514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:24.345963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:24.346380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:24.496413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:24.505546 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-da070b1a-2f09-466b-a6e8-5a487507939b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.176062 Oct 28 20:04:24.506151 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3341/6684] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:24 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:25.530099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:25.530708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:25.538662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:25.539193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:25.539633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:25.540353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:25.540812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:25.541247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:25.699209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:25.707481 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41e030bf-a9e6-4464-97cc-d9445d59f22a tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.181693 Oct 28 20:04:25.708111 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3344/6685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:25 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:26.741700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:26.742354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:26.750838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:26.751347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:26.751787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:26.752509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:26.752967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:26.753386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:26.920127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:26.932303 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-52678f8f-c6ae-4f45-8cf2-8a727e5daae6 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.194518 Oct 28 20:04:26.932984 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3342/6686] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:26 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:27.956632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:27.957285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:27.964610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:27.965281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:27.965779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:27.966583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:27.967134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:27.967616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:28.124080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:28.133537 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9fcffec7-e0fb-495e-a861-98f5ab9db7b9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.181000 Oct 28 20:04:28.134150 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3345/6687] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:27 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:29.158061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:29.158884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:29.167110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:29.167621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:29.168066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:29.168799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:29.169264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:29.169693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:29.388931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:29.398420 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a7165d0d-6ad1-4e7c-aed9-2d78b043218d tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.244718 Oct 28 20:04:29.399186 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3343/6688] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:29 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:30.437290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:30.437993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:30.446170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:30.446696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:30.447155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:30.447878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:30.448339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:30.448782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:30.603451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:30.612573 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-643f35fc-fee1-40f7-9de3-620ec3da6b2b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.179981 Oct 28 20:04:30.613273 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3346/6689] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:30 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:31.636501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:31.637303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:31.650338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:31.651424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:31.652232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:31.653647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:31.654546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:31.655446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:31.820671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:31.829230 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c156088c-7376-466d-b860-c089c6973692 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.196994 Oct 28 20:04:31.829819 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3344/6690] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:31 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:32.853557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:32.854161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:32.861650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:32.862189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:32.862730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:32.863583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:32.864084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:32.864590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:33.011396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:33.020681 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-55993446-b20c-457b-a980-bdd273302107 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.171048 Oct 28 20:04:33.021295 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3347/6691] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:32 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:34.047493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:34.048074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:34.050899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=36 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:34.056645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:34.057111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:34.057545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:34.058240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:34.058711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:34.059138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:34.208639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:34.216999 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b49c8b5-823a-4dbf-972a-00fde0e4e5a9 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.175448 Oct 28 20:04:34.217606 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3345/6692] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:34 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:35.240455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:35.241213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:35.244246 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=30 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:35.250040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:35.250596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:35.251084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:35.251850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:35.252316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:35.252786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:35.255974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=86 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:35.392802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:35.401320 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80a6992c-e2ef-4041-a2c7-80e80e0a515f tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.164976 Oct 28 20:04:35.401935 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3348/6693] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:35 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:36.425489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:36.426202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:36.434591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:36.435153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:36.435592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:36.436379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:36.436852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:36.437287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:36.440729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.602590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:36.611296 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ddcfcaa2-40b3-4638-b9d2-10ba9d4797b0 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.189921 Oct 28 20:04:36.611901 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3346/6694] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:36 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:37.635508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:37.636476 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:37.644680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:37.645196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:37.645654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:37.646431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:37.646941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:37.647377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:37.821994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:37.830567 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a7a6f1e0-7120-46af-97f5-0dc732487678 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.199135 Oct 28 20:04:37.831104 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3349/6695] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:37 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:38.858860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:38.859605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:38.869848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:38.870458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:38.871010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:38.872060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:38.872837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:38.873406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:39.036375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:39.048892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-00181403-abf1-41b1-bccc-f82afbf4b0bf tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.196563 Oct 28 20:04:39.049469 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3347/6696] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:38 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:40.074228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:40.075076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:40.084566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:40.085158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:40.085758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:40.086621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:40.087170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:40.087641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:40.227394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:40.241012 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c8432463-807b-4171-bd33-4569f133059e tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.170995 Oct 28 20:04:40.242163 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3350/6697] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:40 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:41.268454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:41.269212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:41.277358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:41.277874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:41.278321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:41.279100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:41.279601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:41.280091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:41.427269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:41.435851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-45bce9a1-356a-40ef-9477-f6db347132cc tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.171741 Oct 28 20:04:41.436450 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3348/6698] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:41 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:42.459050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:42.459914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:42.468317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:42.468822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:42.469312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:42.470173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:42.470639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:42.471103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:42.610500 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:42.619275 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa9e2d0e-bdd9-456c-96de-098e182b77e1 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1515 microversion: 2.1 time: 0.164459 Oct 28 20:04:42.619878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3351/6699] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:42 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:43.447763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffe5036-4515-440d-ab9e-73ee4be43f9c", "name": "network-vif-unplugged", "status": "completed", "tag": "57c154f1-16a6-4dfb-9785-1fed8d1bdfb6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:43.459375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:43.459860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:43.460297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:43.472590 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] Creating event network-vif-unplugged:57c154f1-16a6-4dfb-9785-1fed8d1bdfb6 for instance fffe5036-4515-440d-ab9e-73ee4be43f9c on n-h2-862769-3 Oct 28 20:04:43.478353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] Instance fffe5036-4515-440d-ab9e-73ee4be43f9c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:04:43.489787 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-8b12bced-1e55-4323-9442-a822ef9c713a req-6ec7d2cc-0b54-4e76-9b6d-3aec3c665368 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046290 Oct 28 20:04:43.490626 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3349/6700] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:04:43.644340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:43.645094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:43.652393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:43.652896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:43.653336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:43.654064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:43.654518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:43.655144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:43.797665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:43.807825 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a8823c5d-3632-4f6c-bb88-6375ae0c50b7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1514 microversion: 2.1 time: 0.168476 Oct 28 20:04:43.808453 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3352/6701] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:43 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:44.834460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:44.835190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:44.842271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:44.842794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:44.843229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:44.843930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:44.844389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:44.844918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:44.996727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:45.006241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-be19f48a-effd-4e46-8368-a4e9196c300c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1512 microversion: 2.1 time: 0.177003 Oct 28 20:04:45.006855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3350/6702] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:44 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:45.521963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fffe5036-4515-440d-ab9e-73ee4be43f9c", "tag": "57c154f1-16a6-4dfb-9785-1fed8d1bdfb6"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:45.533366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:45.533971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:45.534395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:45.550472 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] Creating event network-changed:57c154f1-16a6-4dfb-9785-1fed8d1bdfb6 for instance fffe5036-4515-440d-ab9e-73ee4be43f9c on n-h2-862769-3 Oct 28 20:04:45.556948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] Instance fffe5036-4515-440d-ab9e-73ee4be43f9c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:04:45.569322 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0b2f7b8d-2fb1-4919-bdbb-50ed3ca2e9d3 req-2e5f3f48-5154-45ca-9796-6de26477e9ea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051068 Oct 28 20:04:45.569958 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3353/6703] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:04:46.033782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:46.034513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:46.042713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:46.043219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:46.043661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:46.044382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:46.044838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:46.045328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:46.186211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:46.194389 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc51a169-91ce-49b3-b864-74524f9c1dd7 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1509 microversion: 2.1 time: 0.164788 Oct 28 20:04:46.195112 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3351/6704] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:46 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:46.219579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:46.220605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:46.228237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:46.229515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:46.229742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:46.230608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:46.231149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:46.231586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:46.258329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:04:46.310822 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Found an unconfirmed migration during delete, id: 16, status: finished Oct 28 20:04:47.992191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fbf28665-1e47-4655-8d90-d8964be8d710 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 204 len: 0 microversion: 2.1 time: 1.778354 Oct 28 20:04:47.993323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3354/6705] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:04:46 2022] DELETE /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 0 bytes in 1780 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:04:48.002824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:48.003459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:48.011403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:48.011934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:48.012376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:48.013101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:48.013561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:48.013986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:48.161642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:48.170439 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f7929a33-c238-413a-a28e-ca074368de05 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1501 microversion: 2.1 time: 0.172011 Oct 28 20:04:48.171232 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3352/6706] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:47 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:49.195674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:49.196267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:49.203777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:49.204292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:49.204759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:49.206892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:49.206892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:49.206892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:49.341171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3a12e9c1ac4be9b7c2475ef694f77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1c1cb2518a4e5bb023f110f5a82d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:04:49.349639 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0a601c5a-d224-4b4a-8e04-73568b5d1f00 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 200 len: 1501 microversion: 2.1 time: 0.158545 Oct 28 20:04:49.350452 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3355/6707] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:49 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:04:49.732313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5f0352bc-24de-45f4-a08a-87bf7d95d776 req-6e99e4c1-3469-4773-adf9-80c480446e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffe5036-4515-440d-ab9e-73ee4be43f9c", "name": "network-vif-deleted", "tag": "57c154f1-16a6-4dfb-9785-1fed8d1bdfb6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:04:49.744662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5f0352bc-24de-45f4-a08a-87bf7d95d776 req-6e99e4c1-3469-4773-adf9-80c480446e77 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:49.745151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5f0352bc-24de-45f4-a08a-87bf7d95d776 req-6e99e4c1-3469-4773-adf9-80c480446e77 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:49.745713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5f0352bc-24de-45f4-a08a-87bf7d95d776 req-6e99e4c1-3469-4773-adf9-80c480446e77 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:49.770744 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5f0352bc-24de-45f4-a08a-87bf7d95d776 req-6e99e4c1-3469-4773-adf9-80c480446e77 service nova] Creating event network-vif-deleted:57c154f1-16a6-4dfb-9785-1fed8d1bdfb6 for instance fffe5036-4515-440d-ab9e-73ee4be43f9c on n-h2-862769-3 Oct 28 20:04:49.778501 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5f0352bc-24de-45f4-a08a-87bf7d95d776 req-6e99e4c1-3469-4773-adf9-80c480446e77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050064 Oct 28 20:04:49.779349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3353/6708] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:04:50.374446 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:50.375208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:50.385091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:50.385752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:50.386281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:50.387356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:50.387953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:50.388488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:50.405795 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] HTTP exception thrown: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Request method failure captured: Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c HTTP/1.1 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDWw2sMRbto-Fsg2ruXo9axvcvDl1g5X_KUw_2oRvkzDdnYVj_jziQQnHBbDg-_MeqGjClGFKpIkL5faFHFgJe93lMCOswZgMo47uV_2rMIMiMhzjYNaQrUnyBbaJjYYbeGZ0eQqLkrAdptKQdQYu04sfHCRkhart2e8-hfDRqRLRhE Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1c1c1cb2518a4e5bb023f110f5a82d15 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c1c1cb2518a4e5bb023f110f5a82d15", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1c1c1cb2518a4e5bb023f110f5a82d15 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1709856411-project Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: cb3a12e9c1ac4be9b7c2475ef694f77f Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1709856411-project Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'fffe5036-4515-440d-ab9e-73ee4be43f9c'} Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:04:50.407526 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Returning 404 to user: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-538c02ce-b6ba-4512-b501-fb826b54649b tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 404 len: 111 microversion: 2.1 time: 0.039554 Oct 28 20:04:50.412442 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3356/6709] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:50 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:04:50.429659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:50.430275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:50.437058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:50.437573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:50.438008 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:50.438736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:50.439214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:50.439641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:50.453598 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] HTTP exception thrown: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Request method failure captured: Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c HTTP/1.1 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDWw2sMRbto-Fsg2ruXo9axvcvDl1g5X_KUw_2oRvkzDdnYVj_jziQQnHBbDg-_MeqGjClGFKpIkL5faFHFgJe93lMCOswZgMo47uV_2rMIMiMhzjYNaQrUnyBbaJjYYbeGZ0eQqLkrAdptKQdQYu04sfHCRkhart2e8-hfDRqRLRhE Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1c1c1cb2518a4e5bb023f110f5a82d15 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c1c1cb2518a4e5bb023f110f5a82d15", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1c1c1cb2518a4e5bb023f110f5a82d15 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-DeleteServersTestJSON-1709856411-project Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: cb3a12e9c1ac4be9b7c2475ef694f77f Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-DeleteServersTestJSON-1709856411-project Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'fffe5036-4515-440d-ab9e-73ee4be43f9c'} Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:04:50.455337 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Returning 404 to user: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9fae5e7f-f567-4559-9d08-e2dc62c573e2 tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 404 len: 111 microversion: 2.1 time: 0.031664 Oct 28 20:04:50.459832 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3354/6710] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:04:50 2022] DELETE /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:04:50.465652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:04:50.466273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] [instance: fffe5036-4515-440d-ab9e-73ee4be43f9c] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:04:50.472448 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:50.472949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:50.473382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:50.474075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:04:50.474533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:04:50.474992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:04:50.488771 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] HTTP exception thrown: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Request method failure captured: Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c HTTP/1.1 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDWw2sMRbto-Fsg2ruXo9axvcvDl1g5X_KUw_2oRvkzDdnYVj_jziQQnHBbDg-_MeqGjClGFKpIkL5faFHFgJe93lMCOswZgMo47uV_2rMIMiMhzjYNaQrUnyBbaJjYYbeGZ0eQqLkrAdptKQdQYu04sfHCRkhart2e8-hfDRqRLRhE Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1c1c1cb2518a4e5bb023f110f5a82d15 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c1c1cb2518a4e5bb023f110f5a82d15", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c1c1cb2518a4e5bb023f110f5a82d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1c1c1cb2518a4e5bb023f110f5a82d15 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709856411 Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-DeleteServersTestJSON-1709856411-project Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: cb3a12e9c1ac4be9b7c2475ef694f77f Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-DeleteServersTestJSON-1709856411-project Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'fffe5036-4515-440d-ab9e-73ee4be43f9c'} Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:04:50.490220 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] Returning 404 to user: Instance fffe5036-4515-440d-ab9e-73ee4be43f9c could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c42f41bc-be19-44c4-874b-b9a0909a541c tempest-DeleteServersTestJSON-1709856411 tempest-DeleteServersTestJSON-1709856411-project] 10.222.0.44 "GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c" status: 404 len: 111 microversion: 2.1 time: 0.029965 Oct 28 20:04:50.494284 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3357/6711] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:04:50 2022] GET /compute/v2.1/servers/fffe5036-4515-440d-ab9e-73ee4be43f9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:00.253706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1289435708", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "7aad5b2f-38b6-4c87-8e34-996669532fe6"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:00.336949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] validate_networks() for [('7aad5b2f-38b6-4c87-8e34-996669532fe6', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:00.445335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=43 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:00.829299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:00.829672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:00.830286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:00.831090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:00.832277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:00.846589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:00.847128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:00.847572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:00.848450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:00.849049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:00.849488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:00.870035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Getting quotas for project 1f762e3e9b40424eb060105e18fd649f. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:00.877337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Getting quotas for user 8d66cc2a9a3546d2b482d9abc03ef274 and project 1f762e3e9b40424eb060105e18fd649f. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:00.893262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:00.895735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:00.953190 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-740c372b-0527-456f-b1dd-8de5f42dee57 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886276 Oct 28 20:05:00.954098 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3355/6712] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:00.970718 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40a60da1-f62c-4216-b46d-bf748aa081ec tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:00.971475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-40a60da1-f62c-4216-b46d-bf748aa081ec tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:00.975602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:00.976449 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:01.034425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40a60da1-f62c-4216-b46d-bf748aa081ec tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:01.043817 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40a60da1-f62c-4216-b46d-bf748aa081ec tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1218 microversion: 2.1 time: 0.078024 Oct 28 20:05:01.044598 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3358/6713] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:00 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:02.081143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:02.081780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:02.089591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:02.090092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:02.090533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:02.091322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:02.091763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:02.092196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:02.193716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:02.212418 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-90d054f6-4e7a-47f0-8b6b-5e8a11ad4911 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1270 microversion: 2.1 time: 0.135857 Oct 28 20:05:02.214379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3356/6714] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:02 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:03.249922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:03.251043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:03.268702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:03.270789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:03.272646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:03.277994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:03.280385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:03.280993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:03.978212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:04.001282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44b8bb10-1d8b-442a-a873-0f7705229c83 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.756506 Oct 28 20:05:04.003484 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3359/6715] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:03 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:04.718115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-dc3227ab-5c8f-45de-8275-2f5ae92303ac req-7e063783-764c-49c8-9a30-b201d493e7ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929a5396-e11f-4be3-9854-1ba86e3f3f13", "tag": "63060ba2-a482-4771-9877-c250db5a6389"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:04.739994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:04.764042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dc3227ab-5c8f-45de-8275-2f5ae92303ac req-7e063783-764c-49c8-9a30-b201d493e7ba service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:04.764924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dc3227ab-5c8f-45de-8275-2f5ae92303ac req-7e063783-764c-49c8-9a30-b201d493e7ba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:04.774032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-dc3227ab-5c8f-45de-8275-2f5ae92303ac req-7e063783-764c-49c8-9a30-b201d493e7ba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:04.802741 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-dc3227ab-5c8f-45de-8275-2f5ae92303ac req-7e063783-764c-49c8-9a30-b201d493e7ba service nova] Creating event network-changed:63060ba2-a482-4771-9877-c250db5a6389 for instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 on n-h1-862769-3 Oct 28 20:05:04.813966 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-dc3227ab-5c8f-45de-8275-2f5ae92303ac req-7e063783-764c-49c8-9a30-b201d493e7ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107853 Oct 28 20:05:04.815183 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3357/6716] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:05.026388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:05.027281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:05.035211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:05.036332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:05.037001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:05.037949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:05.038598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:05.039217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:05.292977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:05.303465 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f8a3d1ab-6cde-45fa-9f9a-e0b32262287e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.281141 Oct 28 20:05:05.304320 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3360/6717] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:05 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:06.328057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:06.329346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:06.337790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:06.338285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:06.339192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:06.339967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:06.340439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:06.340873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:06.596252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:06.605528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b4e4317b-450a-4c53-8efc-a4d38ebc4be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.282620 Oct 28 20:05:06.606147 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3358/6718] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:06 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:07.644584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:07.646063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:07.654345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:07.654965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:07.655424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:07.656207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:07.656892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:07.657378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:07.825768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:07.834585 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b286782-00ae-4251-9d95-155237d1288d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.194952 Oct 28 20:05:07.835230 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3361/6719] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:07 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:08.861846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:08.863197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:08.875044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:08.875735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:08.876372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:08.877668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:08.878558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:08.879071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:09.049921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:09.059326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ca322e9-b1c1-4482-95eb-d6f7bf740b95 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.204720 Oct 28 20:05:09.059949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3359/6720] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:08 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:10.087423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:10.088346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:10.098091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:10.098645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:10.099178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:10.100066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:10.100755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:10.101274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:10.263683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:10.273050 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c433269a-788f-4578-bdbb-c13b614ebc34 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.191785 Oct 28 20:05:10.273555 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3362/6721] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:10 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:10.896339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-751e00c0-e33c-4abb-91a4-5f94ce76b684 req-caeadc2a-28de-4028-bf9f-949a1c158eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929a5396-e11f-4be3-9854-1ba86e3f3f13", "name": "network-vif-plugged", "status": "completed", "tag": "63060ba2-a482-4771-9877-c250db5a6389"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:10.903867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:10.905208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:10.919588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-751e00c0-e33c-4abb-91a4-5f94ce76b684 req-caeadc2a-28de-4028-bf9f-949a1c158eba service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:10.920355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-751e00c0-e33c-4abb-91a4-5f94ce76b684 req-caeadc2a-28de-4028-bf9f-949a1c158eba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:10.921114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-751e00c0-e33c-4abb-91a4-5f94ce76b684 req-caeadc2a-28de-4028-bf9f-949a1c158eba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:10.935836 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-751e00c0-e33c-4abb-91a4-5f94ce76b684 req-caeadc2a-28de-4028-bf9f-949a1c158eba service nova] Creating event network-vif-plugged:63060ba2-a482-4771-9877-c250db5a6389 for instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 on n-h1-862769-3 Oct 28 20:05:10.942375 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-751e00c0-e33c-4abb-91a4-5f94ce76b684 req-caeadc2a-28de-4028-bf9f-949a1c158eba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049868 Oct 28 20:05:10.943331 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3360/6722] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:11.310121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:11.310884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:11.312843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:11.319341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:11.319847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:11.320293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:11.321026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:11.321492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:11.321928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:11.494331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:11.503243 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-361e8cfb-27aa-4547-85dd-3b2dcb4bddff tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1318 microversion: 2.1 time: 0.197088 Oct 28 20:05:11.503878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3363/6723] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:11 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:12.528029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:12.528608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:12.536040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:12.536533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:12.536963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:12.537672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:12.538126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:12.538546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:12.695077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:12.704338 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a25f23a-c8f8-4d48-8862-3ca43da8ca03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1508 microversion: 2.1 time: 0.181888 Oct 28 20:05:12.705044 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3361/6724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:12 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:12.746191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:12.747622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:12.759913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:12.760776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:12.761501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:12.762901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:12.763762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:12.764435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:12.933987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:12.942717 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-50d3713a-6325-4ddb-9bd5-968e36d84005 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1508 microversion: 2.1 time: 0.203475 Oct 28 20:05:12.943322 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3364/6725] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:12 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:12.969542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:12.973638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:12.982612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:12.983526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:12.984340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:12.985786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:12.986828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:12.987600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.067752 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7b441da-97ed-469e-a469-c8f78741681b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "PUT /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1080 microversion: 2.1 time: 0.105249 Oct 28 20:05:13.068661 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3362/6726] 10.222.0.44 () {60 vars in 1256 bytes} [Fri Oct 28 20:05:12 2022] PUT /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1080 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:13.088328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:13.088962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:13.095866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.096388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.096838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.097584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.098057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.098526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.256486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:13.266211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f9034863-7fa1-49ca-beec-6a5450468bed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1506 microversion: 2.1 time: 0.181618 Oct 28 20:05:13.267055 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3365/6727] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:13 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:13.290125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:13.290977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:13.297959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.298620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.299135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.299923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.300463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.300940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.447402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:13.460795 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-02db03c9-4f55-4156-9346-1ad762a0482a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1506 microversion: 2.1 time: 0.174786 Oct 28 20:05:13.461850 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3363/6728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:13 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:13.484190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:13.486617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:13.493455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.493958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.494403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.495151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.495610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.496037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.527176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:13.533898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Old instance type m1.heat2, new instance type m1.heat {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:05:13.541903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:13.542335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:13.542890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:13.543307 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:13.543705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:13.637532 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d2b4854d-bad1-4664-98be-40739d5a7c5c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13/action" status: 202 len: 0 microversion: 2.1 time: 0.157474 Oct 28 20:05:13.638043 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3366/6729] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:05:13 2022] POST /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:05:13.652026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:13.653892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:13.664057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.664813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.665355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.666498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:13.667137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:13.667674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:13.840126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:13.849656 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e14358bd-86ae-43bb-9f6d-528d9c6c9e6c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1517 microversion: 2.1 time: 0.205521 Oct 28 20:05:13.862737 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3364/6730] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:13 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:14.876441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:14.877237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:14.891178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:14.892032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:14.892767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:14.893953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:14.894711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:14.895444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:15.091994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:15.101298 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ab8873b7-d957-4716-86d1-5e486fae246c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1517 microversion: 2.1 time: 0.230210 Oct 28 20:05:15.102182 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3367/6731] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:14 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:16.125364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:16.126029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:16.134055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:16.134551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:16.135021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:16.135756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:16.136218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:16.136648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:16.281673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:16.292479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6c4461ae-6305-4969-a787-30ef092dc54d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.171243 Oct 28 20:05:16.293183 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3365/6732] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:16 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:17.319127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:17.320048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:17.327934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:17.328544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:17.329003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:17.329777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:17.330286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:17.330735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:17.474577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:17.482830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-baf89f0d-695b-4a8b-94a5-c812522cb868 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.170147 Oct 28 20:05:17.483336 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3368/6733] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:17 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:18.506456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:18.507042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:18.514592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:18.515129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:18.515568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:18.516286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:18.516748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:18.517175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:18.676583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:18.685522 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f2aba43-1e55-4224-bee0-f4553239843a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.183259 Oct 28 20:05:18.686239 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3366/6734] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:18 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:19.710042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:19.710714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:19.718240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:19.718766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:19.719216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:19.719970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:19.720437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:19.720872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:19.869413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:19.878964 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f49e7aff-f0b5-4884-9f69-0226972edb3a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.172857 Oct 28 20:05:19.879560 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3369/6735] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:19 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:20.902942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:20.903682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:20.911880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:20.912373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:20.912811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:20.913560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:20.914018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:20.914450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:21.132396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:21.140748 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4abab9ee-92e4-4f83-bbdf-f36a6815c4cb tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.242324 Oct 28 20:05:21.141344 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3367/6736] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:20 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:22.176184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:22.176908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:22.185144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:22.185640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:22.186115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:22.186853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:22.187283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:22.187765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:22.455812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:22.463899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1fe713ad-0b25-4c39-9d73-11ec4f84b7bf tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.292640 Oct 28 20:05:22.464361 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3370/6737] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:22 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:23.489159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:23.489889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:23.497430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:23.497930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:23.498363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:23.499126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:23.499582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:23.500004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:23.653517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:23.662594 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2fc8f292-21c6-4315-b123-e27b86127be8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.177748 Oct 28 20:05:23.663252 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3368/6738] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:23 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:24.685800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:24.686457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:24.694153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:24.694543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:24.695035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:24.695727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:24.696205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:24.696632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:24.877336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:24.887223 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-efe3ab50-2ef3-4d0b-bbd5-02ba4b9eff35 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.205096 Oct 28 20:05:24.888097 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3371/6739] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:24 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:25.913840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:25.914445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:25.921856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:25.922348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:25.922796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:25.923529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:25.924000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:25.924400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:26.162384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:26.171412 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d9f8998-5ec5-465f-b5c9-8fa4fd069f73 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.262096 Oct 28 20:05:26.171905 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3369/6740] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:25 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:27.195969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:27.196605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:27.204523 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:27.205034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:27.205482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:27.206284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:27.206773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:27.207210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:27.358755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:27.367714 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ba3c4c3e-c637-4e4a-829a-1aa740c9c96b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.176198 Oct 28 20:05:27.368355 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3372/6741] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:27 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:28.391191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:28.391967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:28.400104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:28.400635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:28.401078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:28.401860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:28.402342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:28.402804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:28.572129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:28.584377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-999781d4-a844-4271-a592-1089b57e3b42 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.197166 Oct 28 20:05:28.584985 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3370/6742] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:28 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:29.608014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:29.608654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:29.616985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:29.617473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:29.617914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:29.618641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:29.619145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:29.619582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:29.867072 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:29.876437 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8519f1f2-309a-493f-8a0b-eb8e8b4f9112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.272557 Oct 28 20:05:29.876969 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3373/6743] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:29 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:30.900830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:30.901491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:30.908936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:30.909469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:30.909911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:30.911194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:30.911881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:30.912458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:30.916394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:31.081391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:31.090296 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4dfc4d70-9d17-4306-996b-9f26729559b5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.193789 Oct 28 20:05:31.090964 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3371/6744] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:30 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:32.114891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:32.115669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:32.118266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=39 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:32.124011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:32.124512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:32.124953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:32.125665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:32.126121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:32.126552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:32.129457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:32.272421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:32.280746 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b28b73ee-7669-4598-a5ea-7c24ca282cd4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.170102 Oct 28 20:05:32.281318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3374/6745] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:32 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:33.304119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:33.304775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:33.312114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:33.312608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:33.313038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:33.313745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:33.314196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:33.314629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:33.465631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:33.475195 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-16df7071-f7dd-4909-9fd8-ff21a9cc07d4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.175261 Oct 28 20:05:33.475808 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3372/6746] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:33 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:34.499758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:34.500360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:34.510001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:34.510971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:34.511743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:34.513058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:34.513916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:34.514742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:34.670513 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:34.680155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-37d28098-5d51-4eed-9a78-9c60408c2244 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.184321 Oct 28 20:05:34.680820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3375/6747] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:34 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:35.704991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:35.705611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:35.708685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=32 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:35.714808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:35.715315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:35.715765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:35.716554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:35.717018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:35.717482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:35.870375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:35.883136 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51d03498-9473-4c9a-bcc8-e26fac57e605 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.182393 Oct 28 20:05:35.883901 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3373/6748] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:35 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:36.911351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:36.912007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:36.919236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:36.919737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:36.920176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:36.920879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:36.921340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:36.921764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:37.072461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:37.081348 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-672d0c99-4af8-4c4a-af02-ac2702b720e3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.174326 Oct 28 20:05:37.082059 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3376/6749] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:36 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:38.113821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:38.114719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:38.122172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:38.122669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:38.123136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:38.123849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:38.124383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:38.124719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:38.279945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:38.291142 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-34bcef7e-f7a2-402c-8418-5f509c90bfee tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.181577 Oct 28 20:05:38.291770 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3374/6750] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:38 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:39.318804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:39.319447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:39.327203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:39.327725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:39.328238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:39.328994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:39.329622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:39.330193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:39.472667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:39.481503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54f1c35b-21a4-4459-b228-b4eeb95262d7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.168151 Oct 28 20:05:39.482124 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3377/6751] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:39 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:40.507690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:40.508283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:40.516001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:40.516495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:40.516924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:40.517634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:40.518085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:40.518492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:40.670566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:40.679096 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1b552aba-8778-4d05-b3ef-41941bc3d370 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.175790 Oct 28 20:05:40.679646 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3375/6752] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:40 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:41.704528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:41.705175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:41.712804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:41.713304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:41.713748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:41.714558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:41.715082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:41.715601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:41.869397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:41.877653 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6bb06ab3-7bcc-4a24-b0ce-303c76deaa5f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.179590 Oct 28 20:05:41.878247 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3378/6753] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:41 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:42.902117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:42.902854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:42.911679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:42.912157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:42.912879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:42.913835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:42.914360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:42.914738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:43.071541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:43.079961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6fa8f848-775d-4502-8ece-fa3edbb2f85e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1522 microversion: 2.1 time: 0.182646 Oct 28 20:05:43.080544 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3376/6754] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:42 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:43.649109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929a5396-e11f-4be3-9854-1ba86e3f3f13", "name": "network-vif-unplugged", "status": "completed", "tag": "63060ba2-a482-4771-9877-c250db5a6389"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:43.659131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:43.659617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:43.660052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:43.676514 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] Creating event network-vif-unplugged:63060ba2-a482-4771-9877-c250db5a6389 for instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 on n-h2-862769-3 Oct 28 20:05:43.683439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:05:43.695831 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-04be6fd2-14b5-47a9-94fe-f5dfacf62825 req-3a4dd1b5-6b27-43aa-bbe2-89fc5bdd0154 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103336 Oct 28 20:05:43.696371 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3379/6755] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:05:44.108015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:44.108641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:44.115478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:44.115983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:44.116482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:44.117408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:44.117880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:44.118314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:44.269283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:44.279225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fbea47cd-e240-4923-9dde-1388f2ffdfac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1521 microversion: 2.1 time: 0.178400 Oct 28 20:05:44.279841 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3377/6756] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:44 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:45.308624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:45.309511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:45.318579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:45.319182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:45.319670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:45.320720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:45.321376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:45.321882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:45.470411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:45.478911 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6091a0b1-0a93-4a3a-9472-d6bcab3a0689 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1519 microversion: 2.1 time: 0.175242 Oct 28 20:05:45.479531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3380/6757] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:45 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:45.711793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929a5396-e11f-4be3-9854-1ba86e3f3f13", "tag": "63060ba2-a482-4771-9877-c250db5a6389"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:45.723874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:45.724340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:45.724841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:45.738667 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] Creating event network-changed:63060ba2-a482-4771-9877-c250db5a6389 for instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 on n-h2-862769-3 Oct 28 20:05:45.745283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:05:45.759075 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e1cf29a5-f75e-4c66-8941-0dd620def154 req-9b514d6a-1b37-4461-876a-eb53f41fae3f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050980 Oct 28 20:05:45.759880 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3378/6758] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:46.503207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:46.503872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:46.512264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.512903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.513349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.514141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.514605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.515136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.669892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:46.680225 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-095c5f98-a405-4f0f-90fa-042156d10518 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1516 microversion: 2.1 time: 0.180966 Oct 28 20:05:46.680749 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3381/6759] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:46 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:46.703813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:46.704448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:46.711575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.712080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.712652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.713211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.713672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.714104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.779918 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2eaea0fb-7d2d-47b6-9ab1-fb13f437e6e4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13/action" status: 204 len: 0 microversion: 2.1 time: 0.080337 Oct 28 20:05:46.780591 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3379/6760] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:05:46 2022] POST /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:05:46.790354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:46.791005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:46.797583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.798134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.798624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:46.799515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:46.799981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:46.800438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:47.023798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:47.032672 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44e6297a-c3e5-4551-926c-fade51cb6092 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1516 microversion: 2.1 time: 0.247473 Oct 28 20:05:47.033288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3382/6761] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:46 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1516 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:48.058273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:48.059096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:48.066597 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:48.067451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:48.068098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:48.069160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:48.069917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:48.070523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:48.212681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:48.223247 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c2e5e52a-8410-4410-b8d6-9ee304ef292f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1516 microversion: 2.1 time: 0.170215 Oct 28 20:05:48.223860 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3380/6762] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:48 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:49.247201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:49.247970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:49.255790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.256288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.256731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.257470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.257981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.258617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.405928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:49.414616 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f92fd139-6d5e-4b02-ad03-da7e90641dac tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1508 microversion: 2.1 time: 0.171912 Oct 28 20:05:49.415330 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3383/6763] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:49 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:49.439075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:49.439674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:49.447047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.447878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.447996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.448987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:49.449175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:49.449717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:49.588882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:49.597436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37e68d8f-c29d-4b4c-9613-0b06a2d1ef26 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1508 microversion: 2.1 time: 0.163059 Oct 28 20:05:49.598026 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3381/6764] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:49 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:49.623315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c4b23f2-dab3-44f0-96ae-e74e37d84f70 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'create', calling method: .version_select at 0x7f1d7689b160>, body: {"keypair": {"name": "tempest-keypair-1079631004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF98YDbX+wXmdEQD3LhNVBfzHTGrjJmzCuYCS+OPYmLEDSQJskWYWpn5KYOud37RAXwuXjNVdfMyqnWh8Ldwq/ZSR442HCD/6dVF+9PmWpJHDWWK+7a/C3rGSh5cfveKvw=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:49.640058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7c4b23f2-dab3-44f0-96ae-e74e37d84f70 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Getting quotas for project 1f762e3e9b40424eb060105e18fd649f. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:49.645791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7c4b23f2-dab3-44f0-96ae-e74e37d84f70 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Getting quotas for user 8d66cc2a9a3546d2b482d9abc03ef274 and project 1f762e3e9b40424eb060105e18fd649f. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:49.675884 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7c4b23f2-dab3-44f0-96ae-e74e37d84f70 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056239 Oct 28 20:05:49.676502 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3384/6765] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:05:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:50.976866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:50.977538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:50.985043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:50.985530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:50.985963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:50.986666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:50.987153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:50.987571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.039294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b70503fa-ab22-4582-963b-516ccd54c10d req-48f143a9-47ed-46b1-a06d-41d5986c1e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929a5396-e11f-4be3-9854-1ba86e3f3f13", "name": "network-vif-plugged", "status": "completed", "tag": "63060ba2-a482-4771-9877-c250db5a6389"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:51.051191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b70503fa-ab22-4582-963b-516ccd54c10d req-48f143a9-47ed-46b1-a06d-41d5986c1e95 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.051947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b70503fa-ab22-4582-963b-516ccd54c10d req-48f143a9-47ed-46b1-a06d-41d5986c1e95 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.052532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b70503fa-ab22-4582-963b-516ccd54c10d req-48f143a9-47ed-46b1-a06d-41d5986c1e95 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.071607 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b70503fa-ab22-4582-963b-516ccd54c10d req-48f143a9-47ed-46b1-a06d-41d5986c1e95 service nova] Creating event network-vif-plugged:63060ba2-a482-4771-9877-c250db5a6389 for instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 on n-h2-862769-3 Oct 28 20:05:51.077236 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b70503fa-ab22-4582-963b-516ccd54c10d req-48f143a9-47ed-46b1-a06d-41d5986c1e95 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043291 Oct 28 20:05:51.078357 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3385/6766] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:51.145341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:51.154577 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43c9b0dc-aa69-4b95-bc99-4aea19edea85 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 200 len: 1508 microversion: 2.1 time: 0.181775 Oct 28 20:05:51.155190 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3382/6767] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:50 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:51.191080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:51.191740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:51.198381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.198914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.199358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.200095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:51.200536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:51.200991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:51.227805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:05:51.316131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-30f941f2-2347-4a66-ba9e-3be67331b1a8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "DELETE /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 204 len: 0 microversion: 2.1 time: 0.129005 Oct 28 20:05:51.316815 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3386/6768] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:05:51 2022] DELETE /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:05:51.383220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-971137798", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "7aad5b2f-38b6-4c87-8e34-996669532fe6"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:51.440916 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] validate_networks() for [('7aad5b2f-38b6-4c87-8e34-996669532fe6', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:05:52.195423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:05:52.196036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:05:52.196434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:05:52.197191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:05:52.197958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:05:52.212700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.213593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.214387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.215716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:52.216511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:52.217332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:52.237488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Getting quotas for project 1f762e3e9b40424eb060105e18fd649f. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:05:52.243418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Getting quotas for user 8d66cc2a9a3546d2b482d9abc03ef274 and project 1f762e3e9b40424eb060105e18fd649f. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:05:52.257897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:05:52.260321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:05:52.310358 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b023003d-deea-410a-a8b5-aab443331fc9 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930951 Oct 28 20:05:52.311080 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3383/6769] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:05:52.323065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ec9c3aea-02cc-4f3c-a9e9-0351d5d7c2f1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:52.324517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ec9c3aea-02cc-4f3c-a9e9-0351d5d7c2f1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:52.386807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ec9c3aea-02cc-4f3c-a9e9-0351d5d7c2f1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:52.394510 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ec9c3aea-02cc-4f3c-a9e9-0351d5d7c2f1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1217 microversion: 2.1 time: 0.075869 Oct 28 20:05:52.400860 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3387/6770] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:52 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:53.091648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3c00b61a-442d-4ce7-a9e0-d722d3913385 req-fb6f29a6-01cb-4bf5-b190-1b34730b4374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929a5396-e11f-4be3-9854-1ba86e3f3f13", "name": "network-vif-deleted", "tag": "63060ba2-a482-4771-9877-c250db5a6389"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:53.104536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3c00b61a-442d-4ce7-a9e0-d722d3913385 req-fb6f29a6-01cb-4bf5-b190-1b34730b4374 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.105033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3c00b61a-442d-4ce7-a9e0-d722d3913385 req-fb6f29a6-01cb-4bf5-b190-1b34730b4374 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:53.105499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3c00b61a-442d-4ce7-a9e0-d722d3913385 req-fb6f29a6-01cb-4bf5-b190-1b34730b4374 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.117774 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3c00b61a-442d-4ce7-a9e0-d722d3913385 req-fb6f29a6-01cb-4bf5-b190-1b34730b4374 service nova] Creating event network-vif-deleted:63060ba2-a482-4771-9877-c250db5a6389 for instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 on n-h2-862769-3 Oct 28 20:05:53.123993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3c00b61a-442d-4ce7-a9e0-d722d3913385 req-fb6f29a6-01cb-4bf5-b190-1b34730b4374 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037621 Oct 28 20:05:53.124812 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3384/6771] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:53.418098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:53.419007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:53.427784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.428632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:53.429348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.430630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:53.431454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:53.432227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:53.514955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:53.525144 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-70300bd2-972c-4e96-83ae-3763840d48a2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1277 microversion: 2.1 time: 0.111173 Oct 28 20:05:53.525933 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3388/6772] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:53 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:54.550678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:54.551429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:54.559521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:54.560029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:54.560463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:54.561184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:54.561645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:54.562077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:54.713507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:54.723187 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dc48f53c-ef1f-4ed6-b657-ce6749871add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.176823 Oct 28 20:05:54.723802 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3385/6773] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:54 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:55.150144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f75834d4-4174-44f1-b89a-c5b814e963da req-8aaa6650-e211-4f94-a5c5-dcd4bb80c4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1658debf-eaca-4cea-963c-3853999dbf76", "tag": "474b6467-caf0-4796-b36b-2749e4358850"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:05:55.163715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f75834d4-4174-44f1-b89a-c5b814e963da req-8aaa6650-e211-4f94-a5c5-dcd4bb80c4fd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.164204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f75834d4-4174-44f1-b89a-c5b814e963da req-8aaa6650-e211-4f94-a5c5-dcd4bb80c4fd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.164639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f75834d4-4174-44f1-b89a-c5b814e963da req-8aaa6650-e211-4f94-a5c5-dcd4bb80c4fd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.177359 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f75834d4-4174-44f1-b89a-c5b814e963da req-8aaa6650-e211-4f94-a5c5-dcd4bb80c4fd service nova] Creating event network-changed:474b6467-caf0-4796-b36b-2749e4358850 for instance 1658debf-eaca-4cea-963c-3853999dbf76 on n-h2-862769-3 Oct 28 20:05:55.183337 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f75834d4-4174-44f1-b89a-c5b814e963da req-8aaa6650-e211-4f94-a5c5-dcd4bb80c4fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 Oct 28 20:05:55.184323 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3389/6774] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:05:55.747922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:55.748562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:55.756331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.756818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.757251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.757957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:55.758411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:55.758876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:55.912754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:55.921517 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ffe71809-a886-4fa4-a037-dc5a0593bf87 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.177887 Oct 28 20:05:55.922092 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3386/6775] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:55 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:56.946598 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:56.947357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:56.954104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.954599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.955055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:56.955793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:56.956248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:56.956683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:57.101150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:57.109567 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2b066f2b-76bb-4d0b-8058-b7f7bf395192 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.168085 Oct 28 20:05:57.110304 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3390/6776] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:56 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:58.137144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:58.137802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:58.147144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.147706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.148277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.149176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:58.149734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:58.150284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:58.293524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:58.301921 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ddceb73-93db-4a82-b5e1-0dfb5ba27d09 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.168805 Oct 28 20:05:58.302564 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3387/6777] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:58 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:05:59.325582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:05:59.326332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:05:59.333540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.334040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.334497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.335240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:05:59.335720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:05:59.336193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:05:59.479103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:05:59.487025 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-335f11ec-426a-4e69-aaf5-0c5fd8a51a23 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.165464 Oct 28 20:05:59.487604 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3391/6778] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:05:59 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:00.514013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:00.514583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:00.522236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.522725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.523179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.523876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:00.524326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:00.524736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:00.529276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:00.668159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:00.677775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28e2b9c6-4538-43b7-ac4f-ce55665f2e27 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.167929 Oct 28 20:06:00.678378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3388/6779] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:00 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:01.048740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-44775c92-bb6d-4fdd-8b7c-557b92a86015 req-d6ec0d4b-e1d6-467b-850a-59683e766bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1658debf-eaca-4cea-963c-3853999dbf76", "name": "network-vif-plugged", "status": "completed", "tag": "474b6467-caf0-4796-b36b-2749e4358850"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:01.067725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44775c92-bb6d-4fdd-8b7c-557b92a86015 req-d6ec0d4b-e1d6-467b-850a-59683e766bd9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.068426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44775c92-bb6d-4fdd-8b7c-557b92a86015 req-d6ec0d4b-e1d6-467b-850a-59683e766bd9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.068683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-44775c92-bb6d-4fdd-8b7c-557b92a86015 req-d6ec0d4b-e1d6-467b-850a-59683e766bd9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.082950 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-44775c92-bb6d-4fdd-8b7c-557b92a86015 req-d6ec0d4b-e1d6-467b-850a-59683e766bd9 service nova] Creating event network-vif-plugged:474b6467-caf0-4796-b36b-2749e4358850 for instance 1658debf-eaca-4cea-963c-3853999dbf76 on n-h2-862769-3 Oct 28 20:06:01.089469 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-44775c92-bb6d-4fdd-8b7c-557b92a86015 req-d6ec0d4b-e1d6-467b-850a-59683e766bd9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045032 Oct 28 20:06:01.090796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3392/6780] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:01.701675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:01.702580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:01.709867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.711231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.711662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.712438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:01.712898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:01.713374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:01.860624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:01.873162 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d61c736-9a68-437f-8f19-7f52f7a09add tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1317 microversion: 2.1 time: 0.175225 Oct 28 20:06:01.874103 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3389/6781] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:01 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:02.903993 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:02.904740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:02.908702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:02.909374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:02.918256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.918964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.919576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.920649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:02.921447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:02.921860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:02.925749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:03.080031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:03.092054 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f6d7fd8-ecd3-45e9-9a46-a9918c4769ce tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1507 microversion: 2.1 time: 0.193925 Oct 28 20:06:03.092822 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3393/6782] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:02 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:03.115208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:03.115831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:03.117749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:03.118455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:03.125681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.126168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.126605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.127353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.127796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.128262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.285535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:03.296415 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-187ed0b5-4cc2-4394-bede-d51163c2bccd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1507 microversion: 2.1 time: 0.185020 Oct 28 20:06:03.297170 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3390/6783] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:03 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:03.324096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:03.326402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:03.333602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.334094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.334532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.335259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.335717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.336144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.365978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:03.372485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Old instance type m1.heat2, new instance type m1.heat {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:06:03.380179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:06:03.380743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:06:03.381275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:06:03.381831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:06:03.382250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:06:03.452713 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d4074c8-7701-41d9-bdbf-31478262059a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76/action" status: 202 len: 0 microversion: 2.1 time: 0.132835 Oct 28 20:06:03.453637 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3394/6784] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:06:03 2022] POST /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:06:03.461887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:03.462500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:03.468794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.469285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.469715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.470475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:03.471163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:03.471587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:03.611440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:03.621034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-98f95326-a249-44ac-aa46-a3da50e4dfb4 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1514 microversion: 2.1 time: 0.163168 Oct 28 20:06:03.621623 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3391/6785] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:03 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:04.646459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:04.647270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:04.657888 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.658392 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.659518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.660562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:04.661030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:04.661467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:04.803149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:04.811959 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d0d75f4-9e9e-4017-889c-e612ae5c7337 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1514 microversion: 2.1 time: 0.171262 Oct 28 20:06:04.812559 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3395/6786] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:04 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:05.835617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:05.836228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:05.839390 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:06:05.839588 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:06:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 (ip 10.222.0.44) !!! Oct 28 20:06:05.840545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:05.848061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.848538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.848975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:05.849697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:05.850148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:05.850743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:06.004207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:06.016101 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a0e66a9f-d805-483b-9689-5cc8cd48f251 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.184151 Oct 28 20:06:06.016931 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3392/6787] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:05 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:07.040938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:07.041527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:07.049341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:07.049843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:07.050290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:07.051042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:07.051520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:07.051978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:07.188549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:07.196562 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c39dcc24-c5c9-4610-ae2e-16bf891a71f5 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.159652 Oct 28 20:06:07.197164 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3396/6788] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:07 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:08.221229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:08.221893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:08.229735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.230229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.230657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.231393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:08.231843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:08.232269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:08.376656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:08.384861 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2aa28911-1bb7-45aa-aee2-97b664bda86b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.167790 Oct 28 20:06:08.385420 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3393/6789] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:08 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:09.408187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:09.408760 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:09.416491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.416982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.417420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.418125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:09.418581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:09.419045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:09.556001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:09.567337 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2ecb8c01-1075-47a2-975b-64a27c7d04e7 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.163006 Oct 28 20:06:09.568049 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3397/6790] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:09 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:10.594115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:10.594844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:10.602580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.603131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.603563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.604270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:10.604711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:10.605170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:10.746017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:10.754797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6bcace6c-c93f-462a-8b76-7d5f9b178aba tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.164641 Oct 28 20:06:10.755415 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3394/6791] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:10 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:11.778928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:11.779554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:11.790327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.791169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.791705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.792424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:11.793121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:11.793799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:11.949954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:11.962303 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6b55f4d4-70ac-4b15-a339-1e5fac939a8b tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.188010 Oct 28 20:06:11.963369 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3398/6792] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:11 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:12.991676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:12.992287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:12.999704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.000512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.001037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.002432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:13.002974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:13.003410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:13.149188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:13.157668 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38ce7f5d-77e0-48a5-8051-548887d07c69 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.170071 Oct 28 20:06:13.158308 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3395/6793] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:12 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:14.183870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:14.184456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:14.192339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.192849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.193287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.193984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:14.194457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:14.194908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:14.337941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:14.347371 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e683a174-1e27-4859-95f1-16b24f9e56e0 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.167402 Oct 28 20:06:14.348115 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3399/6794] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:14 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:15.372865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:15.373500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:15.380882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.381375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.381955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.383180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:15.383741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:15.384461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:15.526101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:15.534472 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f97b4de0-780e-4092-9da1-14a724766481 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.165601 Oct 28 20:06:15.535487 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3396/6795] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:15 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:16.564562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:16.565394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:16.573065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.573566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.574010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.574745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:16.575211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:16.575666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:16.723160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:16.731770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-208124da-40cb-4a72-af6e-a4d96180970e tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.173440 Oct 28 20:06:16.732369 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3400/6796] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:16 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:06:17.755783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:17.756397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:17.764011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.764497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.764934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.765670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:17.766124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:17.766552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:17.916766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:17.928699 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ec0ad0a-b463-460a-9784-f613dc622e81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.176515 Oct 28 20:06:17.929365 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3397/6797] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:17 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:18.957917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:18.958574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:18.965520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.966019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.966464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:18.967209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:18.967679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:18.968173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:19.119171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:19.127336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-402c80bc-cf44-46ab-9ff2-58e2044882df tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.173758 Oct 28 20:06:19.127925 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3401/6798] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:18 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:20.152092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:20.152793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:20.160585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.161066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.161500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.162180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:20.162645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:20.163100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:20.316338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:20.324664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49e4956a-b58d-4471-b0fb-c4fe6d636f66 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.176758 Oct 28 20:06:20.325240 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3398/6799] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:20 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:21.348026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:21.348639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:21.356081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.356626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.357179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.358195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:21.358838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:21.359502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:21.504876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:21.513426 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7c9b13c-7c81-4c13-ba4d-7128006d1437 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.169366 Oct 28 20:06:21.514015 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3402/6800] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:21 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:22.539323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:22.539912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:22.547306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.547795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.548221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.548912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:22.549366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:22.549870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:22.693420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:22.701893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5e37c031-17e6-4def-b046-b02f5de567ed tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.167083 Oct 28 20:06:22.702481 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3399/6801] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:22 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:23.726051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:23.726676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:23.733672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.734167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.734605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.735334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:23.735792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:23.736219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:23.873574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:23.883088 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0bafdde6-e3e1-4ec1-9b2c-9b08bbdb4fa2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.161000 Oct 28 20:06:23.883618 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3403/6802] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:23 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:24.907635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:24.908261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:24.916252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.916757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.917163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:24.917881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:24.918373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:24.918837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:25.059498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:25.067716 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a2e48ba-c150-450f-91ca-0fa5b257fc6f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.164306 Oct 28 20:06:25.068312 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3400/6803] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:24 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:26.091035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:26.091792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:26.099172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:26.099661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:26.100099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:26.100810 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:26.101265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:26.101864 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:26.248702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:26.257019 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17992883-0fd4-461f-8a75-202e267ce895 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.170002 Oct 28 20:06:26.257590 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3404/6804] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:26 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:27.281203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:27.281950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:27.291059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.291594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.292132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.292836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:27.293284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:27.293706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:27.435613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:27.446115 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-640d3939-79a0-4ab5-bc2e-bca3a8913ec3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.168774 Oct 28 20:06:27.446744 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3401/6805] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:27 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:28.470980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:28.471733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:28.479907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.480342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.480786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.481683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:28.482232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:28.482731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:28.638549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:28.647646 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-760792bc-f7d5-4ea0-aaff-ecb2fde290d8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.180197 Oct 28 20:06:28.647646 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3405/6806] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:28 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:29.672328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:29.672952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:29.680730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.681224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.681653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.682372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:29.683066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:29.683402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:29.831641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:29.840732 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-22d9dbc1-3d35-4117-becf-4aec0c346112 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.172322 Oct 28 20:06:29.841327 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3402/6807] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:29 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:30.865404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:30.866522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:30.875075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:30.875582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:30.876024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:30.876746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:30.877209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:30.877645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:31.033382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:31.041782 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-254f67a6-6c2e-49a5-bd43-63a1c978e3fe tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.181078 Oct 28 20:06:31.042391 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3406/6808] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:30 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:32.065607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:32.066226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:32.075040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.075580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.076030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.076933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.077387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.078017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.084143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=89 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:32.253442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:32.264436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3ffb5ef2-81f0-48aa-8f4f-a7830ebf6130 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1519 microversion: 2.1 time: 0.202661 Oct 28 20:06:32.264984 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3403/6809] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:32 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:32.757785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1658debf-eaca-4cea-963c-3853999dbf76", "name": "network-vif-unplugged", "status": "completed", "tag": "474b6467-caf0-4796-b36b-2749e4358850"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:32.769852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:32.770355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:32.770828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:32.783874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] Creating event network-vif-unplugged:474b6467-caf0-4796-b36b-2749e4358850 for instance 1658debf-eaca-4cea-963c-3853999dbf76 on n-h1-862769-3 Oct 28 20:06:32.790496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] Instance 1658debf-eaca-4cea-963c-3853999dbf76 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:06:32.801821 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-65489b4c-de6d-4f56-ac3f-28ba0a5ef792 req-1ed27d6f-b30e-4e58-a1ac-0a12b36845b5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101538 Oct 28 20:06:32.802863 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3407/6810] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:33.296088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:33.297242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:33.308314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.309354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.309354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.310103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:33.310547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:33.311016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:33.529445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:33.538575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad533a03-1b89-4d85-bec9-fd036546447a tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1518 microversion: 2.1 time: 0.249674 Oct 28 20:06:33.539224 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3404/6811] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:33 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1518 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:34.563427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:34.563992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:34.566014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=34 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:34.571798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:34.572298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:34.572728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:34.573435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:34.573900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:34.574329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:34.577145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:34.817841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1658debf-eaca-4cea-963c-3853999dbf76", "tag": "474b6467-caf0-4796-b36b-2749e4358850"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:34.829019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:34.829500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:34.829938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:34.842895 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] Creating event network-changed:474b6467-caf0-4796-b36b-2749e4358850 for instance 1658debf-eaca-4cea-963c-3853999dbf76 on n-h1-862769-3 Oct 28 20:06:34.848907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] Instance 1658debf-eaca-4cea-963c-3853999dbf76 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:06:34.860232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-57917eb8-97c5-4f31-aa5e-5f4d4af5d221 req-60d69b1a-d364-42d1-b0c8-87d8e764d957 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046264 Oct 28 20:06:34.860838 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3405/6812] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:35.045317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:35.066343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f1d06db4-d914-485d-9383-991ca03991fd tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1516 microversion: 2.1 time: 0.508054 Oct 28 20:06:35.082795 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3408/6813] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:34 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1516 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:36.094944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:36.095642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:36.097586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=28 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:36.103204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.103683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.104134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.104830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.105279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.105692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.247968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:36.256120 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e64ce2e7-3ede-4328-8d5f-085b09755c7c tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1513 microversion: 2.1 time: 0.166776 Oct 28 20:06:36.256762 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3406/6814] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:36 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:36.279841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:36.280404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:36.288383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.288898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.289354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.290076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.290551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.291030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.353486 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6bfeca6f-0310-4727-8b94-37d42b68e9f8 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "POST /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76/action" status: 204 len: 0 microversion: 2.1 time: 0.077371 Oct 28 20:06:36.354016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3409/6815] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:06:36 2022] POST /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:06:36.362973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:36.363602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:36.370067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.370567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.371076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.371967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:36.372440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:36.372873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:36.515051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:36.532316 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d899d7a-acbb-4c82-af7f-ed73619aa221 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1513 microversion: 2.1 time: 0.173575 Oct 28 20:06:36.533412 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3407/6816] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:36 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:37.557344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:37.558063 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:37.564887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.565274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.565720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.566435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.566976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.567527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.723987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:37.733060 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef332b94-fae0-4d5a-bc72-08074ee301e2 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1505 microversion: 2.1 time: 0.180700 Oct 28 20:06:37.733899 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3410/6817] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:37 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:37.757657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:37.758316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:37.765388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.765885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.766327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.767065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.767532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.767962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.917362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:37.925744 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca4e3564-aa17-49dd-b440-f6d5140d015d tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1505 microversion: 2.1 time: 0.172199 Oct 28 20:06:37.926325 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3408/6818] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:37 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:37.948118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:37.948743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:37.955183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.955682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.956128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:37.956835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:37.957297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:37.957723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.096823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:38.105013 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e45364fb-10c3-4d1e-adc7-873cf95dd075 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1505 microversion: 2.1 time: 0.160796 Oct 28 20:06:38.105614 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3411/6819] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:37 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:38.130209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:38.130906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:38.139339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.139829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.140264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.140954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.141406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.141834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.170303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:06:38.252991 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efdff217-0adf-4f04-882a-7e08137fd850 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 204 len: 0 microversion: 2.1 time: 0.128727 Oct 28 20:06:38.253705 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3409/6820] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:06:38 2022] DELETE /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:06:38.268565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:38.269076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:38.275489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.275969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.276411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.277122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.277681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.278136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.303387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:06:38.347774 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.compute.api [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Instance is already in deleting state, ignoring this request Oct 28 20:06:38.348612 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a4256079-acb6-4ffd-91ef-ca9a3c0cf40f tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 204 len: 0 microversion: 2.1 time: 0.084206 Oct 28 20:06:38.349172 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3412/6821] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:06:38 2022] DELETE /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 20:06:38.358598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:38.359329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:38.367871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.368356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.368791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.369971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:38.370438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:38.370904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:38.523471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:38.532092 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cbd8b5bd-b216-4faa-b827-7f3b4734b070 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1511 microversion: 2.1 time: 0.177802 Oct 28 20:06:38.532672 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3410/6822] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:38 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:39.495429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-d2bf18b3-e1e9-488b-a06c-e63e15724821 req-41990da5-8db7-49ad-a790-3b8694ab8912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1658debf-eaca-4cea-963c-3853999dbf76", "name": "network-vif-plugged", "status": "completed", "tag": "474b6467-caf0-4796-b36b-2749e4358850"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:39.507252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d2bf18b3-e1e9-488b-a06c-e63e15724821 req-41990da5-8db7-49ad-a790-3b8694ab8912 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.507847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d2bf18b3-e1e9-488b-a06c-e63e15724821 req-41990da5-8db7-49ad-a790-3b8694ab8912 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.508361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-d2bf18b3-e1e9-488b-a06c-e63e15724821 req-41990da5-8db7-49ad-a790-3b8694ab8912 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.520167 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-d2bf18b3-e1e9-488b-a06c-e63e15724821 req-41990da5-8db7-49ad-a790-3b8694ab8912 service nova] Creating event network-vif-plugged:474b6467-caf0-4796-b36b-2749e4358850 for instance 1658debf-eaca-4cea-963c-3853999dbf76 on n-h1-862769-3 Oct 28 20:06:39.525471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-d2bf18b3-e1e9-488b-a06c-e63e15724821 req-41990da5-8db7-49ad-a790-3b8694ab8912 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102381 Oct 28 20:06:39.526223 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3413/6823] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:39.563403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:39.564019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:39.571845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.572330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.572756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.573518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:39.573939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:39.574429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:39.754807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66cc2a9a3546d2b482d9abc03ef274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f762e3e9b40424eb060105e18fd649f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:39.763449 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f518c16-d041-4129-9f92-80b9f2efaf03 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 200 len: 1511 microversion: 2.1 time: 0.204148 Oct 28 20:06:39.764045 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3411/6824] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:39 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:40.218394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-8366a6b7-b552-4fd1-8419-dbca254b1347 req-7a055751-56ae-4b4b-97eb-d65eebee0104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1658debf-eaca-4cea-963c-3853999dbf76", "name": "network-vif-deleted", "tag": "474b6467-caf0-4796-b36b-2749e4358850"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:40.229742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8366a6b7-b552-4fd1-8419-dbca254b1347 req-7a055751-56ae-4b4b-97eb-d65eebee0104 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.230237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8366a6b7-b552-4fd1-8419-dbca254b1347 req-7a055751-56ae-4b4b-97eb-d65eebee0104 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.231106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8366a6b7-b552-4fd1-8419-dbca254b1347 req-7a055751-56ae-4b4b-97eb-d65eebee0104 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.244508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-8366a6b7-b552-4fd1-8419-dbca254b1347 req-7a055751-56ae-4b4b-97eb-d65eebee0104 service nova] Creating event network-vif-deleted:474b6467-caf0-4796-b36b-2749e4358850 for instance 1658debf-eaca-4cea-963c-3853999dbf76 on n-h1-862769-3 Oct 28 20:06:40.249361 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-8366a6b7-b552-4fd1-8419-dbca254b1347 req-7a055751-56ae-4b4b-97eb-d65eebee0104 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Oct 28 20:06:40.249967 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3414/6825] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:40.787867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:40.788437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 1658debf-eaca-4cea-963c-3853999dbf76] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:40.796160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.796651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.797089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.797790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:40.798243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:40.798668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:40.813427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] HTTP exception thrown: Instance 1658debf-eaca-4cea-963c-3853999dbf76 could not be found. Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Request method failure captured: Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 HTTP/1.1 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDXrxJ3TRjGN6PFDw0odm5jJ2rT1MWJ8OvifgEL-qFp7daksZ2qqj168S3F5WxgOrK9r9-VEbarxflrjnkZUHDbvX6qd6n6jCyVxIfvsWW738lJcpwHrQVj_aeiWdVF9pMRmX_aUD_QFSpjbwq6TYLLqhH5LJ7rX5hyrJG2_kRPJ7Rw Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1f762e3e9b40424eb060105e18fd649f Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f762e3e9b40424eb060105e18fd649f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1f762e3e9b40424eb060105e18fd649f Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerDiskConfigTestJSON-1630058487-project Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8d66cc2a9a3546d2b482d9abc03ef274 Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerDiskConfigTestJSON-1630058487-project Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 1658debf-eaca-4cea-963c-3853999dbf76 could not be found. Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '1658debf-eaca-4cea-963c-3853999dbf76'} Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1658debf-eaca-4cea-963c-3853999dbf76 could not be found. Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1658debf-eaca-4cea-963c-3853999dbf76 could not be found. Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:40.815189 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1658debf-eaca-4cea-963c-3853999dbf76 could not be found. Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Returning 404 to user: Instance 1658debf-eaca-4cea-963c-3853999dbf76 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7d9a0bc5-3144-49f2-b887-cb3ba44f1b81 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76" status: 404 len: 111 microversion: 2.1 time: 0.033151 Oct 28 20:06:40.822268 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3412/6826] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:40 2022] GET /compute/v2.1/servers/1658debf-eaca-4cea-963c-3853999dbf76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:40.834648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2cf9e503-845f-45b6-a9b9-0b0735ca41a1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '.version_select at 0x7f1d7c21f9d0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:40.864820 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2cf9e503-845f-45b6-a9b9-0b0735ca41a1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079631004" status: 202 len: 0 microversion: 2.1 time: 0.040786 Oct 28 20:06:40.865361 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3415/6827] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 20:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079631004 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:06:41.519901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:41.520648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:41.529407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:41.529902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:41.530405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:41.531078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:41.531538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:41.531964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:41.546251 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] HTTP exception thrown: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Request method failure captured: Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 HTTP/1.1 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDXrxJ3TRjGN6PFDw0odm5jJ2rT1MWJ8OvifgEL-qFp7daksZ2qqj168S3F5WxgOrK9r9-VEbarxflrjnkZUHDbvX6qd6n6jCyVxIfvsWW738lJcpwHrQVj_aeiWdVF9pMRmX_aUD_QFSpjbwq6TYLLqhH5LJ7rX5hyrJG2_kRPJ7Rw Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 1f762e3e9b40424eb060105e18fd649f Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f762e3e9b40424eb060105e18fd649f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 1f762e3e9b40424eb060105e18fd649f Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerDiskConfigTestJSON-1630058487-project Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 8d66cc2a9a3546d2b482d9abc03ef274 Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerDiskConfigTestJSON-1630058487-project Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '929a5396-e11f-4be3-9854-1ba86e3f3f13'} Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:41.547875 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Returning 404 to user: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-66342ccc-ff78-4f5c-98bf-021c2b83fbe3 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "DELETE /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 404 len: 111 microversion: 2.1 time: 0.036079 Oct 28 20:06:41.552352 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3413/6828] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:06:41 2022] DELETE /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:41.558396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:41.559341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] [instance: 929a5396-e11f-4be3-9854-1ba86e3f3f13] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:41.568770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:41.569267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:41.569705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:41.570409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:41.570920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:41.571482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:41.585339 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] HTTP exception thrown: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Request method failure captured: Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 HTTP/1.1 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDXrxJ3TRjGN6PFDw0odm5jJ2rT1MWJ8OvifgEL-qFp7daksZ2qqj168S3F5WxgOrK9r9-VEbarxflrjnkZUHDbvX6qd6n6jCyVxIfvsWW738lJcpwHrQVj_aeiWdVF9pMRmX_aUD_QFSpjbwq6TYLLqhH5LJ7rX5hyrJG2_kRPJ7Rw Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 1f762e3e9b40424eb060105e18fd649f Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f762e3e9b40424eb060105e18fd649f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f762e3e9b40424eb060105e18fd649f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 1f762e3e9b40424eb060105e18fd649f Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1630058487 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerDiskConfigTestJSON-1630058487-project Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 8d66cc2a9a3546d2b482d9abc03ef274 Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerDiskConfigTestJSON-1630058487-project Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '929a5396-e11f-4be3-9854-1ba86e3f3f13'} Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:06:41.587053 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] Returning 404 to user: Instance 929a5396-e11f-4be3-9854-1ba86e3f3f13 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4327731-9465-48b0-84b0-6eb0bd6fedf1 tempest-ServerDiskConfigTestJSON-1630058487 tempest-ServerDiskConfigTestJSON-1630058487-project] 10.222.0.44 "GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13" status: 404 len: 111 microversion: 2.1 time: 0.034205 Oct 28 20:06:41.591351 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3416/6829] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:41 2022] GET /compute/v2.1/servers/929a5396-e11f-4be3-9854-1ba86e3f3f13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:06:50.486630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e82224c-9b55-4441-b62c-67aac1327c68 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'create', calling method: .version_select at 0x7f1d778a0550>, body: {"keypair": {"name": "tempest-keypair-1391233376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9AgX2SJ8zQHJS0VJPTd1HjKbPbpsI5i+Z+NhUXlpGcNhM92rHVYUvUqEZFk3FpyUkw3Sqb7Yl4Av6lZrdACQbRK96AP4DhcDNaxsajPL23kJxQHkQXjtrTgOe9K1E6bw=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:50.506444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9e82224c-9b55-4441-b62c-67aac1327c68 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:06:50.512077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9e82224c-9b55-4441-b62c-67aac1327c68 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:06:50.543450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e82224c-9b55-4441-b62c-67aac1327c68 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175204 Oct 28 20:06:50.544045 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3414/6830] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:06:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:06:51.863673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2060188558", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfac833c-73c2-47c5-98d7-9281b6657401"}], "security_groups": [{"name": "tempest-securitygroup--1752382464"}], "key_name": "tempest-keypair-1391233376", "user_data": "}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:51.873047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:51.873733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:51.982422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] validate_networks() for [('bfac833c-73c2-47c5-98d7-9281b6657401', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:06:52.454316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:06:52.454944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:06:52.455482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:06:52.455953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:06:52.456596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:06:52.469341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:52.469853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:52.470299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:52.471124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:52.471574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:52.472004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:52.492753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:06:52.498158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:06:52.510775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:06:52.513264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:06:52.560421 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a5d330a8-3ec0-4e5c-a932-bfcaa4152de0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.701462 Oct 28 20:06:52.567145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3417/6831] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:06:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:06:52.570327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:52.575368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-82255571-24fc-4df9-b8b2-182ee9dfdd87 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:52.575996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-82255571-24fc-4df9-b8b2-182ee9dfdd87 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:52.656476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-82255571-24fc-4df9-b8b2-182ee9dfdd87 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:52.667106 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-82255571-24fc-4df9-b8b2-182ee9dfdd87 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1239 microversion: 2.1 time: 0.098335 Oct 28 20:06:52.668215 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3415/6832] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:52 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:53.693414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:53.694343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:53.701871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:53.702344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:53.703046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:53.703769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:53.704268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:53.704717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:53.783865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:53.793206 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7e5d213-a7e9-4261-8963-50f03a3e4a34 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1291 microversion: 2.1 time: 0.104870 Oct 28 20:06:53.806786 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3418/6833] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:53 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1291 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:54.816812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:54.817414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:54.824818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:54.825560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:54.826000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:54.826738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:54.827204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:54.827632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:55.041684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:55.051451 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd7bad7d-6e1d-42a8-aba4-0be7cb9a8cec tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1365 microversion: 2.1 time: 0.238541 Oct 28 20:06:55.052041 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3416/6834] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:54 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:55.366498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-35c72468-9755-44d1-b8d1-07dcc2225afa req-9d556cd3-f36b-45db-bd75-4bfda32ee595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:55.380265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-35c72468-9755-44d1-b8d1-07dcc2225afa req-9d556cd3-f36b-45db-bd75-4bfda32ee595 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:55.380753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-35c72468-9755-44d1-b8d1-07dcc2225afa req-9d556cd3-f36b-45db-bd75-4bfda32ee595 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:55.381170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-35c72468-9755-44d1-b8d1-07dcc2225afa req-9d556cd3-f36b-45db-bd75-4bfda32ee595 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:55.393374 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-35c72468-9755-44d1-b8d1-07dcc2225afa req-9d556cd3-f36b-45db-bd75-4bfda32ee595 service nova] Creating event network-changed:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h1-862769-3 Oct 28 20:06:55.398750 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-35c72468-9755-44d1-b8d1-07dcc2225afa req-9d556cd3-f36b-45db-bd75-4bfda32ee595 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035998 Oct 28 20:06:55.399367 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3419/6835] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:56.076516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:56.077144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:56.084654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:56.085137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:56.085570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:56.086271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:56.086728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:56.087239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:56.219855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:56.228273 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-90777f9e-8c94-4489-a0f8-69d8b1d4c366 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1365 microversion: 2.1 time: 0.155839 Oct 28 20:06:56.228841 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3417/6836] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:56 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:57.255906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:57.256704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:57.263524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:57.264481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:57.264481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:57.265265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:57.265739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:57.266175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:57.420564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:57.428558 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93aafa1f-ba22-40f2-accd-24d97feb3ba7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1365 microversion: 2.1 time: 0.178944 Oct 28 20:06:57.432518 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3420/6837] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:57 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:58.451851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:58.452697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:58.460987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.461520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.461957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.462671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:58.463165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:58.463589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:58.616397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:58.624959 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7311800-0266-4405-ab94-17565bfe6ff7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1365 microversion: 2.1 time: 0.177866 Oct 28 20:06:58.625573 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3418/6838] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:58 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:06:59.525524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4e19ad93-49eb-45c5-a882-d8395957c6c3 req-ac516f3b-b96d-4251-b60c-4e51450976dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "name": "network-vif-plugged", "status": "completed", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:06:59.537421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e19ad93-49eb-45c5-a882-d8395957c6c3 req-ac516f3b-b96d-4251-b60c-4e51450976dc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.538148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e19ad93-49eb-45c5-a882-d8395957c6c3 req-ac516f3b-b96d-4251-b60c-4e51450976dc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.538633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e19ad93-49eb-45c5-a882-d8395957c6c3 req-ac516f3b-b96d-4251-b60c-4e51450976dc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.552209 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4e19ad93-49eb-45c5-a882-d8395957c6c3 req-ac516f3b-b96d-4251-b60c-4e51450976dc service nova] Creating event network-vif-plugged:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h1-862769-3 Oct 28 20:06:59.557282 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4e19ad93-49eb-45c5-a882-d8395957c6c3 req-ac516f3b-b96d-4251-b60c-4e51450976dc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035764 Oct 28 20:06:59.557898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3421/6839] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:06:59.649472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:06:59.650197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:06:59.660912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.661535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.662063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.662996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:06:59.663614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:06:59.664061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:06:59.824352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:06:59.832951 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7b29be11-a93a-48c4-be49-0148731ec12d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1365 microversion: 2.1 time: 0.187931 Oct 28 20:06:59.833568 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3419/6840] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:06:59 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:00.858371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:00.859130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:00.866060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:00.866570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:00.867083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:00.867812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:00.868318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:00.868733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:01.021459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:01.030418 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-afaf32e4-7eec-448b-955b-e0dcab93821d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1365 microversion: 2.1 time: 0.177457 Oct 28 20:07:01.031299 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3422/6841] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:00 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:02.057757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:02.058442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:02.069591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.070348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.071104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.072114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.072746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.073349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.588972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:02.597751 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b1ece5e2-e044-4a30-9b83-b9b452aacef2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1551 microversion: 2.1 time: 0.546256 Oct 28 20:07:02.598359 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3420/6842] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:02 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1551 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:02.622070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:02.622676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:02.625727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:02.626581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:02.633493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.634044 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.634488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.635245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:02.635711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:02.636215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:02.759798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7e6987fb-bbc0-4ffb-9b5a-c89b754ff1b6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142025 Oct 28 20:07:02.761302 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3423/6843] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:07:02 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:03.732476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3006231e-5067-48db-af34-7e341342323c req-314a38e8-3ec2-4125-89c5-8eb8dfee17d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:03.737766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:03.744663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3006231e-5067-48db-af34-7e341342323c req-314a38e8-3ec2-4125-89c5-8eb8dfee17d7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:03.745182 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3006231e-5067-48db-af34-7e341342323c req-314a38e8-3ec2-4125-89c5-8eb8dfee17d7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:03.745982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3006231e-5067-48db-af34-7e341342323c req-314a38e8-3ec2-4125-89c5-8eb8dfee17d7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:03.757687 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3006231e-5067-48db-af34-7e341342323c req-314a38e8-3ec2-4125-89c5-8eb8dfee17d7 service nova] Creating event network-changed:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h1-862769-3 Oct 28 20:07:03.764502 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3006231e-5067-48db-af34-7e341342323c req-314a38e8-3ec2-4125-89c5-8eb8dfee17d7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 Oct 28 20:07:03.769486 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3421/6844] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:07:39.799893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:39.800829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=28 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:39.806364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:39.807008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:39.814793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:39.815294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:39.815738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:39.816440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:39.816903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:39.817333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:39.972412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:39.983376 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-64c99740-a435-4ffd-ae7e-7d041682ab08 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1670 microversion: 2.1 time: 0.185526 Oct 28 20:07:39.984284 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3424/6845] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:39 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:40.007871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:40.008686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=32 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:40.013061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:40.013798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:40.025399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.025887 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.026318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.027054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.027505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.027922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.176530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:40.186293 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-25846b30-02fb-4233-8986-420049e555ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1670 microversion: 2.1 time: 0.180556 Oct 28 20:07:40.186925 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3422/6846] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:40 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:40.211354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:40.212281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:40.224970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.225376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.225859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.226572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.227052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.227708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.377692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:40.387922 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-829bb96d-e885-42c3-8890-85e9d65c3756 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1670 microversion: 2.1 time: 0.182800 Oct 28 20:07:40.388500 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3425/6847] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:40 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1670 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:40.410945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:07:40.413327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:40.422752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.423229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.423662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.424368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.424822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.425244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.454093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:40.460220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Old instance type m1.heat2, new instance type m1.heat {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:07:40.467558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:07:40.467981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:07:40.468480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:07:40.468867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:07:40.469260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:07:40.545295 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de25d573-b2f5-480a-857e-c9b3aec2da40 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97/action" status: 202 len: 0 microversion: 2.1 time: 0.138634 Oct 28 20:07:40.545956 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3423/6848] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:07:40 2022] POST /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:07:40.554459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:40.555130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:40.562269 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.563131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.563382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.564247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:40.564628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:40.565067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:40.714293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:40.722559 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-93ef6bc8-6b3d-4612-a65d-0b6ebd773384 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1679 microversion: 2.1 time: 0.172059 Oct 28 20:07:40.723285 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3426/6849] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:40 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:41.747910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:41.748581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:41.758346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:41.758947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:41.759298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:41.760009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:41.760613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:41.760959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:41.900051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:41.911691 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0d03575-8ee7-42a9-834d-b92389d44889 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1679 microversion: 2.1 time: 0.169479 Oct 28 20:07:41.912326 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3424/6850] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:41 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:42.936908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:42.937538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:42.945326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:42.945865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:42.946358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:42.947179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:42.947699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:42.948165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:43.100546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:43.109244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fc1463a-f4a2-4109-a0d9-64c53d04e2dc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.177147 Oct 28 20:07:43.109856 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3427/6851] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:42 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:44.136705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:44.137329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:44.144726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:44.145222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:44.145661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:44.146367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:44.146851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:44.147292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:44.286132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:44.294478 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf0c4972-201b-440e-82ba-4bdef191aec9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.163688 Oct 28 20:07:44.294997 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3425/6852] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:44 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:45.322747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:45.323457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:45.334147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:45.334636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:45.335109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:45.335839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:45.336305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:45.336738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:45.481352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:45.490289 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2e1997b6-c04f-4be9-92e5-49fac4cdb259 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.171489 Oct 28 20:07:45.490819 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3428/6853] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:45 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:46.520305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:46.520913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:46.529028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.529531 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.529973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.530722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:46.531230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:46.531664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:46.695856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:46.704148 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7059ccd-8ba2-449f-b5fd-a334a80acca2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.188079 Oct 28 20:07:46.704731 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3426/6854] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:46 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:47.730880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:47.731470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:47.738719 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:47.739220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:47.739670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:47.740376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:47.740843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:47.741277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:47.879131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:47.887563 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cee2d370-6359-4fb5-a6d3-916c39e14403 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.162562 Oct 28 20:07:47.888124 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3429/6855] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:47 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:48.911860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:48.912481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:48.919241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.919732 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.920171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:48.920870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:48.921329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:48.921776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:49.066964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:49.075632 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2936cbf6-6d6b-4b88-aa36-d8f39acc6396 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.168275 Oct 28 20:07:49.076249 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3427/6856] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:48 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:50.100101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:50.100723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:50.108705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:50.109210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:50.109661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:50.110375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:50.110885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:50.111328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:50.261779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:50.273677 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-647d9821-15f8-49d3-9e5a-f8fd300c30c7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.177470 Oct 28 20:07:50.274568 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3430/6857] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:50 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:51.298025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:51.298640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:51.306382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:51.306900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:51.307359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:51.308074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:51.308526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:51.308945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:51.467969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:51.476826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f94dcfa3-42f9-46f1-9a49-49ab09a5aa07 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.182710 Oct 28 20:07:51.477587 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3428/6858] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:51 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:52.500845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:52.501457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:52.508799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:52.509312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:52.509743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:52.510509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:52.511019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:52.511457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:52.656842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:52.665592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3fafe681-61bb-4e72-b2ae-a6ab8c25f0be tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.168968 Oct 28 20:07:52.666189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3431/6859] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:52 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:53.689906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:53.690523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:53.699829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:53.700405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:53.700878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:53.701719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:53.702309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:53.702825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:53.851198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:53.859822 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-520dba02-e564-40a5-8f2c-984da7890d49 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.174274 Oct 28 20:07:53.860423 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3429/6860] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:53 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:54.884334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:54.885053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:54.892977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.893489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.893941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:54.894675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:54.895191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:54.895626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:55.043801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:55.052818 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cca7cc5c-d175-4859-bb40-81ae47c7ffb3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.172499 Oct 28 20:07:55.053456 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3432/6861] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:54 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:56.077276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:56.077880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:56.087660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.088152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.088586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.089286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:56.089739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:56.090160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:56.230642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:56.239766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8e1e961-0390-45a2-bbf4-96c689e2af7c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.166472 Oct 28 20:07:56.240375 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3430/6862] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:56 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:57.265909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:57.266520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:57.274395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.275084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.275702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.276588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:57.277080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:57.277596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:57.429708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:57.444729 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed1c8479-eaee-49b8-b7fa-5abafb686912 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.182294 Oct 28 20:07:57.445823 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3433/6863] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:57 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:58.469429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:58.470057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:58.477625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:58.478115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:58.478552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:58.479295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:58.479856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:58.480232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:58.619435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:58.628820 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4789fbc5-c3a4-4cc5-9de9-eaad8e1b72db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.163346 Oct 28 20:07:58.629438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3431/6864] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:58 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:07:59.653529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:07:59.654243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:07:59.663071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:59.663514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:59.664167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:59.665105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:07:59.665657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:07:59.666206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:07:59.872548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:07:59.881699 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-988aa0d9-b56c-4f8d-9613-e0e27cb6e2f0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1684 microversion: 2.1 time: 0.232830 Oct 28 20:07:59.882306 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3434/6865] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:07:59 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:00.485891 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "name": "network-vif-unplugged", "status": "completed", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:00.497100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:00.497581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:00.498010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:00.514425 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] Creating event network-vif-unplugged:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h2-862769-3 Oct 28 20:08:00.520941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] Instance c91bb475-32be-43cb-b676-096fa6fb2d97 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:08:00.532650 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-112fde11-9c25-466e-a91c-433f5de28000 req-d922db15-77b1-4004-8b14-fbf41f51ec14 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050758 Oct 28 20:08:00.533481 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3432/6866] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:00.907065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:00.907700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:00.915298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:00.915814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:00.916271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:00.917008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:00.917486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:00.917927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:01.059724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:01.068331 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd54308d-5e77-4def-bd5c-bf2938b18535 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1683 microversion: 2.1 time: 0.165650 Oct 28 20:08:01.068927 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3435/6867] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:00 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:02.094081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:02.094792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:02.101912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.102408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.102893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.103610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.104144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.104582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.246221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:02.254975 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4a25a51a-3b50-4d63-99c7-3815061139f3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1681 microversion: 2.1 time: 0.166226 Oct 28 20:08:02.255565 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3433/6868] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:02 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:02.548750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:02.562630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:02.563151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:02.563601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:02.576058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] Creating event network-changed:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h2-862769-3 Oct 28 20:08:02.581909 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] Instance c91bb475-32be-43cb-b676-096fa6fb2d97 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:08:02.593154 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-174a39ed-dffb-4f1f-8bbc-dc3d6a4760c3 req-b934bbf2-42ec-413c-a1ff-9959ac779d17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048290 Oct 28 20:08:02.593777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3436/6869] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:03.280471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:03.281023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:03.288438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.288920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.289357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.290070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.290515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.290971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.441831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.451102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-880cb281-f42b-48ba-bbd5-b5d547c85460 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1678 microversion: 2.1 time: 0.175816 Oct 28 20:08:03.452168 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3434/6870] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:03 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:03.475823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:03.476462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:03.483106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.483612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.484057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.484776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.485244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.485678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.550959 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dc59dbba-eee1-4d70-8d79-03cbe391b4b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97/action" status: 204 len: 0 microversion: 2.1 time: 0.079118 Oct 28 20:08:03.552117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3437/6871] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:08:03 2022] POST /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:08:03.561726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:03.562481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:03.569880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.570555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.571207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.572177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:03.572801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:03.573280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:03.812094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:03.820353 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d537e1de-f889-4bbc-b5f8-ab894ea5d365 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1678 microversion: 2.1 time: 0.263907 Oct 28 20:08:03.820929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3435/6872] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:03 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1678 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:04.845887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:04.846648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:04.854292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.854831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.855280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.856059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:04.856538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:04.856971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:04.999433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:05.007516 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-72837db6-36b4-40a8-ba57-7d5a31ba5798 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1678 microversion: 2.1 time: 0.166136 Oct 28 20:08:05.008080 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3438/6873] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:04 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:06.032705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.033331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.041130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.041619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.042060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.042798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.043253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.043689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.199314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.211652 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee3463ac-8549-4276-94e8-80e25deb3e84 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1670 microversion: 2.1 time: 0.183094 Oct 28 20:08:06.212568 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3436/6874] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1670 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:06.237788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.238492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.248276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.248780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.249236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.249949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.250418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.250889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.386704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.391253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:06.398158 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9c1866d9-ab7f-4fd7-802f-eac9b9094dcf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1670 microversion: 2.1 time: 0.166648 Oct 28 20:08:06.398787 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3439/6875] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:06.421167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.421787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.427994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.428785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.429228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.429928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.430391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.435159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.459226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:06.584290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.596680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-163ed361-ad9a-4fa8-88a3-3b28b5ee9846 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1670 microversion: 2.1 time: 0.179329 Oct 28 20:08:06.597607 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3437/6876] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:06.621747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.622263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.630335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.630837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.631304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.632015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.632487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.632918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.659997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:08:06.742592 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8babf848-3c51-4e26-81b5-f59192c4cb60 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 204 len: 0 microversion: 2.1 time: 0.124773 Oct 28 20:08:06.743318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3440/6877] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:08:06 2022] DELETE /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:08:06.751977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:06.752602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:06.758843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.759343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.759781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.760486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:06.760948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:06.761369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:06.905980 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:06.914656 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8f0b3f64-0ec6-4fa4-8b75-3fa9a49e222f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1676 microversion: 2.1 time: 0.166491 Oct 28 20:08:06.915175 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3438/6878] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:06 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:07.634363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4bcc894c-5747-4118-8055-575299749f18 req-6d4af456-0acf-4c2b-970c-2b660d9d2f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "name": "network-vif-plugged", "status": "completed", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:07.645779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4bcc894c-5747-4118-8055-575299749f18 req-6d4af456-0acf-4c2b-970c-2b660d9d2f83 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.646276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4bcc894c-5747-4118-8055-575299749f18 req-6d4af456-0acf-4c2b-970c-2b660d9d2f83 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.646737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4bcc894c-5747-4118-8055-575299749f18 req-6d4af456-0acf-4c2b-970c-2b660d9d2f83 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.657780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4bcc894c-5747-4118-8055-575299749f18 req-6d4af456-0acf-4c2b-970c-2b660d9d2f83 service nova] Creating event network-vif-plugged:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h2-862769-3 Oct 28 20:08:07.663949 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4bcc894c-5747-4118-8055-575299749f18 req-6d4af456-0acf-4c2b-970c-2b660d9d2f83 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Oct 28 20:08:07.664601 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3441/6879] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:07.937878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:07.938494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:07.946035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.946525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.946987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:07.947685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:07.948136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:07.948561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:08.086315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:08.094506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-97741405-a595-4c02-8ddf-f929fea8779e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1676 microversion: 2.1 time: 0.160596 Oct 28 20:08:08.104324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3439/6880] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:07 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:08.977594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4aec4add-9aba-42f8-93cc-677bc994a06e req-ab28a2bb-f965-4ef4-9584-3bdf76afd5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bb475-32be-43cb-b676-096fa6fb2d97", "name": "network-vif-deleted", "tag": "3080a70a-b044-49dc-bdd2-60e981c0a792"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:08.994131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4aec4add-9aba-42f8-93cc-677bc994a06e req-ab28a2bb-f965-4ef4-9584-3bdf76afd5e0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:08.994628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4aec4add-9aba-42f8-93cc-677bc994a06e req-ab28a2bb-f965-4ef4-9584-3bdf76afd5e0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:08.995124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4aec4add-9aba-42f8-93cc-677bc994a06e req-ab28a2bb-f965-4ef4-9584-3bdf76afd5e0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.007388 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4aec4add-9aba-42f8-93cc-677bc994a06e req-ab28a2bb-f965-4ef4-9584-3bdf76afd5e0 service nova] Creating event network-vif-deleted:3080a70a-b044-49dc-bdd2-60e981c0a792 for instance c91bb475-32be-43cb-b676-096fa6fb2d97 on n-h2-862769-3 Oct 28 20:08:09.012719 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4aec4add-9aba-42f8-93cc-677bc994a06e req-ab28a2bb-f965-4ef4-9584-3bdf76afd5e0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040041 Oct 28 20:08:09.014900 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3442/6881] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:09.118298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:09.119603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:09.127075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.127544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.128183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.128912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.129631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.130150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.168538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:09.169031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:09.169479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:09.170145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lazy-loading 'fault' on Instance uuid c91bb475-32be-43cb-b676-096fa6fb2d97 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:08:09.221471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:09.230177 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bd92f26-8f57-49b0-b7c6-e1c95b80c063 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 200 len: 1329 microversion: 2.1 time: 0.116238 Oct 28 20:08:09.230644 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3440/6882] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:09 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:10.260565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:10.261377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:10.264472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:10.270876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.271374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.271814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.272549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.272983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.273432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.288555 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 HTTP/1.1 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c91bb475-32be-43cb-b676-096fa6fb2d97'} Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:08:10.290231 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed918a1a-5ce4-446b-bd13-f78fc2da3c2b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 404 len: 111 microversion: 2.1 time: 0.041042 Oct 28 20:08:10.294185 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3443/6883] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:10 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:08:10.304646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:10.305262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:10.307997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=45 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:10.313532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.314013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.314446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.315256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.315712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.316133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.330248 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 HTTP/1.1 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c91bb475-32be-43cb-b676-096fa6fb2d97'} Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:08:10.331944 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-11d8894b-2e51-410d-88a6-e7f27fe4b024 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 404 len: 111 microversion: 2.1 time: 0.032903 Oct 28 20:08:10.336611 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3441/6884] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:10 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:08:10.382964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1799795293", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "bfac833c-73c2-47c5-98d7-9281b6657401"}], "security_groups": [{"name": "tempest-securitygroup--1752382464"}], "key_name": "tempest-keypair-1391233376", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:10.494318 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] validate_networks() for [('bfac833c-73c2-47c5-98d7-9281b6657401', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:08:10.892136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:08:10.892566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:08:10.893217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:08:10.893763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:08:10.894323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:08:10.908817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.910079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.910842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.912024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:10.912646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:10.913238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:10.932969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:08:10.938629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:08:10.951907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:08:10.954261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:08:11.002212 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d8a09ec-9245-4eb1-8459-e79d9542d0e6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.623212 Oct 28 20:08:11.002891 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3444/6885] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:08:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:08:11.014277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-95729448-f3c1-4732-8b2c-4bcc727533c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:11.015146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-95729448-f3c1-4732-8b2c-4bcc727533c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:11.069384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-95729448-f3c1-4732-8b2c-4bcc727533c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:11.077126 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-95729448-f3c1-4732-8b2c-4bcc727533c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1239 microversion: 2.1 time: 0.066717 Oct 28 20:08:11.077692 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3442/6886] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:11 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:12.101913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:12.102548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:12.109546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:12.110046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:12.110490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:12.111304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:12.111772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:12.112204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:12.211706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:12.221962 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f4d4d51e-2a66-4b3e-bb20-8df43966f76c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1299 microversion: 2.1 time: 0.124636 Oct 28 20:08:12.222599 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3445/6887] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:12 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:13.246443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:13.247274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:13.255875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.256373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.256884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.257662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.258218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.258652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.486171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:13.494569 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fbd68609-2f2b-4546-816f-8a385d4b1ae4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1365 microversion: 2.1 time: 0.252439 Oct 28 20:08:13.495205 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3443/6888] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:13 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:13.682423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0c9ce23a-2d61-43d3-8004-567e46699c3e req-06843779-ceea-4d08-bff0-4aa6d12f5759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:13.698201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0c9ce23a-2d61-43d3-8004-567e46699c3e req-06843779-ceea-4d08-bff0-4aa6d12f5759 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:13.698716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0c9ce23a-2d61-43d3-8004-567e46699c3e req-06843779-ceea-4d08-bff0-4aa6d12f5759 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:13.699366 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0c9ce23a-2d61-43d3-8004-567e46699c3e req-06843779-ceea-4d08-bff0-4aa6d12f5759 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:13.715511 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0c9ce23a-2d61-43d3-8004-567e46699c3e req-06843779-ceea-4d08-bff0-4aa6d12f5759 service nova] Creating event network-changed:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h1-862769-3 Oct 28 20:08:13.720784 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0c9ce23a-2d61-43d3-8004-567e46699c3e req-06843779-ceea-4d08-bff0-4aa6d12f5759 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042074 Oct 28 20:08:13.721406 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3446/6889] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:14.519579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:14.520140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:14.527834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.528326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.528768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.529481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:14.529941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:14.530377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:14.674367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:14.686604 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-40b8a32e-9950-4b36-8bba-f8fbc6e05aa5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1365 microversion: 2.1 time: 0.171198 Oct 28 20:08:14.687245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3444/6890] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:14 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:15.712101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:15.712824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:15.720944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.721452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.721903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:15.722641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:15.723152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:15.723582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:16.004725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:16.013086 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4fb95dcf-fa19-4c0b-a5f9-5fbb04b4ee23 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1365 microversion: 2.1 time: 0.305443 Oct 28 20:08:16.013975 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3447/6891] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:15 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:17.038785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:17.039418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:17.046972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.047468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.047907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.048617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:17.049083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:17.049509 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:17.189748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:17.201957 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-19aac051-5531-4ed5-83bf-81d4125f9f25 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1365 microversion: 2.1 time: 0.167638 Oct 28 20:08:17.202739 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3445/6892] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:17 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:18.025112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9ca72df1-8b08-4d79-b40d-556466c8e9b9 req-53665741-8516-4fa7-b682-e605ecc776ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "name": "network-vif-plugged", "status": "completed", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:18.036886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9ca72df1-8b08-4d79-b40d-556466c8e9b9 req-53665741-8516-4fa7-b682-e605ecc776ba service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.037572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9ca72df1-8b08-4d79-b40d-556466c8e9b9 req-53665741-8516-4fa7-b682-e605ecc776ba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.037824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9ca72df1-8b08-4d79-b40d-556466c8e9b9 req-53665741-8516-4fa7-b682-e605ecc776ba service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.049464 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9ca72df1-8b08-4d79-b40d-556466c8e9b9 req-53665741-8516-4fa7-b682-e605ecc776ba service nova] Creating event network-vif-plugged:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h1-862769-3 Oct 28 20:08:18.054451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9ca72df1-8b08-4d79-b40d-556466c8e9b9 req-53665741-8516-4fa7-b682-e605ecc776ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033217 Oct 28 20:08:18.055300 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3448/6893] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:18.226973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:18.227575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:18.234802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.235292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.235733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.236446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:18.236895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:18.237324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:18.369248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:18.379816 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7595355b-08c6-4946-b8f2-a0c59e0c98f4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1365 microversion: 2.1 time: 0.156717 Oct 28 20:08:18.380391 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3446/6894] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:18 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:19.407778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:19.408574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:19.415654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.416157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.416601 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.417316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:19.417826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:19.418257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:19.556136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:19.564091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dccb77fd-cf45-430b-a1fb-5fd7415abd3b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1365 microversion: 2.1 time: 0.163960 Oct 28 20:08:19.564668 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3449/6895] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:19 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:20.598457 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:20.599149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:20.606264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.606778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.607211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.607921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.608381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.608836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.771230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:20.783015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9d7ce9a0-4b6f-4336-a6f1-c71a2d5522df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1551 microversion: 2.1 time: 0.190594 Oct 28 20:08:20.783755 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3447/6896] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:20 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1551 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:20.808762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:20.809349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:20.816319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.816855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.817381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.818067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:20.818531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:20.819069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:20.898872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9496df37-06e2-4e57-bc8b-4cdec62cff35 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093819 Oct 28 20:08:20.899471 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3450/6897] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:08:20 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:21.884952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b1e2d06c-7e4e-4f36-861b-a4fbd58dd82e req-54ae6d1f-35a8-4de2-afc8-233f29e6fdfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:21.890094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:21.897135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1e2d06c-7e4e-4f36-861b-a4fbd58dd82e req-54ae6d1f-35a8-4de2-afc8-233f29e6fdfe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:21.897703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1e2d06c-7e4e-4f36-861b-a4fbd58dd82e req-54ae6d1f-35a8-4de2-afc8-233f29e6fdfe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:21.898205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b1e2d06c-7e4e-4f36-861b-a4fbd58dd82e req-54ae6d1f-35a8-4de2-afc8-233f29e6fdfe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:21.910353 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b1e2d06c-7e4e-4f36-861b-a4fbd58dd82e req-54ae6d1f-35a8-4de2-afc8-233f29e6fdfe service nova] Creating event network-changed:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h1-862769-3 Oct 28 20:08:21.915987 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b1e2d06c-7e4e-4f36-861b-a4fbd58dd82e req-54ae6d1f-35a8-4de2-afc8-233f29e6fdfe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034861 Oct 28 20:08:21.916612 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3448/6898] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:08:55.075656 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:55.076678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:55.079325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:55.080145 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:55.085833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ba804c4-ea39-4ad2-b4f8-e507d1ab6f24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:08:55.096649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba804c4-ea39-4ad2-b4f8-e507d1ab6f24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.097171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba804c4-ea39-4ad2-b4f8-e507d1ab6f24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.097665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ba804c4-ea39-4ad2-b4f8-e507d1ab6f24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.121508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ba804c4-ea39-4ad2-b4f8-e507d1ab6f24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Going to try to stop instance {{(pid=120629) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 20:08:55.171220 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ba804c4-ea39-4ad2-b4f8-e507d1ab6f24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action" status: 202 len: 0 microversion: 2.1 time: 0.096651 Oct 28 20:08:55.171840 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3451/6899] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:08:55 2022] POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:08:55.178667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=17 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:55.179608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=56 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:55.184217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:55.184925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:55.192895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.193387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.193828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.194535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:55.195021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:55.195449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:55.340141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:55.349482 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-62486a1e-1a73-432d-a317-6f894b581ff1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.172865 Oct 28 20:08:55.350138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3449/6900] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:55 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:56.386624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:56.387776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:56.395546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.396047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.396521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.397194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:56.397660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:56.398106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:56.548300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:56.560500 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-82a13222-d048-445f-bbad-d6454f31a35d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.181741 Oct 28 20:08:56.561392 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3452/6901] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:56 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:57.586630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:57.587283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:57.595877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.596372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.596807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.597543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:57.598000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:57.598430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:57.749479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:57.761620 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ae38b08-cc15-44b4-8159-d419e34b918d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.180344 Oct 28 20:08:57.762482 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3450/6902] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:57 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:58.788170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:58.788806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:58.795933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.796439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.796886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.797599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:58.798064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:58.798504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:58.943974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:08:58.952203 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a4fb1348-dbc4-491a-9e6a-018c1d014e32 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.168422 Oct 28 20:08:58.952799 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3453/6903] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:58 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:08:59.977939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:08:59.978502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:08:59.986946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.987448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.987899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:08:59.988587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:08:59.989041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:08:59.989458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:00.132985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:00.142257 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-097ee29a-47af-43b6-853b-d2e8ceed6fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.168883 Oct 28 20:09:00.142855 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3451/6904] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:08:59 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:01.165873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:01.166487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:01.174615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.175161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.175607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.176317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:01.176777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:01.177212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:01.310844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:01.319128 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-08ce89be-f232-4d20-b880-1f2e93476fc4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.157197 Oct 28 20:09:01.319707 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3454/6905] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:01 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:02.342963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:02.343539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:02.350984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.351620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.352140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.352949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:02.353434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:02.353845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:02.514425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:02.522634 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e8cde6b2-1053-4a96-b91d-4376e295be31 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.183855 Oct 28 20:09:02.523261 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3452/6906] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:02 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:03.546079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:03.546821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:03.554073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:03.554573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:03.555070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:03.555778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:03.556237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:03.556675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:03.694565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:03.706029 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69242ef4-9e17-4323-a1ea-03a1191a5976 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.163929 Oct 28 20:09:03.706576 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3455/6907] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:03 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:04.729777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:04.730399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:04.738075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.738562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.739030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.739722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:04.740174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:04.740598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:04.877679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:04.886276 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1b197f9-3e53-4ca5-804c-a2938cdc0391 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.160474 Oct 28 20:09:04.886858 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3453/6908] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:04 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:05.910502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:05.911148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:05.918533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.919071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.919521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:05.920237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:05.920705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:05.921133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.065026 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:06.078386 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0122117c-3246-4725-9c6f-4c683ba106c0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1657 microversion: 2.1 time: 0.172218 Oct 28 20:09:06.079345 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3456/6909] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:05 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1657 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:06.103074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:06.105400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:06.112917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.113415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.113972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.114726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.115188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.115623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.149111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:06.154897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:09:06.162376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:09:06.162838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:09:06.163319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:09:06.163735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:09:06.164179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:09:06.234559 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c7da74e7-ac55-412d-8aad-efb064bd8f33 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action" status: 202 len: 0 microversion: 2.1 time: 0.135648 Oct 28 20:09:06.235231 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3454/6910] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:09:06 2022] POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:09:06.243928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:06.244560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:06.251473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.252082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.252698 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.253549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:06.254030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:06.254519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:06.388829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:06.397599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c0121391-f336-49ae-be73-1c5e6bc2049f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.157952 Oct 28 20:09:06.398317 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3457/6911] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:06 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:09:07.422162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:07.422826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:07.430523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.431048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.431581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.432282 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:07.432745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:07.433174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:07.626133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:07.635614 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5ec2e40e-a18f-4bed-a666-251b9f5eeb37 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1680 microversion: 2.1 time: 0.218425 Oct 28 20:09:07.636700 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3455/6912] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:07 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:08.660484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:08.661221 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:08.669750 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.670316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.670795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.671947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:08.672451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:08.672885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:08.811860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:08.823873 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ad88066a-4cea-43ff-81ef-ac4259bc3506 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1685 microversion: 2.1 time: 0.167582 Oct 28 20:09:08.824821 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3458/6913] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:08 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:09.848652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:09.849272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:09.857085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.857577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.858016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:09.858712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:09.859222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:09.859650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.006265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:10.015406 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-072816c8-4d04-457d-af44-62e7015b307e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1685 microversion: 2.1 time: 0.170779 Oct 28 20:09:10.016039 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3456/6914] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:09 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:10.826783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "name": "network-vif-unplugged", "status": "completed", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:10.838208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:10.838738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:10.839177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:10.851439 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] Creating event network-vif-unplugged:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h2-862769-3 Oct 28 20:09:10.857316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:09:10.869329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-262ae916-75b5-4225-a2aa-24b76fc278da req-65f47d14-0271-436c-bdf8-892612d60209 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046283 Oct 28 20:09:10.870349 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3459/6915] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:11.040213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:11.040784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:11.048418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:11.048921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:11.049362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:11.050075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:11.050514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:11.050994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:11.183553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:11.191533 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c0245b3-7240-4b4c-8ef3-b707fb5692d9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1684 microversion: 2.1 time: 0.155388 Oct 28 20:09:11.192084 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3457/6916] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:11 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:12.219047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:12.219836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:12.228489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.229088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.229534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.230257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.231160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.231160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.379641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:12.387908 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d1d129c-5e14-4781-9ecf-827e7e9b9d76 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1682 microversion: 2.1 time: 0.175692 Oct 28 20:09:12.388514 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3460/6917] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:12 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:12.912404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:12.924294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:12.924780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:12.925217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:12.937701 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] Creating event network-changed:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h2-862769-3 Oct 28 20:09:12.943773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:09:12.955595 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-426051da-351e-4d93-9fb8-2c94f857329b req-26c6f288-cbd2-48b3-b5e1-10f244eeda6b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049433 Oct 28 20:09:12.956126 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3458/6918] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:13.411400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:13.411997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:13.419736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.420673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.421116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.421839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.422298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.422759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.604551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:13.612599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f7dabcaf-fd52-41d2-872b-877ebae57bab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1678 microversion: 2.1 time: 0.205756 Oct 28 20:09:13.613190 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3461/6919] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:13 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:13.636216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:13.636836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:13.643316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.643797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.644229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.644912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.645362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.645783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.707143 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6df76651-d277-4996-970a-b95ed9b9a10e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action" status: 204 len: 0 microversion: 2.1 time: 0.075168 Oct 28 20:09:13.707881 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3459/6920] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:09:13 2022] POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:09:13.716511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:13.718155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:13.725467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.725903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.726371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.727128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:13.727599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:13.728053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:13.938076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:13.946410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-05734c41-fc67-4ca5-b263-36e09bdb9607 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1678 microversion: 2.1 time: 0.234118 Oct 28 20:09:13.947155 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3462/6921] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:13 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:14.972129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:14.972934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:14.979628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.979951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.980376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:14.981072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:14.981529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:14.981949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:15.125199 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:15.134012 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-448d7958-833e-45b8-893a-26cbf48245bb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1678 microversion: 2.1 time: 0.166998 Oct 28 20:09:15.134516 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3460/6922] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:14 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:16.166157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:16.166788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:16.174450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.175005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.175460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.176196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.176668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.177116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.315728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:16.328087 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-07f79bd1-7e81-4855-8745-3620895881cb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1657 microversion: 2.1 time: 0.165352 Oct 28 20:09:16.328771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3463/6923] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:16 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1657 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:16.350933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:16.351554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:16.359121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.359612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.360051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.360752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.361208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.361638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.498019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:16.505993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e3c82d49-6243-4b3c-9e5c-ca220f1e88c1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1657 microversion: 2.1 time: 0.159166 Oct 28 20:09:16.506574 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3461/6924] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:16 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:16.528850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0dd62efd-7964-4ae3-bdf2-5b30ab9c81d6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:16.535520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dd62efd-7964-4ae3-bdf2-5b30ab9c81d6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.536030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dd62efd-7964-4ae3-bdf2-5b30ab9c81d6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.536532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0dd62efd-7964-4ae3-bdf2-5b30ab9c81d6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.560405 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0dd62efd-7964-4ae3-bdf2-5b30ab9c81d6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Going to try to start instance {{(pid=120629) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 20:09:16.619061 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0dd62efd-7964-4ae3-bdf2-5b30ab9c81d6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action" status: 202 len: 0 microversion: 2.1 time: 0.094333 Oct 28 20:09:16.619681 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3464/6925] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:09:16 2022] POST /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:09:16.629140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:16.629757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:16.636192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.636687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.637119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.637892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:16.638822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:16.639393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:16.776532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:16.785576 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a392a7ce-ae83-4a98-bc54-237db877e232 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1666 microversion: 2.1 time: 0.160574 Oct 28 20:09:16.786195 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3462/6926] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:16 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:17.811087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:17.811817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:17.818206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.818732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.819179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.819897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.820355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.820792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.884832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-b62fec6a-7c0b-4351-b2b3-27ef5232cd65 req-de5aeca6-f342-48bf-846f-361852f3ef7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "name": "network-vif-plugged", "status": "completed", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:17.897029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b62fec6a-7c0b-4351-b2b3-27ef5232cd65 req-de5aeca6-f342-48bf-846f-361852f3ef7a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:17.897458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b62fec6a-7c0b-4351-b2b3-27ef5232cd65 req-de5aeca6-f342-48bf-846f-361852f3ef7a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:17.897888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-b62fec6a-7c0b-4351-b2b3-27ef5232cd65 req-de5aeca6-f342-48bf-846f-361852f3ef7a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:17.910739 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-b62fec6a-7c0b-4351-b2b3-27ef5232cd65 req-de5aeca6-f342-48bf-846f-361852f3ef7a service nova] Creating event network-vif-plugged:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h2-862769-3 Oct 28 20:09:17.915801 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-b62fec6a-7c0b-4351-b2b3-27ef5232cd65 req-de5aeca6-f342-48bf-846f-361852f3ef7a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Oct 28 20:09:17.916771 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3463/6927] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:09:17.971951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:17.977295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:17.984687 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10125264-f795-4870-ac79-d6fa9a7ec729 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1670 microversion: 2.1 time: 0.178971 Oct 28 20:09:17.985548 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3465/6928] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:17 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:18.010099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:18.010712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:18.017186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.017678 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.018116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.018881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.019337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.019758 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.022435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:18.048157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:09:18.131162 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f8b877e5-abc3-4442-8005-8705c9d8952b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 204 len: 0 microversion: 2.1 time: 0.125047 Oct 28 20:09:18.131789 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3464/6929] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:09:18 2022] DELETE /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:09:18.141525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:18.142170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:18.149031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.149518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.149961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.150664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:18.151162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:18.151618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:18.301345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:18.309655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6d1409e9-8adb-4ebf-a886-08a1d2f09f61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1676 microversion: 2.1 time: 0.172911 Oct 28 20:09:18.310237 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3466/6930] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:18 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:19.334302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:19.335046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:19.342208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:19.342731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:19.343181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:19.343884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:19.344363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:19.344789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:19.491786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:19.500657 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4a5e6f67-863a-4d8c-93f7-ce8417d76905 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 200 len: 1676 microversion: 2.1 time: 0.170968 Oct 28 20:09:19.501349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3465/6931] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:19 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:20.317696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-fb543e08-f1b1-4b5e-9c5b-acb99027dd03 req-2b7517b3-2068-4cc9-a7f4-2d07b7e7e084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a527e98-4392-42f3-aa29-9e19fb0510b1", "name": "network-vif-deleted", "tag": "144b6799-8a50-4d60-a4cc-3407453867aa"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:20.331325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fb543e08-f1b1-4b5e-9c5b-acb99027dd03 req-2b7517b3-2068-4cc9-a7f4-2d07b7e7e084 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:20.331818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fb543e08-f1b1-4b5e-9c5b-acb99027dd03 req-2b7517b3-2068-4cc9-a7f4-2d07b7e7e084 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:20.332252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fb543e08-f1b1-4b5e-9c5b-acb99027dd03 req-2b7517b3-2068-4cc9-a7f4-2d07b7e7e084 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:20.348683 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-fb543e08-f1b1-4b5e-9c5b-acb99027dd03 req-2b7517b3-2068-4cc9-a7f4-2d07b7e7e084 service nova] Creating event network-vif-deleted:144b6799-8a50-4d60-a4cc-3407453867aa for instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 on n-h2-862769-3 Oct 28 20:09:20.355029 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-fb543e08-f1b1-4b5e-9c5b-acb99027dd03 req-2b7517b3-2068-4cc9-a7f4-2d07b7e7e084 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040874 Oct 28 20:09:20.356350 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3467/6932] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:20.524587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:20.526162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:20.534016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:20.534907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:20.535359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:20.536090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:20.536550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:20.536979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:20.553097 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 HTTP/1.1 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '2a527e98-4392-42f3-aa29-9e19fb0510b1'} Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:20.554897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1d79800c-a31b-430a-9ba4-6b2aa6624076 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 404 len: 111 microversion: 2.1 time: 0.036285 Oct 28 20:09:20.559064 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3466/6933] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:20 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:09:20.573808 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:20.575125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:20.581381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:20.581893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:20.582343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:20.583264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:20.583747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:20.584169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:20.601835 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 HTTP/1.1 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2a527e98-4392-42f3-aa29-9e19fb0510b1'} Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:09:20.603678 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-049d0a3c-9ed5-498d-a1d7-4be448714db0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 404 len: 111 microversion: 2.1 time: 0.037186 Oct 28 20:09:20.608717 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3468/6934] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:20 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:09:20.656305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-374210173", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "bfac833c-73c2-47c5-98d7-9281b6657401"}], "security_groups": [{"name": "tempest-securitygroup--1752382464"}], "key_name": "tempest-keypair-1391233376", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:20.765254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] validate_networks() for [('bfac833c-73c2-47c5-98d7-9281b6657401', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:09:21.241398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:09:21.241820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:09:21.242356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:09:21.242803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:09:21.243219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:09:21.252685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:21.253161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:21.253574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:21.254560 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:21.255026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:21.255451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:21.276392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:09:21.282313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:09:21.296890 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:09:21.299464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:09:21.352437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cf10eb72-71d4-4b55-b860-ee6fc873ea2d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700085 Oct 28 20:09:21.353633 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3467/6935] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:09:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:09:21.365130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-14ae1380-6fc4-4a8f-b847-88997282c0df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:21.366461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-14ae1380-6fc4-4a8f-b847-88997282c0df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:21.436144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-14ae1380-6fc4-4a8f-b847-88997282c0df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:21.445432 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-14ae1380-6fc4-4a8f-b847-88997282c0df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1238 microversion: 2.1 time: 0.084220 Oct 28 20:09:21.446264 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3469/6936] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:21 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:22.470896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:22.471562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:22.479853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:22.480248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:22.480691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:22.481408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:22.481881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:22.482442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:22.598074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:22.627023 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-575fe3d3-7d25-461e-a131-18026b6c90fa tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1290 microversion: 2.1 time: 0.160129 Oct 28 20:09:22.639055 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3468/6937] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:22 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1290 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:23.652647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:23.653462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:23.660395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:23.660923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:23.661350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:23.662074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:23.662537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:23.662996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:23.906314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:23.914878 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4da43a01-0723-4af8-a2bb-0122e23b9529 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1364 microversion: 2.1 time: 0.267227 Oct 28 20:09:23.915489 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3470/6938] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:23 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:24.120751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0b04dc42-3a21-4229-b668-5a01bec5aca1 req-3194f0b3-1d5a-4fc7-ab7d-faabee7c2c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:24.134947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0b04dc42-3a21-4229-b668-5a01bec5aca1 req-3194f0b3-1d5a-4fc7-ab7d-faabee7c2c3a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.136295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0b04dc42-3a21-4229-b668-5a01bec5aca1 req-3194f0b3-1d5a-4fc7-ab7d-faabee7c2c3a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.136733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0b04dc42-3a21-4229-b668-5a01bec5aca1 req-3194f0b3-1d5a-4fc7-ab7d-faabee7c2c3a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:24.150291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0b04dc42-3a21-4229-b668-5a01bec5aca1 req-3194f0b3-1d5a-4fc7-ab7d-faabee7c2c3a service nova] Creating event network-changed:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:09:24.156015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0b04dc42-3a21-4229-b668-5a01bec5aca1 req-3194f0b3-1d5a-4fc7-ab7d-faabee7c2c3a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038740 Oct 28 20:09:24.156772 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3469/6939] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:24.941431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:24.942125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:24.949481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.949997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.950450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:24.951195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:24.951669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:24.952116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:25.087162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:25.095564 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ca2bc40-5be3-4b80-a01d-454ff6279979 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1364 microversion: 2.1 time: 0.160288 Oct 28 20:09:25.096115 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3471/6940] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:24 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:26.119029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:26.119702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:26.122538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:26.128537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:26.129040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:26.129470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:26.130136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:26.130601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:26.131049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:26.267827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:26.276110 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-566d9c46-4959-455a-a39f-eaa7d0e060dd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1364 microversion: 2.1 time: 0.161215 Oct 28 20:09:26.276642 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3470/6941] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:26 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:27.300372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:27.300979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:27.303155 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:09:27.303326 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:09:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 (ip 10.222.0.44) !!! Oct 28 20:09:27.305836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=45 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:27.313388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:27.313878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:27.314346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:27.315113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:27.315586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:27.316021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:27.456655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:27.465255 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-25a650af-c363-4d2f-b2ab-82135ca7de14 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1364 microversion: 2.1 time: 0.168918 Oct 28 20:09:27.465860 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3472/6942] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:27 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:28.367725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9c2c7e97-7a2e-4974-8a70-e4267fee3c54 req-dc98cb99-95e3-4c55-8afd-c844f1bd4f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "name": "network-vif-plugged", "status": "completed", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:28.375823 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:09:28.375975 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:09:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:09:28.382504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9c2c7e97-7a2e-4974-8a70-e4267fee3c54 req-dc98cb99-95e3-4c55-8afd-c844f1bd4f8c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.383021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9c2c7e97-7a2e-4974-8a70-e4267fee3c54 req-dc98cb99-95e3-4c55-8afd-c844f1bd4f8c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.383450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9c2c7e97-7a2e-4974-8a70-e4267fee3c54 req-dc98cb99-95e3-4c55-8afd-c844f1bd4f8c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.396746 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9c2c7e97-7a2e-4974-8a70-e4267fee3c54 req-dc98cb99-95e3-4c55-8afd-c844f1bd4f8c service nova] Creating event network-vif-plugged:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:09:28.405971 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9c2c7e97-7a2e-4974-8a70-e4267fee3c54 req-dc98cb99-95e3-4c55-8afd-c844f1bd4f8c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039085 Oct 28 20:09:28.405971 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3471/6943] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:28.488631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:28.489413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:28.496730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.497238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.497667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.498404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:28.498895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:28.499489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:28.661935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:28.671578 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a1e3843f-ada6-4d2e-920c-6188c02e94bf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1364 microversion: 2.1 time: 0.186837 Oct 28 20:09:28.672167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3473/6944] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:28 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:29.696685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:29.697336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:29.705605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:29.706340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:29.707072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:29.708147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:29.708791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:29.709449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:29.851360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:29.860443 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b65a3f19-9a6e-42c7-a92b-b9e15f67a525 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1364 microversion: 2.1 time: 0.168907 Oct 28 20:09:29.861301 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3472/6945] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:29 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:30.886856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:30.887509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:30.895024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:30.895536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:30.895979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:30.896722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:30.897194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:30.897682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:31.035835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:09:31.044784 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0baae30b-fbab-49fb-a1d8-809ca9ba7e7f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1550 microversion: 2.1 time: 0.162372 Oct 28 20:09:31.044898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3474/6946] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:09:30 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:09:31.067799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:09:31.068330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:09:31.075628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:31.076113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:31.076551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:31.077249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:31.077703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:31.078131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:31.161776 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-552925cd-030a-4983-bef8-1e5cac3e9120 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097590 Oct 28 20:09:31.162748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3473/6947] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:09:31 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:09:32.132812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-7f188a3d-9195-49ab-a966-61e04643e393 req-c58339f1-a4ad-4ac3-8a3a-1a725f71c3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:09:32.137556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:09:32.144189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7f188a3d-9195-49ab-a966-61e04643e393 req-c58339f1-a4ad-4ac3-8a3a-1a725f71c3b7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:09:32.144669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7f188a3d-9195-49ab-a966-61e04643e393 req-c58339f1-a4ad-4ac3-8a3a-1a725f71c3b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:09:32.145108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-7f188a3d-9195-49ab-a966-61e04643e393 req-c58339f1-a4ad-4ac3-8a3a-1a725f71c3b7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:09:32.157131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-7f188a3d-9195-49ab-a966-61e04643e393 req-c58339f1-a4ad-4ac3-8a3a-1a725f71c3b7 service nova] Creating event network-changed:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:09:32.162705 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-7f188a3d-9195-49ab-a966-61e04643e393 req-c58339f1-a4ad-4ac3-8a3a-1a725f71c3b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Oct 28 20:09:32.163350 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3475/6948] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:12.955574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:12.956246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:12.958181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=7 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:12.958842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:12.962922 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:12.965184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:12.973762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.974246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.974769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:12.975463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:12.975918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:12.976342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.005846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:13.012011 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120628) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:10:13.019093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:10:13.019519 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:10:13.019985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:10:13.020393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:10:13.020802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:10:13.091407 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-964d78c2-0058-4adf-84a8-9145d7a4ddf7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0/action" status: 202 len: 0 microversion: 2.1 time: 0.136729 Oct 28 20:10:13.092027 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3474/6949] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:10:12 2022] POST /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:10:13.098706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=7 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:13.099639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=42 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:13.104052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:13.104897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:13.112030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.112578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.112975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.113708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:13.114174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:13.114623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:13.252467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:13.260991 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ef1f3500-7c2a-4268-ade3-d2f33c5d4572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1678 microversion: 2.1 time: 0.164419 Oct 28 20:10:13.261771 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3476/6950] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:13 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:14.286554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:14.287177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:14.293680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:14.294174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:14.294624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:14.295344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:14.295805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:14.296233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:14.443861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:14.451997 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-751c1a41-7454-4b6f-a8da-49a31f9b90b1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1678 microversion: 2.1 time: 0.171963 Oct 28 20:10:14.452565 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3475/6951] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:14 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:15.477690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:15.478291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:15.486447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:15.486907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:15.487372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:15.488104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:15.488564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:15.489001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:15.636856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:15.647973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3a7acbc-68ba-4a14-9ddb-4675f6486d8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.174558 Oct 28 20:10:15.648806 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3477/6952] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:15 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:16.673931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:16.674729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:16.682520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.683049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.683482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.684190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:16.684638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:16.685088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:16.820055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:16.828545 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f47dadf-c8b2-48f3-9a10-7b4175f963f6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.159217 Oct 28 20:10:16.829116 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3476/6953] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:16 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:17.852385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:17.853086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:17.860197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.860654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.861132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:17.862048 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:17.862487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:17.862968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:18.007338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:18.015599 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d9c6534e-c47b-46c0-a784-6c0d74ce40e0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.167430 Oct 28 20:10:18.016162 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3478/6954] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:17 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:19.048997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:19.049724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:19.058326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:19.059024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:19.059546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:19.060384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:19.060930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:19.061444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:19.205548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:19.216972 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bfbbf86-98bb-44bb-9681-33efc0b4632d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.172125 Oct 28 20:10:19.218554 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3477/6955] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:19 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:20.247200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:20.247804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:20.255768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:20.256278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:20.256726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:20.257462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:20.257923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:20.258354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:20.394180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:20.407563 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4a40ae9a-f589-499e-b068-7412c67b205d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.166819 Oct 28 20:10:20.408532 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3479/6956] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:20 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:21.436525 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:21.437156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:21.444652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.445148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.445605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.446291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:21.446782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:21.447185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:21.586590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:21.595676 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca9bf344-b803-4588-8594-5a5e43a395f7 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.163667 Oct 28 20:10:21.596263 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3478/6957] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:21 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:22.618407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:22.619068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:22.626299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.626822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.627272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.627982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:22.628472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:22.628906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:22.778120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:22.787180 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9ef11878-2d81-45d2-a9a3-a8574e1ea140 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.172688 Oct 28 20:10:22.787758 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3480/6958] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:22 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:23.810896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:23.811489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:23.818960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.819440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.819878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.820570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:23.821029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:23.821446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:23.970391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:23.978638 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0a51fb01-beda-426c-82bb-ad51e3d4a300 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.171839 Oct 28 20:10:23.979245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3479/6959] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:23 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:25.003272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:25.003890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:25.011657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:25.012171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:25.012612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:25.013376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:25.013795 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:25.014235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:25.164948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:25.175307 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d1c5f937-18aa-4011-a451-f36e4d5c7fd6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.176126 Oct 28 20:10:25.175918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3481/6960] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:24 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:26.204897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:26.205883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:26.216301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.216794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.217232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.217937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:26.218436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:26.218888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:26.447167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:26.455586 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c756d1d0-b90c-454a-b163-6b8e2b63795b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1683 microversion: 2.1 time: 0.256809 Oct 28 20:10:26.456100 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3480/6961] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:26 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1683 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:27.479437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:27.480078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:27.487232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:27.487733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:27.488168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:27.488873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:27.489336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:27.489796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:27.625595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:27.634162 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-52a2c816-91b5-441e-993a-2d6a0bf1a9ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1682 microversion: 2.1 time: 0.158620 Oct 28 20:10:27.634761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3482/6962] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:27 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:27.998422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "name": "network-vif-unplugged", "status": "completed", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:28.010947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.011411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.011849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.024413 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] Creating event network-vif-unplugged:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h2-862769-3 Oct 28 20:10:28.030076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] Instance b24685fe-d140-4094-b96e-a9c3e87954f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:10:28.042177 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f72b1075-0c71-40ab-af4b-339b92851ecf req-6b0def30-3dc4-4316-803b-b10f6fc54ca9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047595 Oct 28 20:10:28.042800 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3481/6963] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:28.658024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:28.659340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:28.666538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.667058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.667502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.668223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:28.668703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:28.669146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:28.811771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:28.820064 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f53c0349-2dc9-42d1-9337-655d722e933d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1682 microversion: 2.1 time: 0.166214 Oct 28 20:10:28.820665 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3483/6964] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:28 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:29.844783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:29.845518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:29.852546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.853041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.853476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.854181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:29.854630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:29.855092 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:29.997392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:30.007371 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-491dcc81-d908-4edc-9cd4-d0e17ecf2b15 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1680 microversion: 2.1 time: 0.167928 Oct 28 20:10:30.008172 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3482/6965] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:29 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:30.078646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:30.089989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:30.090488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:30.090952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:30.104346 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] Creating event network-changed:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h2-862769-3 Oct 28 20:10:30.109738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] Instance b24685fe-d140-4094-b96e-a9c3e87954f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:10:30.120606 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5d0fb6ea-f798-4f03-b33a-b03c5f296b50 req-f0782a15-eb4b-45fd-83e0-84041f62638a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045797 Oct 28 20:10:30.121200 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3484/6966] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:31.033574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:31.034508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:31.042248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.042744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.043214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.043930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.044416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.044840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.192029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:31.200895 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd1de903-7aa9-43e8-9ce8-a027c9ddd572 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1677 microversion: 2.1 time: 0.171496 Oct 28 20:10:31.201477 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3483/6967] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:31 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:31.230253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:31.230913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:31.237842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.238338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.238800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.239546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.240015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.240450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.284309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.284721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.285174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.285932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.286400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.286848 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.308473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:10:31.314239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:10:31.426619 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fe0740f-9062-45eb-a321-32454dcfdc98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0/action" status: 202 len: 0 microversion: 2.1 time: 0.201331 Oct 28 20:10:31.427265 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3485/6968] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:10:31 2022] POST /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:10:31.436991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:31.437600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:31.444557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.445110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.445596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.446392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:31.446952 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:31.447423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:31.588265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:31.599993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dd0df0e9-7a8d-4371-92ca-130c3baa161e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1676 microversion: 2.1 time: 0.168122 Oct 28 20:10:31.600776 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3484/6969] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:31 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:32.627039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:32.627679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:32.635294 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.635802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.636257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.636949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:32.637439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:32.637873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:32.828814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:32.837000 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e38fc12f-3f66-4cc4-a6ad-62a7f983870a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1676 microversion: 2.1 time: 0.215423 Oct 28 20:10:32.837607 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3486/6970] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:32 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:33.861448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:33.862083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:33.870730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.871326 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.871665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:33.872377 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:33.872828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:33.875738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.021344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:34.029664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-636d54fb-207c-40bb-aec6-a80b1460143b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1676 microversion: 2.1 time: 0.172531 Oct 28 20:10:34.030245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3485/6971] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:33 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:34.958239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:34.970034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:34.970661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:34.971120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:34.986514 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] Creating event network-changed:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:10:34.992085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] Instance b24685fe-d140-4094-b96e-a9c3e87954f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:10:35.003917 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4997d2bc-0e66-4738-bb82-cca127ebeb04 req-80acd5b3-2567-4931-b8ea-d80f624b7769 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050752 Oct 28 20:10:35.005485 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3487/6972] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:35.053801 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:35.055443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:35.062598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.063150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.063591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:35.064302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.064818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.065643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:35.139163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "name": "network-vif-plugged", "status": "completed", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:35.149701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:35.150521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:35.151143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:35.166204 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] Creating event network-vif-plugged:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:10:35.173191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] Instance b24685fe-d140-4094-b96e-a9c3e87954f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:10:35.198807 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e26fa361-3807-44d1-ba3d-175478a18b50 req-7db472c1-2c61-44c9-8254-ee226cd9c2ca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063058 Oct 28 20:10:35.200864 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3488/6973] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:35.329071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:35.337680 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48b26fdf-58fe-4897-a293-eb0d903008cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1676 microversion: 2.1 time: 0.287826 Oct 28 20:10:35.338592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3486/6974] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:35 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:36.364097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:36.364844 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:36.372140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:36.372786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:36.373212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:36.373941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:36.374398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:36.374843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:36.525839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:36.535669 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-497012d2-8c25-45d4-b4bf-50b9d0ae4b8b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1676 microversion: 2.1 time: 0.177262 Oct 28 20:10:36.536271 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3489/6975] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:36 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:37.559880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:37.560484 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:37.567906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.568476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.569096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.569865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.570606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.571057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.724699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:37.733048 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6cd7e828-7436-460e-8f4e-5be1a23eed24 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1669 microversion: 2.1 time: 0.177167 Oct 28 20:10:37.733629 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3487/6976] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:37 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:37.757036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:37.757686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:37.766851 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.767365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.767813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.768589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.769001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.769445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.789582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:37.915018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:37.927342 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-edc72e61-815f-49e3-acf0-f42700dc2e88 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1669 microversion: 2.1 time: 0.174474 Oct 28 20:10:37.928151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3490/6977] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:37 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:37.950143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:37.950789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:37.957394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.957872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.958301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:37.959007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:37.959478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:37.959895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.093288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:38.101518 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0ca2ca7e-d104-4170-a72d-df296ede57a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1669 microversion: 2.1 time: 0.155468 Oct 28 20:10:38.102218 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3488/6978] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:37 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:38.123986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:38.124509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:38.130589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.131118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.131563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.132257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.132715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.133158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.158171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:10:38.238316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b5667e63-ea29-42d1-a39e-c8b6a7baffcb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 204 len: 0 microversion: 2.1 time: 0.117995 Oct 28 20:10:38.239252 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3491/6979] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:10:38 2022] DELETE /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:10:38.248274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:38.248996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:38.255173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.255674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.256096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.256799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.257312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.257975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.276987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:38.394985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:38.403157 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f78b20c-6d44-46a5-ac5e-4beabe88a71f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1675 microversion: 2.1 time: 0.159059 Oct 28 20:10:38.403725 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3489/6980] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:38 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:38.733450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-e4cbcb60-5a99-4723-951b-140d57e83054 req-ceaaf159-442c-40fc-a211-ecce53449a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "name": "network-vif-plugged", "status": "completed", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:38.745321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e4cbcb60-5a99-4723-951b-140d57e83054 req-ceaaf159-442c-40fc-a211-ecce53449a13 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:38.745822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e4cbcb60-5a99-4723-951b-140d57e83054 req-ceaaf159-442c-40fc-a211-ecce53449a13 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:38.746274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-e4cbcb60-5a99-4723-951b-140d57e83054 req-ceaaf159-442c-40fc-a211-ecce53449a13 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:38.758377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-e4cbcb60-5a99-4723-951b-140d57e83054 req-ceaaf159-442c-40fc-a211-ecce53449a13 service nova] Creating event network-vif-plugged:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:10:38.763883 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-e4cbcb60-5a99-4723-951b-140d57e83054 req-ceaaf159-442c-40fc-a211-ecce53449a13 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Oct 28 20:10:38.764693 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3492/6981] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:39.427224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:39.427834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:39.435610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.436107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.436557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.437257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:39.437722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:39.438181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:39.576937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:39.584903 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d652cf1e-ff5e-440c-a9c7-19c5c1e056a0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1675 microversion: 2.1 time: 0.161781 Oct 28 20:10:39.585458 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3490/6982] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:39 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:40.494180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-66b41826-dabc-4afc-929c-dfd9edaf2676 req-83060291-87bb-4937-908c-812f0d83f858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24685fe-d140-4094-b96e-a9c3e87954f0", "name": "network-vif-deleted", "tag": "fabbc5e4-12a3-43cf-9183-66453f164669"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:40.505669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-66b41826-dabc-4afc-929c-dfd9edaf2676 req-83060291-87bb-4937-908c-812f0d83f858 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.506163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-66b41826-dabc-4afc-929c-dfd9edaf2676 req-83060291-87bb-4937-908c-812f0d83f858 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.506603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-66b41826-dabc-4afc-929c-dfd9edaf2676 req-83060291-87bb-4937-908c-812f0d83f858 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.519048 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-66b41826-dabc-4afc-929c-dfd9edaf2676 req-83060291-87bb-4937-908c-812f0d83f858 service nova] Creating event network-vif-deleted:fabbc5e4-12a3-43cf-9183-66453f164669 for instance b24685fe-d140-4094-b96e-a9c3e87954f0 on n-h1-862769-3 Oct 28 20:10:40.524533 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-66b41826-dabc-4afc-929c-dfd9edaf2676 req-83060291-87bb-4937-908c-812f0d83f858 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034753 Oct 28 20:10:40.525989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3493/6983] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:40.609850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:40.610476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:40.618603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.619155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.619594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.620569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.621024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.621704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.657222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:40.657720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:40.658336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:40.659386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lazy-loading 'fault' on Instance uuid b24685fe-d140-4094-b96e-a9c3e87954f0 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:10:40.707176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:40.715168 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0bbe9ad8-9c92-49b7-95f1-308d5cecf5f5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 200 len: 1328 microversion: 2.1 time: 0.109387 Oct 28 20:10:40.715753 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3491/6984] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:40 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:41.736334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:41.741852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:41.742651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:41.749732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.750282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.750679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.751417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.751884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.752320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.769557 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 HTTP/1.1 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'b24685fe-d140-4094-b96e-a9c3e87954f0'} Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:10:41.771299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa06e941-a34c-46d3-ace8-19adce6127ce tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 404 len: 111 microversion: 2.1 time: 0.037501 Oct 28 20:10:41.775989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3494/6985] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:41 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:10:41.788583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:41.789206 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:41.796814 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.797293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.797743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.798442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:41.798947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:41.799385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:41.813642 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 HTTP/1.1 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'b24685fe-d140-4094-b96e-a9c3e87954f0'} Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:10:41.815371 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91bfdb26-dac3-4da9-8d7e-463748bc7dd5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 404 len: 111 microversion: 2.1 time: 0.032233 Oct 28 20:10:41.819789 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3492/6986] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:41 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:10:41.872748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1662622112", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "bfac833c-73c2-47c5-98d7-9281b6657401"}], "security_groups": [{"name": "tempest-securitygroup--1752382464"}], "key_name": "tempest-keypair-1391233376", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:41.985395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] validate_networks() for [('bfac833c-73c2-47c5-98d7-9281b6657401', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:10:42.730650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:10:42.731115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:10:42.731641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:10:42.732094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:10:42.732519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:10:42.744312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:42.744997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:42.745397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:42.746027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:42.746480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:42.746935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:42.768757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:10:42.774720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:10:42.789299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:10:42.791684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:10:42.845192 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-634c61f7-8ffd-4176-bbc7-ee877e757602 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975768 Oct 28 20:10:42.846210 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3495/6987] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:10:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:10:42.857927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8fbb7c72-6dff-4dd6-be90-0321088feece tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:42.858553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8fbb7c72-6dff-4dd6-be90-0321088feece tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:42.918121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8fbb7c72-6dff-4dd6-be90-0321088feece tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:42.926878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8fbb7c72-6dff-4dd6-be90-0321088feece tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1239 microversion: 2.1 time: 0.072944 Oct 28 20:10:42.927750 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3493/6988] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:42 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:43.954041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:43.954645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:43.957570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:43.964125 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.964834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.965287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:43.966097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:43.966549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:43.967023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:44.037689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:44.045931 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae6ecd70-2fc4-4abf-87c2-72c33798c437 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1291 microversion: 2.1 time: 0.096028 Oct 28 20:10:44.046506 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3496/6989] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:43 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1291 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:45.071809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:45.072520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:45.075638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=49 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:45.081077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.081566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.081997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.082709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.083175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.083599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.293849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:45.301953 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7bfa1f53-327e-43a0-8635-0e1b98c18e57 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1365 microversion: 2.1 time: 0.234116 Oct 28 20:10:45.302632 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3494/6990] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:45 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:45.655942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4f1317e7-f6b8-4324-aa77-204d0fbfebc9 req-6cad5b10-459b-459d-9699-a479c224e80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:45.670088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4f1317e7-f6b8-4324-aa77-204d0fbfebc9 req-6cad5b10-459b-459d-9699-a479c224e80e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:45.670684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4f1317e7-f6b8-4324-aa77-204d0fbfebc9 req-6cad5b10-459b-459d-9699-a479c224e80e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:45.671184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4f1317e7-f6b8-4324-aa77-204d0fbfebc9 req-6cad5b10-459b-459d-9699-a479c224e80e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:45.684876 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4f1317e7-f6b8-4324-aa77-204d0fbfebc9 req-6cad5b10-459b-459d-9699-a479c224e80e service nova] Creating event network-changed:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h1-862769-3 Oct 28 20:10:45.690855 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4f1317e7-f6b8-4324-aa77-204d0fbfebc9 req-6cad5b10-459b-459d-9699-a479c224e80e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038842 Oct 28 20:10:45.691459 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3497/6991] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:10:46.326798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:46.327528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:46.335552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.336083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.336624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.337421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:46.337902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:46.338378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:46.491950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:46.500541 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-18c593a5-478e-4657-b68d-bf24afe502e4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1365 microversion: 2.1 time: 0.177841 Oct 28 20:10:46.501137 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3495/6992] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:46 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:47.525306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:47.526043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:47.533322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:47.534184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:47.534629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.535379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:47.535845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:47.536274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:47.699886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:47.708173 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f81988f3-8015-4dff-991e-3eb4cef1a14f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1365 microversion: 2.1 time: 0.187368 Oct 28 20:10:47.708750 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3498/6993] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:47 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:48.731617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:48.732218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:48.739900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.740390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.740818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.741526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:48.741981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:48.742399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:48.881026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:48.889217 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d5de9d8a-834e-43d8-b271-fbea48b08789 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1365 microversion: 2.1 time: 0.161592 Oct 28 20:10:48.889793 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3496/6994] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:48 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:49.914508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:49.915114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:49.921725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:49.922232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:49.922681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:49.923473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:49.923946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:49.924386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.071631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:50.083590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2fac1c47-682e-4262-96d0-f4872308c3d0 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1365 microversion: 2.1 time: 0.174048 Oct 28 20:10:50.084204 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3499/6995] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:49 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:50.781296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-45a22a59-cb1c-486b-9659-566c4715b12c req-53dfbab1-55c7-4c57-87dc-ae2b020918a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "name": "network-vif-plugged", "status": "completed", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:50.792619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-45a22a59-cb1c-486b-9659-566c4715b12c req-53dfbab1-55c7-4c57-87dc-ae2b020918a5 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:50.793107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-45a22a59-cb1c-486b-9659-566c4715b12c req-53dfbab1-55c7-4c57-87dc-ae2b020918a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:50.793540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-45a22a59-cb1c-486b-9659-566c4715b12c req-53dfbab1-55c7-4c57-87dc-ae2b020918a5 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:50.805669 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-45a22a59-cb1c-486b-9659-566c4715b12c req-53dfbab1-55c7-4c57-87dc-ae2b020918a5 service nova] Creating event network-vif-plugged:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h1-862769-3 Oct 28 20:10:50.810898 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-45a22a59-cb1c-486b-9659-566c4715b12c req-53dfbab1-55c7-4c57-87dc-ae2b020918a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Oct 28 20:10:50.811496 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3497/6996] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:51.110312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:51.110967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:51.119217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.119717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.120149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.120877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:51.121341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:51.121770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:51.259522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:51.267797 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ff59e84d-ef78-4f23-ab42-2f02cef6d79f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1365 microversion: 2.1 time: 0.163226 Oct 28 20:10:51.268385 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3500/6997] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:51 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:52.293982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:52.294712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:52.301438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.301928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.302384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.303109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.303573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.303998 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.445050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:10:52.453241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07b24597-e436-44d5-9e2d-39896e74350d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1552 microversion: 2.1 time: 0.164600 Oct 28 20:10:52.453839 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3498/6998] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:10:52 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:10:52.484197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:10:52.484745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:10:52.493955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.494603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.495177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.496291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:52.496972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:52.497613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:52.581973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6397e39-4a50-479f-adfb-5f6bc143453a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103631 Oct 28 20:10:52.582942 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3501/6999] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:10:52 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:10:53.578171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:53.636562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e77d14f6-1d8e-40ce-bb2e-e5f992893e56 req-a16e252e-e380-4fa5-bc23-0744c28fdf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:10:53.646442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e77d14f6-1d8e-40ce-bb2e-e5f992893e56 req-a16e252e-e380-4fa5-bc23-0744c28fdf26 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:10:53.646946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e77d14f6-1d8e-40ce-bb2e-e5f992893e56 req-a16e252e-e380-4fa5-bc23-0744c28fdf26 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:10:53.647390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e77d14f6-1d8e-40ce-bb2e-e5f992893e56 req-a16e252e-e380-4fa5-bc23-0744c28fdf26 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:10:53.659436 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e77d14f6-1d8e-40ce-bb2e-e5f992893e56 req-a16e252e-e380-4fa5-bc23-0744c28fdf26 service nova] Creating event network-changed:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h1-862769-3 Oct 28 20:10:53.665040 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e77d14f6-1d8e-40ce-bb2e-e5f992893e56 req-a16e252e-e380-4fa5-bc23-0744c28fdf26 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091288 Oct 28 20:10:53.665746 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3499/7000] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:35.800321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:35.801240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:35.803466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=11 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:35.804327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:35.809926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:35.810531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:35.819627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:35.820167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:35.820605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:35.821313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:35.821774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:35.822210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:35.970059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:35.978918 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6d0305a7-b1b4-414e-a8a8-306e7d997f4b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1671 microversion: 2.1 time: 0.179406 Oct 28 20:11:35.979567 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3502/7001] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:35 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:36.000684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=11 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:36.001439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=46 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:36.007292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f4b47c8-2933-4e48-9102-2aee5bea66f9"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:11:36.009743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:36.018053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.018536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.019006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.019710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:36.020160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:36.020581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:36.284559 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c85866c7-8465-46ca-b7c6-00f494c275d1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286239 Oct 28 20:11:36.285540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3500/7002] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 20:11:35 2022] POST /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:11:47.065827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:11:47.068191 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:47.070815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:47.071885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:47.078277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.078807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.079257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.079966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.080432 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.080877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.110751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:47.116660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Old instance type m1.heat2, new instance type m1.heat {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:11:47.123905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:11:47.124454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:11:47.124975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:11:47.125401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:11:47.125820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:11:47.195314 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-46c25f3c-e9c5-4e89-96d0-ffa4db5211ae tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/action" status: 202 len: 0 microversion: 2.1 time: 0.133528 Oct 28 20:11:47.195896 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3503/7003] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:11:47 2022] POST /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:11:47.202497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:47.203488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:11:47.207928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:47.208664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:47.217086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.217551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.218056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.218818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:47.219361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:47.219794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:47.359848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:47.369161 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b10124a3-fa72-4c9d-b670-80f4ed034d47 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1726 microversion: 2.1 time: 0.168597 Oct 28 20:11:47.369748 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3501/7004] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:47 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:48.394060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:48.394621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:48.402034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.402563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.403051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.403804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:48.404267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:48.404712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:48.618350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:48.627218 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-351c043d-6260-412d-ad7a-fdf9954a1759 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1726 microversion: 2.1 time: 0.238214 Oct 28 20:11:48.627796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3504/7005] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:48 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:49.653625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:49.654293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:49.663217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:49.663710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:49.664160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:49.664880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:49.665339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:49.665769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:49.820154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:49.828720 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0052c72b-347b-48c4-b38f-471251c33438 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.180811 Oct 28 20:11:49.829277 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3502/7006] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:49 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:50.915363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:50.916014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:50.923075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.923578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.924020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:50.924732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:50.925198 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:50.925635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:51.057683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:51.066479 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e32a11d6-a4ed-478d-8d59-ee365ab08b16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.217667 Oct 28 20:11:51.067097 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3505/7007] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:50 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:52.099287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:52.099867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:52.107370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.107854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.108299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.108996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:52.109455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:52.109869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:52.250684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:52.259592 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-78886ba6-d80f-400c-8191-9a2263f8c16f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.164346 Oct 28 20:11:52.260181 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3503/7008] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:52 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:53.285165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:53.285759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:53.293083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.293606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.294110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.294804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:53.295277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:53.295720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:53.436496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:53.445257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc006c79-f38c-4a6f-8925-f8d03143b2db tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.165419 Oct 28 20:11:53.445841 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3506/7009] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:53 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:54.470955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:54.471728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:54.481507 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.482077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.482683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.483665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:54.484281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:54.484862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:54.625151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:54.637891 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59ee7740-3322-44ba-b9bd-a8c9c8f05344 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.172045 Oct 28 20:11:54.638726 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3504/7010] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:54 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:55.662733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:55.663378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:55.670841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:55.671344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.671787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.672489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:55.672957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:55.673380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:55.813045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:55.822266 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15745945-d8de-4bda-97e1-b87da08d5ed9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.163935 Oct 28 20:11:55.822905 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3507/7011] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:55 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:56.849061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:56.849984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:56.859647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.860325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.860881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:56.861859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:56.862594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:56.863057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:57.004332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:57.012942 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e3c15db3-ff67-4b59-b3e5-6a9343b86ef9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.169424 Oct 28 20:11:57.013669 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3505/7012] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:56 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:58.042532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:58.043600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:58.051700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:58.052331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:58.052906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.053691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:58.054183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:58.054617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:58.199056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:58.208163 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17b76765-33a0-4eed-9d39-588207d5c34e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.172558 Oct 28 20:11:58.208757 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3508/7013] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:58 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:11:59.231347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:11:59.231937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:11:59.242135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.242794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.243422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.244420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:11:59.245022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:11:59.245606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:11:59.393668 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:11:59.406364 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-059354d4-628c-495a-8d95-97ac05845a01 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.178821 Oct 28 20:11:59.407124 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3506/7014] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:11:59 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:00.431811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:00.432528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:00.439516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.440037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.440475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.441150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:00.441684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:00.442113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:00.577305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:00.586630 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7602b2ec-e50f-49c8-a947-8fb542c64510 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.158940 Oct 28 20:12:00.587261 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3509/7015] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:00 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:01.621769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:01.622636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:01.632440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.632930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.633373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.634079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:01.634542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:01.635000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:01.792491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:01.801761 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed206eaf-fbb2-4b78-895f-9e3c2ea136fd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.185921 Oct 28 20:12:01.802342 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3507/7016] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:01 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:02.827903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:02.828572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:02.837030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.837534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.837986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.838735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:02.839244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:02.839684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:02.984059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:02.994177 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c2f2d322-c80a-4f11-b767-91c9e7723c16 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.172383 Oct 28 20:12:02.994808 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3510/7017] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:02 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:04.021404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:04.022061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:04.032327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:04.032880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:04.033836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.034945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:04.035594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:04.036373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:04.191059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:04.204378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37953f5a-a6fb-4761-84c7-ee93a6622fa2 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.188678 Oct 28 20:12:04.205243 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3508/7018] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:04 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:05.229901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:05.230541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:05.237975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:05.238470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:05.238948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:05.239661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:05.240124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:05.240554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:05.374403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:05.383044 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-103ed08e-91fa-4058-aef2-cdb9e9b45627 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.157536 Oct 28 20:12:05.383615 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3511/7019] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:05 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:06.407028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:06.407637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:06.415367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:06.415855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:06.416288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.417029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:06.417490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:06.417909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:06.560596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:06.571617 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3888a355-e623-4916-b0e7-d433f76c1a11 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.168571 Oct 28 20:12:06.573033 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3509/7020] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:06 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:07.597290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:07.597908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:07.605749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.606248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.606712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.607444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:07.607905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:07.608386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:07.746788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:07.755947 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1d4b3c30-5718-4a00-8af7-d67df5b7b162 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1731 microversion: 2.1 time: 0.162670 Oct 28 20:12:07.756519 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3512/7021] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:07 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:08.780926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:08.781550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:08.788907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.789730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.790246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.791068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:08.791696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:08.792202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:08.926233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:08.935112 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9b622da5-a45f-4129-ad0e-d1e527dc099a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1730 microversion: 2.1 time: 0.158778 Oct 28 20:12:08.935946 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3510/7022] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:08 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:09.047097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "name": "network-vif-unplugged", "status": "completed", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:09.058248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.058773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.059228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.072330 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] Creating event network-vif-unplugged:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h2-862769-3 Oct 28 20:12:09.077931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:12:09.089354 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-01a50581-89c6-45a2-8c71-2d00f5898ca7 req-083be320-9267-4329-a9c7-fcb452181ddb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046014 Oct 28 20:12:09.090371 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3513/7023] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:09.959679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:09.960317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:09.968358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.968879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.969299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:09.970015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:09.970472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:09.970935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:10.114642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:10.125481 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-88324648-d28d-4f75-98a7-57fcae4616ab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1730 microversion: 2.1 time: 0.169792 Oct 28 20:12:10.126082 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3511/7024] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:09 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:11.129419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:11.140261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.140766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.141212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.149771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:11.150632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:11.154629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] Creating event network-changed:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h2-862769-3 Oct 28 20:12:11.159273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.159880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.160471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.160939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:12:11.161672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:11.162234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:11.162807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:11.172295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c747cc62-b31b-4009-85e7-4ee86eef0305 req-1cb03a0d-be1c-4ab8-86fb-73197ec13211 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047953 Oct 28 20:12:11.172918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3514/7025] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:11.406744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:11.417046 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-df787698-10f2-40ee-9521-2bcce3606094 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.271289 Oct 28 20:12:11.431185 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3512/7026] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:11 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:12.444394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:12.445159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:12.451800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.452306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.452753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.453474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:12.453942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:12.454379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:12.605121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:12.614214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b2d62fb-985b-44ef-8592-2473862715eb tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.175081 Oct 28 20:12:12.614848 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3515/7027] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:12 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:13.638363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:13.638985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:13.646662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.647347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.647796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.648512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:13.648958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:13.649392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:13.791087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:13.800251 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a3e754e-cfe3-44e6-a0f8-a2a6a4fe2cf3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.166034 Oct 28 20:12:13.800811 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3513/7028] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:13 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:14.824066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:14.824726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:14.832415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.832921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.833368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.834082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:14.834547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:14.835013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:14.973235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:14.982763 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bfac18f3-8e63-4e46-aea8-0f4d9d7a7b51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.162718 Oct 28 20:12:14.983385 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3516/7029] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:14 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:16.009117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:16.009714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:16.017005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:16.017521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:16.017961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.018640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:16.019189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:16.019609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:16.512818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:16.521566 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13f9e8b5-88b7-4b88-8614-e85e6b93777c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.516487 Oct 28 20:12:16.522141 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3514/7030] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:16 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:17.545713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:17.546283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:17.548893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=33 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:17.554839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:17.555456 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:17.555904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:17.556640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:17.557102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:17.557535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:17.560742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:17.712398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:17.721155 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b0d2633f-6b7b-4cb1-98ec-751e9f1db051 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.179927 Oct 28 20:12:17.721711 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3517/7031] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:17 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:18.747018 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:18.747640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:18.751171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=29 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:18.757393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.757984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.758517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.759251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:18.759699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:18.760122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:18.763237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=85 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:18.913401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:18.922683 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b3f9751c-e4bf-4f7a-83a7-cda339028f29 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.182274 Oct 28 20:12:18.923296 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3515/7032] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:18 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:19.949452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:19.950505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:19.960725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.961533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.962171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:19.963379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:19.963846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:19.964275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:20.101847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:20.111238 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e626c4ed-0bad-4a53-8331-6f50d2f35e56 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.167383 Oct 28 20:12:20.112023 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3518/7033] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:19 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:21.137088 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:21.137701 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:21.145476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.145967 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.146406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.147143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:21.147603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:21.148033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:21.297456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:21.306320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-53af3665-64bc-438b-82c7-02fcda40bc61 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.173828 Oct 28 20:12:21.307067 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3516/7034] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:21 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:22.331840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:22.332546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:22.339409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.339937 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.340399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.341061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:22.341509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:22.341992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:22.489764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:22.502135 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3fecc805-419f-45ca-a478-32bdd57ad2df tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1728 microversion: 2.1 time: 0.176030 Oct 28 20:12:22.502935 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3519/7035] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:22 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:23.528786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:23.529359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:23.537060 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.537550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.537988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.538715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.539200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.539630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.672945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:23.685039 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91d7ec20-3198-4cef-bad2-43e8ff320092 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1725 microversion: 2.1 time: 0.161880 Oct 28 20:12:23.685680 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3517/7036] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:23 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:23.707917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:23.708485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:23.715671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.716165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.716609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.717306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.717765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.718192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.756038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.756530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.756974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.757702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.758164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.758594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.779051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:12:23.784514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Getting quotas for user 40cf4ee1e913432ea08f00b82ff52bb1 and project 48934cfff7e5482d82ce6168d23ef8fb. Resources: {'cores', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:12:23.907399 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-85cb48d3-dcda-40c9-941a-3687024e02c5 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "POST /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/action" status: 202 len: 0 microversion: 2.1 time: 0.203197 Oct 28 20:12:23.909214 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3520/7037] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:12:23 2022] POST /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:12:23.918977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:23.919693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:23.926033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.926603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.927139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:23.927989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:23.928513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:23.929003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:24.065969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:24.076410 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5a9eb6ee-fb40-4707-bc9c-b5097a9d1830 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.162665 Oct 28 20:12:24.076992 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3518/7038] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:23 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:25.101949 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:25.102658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:25.109560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:25.110065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:25.110495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.111263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:25.111731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:25.112270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:25.250578 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:25.260287 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-63832576-2684-45d0-9b37-babda7067f05 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.163576 Oct 28 20:12:25.261222 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3521/7039] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:25 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:26.301975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:26.302615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:26.309794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:26.310446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:26.310919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:26.311638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:26.312119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:26.312666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:26.453237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:26.463183 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-91437143-2d11-4d48-8ea3-05fcce4e278f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.169078 Oct 28 20:12:26.463771 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3519/7040] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:26 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:27.008919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "name": "network-vif-plugged", "status": "completed", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:27.019923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.020581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.021033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.034217 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] Creating event network-vif-plugged:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h2-862769-3 Oct 28 20:12:27.039905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:12:27.050970 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-8c95bfc4-64e1-43f4-baff-9d8f41b08152 req-9083c476-68b0-403b-9695-9ecf85a27925 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102070 Oct 28 20:12:27.051757 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3522/7041] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:27.487231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:27.487827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:27.495325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.495816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.496245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.496953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:27.497398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:27.497817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:27.633279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:27.642879 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efc2c8cc-f187-4403-8253-3585c023e91a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.159841 Oct 28 20:12:27.643443 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3520/7042] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:27 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:28.666637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:28.668075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:28.675649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.676468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.677187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.677989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:28.678669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:28.679320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:28.883382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:28.892969 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7cb4099f-093e-4f57-9c71-3988d56d4e98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.230471 Oct 28 20:12:28.893905 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3523/7043] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:28 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:29.266498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "name": "network-vif-unplugged", "status": "completed", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:29.275984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.276468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.276896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.290361 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] Creating event network-vif-unplugged:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h1-862769-3 Oct 28 20:12:29.305549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:12:29.318409 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-55009e35-cd6f-44fc-a5b6-22cdad08281a req-312af88f-2c90-4a50-9977-5cbac0d87a62 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121860 Oct 28 20:12:29.319255 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3521/7044] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:29.917395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:29.917992 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:29.925634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.926069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.926536 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:29.927286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:29.927744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:29.928174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:30.151046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:30.160324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9ca6c2a2-0acb-401c-9d81-8bc448a445c6 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.246956 Oct 28 20:12:30.160951 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3524/7045] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:29 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:31.185731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:31.186393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:31.193355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.193856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.194293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.195044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.195506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.195900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.333626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:31.339100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:31.345164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:31.345896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:31.346333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:31.348574 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0eb3b2d7-1297-40d5-87bd-8e222bde4236 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.168279 Oct 28 20:12:31.349431 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3522/7046] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:31 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:31.358979 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] Creating event network-changed:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h1-862769-3 Oct 28 20:12:31.365611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:12:31.376733 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c2a8f040-5413-4d03-8b45-c7be4a04c59a req-9ea91345-30f6-4f39-9506-00843011e003 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046919 Oct 28 20:12:31.377344 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3525/7047] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:12:32.372961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:32.373659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:32.381212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.381760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.382210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.382994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:32.383490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:32.383919 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:32.521394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:32.530356 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e9bdcf75-e92e-4f4e-81bb-49472751b09e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.161248 Oct 28 20:12:32.530956 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3523/7048] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:32 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:33.557501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:33.558336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:33.564977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.565594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.566102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.566921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:33.567451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:33.567970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:33.706474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:33.715205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6519ac55-b87a-4831-b349-e0be3d3183f9 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.162976 Oct 28 20:12:33.715737 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3526/7049] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:33 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:34.740559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:34.741381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:34.748901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.749397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.749875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.750564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:34.751063 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:34.751485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:34.888843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:34.897932 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cc8de34c-c125-44b3-9d2f-6a969282b09a tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.161343 Oct 28 20:12:34.898495 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3524/7050] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:34 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:35.925260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:35.925853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:35.928611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:35.936637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.937129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.937566 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:35.938278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:35.938734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:35.939209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:36.086914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:36.095726 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0fba932d-5c8c-41fa-bc12-cf44f2eddbcc tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.176623 Oct 28 20:12:36.096289 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3527/7051] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:35 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:37.119981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:37.120592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:37.127647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:37.128125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:37.128567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.129269 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:37.129733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:37.130160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:37.284518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:37.296175 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-160c64d3-682e-4bed-bde8-f7965cfed6bd tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.180347 Oct 28 20:12:37.296798 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3525/7052] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:37 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:38.320083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:38.320677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:38.328470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.328967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.329404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.330112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:38.330570 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:38.331032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:38.463612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:38.472801 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-75b4045c-bb71-43f4-9898-f1a53b493f42 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.156801 Oct 28 20:12:38.473383 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3528/7053] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:38 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:39.496467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:39.497044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:39.504374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.504864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.505304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.506005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:39.506468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:39.506932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:39.650378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:39.664024 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6aaf051-9e68-49bd-8b52-5add917f1f3e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.171483 Oct 28 20:12:39.664808 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3526/7054] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:39 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:40.688577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:40.689334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:40.696576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.697068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.697510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.698216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:40.698677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:40.699133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:40.844668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:40.853754 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a13d4e9-e0ef-4d42-9fa0-1bcfd34c7aab tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.169379 Oct 28 20:12:40.854359 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3529/7055] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:40 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:41.881002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:41.881626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:41.889603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.890097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.890511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:41.891246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:41.891739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:41.892243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:42.034083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:42.042653 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c06bb5dd-7635-422b-8679-e360b5f9f5a4 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1724 microversion: 2.1 time: 0.165715 Oct 28 20:12:42.043273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3527/7056] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:41 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:43.066298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.066919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.075128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.075637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.076082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.076800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.077261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.077696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.226074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.234850 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-925268a6-61c1-4199-9e6d-0b403aed6ef3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1717 microversion: 2.1 time: 0.172912 Oct 28 20:12:43.235580 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3530/7057] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:43 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:43.315640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.316242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.326421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.327178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.327669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.328780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.329388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.329975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.471996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.480866 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca45e32d-cb7b-4150-bb07-1251f2525857 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1717 microversion: 2.1 time: 0.169214 Oct 28 20:12:43.481456 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3528/7058] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:43 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:43.503683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.504302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.510309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.510832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.511275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.511967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.512429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.512853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.528321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:43.651302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.660880 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-599ba89d-d486-4304-a691-19c747d2782c tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1717 microversion: 2.1 time: 0.161266 Oct 28 20:12:43.661477 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3531/7059] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:43 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:12:43.685502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.686622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.694265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.694777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.695215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.695911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.696364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.696788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.721995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:12:43.811612 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e5a75a9c-a900-40ef-8bd0-90b7f522f082 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 204 len: 0 microversion: 2.1 time: 0.131834 Oct 28 20:12:43.812242 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3529/7060] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:12:43 2022] DELETE /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:12:43.821196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:43.821870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:43.828671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.829185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.829634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.830363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:43.830859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:43.831267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:43.977322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:43.988988 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-13fc58bc-de94-4484-a7e1-25119581f0ca tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1723 microversion: 2.1 time: 0.172014 Oct 28 20:12:43.989609 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3532/7061] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:43 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:45.014710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:45.015577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:45.024155 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.024620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.025154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.025988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:45.026547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:45.027085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:45.043925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:45.174971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:45.183995 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e7d825c4-534a-4036-8b6f-515d36d3556e tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1723 microversion: 2.1 time: 0.174498 Oct 28 20:12:45.184441 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3530/7062] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:45 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:46.207781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:46.208522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:46.216643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.217265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.217752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.219177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.219734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.220238 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.302903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:46.311665 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae003ed5-3b15-4b95-a891-5a12a5c992a1 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1655 microversion: 2.1 time: 0.107971 Oct 28 20:12:46.312226 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3533/7063] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:46 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:46.422378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-81a44a7e-8e42-47d0-a09e-baa65dc70851 req-e1a546ba-717d-4773-a153-ed10848651e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cbb7b9-59a7-46db-b2ad-a659fcc18b62", "name": "network-vif-deleted", "tag": "84246046-0e41-41bc-950a-ff9bac8b39eb"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:12:46.434391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-81a44a7e-8e42-47d0-a09e-baa65dc70851 req-e1a546ba-717d-4773-a153-ed10848651e2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:46.441666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-81a44a7e-8e42-47d0-a09e-baa65dc70851 req-e1a546ba-717d-4773-a153-ed10848651e2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:46.442198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-81a44a7e-8e42-47d0-a09e-baa65dc70851 req-e1a546ba-717d-4773-a153-ed10848651e2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:46.458222 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-81a44a7e-8e42-47d0-a09e-baa65dc70851 req-e1a546ba-717d-4773-a153-ed10848651e2 service nova] Creating event network-vif-deleted:84246046-0e41-41bc-950a-ff9bac8b39eb for instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 on n-h1-862769-3 Oct 28 20:12:46.468372 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-81a44a7e-8e42-47d0-a09e-baa65dc70851 req-e1a546ba-717d-4773-a153-ed10848651e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048927 Oct 28 20:12:46.469215 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3531/7064] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:12:47.336665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:47.337275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:47.344631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.346842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.346842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.346842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:47.346842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:47.347291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:47.418545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:47.427202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ad429e37-6ed1-46b6-857d-80b123d97d98 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1370 microversion: 2.1 time: 0.094394 Oct 28 20:12:47.427799 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3534/7065] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:47 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:48.452477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:48.453033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:48.460138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.460760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.461049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.461757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:48.463685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:48.463685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:48.528859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:48.537989 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28e9cc27-5353-4e4c-801b-44235056928b tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1370 microversion: 2.1 time: 0.091299 Oct 28 20:12:48.538573 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3532/7066] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:48 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:49.561122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:49.561667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:49.564839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:49.571460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.572188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.572647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.573367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:49.573834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:49.574270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:49.640519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:49.649773 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aa8efb3e-afa4-4367-9348-1c37200f2f5f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1370 microversion: 2.1 time: 0.092639 Oct 28 20:12:49.650417 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3535/7067] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:49 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:50.673468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:50.674958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:50.676968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:12:50.683728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.684224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.684667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.685397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.685856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.686276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.723001 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:50.723402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:50.723843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:50.724290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lazy-loading 'fault' on Instance uuid 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:12:50.768443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf4ee1e913432ea08f00b82ff52bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48934cfff7e5482d82ce6168d23ef8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:12:50.777038 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c23f976a-1a34-4271-b086-79ca5170d76f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 200 len: 1375 microversion: 2.1 time: 0.107522 Oct 28 20:12:50.777595 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3533/7068] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:50 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 1375 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:12:51.801275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:51.801892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:51.809083 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.809576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.810023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.810726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.811220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.811709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.825682 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 HTTP/1.1 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '14cbb7b9-59a7-46db-b2ad-a659fcc18b62'} Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:51.827445 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2e52e096-ebd8-49f0-ba57-f9b20ced5538 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 404 len: 111 microversion: 2.1 time: 0.031921 Oct 28 20:12:51.831981 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3536/7069] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:51 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:51.893567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:51.895812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:51.903483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.903978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.904412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.905124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:51.905565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:51.905990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:51.919703 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-volume_attachments HTTP/1.1 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '14cbb7b9-59a7-46db-b2ad-a659fcc18b62'} Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:51.921423 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-162c48d7-40bb-4718-be20-c67798c928da tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033321 Oct 28 20:12:51.926021 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3534/7070] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:12:51 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.271487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.272189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.280139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.280651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.281107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.281833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.282302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.282766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.297247 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 HTTP/1.1 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '14cbb7b9-59a7-46db-b2ad-a659fcc18b62'} Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.298954 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a65b7ad-741a-434d-b81e-d398d459e2b3 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 404 len: 111 microversion: 2.1 time: 0.033013 Oct 28 20:12:55.302987 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3537/7071] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:12:55 2022] DELETE /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 20:12:55.311818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.312497 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 14cbb7b9-59a7-46db-b2ad-a659fcc18b62] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.323128 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.323760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.324259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.325365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.326589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.326589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.343067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 HTTP/1.1 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '14cbb7b9-59a7-46db-b2ad-a659fcc18b62'} Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.344636 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 14cbb7b9-59a7-46db-b2ad-a659fcc18b62 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87433f6f-00b3-4e30-bd28-01e950c2929f tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62" status: 404 len: 111 microversion: 2.1 time: 0.040249 Oct 28 20:12:55.348897 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3535/7072] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/14cbb7b9-59a7-46db-b2ad-a659fcc18b62 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.355226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.355746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.362502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.363069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.363529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.364342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.364847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.365297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.380681 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 HTTP/1.1 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'b24685fe-d140-4094-b96e-a9c3e87954f0'} Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.382348 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.387396 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f0605ed6-3014-42d2-bf53-b5264d37d900 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 404 len: 111 microversion: 2.1 time: 0.032907 Oct 28 20:12:55.388314 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3538/7073] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:12:55 2022] DELETE /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.393402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.394028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: b24685fe-d140-4094-b96e-a9c3e87954f0] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.400931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.401422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.401863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.402581 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.403066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.403501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.419030 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 HTTP/1.1 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'b24685fe-d140-4094-b96e-a9c3e87954f0'} Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.420918 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance b24685fe-d140-4094-b96e-a9c3e87954f0 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2e97fc8a-e5c4-494d-8768-dcd92c92eb51 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0" status: 404 len: 111 microversion: 2.1 time: 0.032828 Oct 28 20:12:55.425266 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3536/7074] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/b24685fe-d140-4094-b96e-a9c3e87954f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.432801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.433327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.439837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.440358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.440815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.441547 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.442161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.442606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.457476 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 HTTP/1.1 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '2a527e98-4392-42f3-aa29-9e19fb0510b1'} Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.459113 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fdc98ad-b2f5-48df-9bf3-64d5ecf8df26 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 404 len: 111 microversion: 2.1 time: 0.031943 Oct 28 20:12:55.463481 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3539/7075] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:12:55 2022] DELETE /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.469471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.470109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: 2a527e98-4392-42f3-aa29-9e19fb0510b1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.476423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.476903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.477339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.478026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.478548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.479006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.493053 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 HTTP/1.1 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '2a527e98-4392-42f3-aa29-9e19fb0510b1'} Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.494624 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance 2a527e98-4392-42f3-aa29-9e19fb0510b1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a4b95fca-be93-4c67-b277-3fe8b449d7cf tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1" status: 404 len: 111 microversion: 2.1 time: 0.030611 Oct 28 20:12:55.499702 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3537/7076] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/2a527e98-4392-42f3-aa29-9e19fb0510b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.506623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.507201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.513742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.514241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.514683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.515418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.515887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.516319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.530741 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 HTTP/1.1 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c91bb475-32be-43cb-b676-096fa6fb2d97'} Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.532390 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8c875091-8b80-44aa-983d-2d5183df9e03 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 404 len: 111 microversion: 2.1 time: 0.031765 Oct 28 20:12:55.536711 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3540/7077] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:12:55 2022] DELETE /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.543106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.543719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [instance: c91bb475-32be-43cb-b676-096fa6fb2d97] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:12:55.550019 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.550505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.550961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.551843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:12:55.552303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:12:55.552715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:12:55.566574 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] HTTP exception thrown: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Request method failure captured: Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 HTTP/1.1 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDZayuQJZDG6oM1wJ-XSPMKXS4__aMZHwUUMo84iPnoOc1pEugNX2MTIqQBJboNvrXEmmaYUiR6UPfVM9kUYIUwLqDnWaqkDuYOEtMDTRVHiuYVMH7pqq7F4kRTo6AkCh1vrbRzYWfcL0m1HIEPrPD_xN0dn-BomR--HLNTDcIou_V0 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_48934cfff7e5482d82ce6168d23ef8fb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/48934cfff7e5482d82ce6168d23ef8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 48934cfff7e5482d82ce6168d23ef8fb Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServerActionsTestJSON-34292657 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 40cf4ee1e913432ea08f00b82ff52bb1 Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServerActionsTestJSON-34292657-project Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c91bb475-32be-43cb-b676-096fa6fb2d97'} Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:12:55.568241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Returning 404 to user: Instance c91bb475-32be-43cb-b676-096fa6fb2d97 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bdfdd6cd-9ada-4ae0-a563-cd487025ff36 tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97" status: 404 len: 111 microversion: 2.1 time: 0.030532 Oct 28 20:12:55.572409 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3538/7078] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:12:55 2022] GET /compute/v2.1/servers/c91bb475-32be-43cb-b676-096fa6fb2d97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:12:55.578702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-21ea036c-7e32-4242-9ee8-8622a152203d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] Calling method '.version_select at 0x7f1d772324c0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:12:55.583495 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21ea036c-7e32-4242-9ee8-8622a152203d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [8dab03a3-a971-4caa-b449-4716773632b0] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:12:56.601416 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [None req-21ea036c-7e32-4242-9ee8-8622a152203d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] [8dab03a3-a971-4caa-b449-4716773632b0] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 39080. Oct 28 20:12:56.631659 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-21ea036c-7e32-4242-9ee8-8622a152203d tempest-ServerActionsTestJSON-34292657 tempest-ServerActionsTestJSON-34292657-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391233376" status: 202 len: 0 microversion: 2.1 time: 1.056835 Oct 28 20:12:56.632265 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3541/7079] 10.222.0.44 () {58 vars in 1221 bytes} [Fri Oct 28 20:12:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391233376 => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:13:06.187237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=13 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:06.188648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=29 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:06.334371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-921299937", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e17f27bf-a739-46d8-ace7-fae3390df2ee"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:06.391298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] validate_networks() for [('e17f27bf-a739-46d8-ace7-fae3390df2ee', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:13:06.792446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:13:06.792864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:13:06.793361 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:13:06.794158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:13:06.794249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:13:06.804179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.804799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.805312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.806114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:06.806638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:06.807177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:06.825083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Getting quotas for project 36c2ea7406aa4d6b87697c3fb7fe6ca2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:13:06.830868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Getting quotas for user d3b693914c9e467995c2bdc25ca9656f and project 36c2ea7406aa4d6b87697c3fb7fe6ca2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:13:06.844989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:13:06.847426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:13:06.892990 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [71f22fd6-515a-4810-9ef3-1140c046b896] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:13:07.905770 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [71f22fd6-515a-4810-9ef3-1140c046b896] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 39162. Oct 28 20:13:07.914238 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80e11068-d9ab-4d14-86a9-de581c96e8a2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732902 Oct 28 20:13:07.921099 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3539/7080] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:13:07.925170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=37 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:07.926171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:07.932654 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-69a91d13-2b3d-441b-b978-cc84e5095ddc tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:07.933541 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-69a91d13-2b3d-441b-b978-cc84e5095ddc tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:07.998270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-69a91d13-2b3d-441b-b978-cc84e5095ddc tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:08.005958 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-69a91d13-2b3d-441b-b978-cc84e5095ddc tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1216 microversion: 2.1 time: 0.083348 Oct 28 20:13:08.006540 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3542/7081] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:07 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:09.029950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:09.030574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:09.039021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.039864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.040912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.042595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:09.043508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:09.044096 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:09.147385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:09.158529 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-224b458c-c8fa-4a52-83df-321f10d8a925 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1276 microversion: 2.1 time: 0.133252 Oct 28 20:13:09.159350 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3540/7082] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:09 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:10.183216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:10.183855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:10.193726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.194239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.194683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.195436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.195903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.200120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.467310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:10.476055 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ab58b3b5-11aa-437c-adff-7e5bb8117768 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.297756 Oct 28 20:13:10.476619 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3543/7083] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:10 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:10.634934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-16a034a7-fda2-4b3f-8ede-c50828425797 req-26bcc7bd-4c63-4b96-9a16-a8eb3d7848e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7301ae12-12e0-4571-a86d-9df990348b35", "tag": "ebeee835-f0ab-45fb-bf42-df681bb423c0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:10.647298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-16a034a7-fda2-4b3f-8ede-c50828425797 req-26bcc7bd-4c63-4b96-9a16-a8eb3d7848e3 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:10.647777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-16a034a7-fda2-4b3f-8ede-c50828425797 req-26bcc7bd-4c63-4b96-9a16-a8eb3d7848e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:10.648292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-16a034a7-fda2-4b3f-8ede-c50828425797 req-26bcc7bd-4c63-4b96-9a16-a8eb3d7848e3 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:10.660828 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-16a034a7-fda2-4b3f-8ede-c50828425797 req-26bcc7bd-4c63-4b96-9a16-a8eb3d7848e3 service nova] Creating event network-changed:ebeee835-f0ab-45fb-bf42-df681bb423c0 for instance 7301ae12-12e0-4571-a86d-9df990348b35 on n-h1-862769-3 Oct 28 20:13:10.665998 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-16a034a7-fda2-4b3f-8ede-c50828425797 req-26bcc7bd-4c63-4b96-9a16-a8eb3d7848e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035380 Oct 28 20:13:10.666607 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3541/7084] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:11.503195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:11.503957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:11.511801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.512305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.512756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.513474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:11.513921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:11.514382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:11.659876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:11.668978 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1b66e0f8-8d95-47bf-85a8-74e17cecb80c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.172502 Oct 28 20:13:11.669690 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3544/7085] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:11 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:12.699114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:12.699793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:12.706638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.707165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.707602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.708442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:12.709038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:12.709308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:12.851198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:12.862097 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d221c123-d17d-4162-86bd-389ca863e7e0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.171498 Oct 28 20:13:12.862809 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3542/7086] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:12 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:13.890283 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:13.890939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:13.901516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.902142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.902757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:13.903735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:13.904341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:13.904935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:14.051969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:14.064451 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c03dd14-6e77-41c1-b006-1ecb9c7b2a3a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.180186 Oct 28 20:13:14.065460 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3545/7087] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:13 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:15.089161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:15.089750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:15.097257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:15.098039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:15.098733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.099951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:15.100500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:15.100930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:15.240888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:15.249369 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-08134b4e-a52d-4512-8000-090b5ab2e4e6 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.164266 Oct 28 20:13:15.249936 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3543/7088] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:15 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:16.272756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:16.273360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:16.282401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.283299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.283747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.284465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:16.284932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:16.285354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:16.432560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:16.444452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92704cc4-9458-40ba-b900-8245cc0d6700 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.175696 Oct 28 20:13:16.445267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3546/7089] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:16 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:17.396765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fae90ce9-5702-4582-b864-8c9674252494 req-4724788c-92fe-43fe-96f9-f547f185265a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7301ae12-12e0-4571-a86d-9df990348b35", "name": "network-vif-plugged", "status": "completed", "tag": "ebeee835-f0ab-45fb-bf42-df681bb423c0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:17.403156 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:13:17.403305 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:13:17.406207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:17.407056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:17.418714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fae90ce9-5702-4582-b864-8c9674252494 req-4724788c-92fe-43fe-96f9-f547f185265a service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.419201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fae90ce9-5702-4582-b864-8c9674252494 req-4724788c-92fe-43fe-96f9-f547f185265a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.419635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fae90ce9-5702-4582-b864-8c9674252494 req-4724788c-92fe-43fe-96f9-f547f185265a service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.431906 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fae90ce9-5702-4582-b864-8c9674252494 req-4724788c-92fe-43fe-96f9-f547f185265a service nova] Creating event network-vif-plugged:ebeee835-f0ab-45fb-bf42-df681bb423c0 for instance 7301ae12-12e0-4571-a86d-9df990348b35 on n-h1-862769-3 Oct 28 20:13:17.437571 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fae90ce9-5702-4582-b864-8c9674252494 req-4724788c-92fe-43fe-96f9-f547f185265a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045098 Oct 28 20:13:17.438313 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3544/7090] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:17.468914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:17.469593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:17.475873 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.476382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.476829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.477544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:17.478011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:17.478440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:17.664372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:17.672715 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c3117754-1dba-44e8-9c54-e7b3c675fe6b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.209434 Oct 28 20:13:17.673257 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3547/7091] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:17 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:18.698146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:18.698899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:18.705458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.705948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.706384 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.707111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:18.707570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:18.708054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:18.851924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:18.861088 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d8d39f97-b577-4a60-8160-75ef3ee6b1c0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1316 microversion: 2.1 time: 0.168047 Oct 28 20:13:18.861703 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3545/7092] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:18 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:19.884755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:19.885651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:19.887565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:19.894724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.895229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.895671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:19.896411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:19.896866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:19.897305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.028753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:20.037257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0c5208ed-50f9-4ae7-9edd-7931520352ac tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.156801 Oct 28 20:13:20.037811 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3548/7093] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:19 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:20.099364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-815595521", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "e17f27bf-a739-46d8-ace7-fae3390df2ee"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:20.154311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] validate_networks() for [('e17f27bf-a739-46d8-ace7-fae3390df2ee', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:13:20.532611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:13:20.533423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:13:20.534106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:13:20.534633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:13:20.535246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:13:20.546135 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.546617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.547084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.547812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:20.548286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:20.548705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:20.565667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Getting quotas for project 36c2ea7406aa4d6b87697c3fb7fe6ca2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:13:20.571115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Getting quotas for user d3b693914c9e467995c2bdc25ca9656f and project 36c2ea7406aa4d6b87697c3fb7fe6ca2. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:13:20.583385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:13:20.585696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:13:20.633737 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c6a7238d-935a-4a49-81e2-cd33c4d79b1a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538370 Oct 28 20:13:20.634531 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3546/7094] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:13:20.646803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-388fdd4e-4c58-48ae-9b09-ec0cad6b794a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:20.647399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-388fdd4e-4c58-48ae-9b09-ec0cad6b794a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:20.708043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-388fdd4e-4c58-48ae-9b09-ec0cad6b794a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:20.715300 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-388fdd4e-4c58-48ae-9b09-ec0cad6b794a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1216 microversion: 2.1 time: 0.073034 Oct 28 20:13:20.716137 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3549/7095] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:20 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:21.741862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:21.742841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:21.750746 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:21.751394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:21.751862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:21.753075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:21.753605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:21.754153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:22.165160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:22.173532 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ed002aad-e5bd-44b2-b884-677f7688354e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1274 microversion: 2.1 time: 0.439867 Oct 28 20:13:22.174153 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3547/7096] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:21 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1274 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:23.028669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-fe1e184d-773b-48fd-9c18-e424da5cb5d2 req-d5d28851-c090-401d-a020-62f842618c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a4275c-2373-4de9-9445-6d4ca010ec18", "tag": "f6a7698e-eabe-4f42-9a5c-52216c235219"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:23.043458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fe1e184d-773b-48fd-9c18-e424da5cb5d2 req-d5d28851-c090-401d-a020-62f842618c2c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.043955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fe1e184d-773b-48fd-9c18-e424da5cb5d2 req-d5d28851-c090-401d-a020-62f842618c2c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.044388 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-fe1e184d-773b-48fd-9c18-e424da5cb5d2 req-d5d28851-c090-401d-a020-62f842618c2c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.056416 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-fe1e184d-773b-48fd-9c18-e424da5cb5d2 req-d5d28851-c090-401d-a020-62f842618c2c service nova] Creating event network-changed:f6a7698e-eabe-4f42-9a5c-52216c235219 for instance c3a4275c-2373-4de9-9445-6d4ca010ec18 on n-h2-862769-3 Oct 28 20:13:23.062844 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-fe1e184d-773b-48fd-9c18-e424da5cb5d2 req-d5d28851-c090-401d-a020-62f842618c2c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037787 Oct 28 20:13:23.063563 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3550/7097] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:23.197126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:23.197694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:23.204774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.205302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.205717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.206408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:23.206899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:23.207311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:23.342903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:23.351211 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-176e1bd5-fdc2-490d-a8f2-4abe46f48663 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.157977 Oct 28 20:13:23.351736 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3548/7098] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:23 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:24.374522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:24.375272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:24.382631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.383173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.383618 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.384331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:24.384797 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:24.385231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:24.526600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:24.536168 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fc02f3f-4a8f-491b-a528-fd69e2db8078 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.165874 Oct 28 20:13:24.537548 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3551/7099] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:24 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:25.559971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:25.560557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:25.567837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.568328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.568763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.569468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:25.569921 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:25.570345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:25.706990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:25.715430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1aedc9d4-92a7-4c85-a1a2-5abcd2d51b39 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.159490 Oct 28 20:13:25.716046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3549/7100] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:25 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:26.745158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:26.745780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:26.753169 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.753669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.754112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.754853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:26.755437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:26.755879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:26.907997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:26.917299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-44604f7d-fa76-4c70-9d3c-246fe4d549e3 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.176207 Oct 28 20:13:26.917882 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3552/7101] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:26 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:27.940566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:27.941168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:27.948667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:27.949176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:27.949636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:27.950343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:27.950837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:27.951272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:28.094220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:28.104029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de2301bc-f549-4b04-8337-2a0a40da0b3f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.167556 Oct 28 20:13:28.104595 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3550/7102] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:27 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:29.134065 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:29.136058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:29.143486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.143969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.144413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.145135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.145772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.146202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.255974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a3621d0b-55a8-4169-a1f3-8fff2485aff8 req-8294cee7-19f0-40db-aa68-035f6b91aa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a4275c-2373-4de9-9445-6d4ca010ec18", "name": "network-vif-plugged", "status": "completed", "tag": "f6a7698e-eabe-4f42-9a5c-52216c235219"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:29.269494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a3621d0b-55a8-4169-a1f3-8fff2485aff8 req-8294cee7-19f0-40db-aa68-035f6b91aa89 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:29.270608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a3621d0b-55a8-4169-a1f3-8fff2485aff8 req-8294cee7-19f0-40db-aa68-035f6b91aa89 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:29.271347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a3621d0b-55a8-4169-a1f3-8fff2485aff8 req-8294cee7-19f0-40db-aa68-035f6b91aa89 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:29.287344 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a3621d0b-55a8-4169-a1f3-8fff2485aff8 req-8294cee7-19f0-40db-aa68-035f6b91aa89 service nova] Creating event network-vif-plugged:f6a7698e-eabe-4f42-9a5c-52216c235219 for instance c3a4275c-2373-4de9-9445-6d4ca010ec18 on n-h2-862769-3 Oct 28 20:13:29.294231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a3621d0b-55a8-4169-a1f3-8fff2485aff8 req-8294cee7-19f0-40db-aa68-035f6b91aa89 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042129 Oct 28 20:13:29.296505 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3551/7103] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:29.312562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:29.327850 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f8a14b8-2870-4261-b1e5-956bcb1d3ae2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.198552 Oct 28 20:13:29.339556 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3553/7104] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:29 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:30.352529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:30.353119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:30.360665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.361164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.361604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.362336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:30.362821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:30.363234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:30.507664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:30.517431 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6de73564-3dab-494b-af4e-f6f16990172b tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1316 microversion: 2.1 time: 0.169449 Oct 28 20:13:30.518046 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3552/7105] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:30 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:31.541985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:31.542636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:31.545771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:31.551516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.552040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.552483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.553202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.553739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.554211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.694267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:31.703075 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4ec11046-886f-460d-9fb9-02bd4f6b37ce tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1505 microversion: 2.1 time: 0.165331 Oct 28 20:13:31.703705 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3554/7106] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:31 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:31.725792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:31.726378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:31.728571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:31.729285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:31.735706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.736202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.736694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.737416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.737878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.738297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.766920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:13:31.845716 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b50d1d31-4efa-4ce3-bc22-8bc56f9d759f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 204 len: 0 microversion: 2.1 time: 0.123574 Oct 28 20:13:31.846466 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3553/7107] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:13:31 2022] DELETE /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:13:31.855219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:31.855847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:31.862648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.863213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.863659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.864398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:31.864859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:31.865290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:31.998305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:32.006371 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cc73acfa-3c27-44b6-84c4-93380c91561d tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1511 microversion: 2.1 time: 0.155045 Oct 28 20:13:32.007024 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3555/7108] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:31 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:33.030617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:33.031333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:33.039053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.039565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.040007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.040733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.041180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.041600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.179234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:33.187334 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-163b9955-4319-4e26-9a7d-43892bcdefc2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 200 len: 1511 microversion: 2.1 time: 0.161085 Oct 28 20:13:33.188119 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3554/7109] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:33 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:33.620479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-3354c237-3139-4c54-bf35-422d9b0c76ef req-4ef163cc-f06c-4e69-8acb-a6e094fc7614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a4275c-2373-4de9-9445-6d4ca010ec18", "name": "network-vif-deleted", "tag": "f6a7698e-eabe-4f42-9a5c-52216c235219"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:33.633827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3354c237-3139-4c54-bf35-422d9b0c76ef req-4ef163cc-f06c-4e69-8acb-a6e094fc7614 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:33.634327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3354c237-3139-4c54-bf35-422d9b0c76ef req-4ef163cc-f06c-4e69-8acb-a6e094fc7614 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:33.634798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-3354c237-3139-4c54-bf35-422d9b0c76ef req-4ef163cc-f06c-4e69-8acb-a6e094fc7614 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:33.650786 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-3354c237-3139-4c54-bf35-422d9b0c76ef req-4ef163cc-f06c-4e69-8acb-a6e094fc7614 service nova] Creating event network-vif-deleted:f6a7698e-eabe-4f42-9a5c-52216c235219 for instance c3a4275c-2373-4de9-9445-6d4ca010ec18 on n-h2-862769-3 Oct 28 20:13:33.656202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-3354c237-3139-4c54-bf35-422d9b0c76ef req-4ef163cc-f06c-4e69-8acb-a6e094fc7614 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041723 Oct 28 20:13:33.657372 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3556/7110] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:34.212852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.213505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.225260 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.225771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.226184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.226978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.227423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.227847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.245893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] HTTP exception thrown: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 HTTP/1.1 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c3a4275c-2373-4de9-9445-6d4ca010ec18'} Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:34.247620 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 404 to user: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-401641c0-9e0e-4754-bf2e-764b031c9739 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 404 len: 111 microversion: 2.1 time: 0.042260 Oct 28 20:13:34.251912 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3555/7111] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:13:34.261440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.262164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.268870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.269379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.269825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.270532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.271043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.271477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.411215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.423610 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-00e94f05-426b-4cea-817f-a598802e415c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.166193 Oct 28 20:13:34.424402 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3557/7112] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:34.446115 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43bb3305-8436-405e-b650-86682f8c42cf tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:34.448498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-43bb3305-8436-405e-b650-86682f8c42cf tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 73617023-31b9-4773-8c96-3ca7c518261f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.454540 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-43bb3305-8436-405e-b650-86682f8c42cf tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] HTTP exception thrown: Instance 73617023-31b9-4773-8c96-3ca7c518261f could not be found. Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43bb3305-8436-405e-b650-86682f8c42cf tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/73617023-31b9-4773-8c96-3ca7c518261f/action HTTP/1.1 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 32 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: {"resize": {"flavorRef": "452"}} Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 73617023-31b9-4773-8c96-3ca7c518261f could not be found. Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '73617023-31b9-4773-8c96-3ca7c518261f', 'body': {'resize': {'flavorRef': '452'}}} Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73617023-31b9-4773-8c96-3ca7c518261f could not be found. Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:13:34.456180 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73617023-31b9-4773-8c96-3ca7c518261f could not be found. Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73617023-31b9-4773-8c96-3ca7c518261f could not be found. Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-43bb3305-8436-405e-b650-86682f8c42cf tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 404 to user: Instance 73617023-31b9-4773-8c96-3ca7c518261f could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-43bb3305-8436-405e-b650-86682f8c42cf tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "POST /compute/v2.1/servers/73617023-31b9-4773-8c96-3ca7c518261f/action" status: 404 len: 111 microversion: 2.1 time: 0.015574 Oct 28 20:13:34.460336 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3556/7113] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:13:34 2022] POST /compute/v2.1/servers/73617023-31b9-4773-8c96-3ca7c518261f/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:13:34.469141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.469939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.478533 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.479106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.479623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.480666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.481348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.481982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.628233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.637364 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-80e2531f-7759-4b23-a25d-e625e211f674 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.174433 Oct 28 20:13:34.637949 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3558/7114] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:34.660963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.661611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.668825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.669306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.669736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.670426 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.670904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.671309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.807844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.820430 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-068e76a6-0992-4046-9f8d-c6a067608104 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.163896 Oct 28 20:13:34.821010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3557/7115] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:34.845478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "eec71e96-b72d-4ec7-a39a-c69e68ef482a"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:34.848756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.855506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.856007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.856461 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.857172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.857642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.858075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.895478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:34.901290 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] HTTP exception thrown: Flavor eec71e96-b72d-4ec7-a39a-c69e68ef482a could not be found. Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: request: POST /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35/action HTTP/1.1 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 65 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: {"resize": {"flavorRef": "eec71e96-b72d-4ec7-a39a-c69e68ef482a"}} Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: exception: Flavor eec71e96-b72d-4ec7-a39a-c69e68ef482a could not be found. Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7301ae12-12e0-4571-a86d-9df990348b35', 'body': {'resize': {'flavorRef': 'eec71e96-b72d-4ec7-a39a-c69e68ef482a'}}} Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:34.903319 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor eec71e96-b72d-4ec7-a39a-c69e68ef482a could not be found. Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor eec71e96-b72d-4ec7-a39a-c69e68ef482a could not be found. Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor eec71e96-b72d-4ec7-a39a-c69e68ef482a could not be found. Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 400 to user: Flavor eec71e96-b72d-4ec7-a39a-c69e68ef482a could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bbb1be0e-4933-454f-a600-ab20d8c7538f tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "POST /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35/action" status: 400 len: 107 microversion: 2.1 time: 0.065882 Oct 28 20:13:34.912900 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3559/7116] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:13:34 2022] POST /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 20:13:34.916959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:34.917583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:34.924045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.924541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.924992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:34.925731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:34.926201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:34.926638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.079178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.082934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:35.088198 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-998c7dbb-812f-4c88-ac69-c70953bc2eed tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.175636 Oct 28 20:13:35.088771 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3558/7117] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:34 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:13:35.112150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.112781 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.119634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.120142 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.120592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.121301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.121768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.122213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.269689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.278077 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a2c694e-9415-48e7-97ba-c51f42fd5115 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.169958 Oct 28 20:13:35.278651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3560/7118] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:35.301718 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0faf902-1d0f-4d04-8164-5b523815880c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0faf902-1d0f-4d04-8164-5b523815880c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: request: POST /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35/action HTTP/1.1 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 29 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: {"resize": {"flavorRef": ""}} Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7301ae12-12e0-4571-a86d-9df990348b35', 'body': {'resize': {'flavorRef': ''}}} Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise error Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi '' Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.305417 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d0faf902-1d0f-4d04-8164-5b523815880c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d0faf902-1d0f-4d04-8164-5b523815880c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "POST /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35/action" status: 400 len: 113 microversion: 2.1 time: 0.009975 Oct 28 20:13:35.310378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3559/7119] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:13:35 2022] POST /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 20:13:35.316450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.317057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.323660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.324164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.324614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.325334 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.325834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.326301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.469347 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.478319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3b8dc65-6e46-4faf-bdda-fea58990412c tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1506 microversion: 2.1 time: 0.165755 Oct 28 20:13:35.478969 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3561/7120] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:35.505892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.506413 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.515733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.516399 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.517196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.518169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.518917 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.519611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.538780 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] HTTP exception thrown: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 HTTP/1.1 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'c3a4275c-2373-4de9-9445-6d4ca010ec18'} Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:13:35.540385 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 404 to user: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a55188e4-fde7-4c06-8c9d-589fe379edb2 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 404 len: 111 microversion: 2.1 time: 0.041396 Oct 28 20:13:35.545168 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3560/7121] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:13:35 2022] DELETE /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:13:35.551095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.551776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: c3a4275c-2373-4de9-9445-6d4ca010ec18] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.558278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.558809 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.559254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.559973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.560413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.560852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.565189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=100 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:35.576184 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] HTTP exception thrown: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 HTTP/1.1 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c3a4275c-2373-4de9-9445-6d4ca010ec18'} Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:35.577761 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 404 to user: Instance c3a4275c-2373-4de9-9445-6d4ca010ec18 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e9eee335-6f24-4555-a65b-6164cf412a2e tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18" status: 404 len: 111 microversion: 2.1 time: 0.032193 Oct 28 20:13:35.582232 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3562/7122] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/c3a4275c-2373-4de9-9445-6d4ca010ec18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:13:35.588049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.588547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.594874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.595351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.595793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.596498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.596954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.597382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.625314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:13:35.707142 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f6df109f-7873-4682-8bcf-28eab58ceb32 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 204 len: 0 microversion: 2.1 time: 0.122725 Oct 28 20:13:35.707994 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3561/7123] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:13:35 2022] DELETE /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:13:35.716625 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:35.717250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:35.725614 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.726109 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.726559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.727303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:35.727772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:35.728204 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:35.860494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:35.868536 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-746ea106-43a0-40e4-bfbe-ac97cf4f7874 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1512 microversion: 2.1 time: 0.156304 Oct 28 20:13:35.869123 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3563/7124] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:35 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:36.895591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:36.896198 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:36.900006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:36.906635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.907281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.907881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:36.908621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:36.909070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:36.909544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.052584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:37.060983 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-137d1d65-ee11-4ba4-82da-f23bc841d2d0 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1512 microversion: 2.1 time: 0.172182 Oct 28 20:13:37.061595 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3562/7125] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:36 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:37.746734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-c0e13849-9aeb-44a8-8205-f67bfa91632f req-b3bc9ecf-db42-4c21-bbed-3b678f4ca1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7301ae12-12e0-4571-a86d-9df990348b35", "name": "network-vif-deleted", "tag": "ebeee835-f0ab-45fb-bf42-df681bb423c0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:13:37.761548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c0e13849-9aeb-44a8-8205-f67bfa91632f req-b3bc9ecf-db42-4c21-bbed-3b678f4ca1de service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:37.762047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c0e13849-9aeb-44a8-8205-f67bfa91632f req-b3bc9ecf-db42-4c21-bbed-3b678f4ca1de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:37.762482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-c0e13849-9aeb-44a8-8205-f67bfa91632f req-b3bc9ecf-db42-4c21-bbed-3b678f4ca1de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:37.775763 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-c0e13849-9aeb-44a8-8205-f67bfa91632f req-b3bc9ecf-db42-4c21-bbed-3b678f4ca1de service nova] Creating event network-vif-deleted:ebeee835-f0ab-45fb-bf42-df681bb423c0 for instance 7301ae12-12e0-4571-a86d-9df990348b35 on n-h1-862769-3 Oct 28 20:13:37.780838 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-c0e13849-9aeb-44a8-8205-f67bfa91632f req-b3bc9ecf-db42-4c21-bbed-3b678f4ca1de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037984 Oct 28 20:13:37.781567 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3564/7126] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:13:38.085606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:38.086174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:38.093580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.094066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.094504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.095268 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.095720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.096138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.131111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:38.131658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:38.132103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:38.132533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lazy-loading 'fault' on Instance uuid 7301ae12-12e0-4571-a86d-9df990348b35 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:13:38.177379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3b693914c9e467995c2bdc25ca9656f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2ea7406aa4d6b87697c3fb7fe6ca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:13:38.186032 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-299f02fe-004e-4ad1-963d-a023dfd15a7a tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 200 len: 1306 microversion: 2.1 time: 0.104474 Oct 28 20:13:38.186621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3563/7127] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:38 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:13:39.213266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:13:39.213981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] [instance: 7301ae12-12e0-4571-a86d-9df990348b35] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:13:39.215997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=53 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:13:39.221295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:39.221800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:39.222231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.223013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:13:39.223472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:13:39.223902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:13:39.240541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] HTTP exception thrown: Instance 7301ae12-12e0-4571-a86d-9df990348b35 could not be found. Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Request method failure captured: Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 HTTP/1.1 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDfSoR_Q5wIX4ADm8r43STRG7lWRBPpRLamaMHVDroK25CgpL5w6DoUgmuHICEHTootGB77OLbqeOjhB717NmWEO9i5UZ1J5sa6auCUITEgMEOloXzBCs6WUISiFsBYxYxiO0gSA5j8zfrEeDSXNmG8yfdHu2ViT7qy5ZjyMbdDkbCI Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36c2ea7406aa4d6b87697c3fb7fe6ca2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36c2ea7406aa4d6b87697c3fb7fe6ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 36c2ea7406aa4d6b87697c3fb7fe6ca2 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-ServersNegativeTestJSON-558397896 Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: d3b693914c9e467995c2bdc25ca9656f Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-ServersNegativeTestJSON-558397896-project Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 7301ae12-12e0-4571-a86d-9df990348b35 could not be found. Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '7301ae12-12e0-4571-a86d-9df990348b35'} Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7301ae12-12e0-4571-a86d-9df990348b35 could not be found. Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7301ae12-12e0-4571-a86d-9df990348b35 could not be found. Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:13:39.242300 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7301ae12-12e0-4571-a86d-9df990348b35 could not be found. Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] Returning 404 to user: Instance 7301ae12-12e0-4571-a86d-9df990348b35 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a325f9d6-e10f-49b6-a29a-871e10ded941 tempest-ServersNegativeTestJSON-558397896 tempest-ServersNegativeTestJSON-558397896-project] 10.222.0.44 "GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35" status: 404 len: 111 microversion: 2.1 time: 0.036795 Oct 28 20:13:39.246834 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3565/7128] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:13:39 2022] GET /compute/v2.1/servers/7301ae12-12e0-4571-a86d-9df990348b35 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:14:11.116697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=5 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:11.117626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:11.341253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-69cdf767-3947-457b-9fd2-5378ece48679 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: .version_select at 0x7f1d77420ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-695757072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBg6uXSKpuVYRtq1PrjlUNBc5NuEaKdRhK/JZs4Wdmd91GJFmv35AwtE+hkWjbhKKRnJ2kZVT7Ek+OUrkcT/gQEF0/D6E3AWUVzatPUjnj6tWh+wB3RRFxjphm8RZaMsQ=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:11.358763 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-69cdf767-3947-457b-9fd2-5378ece48679 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:14:11.364045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-69cdf767-3947-457b-9fd2-5378ece48679 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for user 2732e5735cd24e0db347c76489539a57 and project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:14:11.394196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-69cdf767-3947-457b-9fd2-5378ece48679 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.283316 Oct 28 20:14:11.394947 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3564/7129] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:14:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:11.448223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-100566661", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-695757072", "networks": [{"uuid": "2de702ca-38f9-4baf-a1dc-2d3684073394"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:11.457607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:11.458282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=10 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:11.507100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] validate_networks() for [('2de702ca-38f9-4baf-a1dc-2d3684073394', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:14:12.028972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:14:12.029411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:14:12.029918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:14:12.030337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:14:12.030776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:14:12.041179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:12.041857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:12.042119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:12.042887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:12.043407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:12.043838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:12.061290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:14:12.067401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for user 2732e5735cd24e0db347c76489539a57 and project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:14:12.081032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:14:12.083447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:14:12.130046 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [8e6d532d-8564-4b04-9bce-9b38b6e194e1] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:14:13.140362 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [8e6d532d-8564-4b04-9bce-9b38b6e194e1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 39564. Oct 28 20:14:13.144562 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11c21f23-eb9a-4324-aca1-b6162858dc8f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701079 Oct 28 20:14:13.145328 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3566/7130] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:14:13.159670 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48d057ba-e25d-486d-ae1e-220069e5633e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:13.162184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48d057ba-e25d-486d-ae1e-220069e5633e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:13.219865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48d057ba-e25d-486d-ae1e-220069e5633e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:13.230326 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48d057ba-e25d-486d-ae1e-220069e5633e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1261 microversion: 2.1 time: 0.077707 Oct 28 20:14:13.231475 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3565/7131] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:13 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:14.257684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:14.258967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:14.266765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:14.267276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:14.267725 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:14.268454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:14.268911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:14.269346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:14.375972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:14.386790 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8a12e254-b0f0-4b87-be00-24fa63faaab4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1313 microversion: 2.1 time: 0.135192 Oct 28 20:14:14.387687 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3567/7132] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:14 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:15.411985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:15.412632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:15.419875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.420369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.420823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.421526 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.421985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.422409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.655449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:15.668547 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ec5641bf-dfdf-42d9-aed2-389a145b6f97 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.260624 Oct 28 20:14:15.669157 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3566/7133] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:15 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:15.866042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-26b75c86-20cd-4e6b-9299-c21f8a4f3de0 req-b524512b-0def-4ba3-abf4-b587b2ab8494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a72bea-5603-427b-aca9-1d472b32fdbc", "tag": "42a9c7e3-6ce3-4665-802e-ba3bd7758b9c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:15.879542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-26b75c86-20cd-4e6b-9299-c21f8a4f3de0 req-b524512b-0def-4ba3-abf4-b587b2ab8494 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:15.880297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-26b75c86-20cd-4e6b-9299-c21f8a4f3de0 req-b524512b-0def-4ba3-abf4-b587b2ab8494 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:15.880972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-26b75c86-20cd-4e6b-9299-c21f8a4f3de0 req-b524512b-0def-4ba3-abf4-b587b2ab8494 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:15.896721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-26b75c86-20cd-4e6b-9299-c21f8a4f3de0 req-b524512b-0def-4ba3-abf4-b587b2ab8494 service nova] Creating event network-changed:42a9c7e3-6ce3-4665-802e-ba3bd7758b9c for instance d7a72bea-5603-427b-aca9-1d472b32fdbc on n-h1-862769-3 Oct 28 20:14:15.902414 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-26b75c86-20cd-4e6b-9299-c21f8a4f3de0 req-b524512b-0def-4ba3-abf4-b587b2ab8494 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040510 Oct 28 20:14:15.903277 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3568/7134] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:16.693042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:16.693787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:16.702286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:16.702781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:16.703462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:16.704330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:16.704810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:16.705218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:16.842836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:16.850953 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-018a1f7c-a201-40b4-ac9f-15ce976f98e4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.162051 Oct 28 20:14:16.851691 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3567/7135] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:16 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:17.875871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:17.876619 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:17.884981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:17.885479 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:17.885920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:17.886634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:17.887130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:17.887605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:18.028396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:18.037006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-113d6cf7-b995-4770-bcac-897c760d8e4e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.166511 Oct 28 20:14:18.037616 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3569/7136] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:17 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:19.061672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:19.062240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:19.070598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:19.071130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:19.071566 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:19.072266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:19.072720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:19.073149 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:19.222776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:19.231564 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5cfc1324-f903-43c4-92a5-f6d54693537f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.174468 Oct 28 20:14:19.232161 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3568/7137] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:19 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:20.253768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:20.254399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:20.261579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:20.262086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:20.262580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:20.263630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:20.264108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:20.264540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:20.408356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:20.416770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-302038e1-e217-43f8-97f9-1bce2359e17f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.166969 Oct 28 20:14:20.417360 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3570/7138] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:20 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:21.442398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:21.443099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:21.451935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.452421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.452857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.453552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.454009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.454429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.591398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:21.600450 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d69be0c4-73c3-42b8-bcbf-daab233912c4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.163958 Oct 28 20:14:21.601031 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3569/7139] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:21 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:21.662622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9407f06d-d06c-4486-9e5f-53810fb96a94 req-e9a6048b-148a-4c06-a785-680e2d49d24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a72bea-5603-427b-aca9-1d472b32fdbc", "name": "network-vif-plugged", "status": "completed", "tag": "42a9c7e3-6ce3-4665-802e-ba3bd7758b9c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:21.674047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9407f06d-d06c-4486-9e5f-53810fb96a94 req-e9a6048b-148a-4c06-a785-680e2d49d24e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:21.674573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9407f06d-d06c-4486-9e5f-53810fb96a94 req-e9a6048b-148a-4c06-a785-680e2d49d24e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:21.675036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9407f06d-d06c-4486-9e5f-53810fb96a94 req-e9a6048b-148a-4c06-a785-680e2d49d24e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:21.686643 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9407f06d-d06c-4486-9e5f-53810fb96a94 req-e9a6048b-148a-4c06-a785-680e2d49d24e service nova] Creating event network-vif-plugged:42a9c7e3-6ce3-4665-802e-ba3bd7758b9c for instance d7a72bea-5603-427b-aca9-1d472b32fdbc on n-h1-862769-3 Oct 28 20:14:21.692358 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9407f06d-d06c-4486-9e5f-53810fb96a94 req-e9a6048b-148a-4c06-a785-680e2d49d24e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033572 Oct 28 20:14:21.692989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3571/7140] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:22.623628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:22.624211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:22.631935 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:22.632475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:22.632888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:22.633584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:22.634052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:22.634452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:22.795250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:22.803566 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9a89e543-266d-485d-8d15-3b11ddad2b27 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1361 microversion: 2.1 time: 0.184215 Oct 28 20:14:22.804138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3570/7141] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:22 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:23.823732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:23.824560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:23.829531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:23.830254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:23.837615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:23.838112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:23.838557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:23.839289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:23.839753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:23.840187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:23.976602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:23.985501 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-30750bfb-af96-4379-8c34-45c7e580d20c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1553 microversion: 2.1 time: 0.162765 Oct 28 20:14:23.986103 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3572/7142] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:23 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:24.008362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:24.008958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:24.010893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:24.017334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:24.017817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:24.018254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:24.019002 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:24.019461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:24.019881 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:24.168146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:24.180658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ca978dd5-5118-4874-b05d-24c17b7b2e51 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1553 microversion: 2.1 time: 0.175954 Oct 28 20:14:24.181320 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3571/7143] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:24 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:25.919883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe40aa19-e38f-4ad6-a82f-e7389a48d10d"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:25.922291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:25.929633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:25.930129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:25.930617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:25.931368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:25.931830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:25.932264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:26.193977 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e61c49e6-7615-41d2-a06a-04a9b16cdd3d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277598 Oct 28 20:14:26.194523 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3573/7144] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 20:14:25 2022] POST /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:36.964805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:36.965409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:36.969022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:36.970082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=36 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:36.978988 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:36.979638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:36.980256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:36.981255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:36.981717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:36.982145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:37.067333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lazy-loading 'services' on Instance uuid d7a72bea-5603-427b-aca9-1d472b32fdbc {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:14:37.144572 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a3a3700-8c53-4dbf-80f7-7040f2f81218 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments/fe40aa19-e38f-4ad6-a82f-e7389a48d10d" status: 202 len: 0 microversion: 2.1 time: 0.185765 Oct 28 20:14:37.145251 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3572/7145] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:14:36 2022] DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments/fe40aa19-e38f-4ad6-a82f-e7389a48d10d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:14:37.155577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:37.158508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:37.161940 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:37.162714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:14:37.171049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:37.171603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:37.172055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:37.172787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:37.173255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:37.173691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:37.210870 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5355958-2919-40b2-8672-eb12ab1cb7b9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060242 Oct 28 20:14:37.211649 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3574/7146] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:37 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:38.225576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:38.228685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:38.236296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:38.236804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:38.237246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:38.237948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:38.238404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:38.238853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:38.270893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e648f49-d11d-4886-98c9-744dab7eeeeb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050625 Oct 28 20:14:38.271447 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3573/7147] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:38 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:39.286313 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:39.288962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:39.296757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:39.297257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:39.297952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:39.298723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:39.299636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:39.300081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:39.333954 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f03d1379-1480-4747-bec0-d201cd6fce88 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054111 Oct 28 20:14:39.334515 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3575/7148] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:39 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:14:40.346997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:40.349254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:40.356552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:40.357033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:40.357501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:40.358196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:40.358645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:40.359102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:40.390882 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ede13c5f-f489-4d7c-a328-7fac4c5ab746 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Oct 28 20:14:40.391518 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3574/7149] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:40 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:41.404162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:41.406412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:41.413908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:41.414411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:41.414887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:41.415608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:41.416074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:41.416511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:41.448232 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-353c2cb1-a758-4b33-8f01-f0e02696f6ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048156 Oct 28 20:14:41.448796 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3576/7150] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:41 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:42.461533 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:42.463778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:42.471209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.471687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.472113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.472803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.473253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.473669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.506024 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc7c99e0-cebe-4fda-b44c-75b26a128c2e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048404 Oct 28 20:14:42.506503 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3575/7151] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:14:42 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:14:42.520201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:42.520792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:42.530632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.531164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.531616 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.532675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:42.533147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:42.533588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:42.614170 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] HTTP exception thrown: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc is not attached to volume fe40aa19-e38f-4ad6-a82f-e7389a48d10d Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Request method failure captured: Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments/fe40aa19-e38f-4ad6-a82f-e7389a48d10d HTTP/1.1 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDgN-IvRuOhybyc5U0eBohuuhhhCg15A3TSnNEQ7Vrh_N0arPOxXdxYex1bmmDHfpL3PRDikd1Y7rciCM9KNKRhNC8CCvcX35MDxYbYCEPEj2OVE7drtleVu22szGqKfYTLZoOg1B5XZAQTWiIYmS03V0vCBq8z7SDGf_LyBxxTrkEo Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1c20a6ce8c04d299de23c6e03b19f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2732e5735cd24e0db347c76489539a57 Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc is not attached to volume fe40aa19-e38f-4ad6-a82f-e7389a48d10d Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': 'd7a72bea-5603-427b-aca9-1d472b32fdbc', 'id': 'fe40aa19-e38f-4ad6-a82f-e7389a48d10d'} Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fe40aa19-e38f-4ad6-a82f-e7389a48d10d. Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc is not attached to volume fe40aa19-e38f-4ad6-a82f-e7389a48d10d Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:14:42.623731 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc is not attached to volume fe40aa19-e38f-4ad6-a82f-e7389a48d10d Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Returning 404 to user: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc is not attached to volume fe40aa19-e38f-4ad6-a82f-e7389a48d10d {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a6f10a4-305b-4229-b5ee-32eff3914f91 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments/fe40aa19-e38f-4ad6-a82f-e7389a48d10d" status: 404 len: 154 microversion: 2.1 time: 0.111126 Oct 28 20:14:42.628553 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3577/7152] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:14:42 2022] DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc/os-volume_attachments/fe40aa19-e38f-4ad6-a82f-e7389a48d10d => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:14:45.987174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:45.987690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:45.994779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:45.995277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:45.995712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:45.996397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:45.996851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:45.997272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.023889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:14:46.115218 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59ac460f-d5d5-4194-8f72-276ff8b893e8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 204 len: 0 microversion: 2.1 time: 0.131463 Oct 28 20:14:46.115964 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3576/7153] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:14:45 2022] DELETE /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:14:46.124346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:46.125011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:46.132956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:46.133805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:46.133911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.134770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:46.135111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:46.135551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:46.272722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:46.281119 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7be26b2b-e411-4e41-82c9-51e553b2140f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1559 microversion: 2.1 time: 0.160843 Oct 28 20:14:46.281733 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3578/7154] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:46 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:47.308129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:47.308899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:47.316555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:47.317046 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:47.317481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:47.318186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:47.318640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:47.319097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:47.474228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:47.482884 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d694525d-47ef-45c1-8de3-19f054ea0011 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1559 microversion: 2.1 time: 0.181042 Oct 28 20:14:47.483498 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3577/7155] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:47 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:48.295918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-48de64d9-6341-4ad1-b588-e86e1b4b1960 req-9793867d-4fd8-49c9-b11f-4881bd4f8ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a72bea-5603-427b-aca9-1d472b32fdbc", "name": "network-vif-deleted", "tag": "42a9c7e3-6ce3-4665-802e-ba3bd7758b9c"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:48.309733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-48de64d9-6341-4ad1-b588-e86e1b4b1960 req-9793867d-4fd8-49c9-b11f-4881bd4f8ebe service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.310223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-48de64d9-6341-4ad1-b588-e86e1b4b1960 req-9793867d-4fd8-49c9-b11f-4881bd4f8ebe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.310661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-48de64d9-6341-4ad1-b588-e86e1b4b1960 req-9793867d-4fd8-49c9-b11f-4881bd4f8ebe service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.325544 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-48de64d9-6341-4ad1-b588-e86e1b4b1960 req-9793867d-4fd8-49c9-b11f-4881bd4f8ebe service nova] Creating event network-vif-deleted:42a9c7e3-6ce3-4665-802e-ba3bd7758b9c for instance d7a72bea-5603-427b-aca9-1d472b32fdbc on n-h1-862769-3 Oct 28 20:14:48.332433 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-48de64d9-6341-4ad1-b588-e86e1b4b1960 req-9793867d-4fd8-49c9-b11f-4881bd4f8ebe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041308 Oct 28 20:14:48.333398 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3579/7156] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:48.509239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:48.509818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:48.520370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.520978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.521723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.523020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.523729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.524345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.560830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:48.561305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:48.561738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:48.562176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lazy-loading 'fault' on Instance uuid d7a72bea-5603-427b-aca9-1d472b32fdbc {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:14:48.614588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:48.623008 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f0f7062-0ffd-4b6c-9034-d857d7224a3b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 200 len: 1351 microversion: 2.1 time: 0.119098 Oct 28 20:14:48.623619 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3578/7157] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:48 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:49.648607 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:49.649284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: d7a72bea-5603-427b-aca9-1d472b32fdbc] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:49.656286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:49.656820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:49.657648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:49.658398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:49.658913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:49.659333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:49.673309 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] HTTP exception thrown: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc could not be found. Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Request method failure captured: Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc HTTP/1.1 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDgN-IvRuOhybyc5U0eBohuuhhhCg15A3TSnNEQ7Vrh_N0arPOxXdxYex1bmmDHfpL3PRDikd1Y7rciCM9KNKRhNC8CCvcX35MDxYbYCEPEj2OVE7drtleVu22szGqKfYTLZoOg1B5XZAQTWiIYmS03V0vCBq8z7SDGf_LyBxxTrkEo Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1c20a6ce8c04d299de23c6e03b19f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2732e5735cd24e0db347c76489539a57 Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc could not be found. Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd7a72bea-5603-427b-aca9-1d472b32fdbc'} Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc could not be found. Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc could not be found. Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:14:49.675050 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc could not be found. Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Returning 404 to user: Instance d7a72bea-5603-427b-aca9-1d472b32fdbc could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cf647b8c-3fec-43d7-a46f-469c9c6220e2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc" status: 404 len: 111 microversion: 2.1 time: 0.033220 Oct 28 20:14:49.679699 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3580/7158] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:49 2022] GET /compute/v2.1/servers/d7a72bea-5603-427b-aca9-1d472b32fdbc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:14:49.685688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-916e0b99-08ca-49f2-b68e-2c5f4f125f57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '.version_select at 0x7f1d7740a280>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:49.712033 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-916e0b99-08ca-49f2-b68e-2c5f4f125f57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-695757072" status: 202 len: 0 microversion: 2.1 time: 0.030443 Oct 28 20:14:49.712624 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3579/7159] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-695757072 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:14:49.732876 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae94ad03-3c55-4b51-b850-c7ae6dc195f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: .version_select at 0x7f1d77196dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-796267975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETg3vDDL5nmknAx8ondEWfGUkuu2KURXTErOZfSOo8V3WjTplbJWsVkQbtbm3WVbcrdRGlam704vag9W3QUWa1gy0WdSYfPiHhrhGgZeP2l+oq9Ao4ZS5rLicOLaMJJIg=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:49.750184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ae94ad03-3c55-4b51-b850-c7ae6dc195f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:14:49.756531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ae94ad03-3c55-4b51-b850-c7ae6dc195f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for user 2732e5735cd24e0db347c76489539a57 and project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:14:49.784003 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae94ad03-3c55-4b51-b850-c7ae6dc195f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.056806 Oct 28 20:14:49.784601 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3581/7160] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:14:49 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:49.836058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1870330829", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-796267975", "networks": [{"uuid": "2de702ca-38f9-4baf-a1dc-2d3684073394"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:49.894429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] validate_networks() for [('2de702ca-38f9-4baf-a1dc-2d3684073394', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:14:50.332482 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:14:50.332894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:14:50.333385 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:14:50.333799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:14:50.334191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:14:50.343356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:50.343831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:50.344264 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:50.344977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:50.345456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:50.345869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:50.363065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:14:50.368564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for user 2732e5735cd24e0db347c76489539a57 and project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:14:50.382079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:14:50.384479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:14:50.430911 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-be16f62d-dc2d-418b-b352-0c405c3ecdb9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598795 Oct 28 20:14:50.431608 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3580/7161] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:14:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:14:50.443055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7b051076-9475-4116-a9f4-cbaf79634a93 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:50.443677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7b051076-9475-4116-a9f4-cbaf79634a93 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:50.505197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7b051076-9475-4116-a9f4-cbaf79634a93 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:50.512134 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7b051076-9475-4116-a9f4-cbaf79634a93 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1262 microversion: 2.1 time: 0.073186 Oct 28 20:14:50.512721 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3582/7162] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:50 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:51.537945 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:51.539307 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:51.546761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:51.547255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:51.547694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:51.548449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:51.548959 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:51.549405 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:51.984823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:51.993409 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4229e420-8376-4c96-b5a8-5b21c2e9996f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1314 microversion: 2.1 time: 0.461272 Oct 28 20:14:51.994132 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3581/7163] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:51 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:53.017939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:53.018486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:53.025965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.026402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.026912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.027639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.028115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.028549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.256549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:53.264636 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-835920e0-7e98-4ae2-b1c5-a387df710204 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.251038 Oct 28 20:14:53.265233 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3583/7164] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:53 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:53.447851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5d4bb824-bd4e-4942-8f5f-79ec286b9dfc req-6bd14027-5070-4a8b-a6a0-e14748e7c349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba36cb7-304d-4b23-9f54-bfbee6577ab1", "tag": "c24e7b73-8a1a-4221-8299-5ecedd23feb6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:53.459929 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5d4bb824-bd4e-4942-8f5f-79ec286b9dfc req-6bd14027-5070-4a8b-a6a0-e14748e7c349 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:53.460404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5d4bb824-bd4e-4942-8f5f-79ec286b9dfc req-6bd14027-5070-4a8b-a6a0-e14748e7c349 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:53.460835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5d4bb824-bd4e-4942-8f5f-79ec286b9dfc req-6bd14027-5070-4a8b-a6a0-e14748e7c349 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:53.472775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5d4bb824-bd4e-4942-8f5f-79ec286b9dfc req-6bd14027-5070-4a8b-a6a0-e14748e7c349 service nova] Creating event network-changed:c24e7b73-8a1a-4221-8299-5ecedd23feb6 for instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 on n-h1-862769-3 Oct 28 20:14:53.477897 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5d4bb824-bd4e-4942-8f5f-79ec286b9dfc req-6bd14027-5070-4a8b-a6a0-e14748e7c349 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033937 Oct 28 20:14:53.478584 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3582/7165] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:14:54.291842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:54.292826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:54.302329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:54.303006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:54.303739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:54.304690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:54.305163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:54.305613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:54.449652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:54.459280 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b5d529cb-84e2-417f-95a1-5964c78c742b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.172897 Oct 28 20:14:54.459926 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3584/7166] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:54 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:55.484146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:55.484850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:55.491240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:55.491764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:55.492190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:55.492882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:55.493337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:55.493757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:55.631914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:55.640475 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f4d31d09-3fa8-434d-a137-f4828d38497a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.161687 Oct 28 20:14:55.641089 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3583/7167] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:55 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:56.664285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:56.664861 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:56.672991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:56.673490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:56.673939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:56.674680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:56.675182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:56.675623 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:56.809346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:56.817615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d0a6083e-f5bd-4215-b521-fb843f5c9163 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.157353 Oct 28 20:14:56.818172 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3585/7168] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:56 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:57.840838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:57.841445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:57.849210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:57.849691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:57.850117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:57.850868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:57.851320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:57.851734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:57.991472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:57.999393 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cec11946-eaee-4423-8c21-0ccd5c968a57 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.162697 Oct 28 20:14:58.000010 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3584/7169] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:57 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:59.026176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:14:59.027289 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:14:59.036720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.037233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.037689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.038441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.038969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.039414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.173067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:14:59.181668 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-27942371-e614-45a9-b69c-e9d2f285607a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.162136 Oct 28 20:14:59.182250 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3586/7170] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:14:59 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:14:59.852266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-242395c0-4b2d-4910-944c-f868303bde8e req-74b3e72c-1ed5-45f3-b63b-b28bcaadc66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba36cb7-304d-4b23-9f54-bfbee6577ab1", "name": "network-vif-plugged", "status": "completed", "tag": "c24e7b73-8a1a-4221-8299-5ecedd23feb6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:14:59.863318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-242395c0-4b2d-4910-944c-f868303bde8e req-74b3e72c-1ed5-45f3-b63b-b28bcaadc66c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:14:59.863982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-242395c0-4b2d-4910-944c-f868303bde8e req-74b3e72c-1ed5-45f3-b63b-b28bcaadc66c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:14:59.864441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-242395c0-4b2d-4910-944c-f868303bde8e req-74b3e72c-1ed5-45f3-b63b-b28bcaadc66c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:14:59.877911 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-242395c0-4b2d-4910-944c-f868303bde8e req-74b3e72c-1ed5-45f3-b63b-b28bcaadc66c service nova] Creating event network-vif-plugged:c24e7b73-8a1a-4221-8299-5ecedd23feb6 for instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 on n-h1-862769-3 Oct 28 20:14:59.882982 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-242395c0-4b2d-4910-944c-f868303bde8e req-74b3e72c-1ed5-45f3-b63b-b28bcaadc66c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034468 Oct 28 20:14:59.883621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3585/7171] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:00.208046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:00.208882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:00.218314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:00.219082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:00.219689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:00.220648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:00.221367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:00.221964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:00.361315 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:00.369561 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-646bde6f-23cf-4c2f-b55c-8f5fb572dbb7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1362 microversion: 2.1 time: 0.167133 Oct 28 20:15:00.370143 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3587/7172] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:00 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:01.397145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:01.398306 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:01.401417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:01.402514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:01.411261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.411741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.412165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.412849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.413294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.413713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.547321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:01.555658 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f142f467-b635-4434-9a9c-ad074ac077d6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1554 microversion: 2.1 time: 0.165587 Oct 28 20:15:01.556239 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3586/7173] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:01 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:01.579708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:01.580358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:01.582356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:01.588981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.589487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.589975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.590721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:01.591188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:01.591627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:01.730439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:01.738723 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-16bebd31-60ce-486a-a8c8-adee1e3b99cd tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1554 microversion: 2.1 time: 0.164397 Oct 28 20:15:01.739557 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3588/7174] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:01 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:03.251605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1947d2ee-a539-4e46-95b1-432a41435165"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:03.253997 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:03.261057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:03.261537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:03.261973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:03.262657 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:03.263142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:03.263557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:03.491664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:03.511167 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0d506f13-4659-4d90-9f34-76fef88b77bb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263327 Oct 28 20:15:03.511795 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3587/7175] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 20:15:03 2022] POST /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:14.314681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:14.315255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:14.319823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:14.320692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=70 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:14.329487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.330222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.330606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.331378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.331850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.332292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.416462 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lazy-loading 'services' on Instance uuid 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:15:14.492214 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-323580ea-7b04-475d-a3be-5c26a4c557fb tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments/1947d2ee-a539-4e46-95b1-432a41435165" status: 202 len: 0 microversion: 2.1 time: 0.183948 Oct 28 20:15:14.492915 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3589/7176] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:15:14 2022] DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments/1947d2ee-a539-4e46-95b1-432a41435165 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:15:14.503074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:14.505468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:14.508795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:14.509699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:14.518920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.519774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.520221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.520985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:14.521444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:14.521872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:14.556722 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-28dab540-becd-4dbd-9950-0ce3418de14b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058079 Oct 28 20:15:14.557273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3588/7177] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:14 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:15.572398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:15.574732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:15.581689 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:15.582184 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:15.582631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:15.583365 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:15.583826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:15.584252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:15.614980 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5e5365a-457c-4fd6-a2a8-b5285a41d614 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048037 Oct 28 20:15:15.615543 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3590/7178] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:15 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:16.628136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:16.630350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:16.637968 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:16.638461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:16.638939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:16.639650 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:16.640107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:16.640534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:16.674703 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37f83959-5963-492e-81d9-4aa48476b38a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050620 Oct 28 20:15:16.675500 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3589/7179] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:16 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:17.687936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:17.690270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:17.697282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.697695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.698172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.698920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:17.699397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:17.699831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:17.731631 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3b457de0-e14f-4258-835b-9e6271902346 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Oct 28 20:15:17.732197 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3591/7180] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:17 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:18.744368 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:18.746586 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:18.753851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:18.754327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:18.754795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:18.755502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:18.755956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:18.756380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:18.787340 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-783654c5-353b-49f8-b0f3-11569603356f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 Oct 28 20:15:18.787894 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3590/7181] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:18 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:19.802902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:19.805428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:19.813040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.813540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.813991 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.814780 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.815207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.815638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.846220 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56920296-aac0-4154-8ce4-84fc033913ba tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048508 Oct 28 20:15:19.846803 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3592/7182] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:19 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:15:19.861544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:19.862424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:19.873807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.874595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.875323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.876338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:19.877085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:19.877711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:19.963609 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] HTTP exception thrown: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 is not attached to volume 1947d2ee-a539-4e46-95b1-432a41435165 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Request method failure captured: Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments/1947d2ee-a539-4e46-95b1-432a41435165 HTTP/1.1 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDgN-IvRuOhybyc5U0eBohuuhhhCg15A3TSnNEQ7Vrh_N0arPOxXdxYex1bmmDHfpL3PRDikd1Y7rciCM9KNKRhNC8CCvcX35MDxYbYCEPEj2OVE7drtleVu22szGqKfYTLZoOg1B5XZAQTWiIYmS03V0vCBq8z7SDGf_LyBxxTrkEo Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1c20a6ce8c04d299de23c6e03b19f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2732e5735cd24e0db347c76489539a57 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 is not attached to volume 1947d2ee-a539-4e46-95b1-432a41435165 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '0ba36cb7-304d-4b23-9f54-bfbee6577ab1', 'id': '1947d2ee-a539-4e46-95b1-432a41435165'} Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1947d2ee-a539-4e46-95b1-432a41435165. Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 is not attached to volume 1947d2ee-a539-4e46-95b1-432a41435165 Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:19.965619 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 is not attached to volume 1947d2ee-a539-4e46-95b1-432a41435165 Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Returning 404 to user: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 is not attached to volume 1947d2ee-a539-4e46-95b1-432a41435165 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-73d40c06-536b-4268-a696-e435c5a516f6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments/1947d2ee-a539-4e46-95b1-432a41435165" status: 404 len: 154 microversion: 2.1 time: 0.112698 Oct 28 20:15:19.969902 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3591/7183] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:15:19 2022] DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1/os-volume_attachments/1947d2ee-a539-4e46-95b1-432a41435165 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:15:23.329032 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:23.329545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:23.336587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:23.337084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:23.337526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:23.338232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:23.338711 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:23.339152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:23.368155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:15:23.451325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f1af1c9a-7e75-429d-a7eb-06c784e1a952 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 204 len: 0 microversion: 2.1 time: 0.125826 Oct 28 20:15:23.451979 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3593/7184] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:15:23 2022] DELETE /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:15:23.460544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:23.461160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:23.468083 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:23.468577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:23.469016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:23.469704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:23.470157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:23.470578 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:23.608318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:23.616639 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48198e62-78e2-4b28-9268-3c58408c6e4d tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1560 microversion: 2.1 time: 0.160070 Oct 28 20:15:23.617214 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3592/7185] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:23 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:15:24.645155 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:24.646382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:24.658826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:24.659587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:24.660042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:24.660794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:24.661267 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:24.661707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:24.795010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:24.803202 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a44f251-bf68-4628-a508-565b98076968 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1560 microversion: 2.1 time: 0.165281 Oct 28 20:15:24.803787 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3594/7186] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:24 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:25.621276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fbf16e33-b6f9-4b57-b784-d6be13ba72ab req-ee89b3e4-842c-4be1-b147-2f399a6247f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba36cb7-304d-4b23-9f54-bfbee6577ab1", "name": "network-vif-deleted", "tag": "c24e7b73-8a1a-4221-8299-5ecedd23feb6"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:25.633483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fbf16e33-b6f9-4b57-b784-d6be13ba72ab req-ee89b3e4-842c-4be1-b147-2f399a6247f1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:25.633958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fbf16e33-b6f9-4b57-b784-d6be13ba72ab req-ee89b3e4-842c-4be1-b147-2f399a6247f1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:25.634452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fbf16e33-b6f9-4b57-b784-d6be13ba72ab req-ee89b3e4-842c-4be1-b147-2f399a6247f1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:25.646611 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fbf16e33-b6f9-4b57-b784-d6be13ba72ab req-ee89b3e4-842c-4be1-b147-2f399a6247f1 service nova] Creating event network-vif-deleted:c24e7b73-8a1a-4221-8299-5ecedd23feb6 for instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 on n-h1-862769-3 Oct 28 20:15:25.652116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fbf16e33-b6f9-4b57-b784-d6be13ba72ab req-ee89b3e4-842c-4be1-b147-2f399a6247f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034950 Oct 28 20:15:25.652733 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3593/7187] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:25.827089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:25.828074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:25.840815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:25.841512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:25.842240 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:25.843451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:25.844219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:25.844918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:25.881624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:25.882115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:25.882550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:25.883041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lazy-loading 'fault' on Instance uuid 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:15:25.930568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:25.938553 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e2bf9ea-01c3-4b89-bb0c-59ff63013796 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 200 len: 1352 microversion: 2.1 time: 0.116122 Oct 28 20:15:25.939169 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3595/7188] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:25 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:26.968478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:26.969688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: 0ba36cb7-304d-4b23-9f54-bfbee6577ab1] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:26.977688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:26.978180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:26.978612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:26.979339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:26.979792 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:26.980215 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:26.994057 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] HTTP exception thrown: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 could not be found. Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Request method failure captured: Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 HTTP/1.1 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDgN-IvRuOhybyc5U0eBohuuhhhCg15A3TSnNEQ7Vrh_N0arPOxXdxYex1bmmDHfpL3PRDikd1Y7rciCM9KNKRhNC8CCvcX35MDxYbYCEPEj2OVE7drtleVu22szGqKfYTLZoOg1B5XZAQTWiIYmS03V0vCBq8z7SDGf_LyBxxTrkEo Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1c20a6ce8c04d299de23c6e03b19f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 2732e5735cd24e0db347c76489539a57 Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 could not be found. Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '0ba36cb7-304d-4b23-9f54-bfbee6577ab1'} Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 could not be found. Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 could not be found. Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:26.995713 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 could not be found. Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Returning 404 to user: Instance 0ba36cb7-304d-4b23-9f54-bfbee6577ab1 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e3d40ab-bfc5-48c9-8144-73ced55762d4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1" status: 404 len: 111 microversion: 2.1 time: 0.037222 Oct 28 20:15:27.000379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3594/7189] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:26 2022] GET /compute/v2.1/servers/0ba36cb7-304d-4b23-9f54-bfbee6577ab1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:15:27.006296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-73d8605d-d251-4370-8333-00643d19bc13 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '.version_select at 0x7f1d77c45310>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:27.029718 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-73d8605d-d251-4370-8333-00643d19bc13 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-796267975" status: 202 len: 0 microversion: 2.1 time: 0.027392 Oct 28 20:15:27.030311 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3596/7190] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:15:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-796267975 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:15:27.051332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e1245a1-cb8b-4295-b3b5-9ceeefdc9e9a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: .version_select at 0x7f1d774f6af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-709222069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4qzpw1qaPGMVzz40SgachFH6vwLLxpb4KkRIm/YvssT4hlGc3SKiFZFQkWPWCLT1fNwZfHkz500LaGJbX2n8AXe8y5krPHCiAgNOHVXlHP3jiv/0ZqEeRa9LQhafssgg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:27.071978 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4e1245a1-cb8b-4295-b3b5-9ceeefdc9e9a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:15:27.077372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-4e1245a1-cb8b-4295-b3b5-9ceeefdc9e9a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for user 2732e5735cd24e0db347c76489539a57 and project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:15:27.101901 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e1245a1-cb8b-4295-b3b5-9ceeefdc9e9a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.056716 Oct 28 20:15:27.102501 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3595/7191] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:15:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:27.181458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-358712963", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-709222069", "networks": [{"uuid": "2de702ca-38f9-4baf-a1dc-2d3684073394"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:27.238244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] validate_networks() for [('2de702ca-38f9-4baf-a1dc-2d3684073394', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:15:27.629908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:15:27.630338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:15:27.630853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:15:27.631264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:15:27.631684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:15:27.640675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:27.641165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:27.641603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:27.642331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:27.642789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:27.643216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:27.661211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:15:27.666727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Getting quotas for user 2732e5735cd24e0db347c76489539a57 and project b1c20a6ce8c04d299de23c6e03b19f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:15:27.679544 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:15:27.681895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:15:27.730646 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b5983419-7353-40a1-b51b-9e043456befa tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553211 Oct 28 20:15:27.731326 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3597/7192] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:15:27.742795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cec09fae-98c6-4102-85a4-ed2166de0497 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:27.743470 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cec09fae-98c6-4102-85a4-ed2166de0497 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:27.883210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cec09fae-98c6-4102-85a4-ed2166de0497 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:27.893050 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cec09fae-98c6-4102-85a4-ed2166de0497 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1261 microversion: 2.1 time: 0.154290 Oct 28 20:15:27.893788 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3596/7193] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:27 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:28.920230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:28.921628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:28.929265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.930161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.930901 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:28.931887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:28.932579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:28.933590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:29.024367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:29.034778 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5c49304a-fba5-418d-b1bb-4ee87957eec4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1321 microversion: 2.1 time: 0.122089 Oct 28 20:15:29.035753 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3598/7194] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:28 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1321 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:30.058390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:30.059047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:30.065649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.066103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.066953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.067772 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.068214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.068634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.273511 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:30.281652 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-31d9dc6e-383a-4ffb-8d06-b305afd7cb6b tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.227358 Oct 28 20:15:30.282642 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3597/7195] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:30 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:30.404394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6f6ad7fc-6d1a-468a-8116-c0630a2a03e7 req-3bd9c378-c54c-4a3b-b0de-f7abe25e2104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca76db66-2841-445c-81e5-eec3f59be12e", "tag": "578ad59b-55e9-4042-975e-fca73609ab79"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:30.416845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6f6ad7fc-6d1a-468a-8116-c0630a2a03e7 req-3bd9c378-c54c-4a3b-b0de-f7abe25e2104 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:30.417875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6f6ad7fc-6d1a-468a-8116-c0630a2a03e7 req-3bd9c378-c54c-4a3b-b0de-f7abe25e2104 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:30.418317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6f6ad7fc-6d1a-468a-8116-c0630a2a03e7 req-3bd9c378-c54c-4a3b-b0de-f7abe25e2104 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:30.431170 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6f6ad7fc-6d1a-468a-8116-c0630a2a03e7 req-3bd9c378-c54c-4a3b-b0de-f7abe25e2104 service nova] Creating event network-changed:578ad59b-55e9-4042-975e-fca73609ab79 for instance ca76db66-2841-445c-81e5-eec3f59be12e on n-h1-862769-3 Oct 28 20:15:30.436698 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6f6ad7fc-6d1a-468a-8116-c0630a2a03e7 req-3bd9c378-c54c-4a3b-b0de-f7abe25e2104 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036275 Oct 28 20:15:30.437328 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3599/7196] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:31.306720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:31.307381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:31.315221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:31.315736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:31.316187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:31.316909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:31.317380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:31.317821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:31.454429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:31.462254 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b70ce6cf-802c-4e72-990b-e7b438c6982e tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.159816 Oct 28 20:15:31.462927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3598/7197] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:31 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:32.490161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:32.490935 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:32.498165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:32.498660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:32.499129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:32.499837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:32.500303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:32.500732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:32.706440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:32.715281 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42b345cb-f8ef-4a2e-b255-ba51b8e7d9ef tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.229527 Oct 28 20:15:32.715870 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3600/7198] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:32 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:33.742357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:33.743833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:33.755853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:33.756330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:33.756759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:33.757446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:33.757896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:33.758318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:33.893665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:33.902009 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4e6e1c16-616a-473e-9029-1022d018bade tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.166162 Oct 28 20:15:33.902601 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3599/7199] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:33 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:34.930296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:34.931301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:34.943320 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.944151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.944906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:34.946057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:34.946907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:34.947648 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:35.147324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:35.159734 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af869116-0422-46dd-8d9a-69b5dd66c0d8 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.235927 Oct 28 20:15:35.160612 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3601/7200] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:34 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:36.042448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-322c828c-b9ee-4b82-a8ad-ccacd623dc00 req-d85da7f7-e42a-49ef-bee6-ed2665b7a139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca76db66-2841-445c-81e5-eec3f59be12e", "name": "network-vif-plugged", "status": "completed", "tag": "578ad59b-55e9-4042-975e-fca73609ab79"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:36.053285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-322c828c-b9ee-4b82-a8ad-ccacd623dc00 req-d85da7f7-e42a-49ef-bee6-ed2665b7a139 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.053809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-322c828c-b9ee-4b82-a8ad-ccacd623dc00 req-d85da7f7-e42a-49ef-bee6-ed2665b7a139 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.054309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-322c828c-b9ee-4b82-a8ad-ccacd623dc00 req-d85da7f7-e42a-49ef-bee6-ed2665b7a139 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.066311 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-322c828c-b9ee-4b82-a8ad-ccacd623dc00 req-d85da7f7-e42a-49ef-bee6-ed2665b7a139 service nova] Creating event network-vif-plugged:578ad59b-55e9-4042-975e-fca73609ab79 for instance ca76db66-2841-445c-81e5-eec3f59be12e on n-h1-862769-3 Oct 28 20:15:36.071888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-322c828c-b9ee-4b82-a8ad-ccacd623dc00 req-d85da7f7-e42a-49ef-bee6-ed2665b7a139 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033235 Oct 28 20:15:36.072528 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3600/7201] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:36.183894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:36.184558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:36.193288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.193806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.194236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.194982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:36.195447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:36.195877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:36.330472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:36.338471 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-36acf289-b712-4229-9e48-021dba960a18 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.158742 Oct 28 20:15:36.339095 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3602/7202] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:36 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:37.363131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:37.363830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:37.370720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:37.371234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:37.371656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:37.372342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:37.372788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:37.373207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:37.511248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:37.519375 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e09cc5d1-e01c-4c5a-819b-ed876161c732 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1361 microversion: 2.1 time: 0.161535 Oct 28 20:15:37.519964 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3601/7203] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:37 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:38.547480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:38.548538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:38.553335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:38.554121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:38.559867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.560364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.560805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.561507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.561966 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.562393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.692731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:38.700901 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3068a71-553e-4c5a-8973-ffb5f95196f9 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1552 microversion: 2.1 time: 0.160172 Oct 28 20:15:38.701460 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3603/7204] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:38 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:38.723815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:38.724401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:38.726446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:38.733438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.734038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.734577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.735455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:38.736009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:38.736528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:38.873165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:15:38.881355 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-357a3448-0882-4675-8bcf-74b36e5dd941 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1552 microversion: 2.1 time: 0.161473 Oct 28 20:15:38.881934 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3602/7205] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:15:38 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:15:40.407875 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656cc8c4-c120-4e70-9588-de3545b75502"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:15:40.410386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:40.417829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:40.418239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:40.418684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:40.419416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:40.419878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:40.420309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:40.548311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:40.669721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83898f95-1d17-48b5-ae44-a168a900f6a7 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "POST /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265932 Oct 28 20:15:40.670342 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3604/7206] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 20:15:40 2022] POST /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:51.459767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:51.460327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:51.463679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:51.464396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=66 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:51.471145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:51.471635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:51.472072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:51.472767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:51.473221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:51.473688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:51.559402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lazy-loading 'services' on Instance uuid ca76db66-2841-445c-81e5-eec3f59be12e {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:15:51.639440 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d43e10d5-5c93-4dbf-8682-c8bc2acc0a6f tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments/656cc8c4-c120-4e70-9588-de3545b75502" status: 202 len: 0 microversion: 2.1 time: 0.186914 Oct 28 20:15:51.640030 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3603/7207] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:15:51 2022] DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments/656cc8c4-c120-4e70-9588-de3545b75502 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:15:51.649234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:51.651867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:51.655271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:51.656021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:15:51.664202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:51.664741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:51.665199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:51.666045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:51.666512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:51.666975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:51.703949 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3a7e5aed-adbb-42de-84ba-59b858fb9321 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059117 Oct 28 20:15:51.704692 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3605/7208] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:51 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:52.718157 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:52.720584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:52.727013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:52.727501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:52.727970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:52.728683 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:52.729123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:52.729555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:52.760342 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-584d2dd6-fd36-43c3-95e3-bd439e8e1bb6 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Oct 28 20:15:52.761201 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3604/7209] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:52 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:53.773680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:53.775951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:53.783776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:53.784342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:53.784789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:53.785519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:53.786150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:53.786715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:53.820131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bca05975-6972-4b92-a413-826d7264cc4a tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050505 Oct 28 20:15:53.820822 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3606/7210] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:53 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:54.833453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:54.835724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:54.843257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:54.843745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:54.844181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:54.844880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:54.845333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:54.845756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:54.876767 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f45483f2-d299-43a1-936e-2eccb2e288e3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047355 Oct 28 20:15:54.877344 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3605/7211] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:54 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:55.889915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:55.892400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:55.900166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:55.900677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:55.901327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:55.902053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:55.902515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:55.902986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:55.935810 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2d09566e-5b04-475d-b7f4-e71f53940893 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050121 Oct 28 20:15:55.936423 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3607/7212] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:55 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:15:56.952159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:56.955774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:56.967424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:56.968236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:56.968955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:56.970081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:56.970871 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:56.971567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.007104 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85c280fe-b804-44e2-9cb2-07789018e5f4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061577 Oct 28 20:15:57.007926 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3606/7213] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:15:56 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:15:57.018735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:15:57.019342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:15:57.026354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:57.026893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:57.027342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.028052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:15:57.028516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:15:57.028947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:15:57.111006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] HTTP exception thrown: Instance ca76db66-2841-445c-81e5-eec3f59be12e is not attached to volume 656cc8c4-c120-4e70-9588-de3545b75502 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Request method failure captured: Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments/656cc8c4-c120-4e70-9588-de3545b75502 HTTP/1.1 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDgN-IvRuOhybyc5U0eBohuuhhhCg15A3TSnNEQ7Vrh_N0arPOxXdxYex1bmmDHfpL3PRDikd1Y7rciCM9KNKRhNC8CCvcX35MDxYbYCEPEj2OVE7drtleVu22szGqKfYTLZoOg1B5XZAQTWiIYmS03V0vCBq8z7SDGf_LyBxxTrkEo Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1c20a6ce8c04d299de23c6e03b19f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2732e5735cd24e0db347c76489539a57 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance ca76db66-2841-445c-81e5-eec3f59be12e is not attached to volume 656cc8c4-c120-4e70-9588-de3545b75502 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': 'ca76db66-2841-445c-81e5-eec3f59be12e', 'id': '656cc8c4-c120-4e70-9588-de3545b75502'} Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 656cc8c4-c120-4e70-9588-de3545b75502. Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca76db66-2841-445c-81e5-eec3f59be12e is not attached to volume 656cc8c4-c120-4e70-9588-de3545b75502 Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:15:57.115153 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca76db66-2841-445c-81e5-eec3f59be12e is not attached to volume 656cc8c4-c120-4e70-9588-de3545b75502 Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Returning 404 to user: Instance ca76db66-2841-445c-81e5-eec3f59be12e is not attached to volume 656cc8c4-c120-4e70-9588-de3545b75502 {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2dca6124-334b-4645-add7-01d5b1c354e0 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments/656cc8c4-c120-4e70-9588-de3545b75502" status: 404 len: 154 microversion: 2.1 time: 0.102134 Oct 28 20:15:57.119389 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3608/7214] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:15:57 2022] DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e/os-volume_attachments/656cc8c4-c120-4e70-9588-de3545b75502 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:16:00.511423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:00.512773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:00.522446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.523301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.524055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.524991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.525635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.526213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.555991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:16:00.638503 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9778b90e-181c-4e01-b2be-8a6f00de10c2 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 204 len: 0 microversion: 2.1 time: 0.131388 Oct 28 20:16:00.639249 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3607/7215] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:16:00 2022] DELETE /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:16:00.648233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:00.649459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:00.657052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.657774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.658223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.659005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:00.659471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:00.659883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:00.797470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:00.806006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9909668e-9c13-4076-83bb-74308bf75e66 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1558 microversion: 2.1 time: 0.162104 Oct 28 20:16:00.806715 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3609/7216] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:00 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:16:01.835736 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:01.836898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:01.844949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:01.845436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:01.845865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:01.846551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:01.847034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:01.847453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:01.988866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:01.997318 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-741c58a8-9849-437a-aca3-d8f8759f73d3 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1558 microversion: 2.1 time: 0.168659 Oct 28 20:16:01.997892 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3608/7217] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:01 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:02.858073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-70143207-327b-4c02-b4c8-f41b0a480e58 req-eef4b84e-3633-49b7-995b-80fc1455d783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca76db66-2841-445c-81e5-eec3f59be12e", "name": "network-vif-deleted", "tag": "578ad59b-55e9-4042-975e-fca73609ab79"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:16:02.870039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-70143207-327b-4c02-b4c8-f41b0a480e58 req-eef4b84e-3633-49b7-995b-80fc1455d783 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:02.870535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-70143207-327b-4c02-b4c8-f41b0a480e58 req-eef4b84e-3633-49b7-995b-80fc1455d783 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:02.871001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-70143207-327b-4c02-b4c8-f41b0a480e58 req-eef4b84e-3633-49b7-995b-80fc1455d783 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:02.883375 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-70143207-327b-4c02-b4c8-f41b0a480e58 req-eef4b84e-3633-49b7-995b-80fc1455d783 service nova] Creating event network-vif-deleted:578ad59b-55e9-4042-975e-fca73609ab79 for instance ca76db66-2841-445c-81e5-eec3f59be12e on n-h1-862769-3 Oct 28 20:16:02.889412 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-70143207-327b-4c02-b4c8-f41b0a480e58 req-eef4b84e-3633-49b7-995b-80fc1455d783 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035741 Oct 28 20:16:02.890143 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3610/7218] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:03.020218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:03.020779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:03.027996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.028492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.028924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.029604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.030255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.030682 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.064228 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:03.064652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:03.065079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:03.065555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lazy-loading 'fault' on Instance uuid ca76db66-2841-445c-81e5-eec3f59be12e {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:16:03.107086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2732e5735cd24e0db347c76489539a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c20a6ce8c04d299de23c6e03b19f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:03.115477 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-841e8336-f2c4-4365-8b00-a4a27e9a8df4 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 200 len: 1351 microversion: 2.1 time: 0.099326 Oct 28 20:16:03.116047 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3609/7219] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:03 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:04.145726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:04.146438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] [instance: ca76db66-2841-445c-81e5-eec3f59be12e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:04.154836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:04.155348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:04.155792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:04.156495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:04.157306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:04.157736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:04.171267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] HTTP exception thrown: Instance ca76db66-2841-445c-81e5-eec3f59be12e could not be found. Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Request method failure captured: Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e HTTP/1.1 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDgN-IvRuOhybyc5U0eBohuuhhhCg15A3TSnNEQ7Vrh_N0arPOxXdxYex1bmmDHfpL3PRDikd1Y7rciCM9KNKRhNC8CCvcX35MDxYbYCEPEj2OVE7drtleVu22szGqKfYTLZoOg1B5XZAQTWiIYmS03V0vCBq8z7SDGf_LyBxxTrkEo Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1c20a6ce8c04d299de23c6e03b19f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1c20a6ce8c04d299de23c6e03b19f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: b1c20a6ce8c04d299de23c6e03b19f11 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-395548420 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 2732e5735cd24e0db347c76489539a57 Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestEncryptedCinderVolumes-395548420-project Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance ca76db66-2841-445c-81e5-eec3f59be12e could not be found. Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ca76db66-2841-445c-81e5-eec3f59be12e'} Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca76db66-2841-445c-81e5-eec3f59be12e could not be found. Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca76db66-2841-445c-81e5-eec3f59be12e could not be found. Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:16:04.172892 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca76db66-2841-445c-81e5-eec3f59be12e could not be found. Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Returning 404 to user: Instance ca76db66-2841-445c-81e5-eec3f59be12e could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-de262bc5-b3ae-4d8b-bfcc-9d09d6d8df28 tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e" status: 404 len: 111 microversion: 2.1 time: 0.036990 Oct 28 20:16:04.177133 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3611/7220] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:04 2022] GET /compute/v2.1/servers/ca76db66-2841-445c-81e5-eec3f59be12e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:16:04.183336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd3f46f7-6727-430f-b0ef-1182a4f0395c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] Calling method '.version_select at 0x7f1d773d9f70>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:04.206304 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd3f46f7-6727-430f-b0ef-1182a4f0395c tempest-TestEncryptedCinderVolumes-395548420 tempest-TestEncryptedCinderVolumes-395548420-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-709222069" status: 202 len: 0 microversion: 2.1 time: 0.026732 Oct 28 20:16:04.206846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3610/7221] 10.222.0.44 () {58 vars in 1275 bytes} [Fri Oct 28 20:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-709222069 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:16:31.238493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-53550ca5-9d88-4632-a8bc-e1b196426b51 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'create', calling method: .version_select at 0x7f1d77df83a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-816442051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3CpW7fCbyUq+1PPxwXCiOA8rbH1R1QAbG0vwFR2wEzuOTbUgw0pP7vPemkRB9gwkdAE1vdC2AVt6Ph6Z+EmV0adnfW8CXlzBsdNosAgUudbC+b+YkEPyr8xTlmUPUs7Q=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:16:31.244179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=14 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:31.244874 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=34 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:31.257720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-53550ca5-9d88-4632-a8bc-e1b196426b51 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for project 23167431d8f7461989c587085e2a14ec. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:16:31.263097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-53550ca5-9d88-4632-a8bc-e1b196426b51 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for user 999d8e2d9b0a43c59a97558e57412d92 and project 23167431d8f7461989c587085e2a14ec. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:16:31.288419 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-53550ca5-9d88-4632-a8bc-e1b196426b51 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054035 Oct 28 20:16:31.289027 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3612/7222] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:16:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:31.339186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:31.339983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:31.344450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1457556964", "imageRef": "8494eb8c-6f27-45bf-b7f9-a06a7c7b4611", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-816442051", "networks": [{"uuid": "ee60b7ab-67f0-4088-9b85-0690c7913a5f"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:16:31.404393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] validate_networks() for [('ee60b7ab-67f0-4088-9b85-0690c7913a5f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:16:31.804862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:16:31.805288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:16:31.805766 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:16:31.806180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:16:31.806596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:16:31.817488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:31.817977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:31.818412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:31.819180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:31.819633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:31.820051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:31.839069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for project 23167431d8f7461989c587085e2a14ec. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:16:31.844853 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for user 999d8e2d9b0a43c59a97558e57412d92 and project 23167431d8f7461989c587085e2a14ec. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:16:31.857461 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:16:31.859789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8494eb8c-6f27-45bf-b7f9-a06a7c7b4611',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:16:31.907249 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1bd7ad57-752e-423d-9b5b-437f38a194a1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569823 Oct 28 20:16:31.907934 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3611/7223] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:16:31.919228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3bd5b618-4dab-42f8-8297-09700aa41a73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:31.919863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3bd5b618-4dab-42f8-8297-09700aa41a73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:31.976213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3bd5b618-4dab-42f8-8297-09700aa41a73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:31.984813 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3bd5b618-4dab-42f8-8297-09700aa41a73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1258 microversion: 2.1 time: 0.069715 Oct 28 20:16:31.985381 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3613/7224] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:31 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:33.013329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:33.013900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:33.020909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:33.021396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:33.021829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:33.022515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:33.022995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:33.023417 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:33.098500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:33.106652 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ad098b7-f387-4eb3-b00e-de71d76891a3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1310 microversion: 2.1 time: 0.101722 Oct 28 20:16:33.107278 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3612/7225] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:33 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:34.129871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:34.131186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:34.139138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:34.139892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:34.140574 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:34.141480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:34.142110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:34.142734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:34.296902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:34.305218 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-eaa179ff-f6a0-4141-92de-c4c26aec7bb5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.179279 Oct 28 20:16:34.306530 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3614/7226] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:34 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:35.329054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:35.329840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:35.337274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:35.343340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:35.344035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:35.344987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:35.345625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:35.346387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:35.490322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:35.498297 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e969cbe0-c4e2-4bd0-b211-423cb4a15e36 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.173332 Oct 28 20:16:35.498939 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3613/7227] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:35 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:36.524188 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:36.524913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:36.532501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:36.533045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:36.533482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:36.534189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:36.534645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:36.535127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:36.679920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:36.688192 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-88768943-b10a-43d9-8973-5077b175e3df tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.168511 Oct 28 20:16:36.688777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3615/7228] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:36 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:37.712548 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:37.713594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:37.722147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:37.723076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:37.723734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:37.724781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:37.725445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:37.726087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:37.861414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:37.870139 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7baeeaa0-f870-42ca-a8c5-ce6fd3c798e1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.161385 Oct 28 20:16:37.876652 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3614/7229] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:37 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:38.893141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:38.893779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:38.900951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:38.901721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:38.902165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:38.902922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:38.903395 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:38.904071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:39.059468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:39.070049 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc060f98-c505-4ef6-9b2c-ab1ba40fd68f tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.180822 Oct 28 20:16:39.081146 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3616/7230] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:38 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:40.096901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:40.097621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:40.105097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:40.105731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:40.106138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:40.107195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:40.107624 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:40.108375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:40.249197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:40.258387 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fafa5816-649d-40f8-89f6-e207540d741d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.165437 Oct 28 20:16:40.271320 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3615/7231] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:40 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:41.284042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:41.284683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:41.293679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:41.294257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:41.294812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:41.295655 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:41.296216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:41.296707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:41.441671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:41.449806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29635256-b7a8-4f7d-b0b5-c3ab9b72cb90 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.171385 Oct 28 20:16:41.450401 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3617/7232] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:41 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:42.363104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-308ef556-e6f0-48b0-852a-5b873fca566a req-8158bdcf-46d7-4245-b35d-df46e28d6ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:16:42.370074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:42.370835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:42.377868 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-308ef556-e6f0-48b0-852a-5b873fca566a req-8158bdcf-46d7-4245-b35d-df46e28d6ecd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.378351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-308ef556-e6f0-48b0-852a-5b873fca566a req-8158bdcf-46d7-4245-b35d-df46e28d6ecd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.378810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-308ef556-e6f0-48b0-852a-5b873fca566a req-8158bdcf-46d7-4245-b35d-df46e28d6ecd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.390878 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-308ef556-e6f0-48b0-852a-5b873fca566a req-8158bdcf-46d7-4245-b35d-df46e28d6ecd service nova] Creating event network-changed:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:16:42.396100 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-308ef556-e6f0-48b0-852a-5b873fca566a req-8158bdcf-46d7-4245-b35d-df46e28d6ecd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037661 Oct 28 20:16:42.396826 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3616/7233] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:42.472895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:42.473484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:42.475516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:16:42.482311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.482840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.483285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.483988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:42.484451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:42.484879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:42.689970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:42.698140 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-39b5047d-13ae-480f-8a4e-7c7219450299 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.229290 Oct 28 20:16:42.699394 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3618/7234] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:42 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:43.729812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:43.731062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:43.742044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:43.742910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:43.743639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:43.744790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:43.745563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:43.746277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:43.916716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:43.925064 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9cc2c257-b139-4503-9a80-3658fe5824a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.204099 Oct 28 20:16:43.925661 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3617/7235] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:43 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:44.951697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:44.952312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:44.959716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:44.960220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:44.960667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:44.961383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:44.961853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:44.962290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:45.095263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:45.103323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9cf2e8da-1c98-40a6-b9fd-c9777bcb7989 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.157797 Oct 28 20:16:45.103909 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3619/7236] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:44 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:46.130733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:46.131859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:46.143788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:46.144607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:46.145338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:46.146502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:46.147315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:46.148027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:46.281802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:46.291073 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-62ce1b3c-e098-49df-a082-1cb3b8117dec tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.166923 Oct 28 20:16:46.292020 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3618/7237] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:46 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:47.316920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:47.317906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:47.328559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:47.329329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:47.330022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:47.331156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:47.331885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:47.332563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:47.475675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:47.483889 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9e654fd3-ff85-48ea-9b5a-16a841c6db9b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.173252 Oct 28 20:16:47.484503 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3620/7238] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:47 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:48.464188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-faa86c78-6c7e-4a51-adec-2adaca45ecaf req-a642c823-235e-4b1c-8982-d3ab43b4c007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "name": "network-vif-plugged", "status": "completed", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:16:48.475057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-faa86c78-6c7e-4a51-adec-2adaca45ecaf req-a642c823-235e-4b1c-8982-d3ab43b4c007 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.475545 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-faa86c78-6c7e-4a51-adec-2adaca45ecaf req-a642c823-235e-4b1c-8982-d3ab43b4c007 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.476014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-faa86c78-6c7e-4a51-adec-2adaca45ecaf req-a642c823-235e-4b1c-8982-d3ab43b4c007 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.487889 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-faa86c78-6c7e-4a51-adec-2adaca45ecaf req-a642c823-235e-4b1c-8982-d3ab43b4c007 service nova] Creating event network-vif-plugged:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:16:48.492808 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-faa86c78-6c7e-4a51-adec-2adaca45ecaf req-a642c823-235e-4b1c-8982-d3ab43b4c007 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 Oct 28 20:16:48.493423 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3619/7239] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:48.506801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:48.507429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:48.515009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.515515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.515963 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.516688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:48.517153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:48.517591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:48.705624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:48.714076 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-58e22cb2-bc07-468f-b22f-55c780e894f1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.211300 Oct 28 20:16:48.714621 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3621/7240] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:48 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:49.743447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:49.744596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:49.752214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:49.752697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:49.753132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:49.753825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:49.754285 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:49.754728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:49.891142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:49.899994 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d1c57f13-e548-4f00-9422-c6c8423b40e5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1358 microversion: 2.1 time: 0.164963 Oct 28 20:16:49.900913 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3620/7241] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:49 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:50.928089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:50.929126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:50.940744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:50.941580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:50.942325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:50.943564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:50.944338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:50.945070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.085274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:51.093476 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2b4d264-f82c-47e9-b09c-baa33a8ee237 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1549 microversion: 2.1 time: 0.172054 Oct 28 20:16:51.094058 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3622/7242] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:50 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:51.115825 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:51.116445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:51.123855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.124330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.124760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.125449 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.125898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.126315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.269712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:51.277956 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e4b01552-4b9e-40d1-881c-cb228634425d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1549 microversion: 2.1 time: 0.166131 Oct 28 20:16:51.278655 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3621/7243] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:51 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:16:51.300005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:51.304716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:51.305499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Searching by: {'deleted': False, 'project_id': '23167431d8f7461989c587085e2a14ec'} {{(pid=120629) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 20:16:51.311034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.311522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.311964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.312694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.313126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.313554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.339714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.multi_cell_list [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 20:16:51.368714 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e13f01d-86bd-4556-a92b-f4c817466dd2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072580 Oct 28 20:16:51.369288 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3623/7244] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 20:16:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:16:51.381455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:16:51.382078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:51.388415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.388907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.389349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.390044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:51.390503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:51.390961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:51.523860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:16:51.535987 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-89667b13-c12b-4fb5-9b12-df36a0fefbfe tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1549 microversion: 2.1 time: 0.158473 Oct 28 20:16:51.536754 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3622/7245] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:16:51 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:16:53.109185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6241a3a5-a198-406e-a061-819a9302dee3"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:16:53.111641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:16:53.118538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:53.119084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:53.119527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:53.120231 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:16:53.120694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:16:53.121130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:16:53.367249 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f72a181-11a9-417f-9168-d3e29a7ec3a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263289 Oct 28 20:16:53.367903 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3624/7246] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 20:16:53 2022] POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:06.489703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:06.490231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:06.493345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:06.494016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=60 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:06.500076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:06.500561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:06.500992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:06.501704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:06.502174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:06.502594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:06.643340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:06.652156 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d491bdce-4cc9-4695-998a-bdb91f9430a5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1595 microversion: 2.1 time: 0.171161 Oct 28 20:17:06.652730 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3623/7247] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:06 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:17:08.339926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:08.340630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:08.341778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:17:08.479084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dc6086a0-6dd6-4305-8d47-6df12a5310aa req-0417e4e5-3ac2-4a0b-bcb3-ca8413600450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:17:08.498068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dc6086a0-6dd6-4305-8d47-6df12a5310aa req-0417e4e5-3ac2-4a0b-bcb3-ca8413600450 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:08.498946 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dc6086a0-6dd6-4305-8d47-6df12a5310aa req-0417e4e5-3ac2-4a0b-bcb3-ca8413600450 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:08.500658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dc6086a0-6dd6-4305-8d47-6df12a5310aa req-0417e4e5-3ac2-4a0b-bcb3-ca8413600450 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:08.518162 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dc6086a0-6dd6-4305-8d47-6df12a5310aa req-0417e4e5-3ac2-4a0b-bcb3-ca8413600450 service nova] Creating event network-changed:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:17:08.525857 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dc6086a0-6dd6-4305-8d47-6df12a5310aa req-0417e4e5-3ac2-4a0b-bcb3-ca8413600450 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191622 Oct 28 20:17:08.526843 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3625/7248] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:17:09.349340 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-419032884"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:17:09.349877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:09.357081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.357570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.358006 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.358716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.359184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.359607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.494148 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.network.security_group_api [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Adding security group 5f0bf814-2c0c-4741-8ef7-8e3628d88aec to port 317f8512-7927-41a1-bf13-edffd53cd857 Oct 28 20:17:09.818810 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dbc0c1b1-b05d-432a-8525-04563a69ccb6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action" status: 202 len: 0 microversion: 2.1 time: 0.473511 Oct 28 20:17:09.819430 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3624/7249] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:17:09 2022] POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:17:09.831751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:17:09.832396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:17:09.836787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-62daae46-8951-4b5d-9c3d-5166402baf62 req-ea5cd947-a1a9-4210-9dc2-e6696cde38e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:17:09.855432 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.855868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-62daae46-8951-4b5d-9c3d-5166402baf62 req-ea5cd947-a1a9-4210-9dc2-e6696cde38e8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.856383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-62daae46-8951-4b5d-9c3d-5166402baf62 req-ea5cd947-a1a9-4210-9dc2-e6696cde38e8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.856515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.856830 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-62daae46-8951-4b5d-9c3d-5166402baf62 req-ea5cd947-a1a9-4210-9dc2-e6696cde38e8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.856958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.857774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:17:09.858301 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:17:09.858963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:17:09.878615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-62daae46-8951-4b5d-9c3d-5166402baf62 req-ea5cd947-a1a9-4210-9dc2-e6696cde38e8 service nova] Creating event network-changed:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:17:09.883805 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-62daae46-8951-4b5d-9c3d-5166402baf62 req-ea5cd947-a1a9-4210-9dc2-e6696cde38e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060261 Oct 28 20:17:09.884568 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3626/7250] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:17:10.099729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:17:10.111068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-525e8ded-8901-4085-ac79-25d0898cc22a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1758 microversion: 2.1 time: 0.282992 Oct 28 20:17:10.122741 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3625/7251] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:17:09 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1758 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:54.346838 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fc1657b-75c1-488d-b75a-e03b085f7311] AMQP server on 10.222.0.44:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 20:18:54.347802 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:18:54.348585 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:54.349470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:54.350327 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:18:54.350485 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:18:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action (ip 10.222.0.44) !!! Oct 28 20:18:54.352551 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 20:18:54.357683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:18:54.360955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:54.371813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.372306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.372770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.373478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.373938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.374393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.454332 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed9301e8-cfdf-43ea-9501-7d8bd198e4d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action" status: 202 len: 0 microversion: 2.1 time: 0.110167 Oct 28 20:18:54.455026 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3627/7252] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:18:54 2022] POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:18:54.462924 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b72bd91-391c-4fa9-9ea6-f22b8465edd5] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:18:54.463954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:54.464733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=16 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:18:54.465926 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 20:18:54.467493 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:18:54.467493 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:18:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 (ip 10.222.0.44) !!! Oct 28 20:18:54.475081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:54.475953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:54.486664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.487175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.487621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.488329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:54.488788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:54.489344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:54.741475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:54.753722 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6d6fca95-c27f-444f-9bb3-f6a49ae62550 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1760 microversion: 2.1 time: 0.292656 Oct 28 20:18:54.754675 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3626/7253] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:54 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1760 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:18:55.784658 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:18:55.785745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:18:55.797280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:55.798023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:55.798749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:55.799820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:18:55.800531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:18:55.801193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:18:55.808346 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fc1657b-75c1-488d-b75a-e03b085f7311] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40370. Oct 28 20:18:55.819172 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40372. Oct 28 20:18:55.956730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:18:55.965554 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b2934383-9a35-46ee-8500-560954a44059 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1758 microversion: 2.1 time: 0.190592 Oct 28 20:18:55.966144 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3628/7254] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:18:55 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:11.802984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-419032884"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:11.803514 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:11.806332 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9c52e5a-70f9-441b-9223-dec5b930acb1] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:20:11.807983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:11.808601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:11.815364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.815857 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.816291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.816995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:11.817451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:11.817873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:11.837346 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b72bd91-391c-4fa9-9ea6-f22b8465edd5] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40400. Oct 28 20:20:11.954569 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.network.security_group_api [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Removing security group 5f0bf814-2c0c-4741-8ef7-8e3628d88aec from port 317f8512-7927-41a1-bf13-edffd53cd857 Oct 28 20:20:12.317479 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0746896e-f31f-4870-9362-62952d18dff0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action" status: 202 len: 0 microversion: 2.1 time: 0.519627 Oct 28 20:20:12.321411 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3627/7255] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:20:11 2022] POST /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:20:12.323610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:12.325085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:12.408487 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-17ed126d-4386-4526-82af-29a4f1774419 req-79f8d971-ea09-4342-8805-405b1c579675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:12.420016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-17ed126d-4386-4526-82af-29a4f1774419 req-79f8d971-ea09-4342-8805-405b1c579675 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:12.420603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-17ed126d-4386-4526-82af-29a4f1774419 req-79f8d971-ea09-4342-8805-405b1c579675 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:12.421239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-17ed126d-4386-4526-82af-29a4f1774419 req-79f8d971-ea09-4342-8805-405b1c579675 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:12.433772 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-17ed126d-4386-4526-82af-29a4f1774419 req-79f8d971-ea09-4342-8805-405b1c579675 service nova] Creating event network-changed:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:20:12.439440 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-17ed126d-4386-4526-82af-29a4f1774419 req-79f8d971-ea09-4342-8805-405b1c579675 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117838 Oct 28 20:20:12.440592 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3629/7256] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:20:13.788205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:13.788771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:13.796603 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9c52e5a-70f9-441b-9223-dec5b930acb1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40426. Oct 28 20:20:13.802564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:13.803087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:13.803527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:13.804235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:13.804700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:13.805130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:13.892856 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lazy-loading 'services' on Instance uuid aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:20:13.969150 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [0d302f4d-6df0-4468-84fd-4e298f14bd58] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:20:14.459259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-60daab5a-4ce5-400a-b28a-9af497596bdc req-e7a14c59-6f1d-4eee-b9ce-4b8f59e71761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:14.469529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-60daab5a-4ce5-400a-b28a-9af497596bdc req-e7a14c59-6f1d-4eee-b9ce-4b8f59e71761 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:14.470038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-60daab5a-4ce5-400a-b28a-9af497596bdc req-e7a14c59-6f1d-4eee-b9ce-4b8f59e71761 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:14.470444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-60daab5a-4ce5-400a-b28a-9af497596bdc req-e7a14c59-6f1d-4eee-b9ce-4b8f59e71761 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:14.482339 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-60daab5a-4ce5-400a-b28a-9af497596bdc req-e7a14c59-6f1d-4eee-b9ce-4b8f59e71761 service nova] Creating event network-changed:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:20:14.487393 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-60daab5a-4ce5-400a-b28a-9af497596bdc req-e7a14c59-6f1d-4eee-b9ce-4b8f59e71761 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033892 Oct 28 20:20:14.487992 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3630/7257] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:14.977932 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [0d302f4d-6df0-4468-84fd-4e298f14bd58] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40434. Oct 28 20:20:14.982712 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-def5df6f-22f8-446e-b90b-66878ce16605 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments/6241a3a5-a198-406e-a061-819a9302dee3" status: 202 len: 0 microversion: 2.1 time: 1.201046 Oct 28 20:20:14.983450 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3628/7258] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:20:13 2022] DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments/6241a3a5-a198-406e-a061-819a9302dee3 => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:20:14.993071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:14.995538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:15.002887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.003471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.003945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.004931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:15.005393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:15.005812 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:15.042492 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ed1a3c2d-f4f4-42e6-9e7b-38cc9b02f977 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054167 Oct 28 20:20:15.043449 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3631/7259] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:14 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:16.057704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:16.060015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:16.067687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.068164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.068561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.069272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:16.069722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:16.070139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:16.103233 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9febc9d4-8dae-43d5-aebf-bee35806ec63 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050954 Oct 28 20:20:16.103872 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3629/7260] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:16 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:17.116807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:17.119182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:17.126606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:17.127157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:17.127599 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:17.128327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:17.128796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:17.129228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:17.161222 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-baf0c7af-cecd-4409-8e43-e4aeefc72b4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048509 Oct 28 20:20:17.161820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3632/7261] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:17 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:18.174371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:18.176577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:18.184042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:18.184535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:18.184971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.185667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:18.186121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:18.186619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:18.216630 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0be069a6-81bc-43e6-9298-0b95126cd3ac tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Oct 28 20:20:18.217177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3630/7262] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:18 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:19.229673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:19.231923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:19.239490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.239987 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.240427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.241129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:19.241588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:19.242015 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:19.271809 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e734751-e547-44b9-b3f7-d789b8abb5f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Oct 28 20:20:19.272398 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3633/7263] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:19 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:20.287889 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:20.290125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:20.297964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.298460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.298940 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.299644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.300102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.300522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.330017 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85b580cc-fec4-4eda-9a40-492756f281d3 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048304 Oct 28 20:20:20.330591 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3631/7264] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:20:20 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:20:20.341606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:20.342135 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:20.349770 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.350196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.350636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.351369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:20.351828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:20.352260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:20.438325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] HTTP exception thrown: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 is not attached to volume 6241a3a5-a198-406e-a061-819a9302dee3 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Request method failure captured: Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: request: DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments/6241a3a5-a198-406e-a061-819a9302dee3 HTTP/1.1 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDiQb_222HBSnOJYTRi2tbn_kno-r6PA60v0ZqqDcUru4aAlScKwRdkPuRLHFJFAC2Ta4R07g8r85Gw_WbaixS26zbdbuu2Gj9JxPpObkbPAha83mY60kaX7yhNOUllNZE5d7yNMYx4Q1-JbfU66QNfuBwednoYPYyqbPqwHnuuGuvw Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23167431d8f7461989c587085e2a14ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23167431d8f7461989c587085e2a14ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 999d8e2d9b0a43c59a97558e57412d92 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 is not attached to volume 6241a3a5-a198-406e-a061-819a9302dee3 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'server_id': 'aaa43fc1-b677-47ae-9bf7-bf06eb1b6144', 'id': '6241a3a5-a198-406e-a061-819a9302dee3'} Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6241a3a5-a198-406e-a061-819a9302dee3. Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 is not attached to volume 6241a3a5-a198-406e-a061-819a9302dee3 Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:20:20.440229 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 is not attached to volume 6241a3a5-a198-406e-a061-819a9302dee3 Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Returning 404 to user: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 is not attached to volume 6241a3a5-a198-406e-a061-819a9302dee3 {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a4d0ed2a-2858-4989-a8d8-75b5cc8579f0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments/6241a3a5-a198-406e-a061-819a9302dee3" status: 404 len: 154 microversion: 2.1 time: 0.104224 Oct 28 20:20:20.444723 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3634/7265] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:20:20 2022] DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144/os-volume_attachments/6241a3a5-a198-406e-a061-819a9302dee3 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:20:23.712362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:23.712864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:23.720271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.720760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.721193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.721894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.722339 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.722785 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.748267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:20:23.834021 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7165044d-a071-4dae-876c-b10bf348baa2 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 204 len: 0 microversion: 2.1 time: 0.125363 Oct 28 20:20:23.837942 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3632/7266] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:20:23 2022] DELETE /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:20:23.843374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:23.844033 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:23.851765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.852266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.852728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.853420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:23.853885 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:23.854317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:23.985097 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:23.993205 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f0cace0-8606-476d-be53-748e2949e1da tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1555 microversion: 2.1 time: 0.153935 Oct 28 20:20:23.993772 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3635/7267] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:23 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:25.021534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:25.022356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:25.032418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:25.033013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:25.033555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.034406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:25.035005 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:25.035530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:25.172158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:25.180659 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8d035fbd-749d-4fa0-b07b-cde12441f5e8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1555 microversion: 2.1 time: 0.165375 Oct 28 20:20:25.181238 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3633/7268] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:25 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:26.201140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f126f3d8-4c5a-470e-906a-8851a8116765 req-cc3cd115-bd6f-4082-80d1-5ca1f3f0b0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa43fc1-b677-47ae-9bf7-bf06eb1b6144", "name": "network-vif-deleted", "tag": "317f8512-7927-41a1-bf13-edffd53cd857"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:26.204418 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:26.205212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:26.211696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f126f3d8-4c5a-470e-906a-8851a8116765 req-cc3cd115-bd6f-4082-80d1-5ca1f3f0b0bd service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.212193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f126f3d8-4c5a-470e-906a-8851a8116765 req-cc3cd115-bd6f-4082-80d1-5ca1f3f0b0bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.212635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f126f3d8-4c5a-470e-906a-8851a8116765 req-cc3cd115-bd6f-4082-80d1-5ca1f3f0b0bd service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.214316 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.214843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.216031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.216754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:26.217579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:26.218189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:26.224992 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f126f3d8-4c5a-470e-906a-8851a8116765 req-cc3cd115-bd6f-4082-80d1-5ca1f3f0b0bd service nova] Creating event network-vif-deleted:317f8512-7927-41a1-bf13-edffd53cd857 for instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 on n-h1-862769-3 Oct 28 20:20:26.230304 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f126f3d8-4c5a-470e-906a-8851a8116765 req-cc3cd115-bd6f-4082-80d1-5ca1f3f0b0bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032983 Oct 28 20:20:26.234415 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3636/7269] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:26.291688 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:26.301059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd365248-7e57-48fa-809c-ed2e458a8e4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 200 len: 1513 microversion: 2.1 time: 0.100929 Oct 28 20:20:26.304177 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3634/7270] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:26 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:27.334229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:27.335202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: aaa43fc1-b677-47ae-9bf7-bf06eb1b6144] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:27.343936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.344590 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.345177 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.346108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:27.346735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:27.347327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:27.364799 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] HTTP exception thrown: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 could not be found. Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Request method failure captured: Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 HTTP/1.1 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDiQb_222HBSnOJYTRi2tbn_kno-r6PA60v0ZqqDcUru4aAlScKwRdkPuRLHFJFAC2Ta4R07g8r85Gw_WbaixS26zbdbuu2Gj9JxPpObkbPAha83mY60kaX7yhNOUllNZE5d7yNMYx4Q1-JbfU66QNfuBwednoYPYyqbPqwHnuuGuvw Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23167431d8f7461989c587085e2a14ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23167431d8f7461989c587085e2a14ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 999d8e2d9b0a43c59a97558e57412d92 Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 could not be found. Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'aaa43fc1-b677-47ae-9bf7-bf06eb1b6144'} Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 could not be found. Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 could not be found. Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:20:27.366460 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 could not be found. Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Returning 404 to user: Instance aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:20:27.371265 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98d513c0-a837-443c-b884-80751d1f60e4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144" status: 404 len: 111 microversion: 2.1 time: 0.041659 Oct 28 20:20:27.371908 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3637/7271] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:27 2022] GET /compute/v2.1/servers/aaa43fc1-b677-47ae-9bf7-bf06eb1b6144 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:20:27.376946 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a08efafa-4bbb-43c2-90f0-bed1d47282dd tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '.version_select at 0x7f1d77928280>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:27.404376 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a08efafa-4bbb-43c2-90f0-bed1d47282dd tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-816442051" status: 202 len: 0 microversion: 2.1 time: 0.031436 Oct 28 20:20:27.405331 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3635/7272] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 20:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-816442051 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 20:20:36.606858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2b6417de-6db7-46eb-bdba-f49fbf402c76 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'create', calling method: .version_select at 0x7f1d7c88f3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-253350311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMq7l5HVsiuJWk0aW16hX3C81Cnclihpkz02RZdltmxsXRJerVI5gYZAzwHFyXSrsK0JjXFx+10nqkRYlrzTJhHlzaa2b78q3Nz985mL0+EyrTBAHIOftSXgMih4B9W3/A=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:36.626108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2b6417de-6db7-46eb-bdba-f49fbf402c76 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for project 23167431d8f7461989c587085e2a14ec. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:20:36.631695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-2b6417de-6db7-46eb-bdba-f49fbf402c76 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for user 999d8e2d9b0a43c59a97558e57412d92 and project 23167431d8f7461989c587085e2a14ec. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:20:36.663502 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2b6417de-6db7-46eb-bdba-f49fbf402c76 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060523 Oct 28 20:20:36.664132 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3638/7273] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:20:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:36.721386 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-90506865", "imageRef": "21246ee8-4ac2-49d3-874b-b573da6675f8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-253350311", "networks": [{"uuid": "ee60b7ab-67f0-4088-9b85-0690c7913a5f"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:36.733189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:36.917397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] validate_networks() for [('ee60b7ab-67f0-4088-9b85-0690c7913a5f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:20:37.347236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:20:37.347649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:20:37.348119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:20:37.348522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:20:37.348925 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:20:37.359794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.360273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.360696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.361416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:37.361865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:37.362277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:37.379788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for project 23167431d8f7461989c587085e2a14ec. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:20:37.385538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Getting quotas for user 999d8e2d9b0a43c59a97558e57412d92 and project 23167431d8f7461989c587085e2a14ec. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:20:37.398985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:20:37.401233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='21246ee8-4ac2-49d3-874b-b573da6675f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:20:37.449475 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9ce2e8dd-0b36-4e11-8fab-c72feb00c3ef tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732576 Oct 28 20:20:37.450298 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3636/7274] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:20:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:20:37.458178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=38 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:37.462222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d547c351-a8e5-422c-a10a-052c6c9d2f84 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:37.462884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d547c351-a8e5-422c-a10a-052c6c9d2f84 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:37.571332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d547c351-a8e5-422c-a10a-052c6c9d2f84 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:37.582211 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d547c351-a8e5-422c-a10a-052c6c9d2f84 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1256 microversion: 2.1 time: 0.124582 Oct 28 20:20:37.583135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3639/7275] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:37 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1256 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:38.611273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6e50521-a217-494f-8c6a-ef02dbbdcd2e tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:38.611759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6e50521-a217-494f-8c6a-ef02dbbdcd2e tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:38.669696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6e50521-a217-494f-8c6a-ef02dbbdcd2e tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:38.676902 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6e50521-a217-494f-8c6a-ef02dbbdcd2e tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1256 microversion: 2.1 time: 0.070840 Oct 28 20:20:38.677489 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3637/7276] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:38 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:39.699843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9442e0cf-b9a5-463f-9627-9a2d8c497715 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:39.700637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9442e0cf-b9a5-463f-9627-9a2d8c497715 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:39.754640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9442e0cf-b9a5-463f-9627-9a2d8c497715 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:39.762427 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9442e0cf-b9a5-463f-9627-9a2d8c497715 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1256 microversion: 2.1 time: 0.066480 Oct 28 20:20:39.763037 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3640/7277] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:39 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:40.790026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d6193c9b-3fc3-460c-832a-51258f109c4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:40.791133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d6193c9b-3fc3-460c-832a-51258f109c4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:40.851143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d6193c9b-3fc3-460c-832a-51258f109c4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:40.859120 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d6193c9b-3fc3-460c-832a-51258f109c4d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1256 microversion: 2.1 time: 0.075604 Oct 28 20:20:40.859699 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3638/7278] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:40 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1256 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:41.882636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:41.883302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:41.894096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:41.894754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:41.895402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:41.896441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:41.897073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:41.897653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:41.969162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:41.977435 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b6b759a7-a949-4d2e-9375-e664287ffef1 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1260 microversion: 2.1 time: 0.098994 Oct 28 20:20:41.978025 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3641/7279] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:41 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1260 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:43.002351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:43.003101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:43.007023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:43.025110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.025726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.026186 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.027040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:43.027544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:43.028068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:43.146681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:43.163149 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a10b06c-9a90-48b7-ba43-2d0961b99899 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1314 microversion: 2.1 time: 0.164778 Oct 28 20:20:43.165093 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3639/7280] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:42 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:44.189469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:44.191060 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:44.194358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:44.200532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.201190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.201706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.202501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:44.203077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:44.203586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:44.346472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:44.356277 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-01cdd18e-b002-4982-b453-c7f39e6f43a6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.172133 Oct 28 20:20:44.357470 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3642/7281] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:44 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:45.379984 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:45.380695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:45.387712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.388201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.388602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.389517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:45.389963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:45.390357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:45.560747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:45.570661 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-18646871-53a6-4bd0-8d56-4f8b22cc86ff tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.194799 Oct 28 20:20:45.571257 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3640/7282] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:45 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:46.595430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:46.597040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:46.605173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.605678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.606102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.606857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:46.607332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:46.607759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:46.745282 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:46.753476 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-70429629-72c0-4fbb-9188-bd20674a21d4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.163320 Oct 28 20:20:46.754267 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3643/7283] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:46 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:47.776467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:47.777086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:47.780255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:47.785694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.786180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.786631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.787353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:47.787849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:47.788218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:47.930444 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:47.939597 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8a0a0535-b83c-4968-a35e-de5a0ed7e146 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.166957 Oct 28 20:20:47.941592 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3641/7284] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:47 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:20:48.964180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:48.964944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:48.972237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:48.972733 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:48.973176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:48.973893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:48.974354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:48.974813 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:49.115593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:49.123914 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-328a719a-939a-4e9e-8244-bc537fa84179 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.163826 Oct 28 20:20:49.124499 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3644/7285] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:48 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:50.147438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:50.148054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:50.156451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.156942 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.157469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.158147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:50.158608 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:50.159433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:50.298372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:50.306619 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fe72cd38-82e7-4b32-a40f-356a73a51917 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.163232 Oct 28 20:20:50.307244 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3642/7286] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:50 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:51.290877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-38f08e4a-4039-49ac-b633-e2a3c2269ea0 req-94e9927e-58a5-4002-8056-661a5eac7f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:51.296617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:51.303868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38f08e4a-4039-49ac-b633-e2a3c2269ea0 req-94e9927e-58a5-4002-8056-661a5eac7f17 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.305271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38f08e4a-4039-49ac-b633-e2a3c2269ea0 req-94e9927e-58a5-4002-8056-661a5eac7f17 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.305569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-38f08e4a-4039-49ac-b633-e2a3c2269ea0 req-94e9927e-58a5-4002-8056-661a5eac7f17 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.317081 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-38f08e4a-4039-49ac-b633-e2a3c2269ea0 req-94e9927e-58a5-4002-8056-661a5eac7f17 service nova] Creating event network-changed:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:20:51.322131 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-38f08e4a-4039-49ac-b633-e2a3c2269ea0 req-94e9927e-58a5-4002-8056-661a5eac7f17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037251 Oct 28 20:20:51.324159 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3645/7287] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:51.329458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:51.330335 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:51.332330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:20:51.341153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.341642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.342064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.342795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:51.343230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:51.343645 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:51.476709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:51.484738 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3b6c62a7-34a1-4381-b50a-4fbf8bbcbb3c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.159188 Oct 28 20:20:51.485324 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3643/7288] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:51 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:52.516608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:52.517350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:52.524342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.524859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.525311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.526037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:52.526512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:52.526984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:52.664412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:52.672810 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-31b6bbc9-6c00-457e-8a4f-edaf52054f3d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.165570 Oct 28 20:20:52.673395 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3646/7289] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:52 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:53.698436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:53.699108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:53.706496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.707029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.707468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.708170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:53.708663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:53.709093 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:53.844407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:53.852391 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-39adea6b-bbbe-4da0-962b-b02984f0a887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.159082 Oct 28 20:20:53.852937 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3644/7290] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:53 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:54.879450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:54.880467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:54.892230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:54.893054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:54.893802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:54.895126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:54.895920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:54.896644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:55.033219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:55.041194 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ab39f8ae-5525-4eba-adc8-e0f8892a7b40 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.168555 Oct 28 20:20:55.041772 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3647/7291] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:54 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:56.073414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:56.074404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:56.086196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.087085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.087806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.088950 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:56.089760 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:56.090467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:56.226448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:56.234990 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bf219e9d-8a52-4d19-81bb-37452132ee20 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.168436 Oct 28 20:20:56.235613 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3645/7292] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:56 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:57.258248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:57.258945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:57.265517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.266020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.266469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.267214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.267679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.268112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.405668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:57.413508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea23d0a8-b2eb-436f-b65c-951e8f898720 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.159677 Oct 28 20:20:57.414115 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3648/7293] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:57 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:57.509203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-20269336-48a4-4fbf-b543-6656ff0cabc8 req-faac4993-3c23-453e-abbe-40298008fcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "name": "network-vif-plugged", "status": "completed", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:20:57.520705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-20269336-48a4-4fbf-b543-6656ff0cabc8 req-faac4993-3c23-453e-abbe-40298008fcb8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:57.521181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-20269336-48a4-4fbf-b543-6656ff0cabc8 req-faac4993-3c23-453e-abbe-40298008fcb8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:57.521605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-20269336-48a4-4fbf-b543-6656ff0cabc8 req-faac4993-3c23-453e-abbe-40298008fcb8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:57.533530 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-20269336-48a4-4fbf-b543-6656ff0cabc8 req-faac4993-3c23-453e-abbe-40298008fcb8 service nova] Creating event network-vif-plugged:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:20:57.539271 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-20269336-48a4-4fbf-b543-6656ff0cabc8 req-faac4993-3c23-453e-abbe-40298008fcb8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091531 Oct 28 20:20:57.539880 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3646/7294] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:20:58.441679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:58.442563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:58.451140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.451645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.452095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.452801 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:58.453265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:58.453697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:58.605212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:58.617721 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ac6f2489-f7b8-46ea-b91f-e7328549483a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1356 microversion: 2.1 time: 0.182851 Oct 28 20:20:58.618531 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3649/7295] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:58 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:59.645981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:59.647038 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:59.654538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.655409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.655841 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.656594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.657049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.657471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.805652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:20:59.817616 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9172d0a6-b9bb-40a8-8b76-223eb5ecbb55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1546 microversion: 2.1 time: 0.179059 Oct 28 20:20:59.818421 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3647/7296] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:59 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:20:59.843911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:20:59.844642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:20:59.854832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.855331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.855783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.856489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:20:59.856951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:20:59.857386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:20:59.998081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:00.006410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-03000f9e-a483-4f24-9a7c-fd01dbd9a15a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1546 microversion: 2.1 time: 0.169277 Oct 28 20:21:00.007050 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3650/7297] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:20:59 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:00.028794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:00.033892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:00.034663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Searching by: {'deleted': False, 'project_id': '23167431d8f7461989c587085e2a14ec'} {{(pid=120628) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 20:21:00.040221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.040694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.041125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.041840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.042288 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.042730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.067376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.multi_cell_list [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 20:21:00.093928 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fd97ad8e-6bbc-44b9-8828-f78bce539f54 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.069077 Oct 28 20:21:00.094497 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3648/7298] 10.222.0.44 () {58 vars in 1125 bytes} [Fri Oct 28 20:21:00 2022] GET /compute/v2.1/servers => generated 341 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:00.106528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:00.107226 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:00.113902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.114400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.114883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.115595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:00.116066 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:00.116504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:00.245375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:00.253749 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d5339022-c08f-483b-ad9e-51c25582d3e0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1546 microversion: 2.1 time: 0.151171 Oct 28 20:21:00.254337 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3651/7299] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:00 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:01.786328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ea76363-0f0d-4583-ae5f-930506b268b0"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:01.788793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:01.796353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:01.796782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:01.797201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:01.797910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:01.798346 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:01.798804 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:02.054225 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-84f62c9c-62f3-4d11-ad68-06dcf55f702a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271856 Oct 28 20:21:02.054917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3649/7300] 10.222.0.44 () {60 vars in 1323 bytes} [Fri Oct 28 20:21:01 2022] POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:12.909736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:12.910363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:12.913402 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=19 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:12.914195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=62 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:12.919639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.920140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.920583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:12.921285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:12.921745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:12.922176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:13.068749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:13.079734 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c4fba882-509f-4fe9-8b57-0fec0dc93e75 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1592 microversion: 2.1 time: 0.173901 Oct 28 20:21:13.080318 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3652/7301] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:12 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1592 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:14.689453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-5a143c94-f9e3-4b8b-9a4b-b9787e60486c req-1e6a5ec2-5c26-470a-8905-27e9240b3b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:14.696795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:14.698023 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=21 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:14.698883 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:14.704895 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5a143c94-f9e3-4b8b-9a4b-b9787e60486c req-1e6a5ec2-5c26-470a-8905-27e9240b3b5e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:14.705538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5a143c94-f9e3-4b8b-9a4b-b9787e60486c req-1e6a5ec2-5c26-470a-8905-27e9240b3b5e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:14.706176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-5a143c94-f9e3-4b8b-9a4b-b9787e60486c req-1e6a5ec2-5c26-470a-8905-27e9240b3b5e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:14.719779 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-5a143c94-f9e3-4b8b-9a4b-b9787e60486c req-1e6a5ec2-5c26-470a-8905-27e9240b3b5e service nova] Creating event network-changed:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:21:14.726059 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-5a143c94-f9e3-4b8b-9a4b-b9787e60486c req-1e6a5ec2-5c26-470a-8905-27e9240b3b5e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040243 Oct 28 20:21:14.726933 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3650/7302] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:15.876695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-944873830"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:15.877325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:15.884201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:15.884762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:15.885292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:15.886076 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:15.886603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:15.887128 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.017349 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.network.security_group_api [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Adding security group d4aee92c-3232-46bc-a812-584cdd4048bb to port 42230f15-f747-4bae-b46e-a0aa0af1dcf0 Oct 28 20:21:16.335547 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ec484ed-f9fd-4dc1-85ad-d6a47356487a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/action" status: 202 len: 0 microversion: 2.1 time: 0.462771 Oct 28 20:21:16.336591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3653/7303] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:21:15 2022] POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:21:16.347536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:16.348404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:16.354958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:16.355443 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:16.355879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.356655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:16.357119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:16.357528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.509700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:16.518323 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f3059df-4948-4d57-9599-41d1b6987f73 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1757 microversion: 2.1 time: 0.177289 Oct 28 20:21:16.518916 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3651/7304] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:16 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:21:16.741798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dbe31633-b841-454e-8913-8e453b94277a req-a0b54d3d-7d0c-4125-abe5-7b39b8a644ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:16.752253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dbe31633-b841-454e-8913-8e453b94277a req-a0b54d3d-7d0c-4125-abe5-7b39b8a644ad service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:16.752743 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dbe31633-b841-454e-8913-8e453b94277a req-a0b54d3d-7d0c-4125-abe5-7b39b8a644ad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:16.753183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dbe31633-b841-454e-8913-8e453b94277a req-a0b54d3d-7d0c-4125-abe5-7b39b8a644ad service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:16.764977 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dbe31633-b841-454e-8913-8e453b94277a req-a0b54d3d-7d0c-4125-abe5-7b39b8a644ad service nova] Creating event network-changed:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:21:16.770083 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dbe31633-b841-454e-8913-8e453b94277a req-a0b54d3d-7d0c-4125-abe5-7b39b8a644ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032172 Oct 28 20:21:16.770755 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3654/7305] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:21:31.507176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:31.508233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:31.560187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:21:31.562471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:31.568754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.569259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.569664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.570348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.570826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.571216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.648775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d316ab50-e213-43ac-8aed-040872902887 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/action" status: 202 len: 0 microversion: 2.1 time: 0.150916 Oct 28 20:21:31.649388 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3652/7306] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:21:31 2022] POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:21:31.656764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:31.657571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:21:31.661717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:31.662437 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:31.669626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.670114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.670562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.671309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:31.671764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:31.672195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:31.824386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:31.833004 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-577b8b93-e97c-471a-9d6e-00612e61e2a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1749 microversion: 2.1 time: 0.178788 Oct 28 20:21:31.833921 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3655/7307] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:31 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:32.863363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:32.864450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:32.875079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.876004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.876445 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:32.877146 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:32.877588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:32.878010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:33.022016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:33.035393 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-52df48c6-d951-4219-9abd-e864eb41069d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.180462 Oct 28 20:21:33.035998 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3653/7308] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:32 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:34.063592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:34.064167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:34.071747 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:34.072236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:34.072677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.073376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:34.073840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:34.074266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:34.230323 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:34.243795 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-40123e29-54fb-4a34-a532-252f7aa8cc55 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.186669 Oct 28 20:21:34.244651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3656/7309] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:34 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:35.273783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:35.274770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:35.287187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.287987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.288691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.289835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:35.290530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:35.291257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:35.444799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:35.456383 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38523014-c0c6-4dec-bcb5-d9f27c4b28d9 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.189486 Oct 28 20:21:35.456934 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3654/7310] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:35 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:36.480129 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:36.480684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:36.487555 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:36.488050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:36.488490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:36.489186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:36.489646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:36.490086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:36.641690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:36.650405 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-70b89164-d082-44be-b113-248d224518a4 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.174386 Oct 28 20:21:36.651025 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3657/7311] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:36 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:37.677170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:37.677932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:37.687499 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.688133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.688712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.689655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:37.690221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:37.690826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:37.843488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:37.852537 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dae3356e-4138-43e0-b520-4793c53cfb9a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.181531 Oct 28 20:21:37.853116 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3655/7312] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:37 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:38.879355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:38.880004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:38.888979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.889525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.890100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:38.891038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:38.891573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:38.892071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:39.047799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:39.057043 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-607bfe7e-6d8e-4523-a974-2c39f1ba85eb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.183745 Oct 28 20:21:39.057604 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3658/7313] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:38 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:40.084764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:40.085815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:40.097630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.098152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.098593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.099325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:40.099778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:40.100213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:40.250021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:40.258641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a1d81304-c8ab-426d-b8fe-19f4d2292795 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.180753 Oct 28 20:21:40.259252 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3656/7314] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:40 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:41.282632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:41.283325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:41.291342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:41.291866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:41.292359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.293113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:41.293613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:41.294069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:41.444818 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:41.457644 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89599f4e-75c9-4ee2-afa0-f3cd600c459d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.179803 Oct 28 20:21:41.458232 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3659/7315] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:41 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:42.485022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:42.485867 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:42.497214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.498070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.498762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.499982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:42.500755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:42.501464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:42.652372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:42.661821 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-85b4f169-bf7e-4fc1-80cf-1cb54c544cf5 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1754 microversion: 2.1 time: 0.183928 Oct 28 20:21:42.662407 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3657/7316] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:42 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:21:43.689765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:21:43.690837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:21:43.702972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:43.703811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:43.704558 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.705738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:21:43.706518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:21:43.707286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:21:43.864359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:21:43.873135 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-da9ee863-e113-4a8d-96f3-9cf5e9651776 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1757 microversion: 2.1 time: 0.190010 Oct 28 20:21:43.873721 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3660/7317] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:21:43 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:16.190187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-944873830"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:16.190936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:16.193162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:16.193941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:16.200201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.200680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.201139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.202029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:16.202478 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:16.202930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:16.337669 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.network.security_group_api [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Removing security group d4aee92c-3232-46bc-a812-584cdd4048bb from port 42230f15-f747-4bae-b46e-a0aa0af1dcf0 Oct 28 20:22:16.987231 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c441be8e-a190-4740-bb51-728990c0a856 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/action" status: 202 len: 0 microversion: 2.1 time: 0.804313 Oct 28 20:22:16.991540 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3658/7318] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:22:16 2022] POST /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:22:17.020765 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6f094ec2-e777-4b8d-9815-2e49d5203bac req-caa0d50b-0f8e-44b4-a2f6-9441d00ff96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:17.026412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=12 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:17.032308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:17.034163 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:22:17.034401 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:22:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:22:17.052430 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6f094ec2-e777-4b8d-9815-2e49d5203bac req-caa0d50b-0f8e-44b4-a2f6-9441d00ff96f service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:17.052635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6f094ec2-e777-4b8d-9815-2e49d5203bac req-caa0d50b-0f8e-44b4-a2f6-9441d00ff96f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:17.053088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6f094ec2-e777-4b8d-9815-2e49d5203bac req-caa0d50b-0f8e-44b4-a2f6-9441d00ff96f service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:17.078747 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6f094ec2-e777-4b8d-9815-2e49d5203bac req-caa0d50b-0f8e-44b4-a2f6-9441d00ff96f service nova] Creating event network-changed:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:22:17.095658 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6f094ec2-e777-4b8d-9815-2e49d5203bac req-caa0d50b-0f8e-44b4-a2f6-9441d00ff96f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078203 Oct 28 20:22:17.097283 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3661/7319] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:18.109141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:18.109692 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:18.115849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.116324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.116751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.117436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.117882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.118297 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.207859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lazy-loading 'services' on Instance uuid 7d87e313-e16c-4a3d-b7e2-61276ce73c88 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:22:18.284507 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a51eee5b-5f95-4706-bace-699503f60b2d tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments/3ea76363-0f0d-4583-ae5f-930506b268b0" status: 202 len: 0 microversion: 2.1 time: 0.180066 Oct 28 20:22:18.285267 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3659/7320] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:22:18 2022] DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments/3ea76363-0f0d-4583-ae5f-930506b268b0 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:22:18.296409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:18.300460 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:18.310159 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.311357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.311820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.312784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:18.313250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:18.313682 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:18.346899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e1822457-d473-4f57-999e-09450a29d4bb tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056199 Oct 28 20:22:18.347635 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3662/7321] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:22:18 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:19.114313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4b578d98-16fc-433f-bfd1-4638f804069e req-6ed03d7e-6267-4a22-b8d3-70542f646c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:19.124928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b578d98-16fc-433f-bfd1-4638f804069e req-6ed03d7e-6267-4a22-b8d3-70542f646c18 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.125489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b578d98-16fc-433f-bfd1-4638f804069e req-6ed03d7e-6267-4a22-b8d3-70542f646c18 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.126529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4b578d98-16fc-433f-bfd1-4638f804069e req-6ed03d7e-6267-4a22-b8d3-70542f646c18 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.139179 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4b578d98-16fc-433f-bfd1-4638f804069e req-6ed03d7e-6267-4a22-b8d3-70542f646c18 service nova] Creating event network-changed:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:22:19.145068 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4b578d98-16fc-433f-bfd1-4638f804069e req-6ed03d7e-6267-4a22-b8d3-70542f646c18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035719 Oct 28 20:22:19.146137 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3660/7322] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:19.360512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:19.362905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:19.370650 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.371209 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.371645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.372345 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:19.372819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:19.373245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:19.408609 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8840b359-da56-4d27-a384-8f93461c021a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052135 Oct 28 20:22:19.413694 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3663/7323] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:22:19 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:20.423369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:20.425664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:20.432244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:20.432729 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:20.433159 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:20.433846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:20.434313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:20.434724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:20.465153 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0c57e46c-9afb-4f51-9846-67dd2301bb07 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Oct 28 20:22:20.465700 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3661/7324] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:22:20 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:21.478507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:21.480678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:21.488005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:21.488508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:21.488962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:21.489671 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:21.490140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:21.490577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:21.521068 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4c2234b9-a0e5-4cc6-89b6-528f375004c6 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046732 Oct 28 20:22:21.521643 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3664/7325] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:22:21 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:22.533623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:22.535863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:22.543337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:22.543955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:22.544390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:22.545166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:22.545634 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:22.546055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:22.576952 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-568a859c-d17a-4f38-b947-91338494e40c tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047850 Oct 28 20:22:22.577526 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3662/7326] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:22:22 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:23.593579 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:23.597218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:23.605580 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.606075 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.606524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.607264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.607727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.608164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.637655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-121fe52b-9973-4c06-a2a4-3c14bf06012b tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050951 Oct 28 20:22:23.638215 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3665/7327] 10.222.0.44 () {58 vars in 1302 bytes} [Fri Oct 28 20:22:23 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 20:22:23.649240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:23.649750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:23.657243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.657728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.658160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.658894 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:23.659350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:23.659767 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:23.736766 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] HTTP exception thrown: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 is not attached to volume 3ea76363-0f0d-4583-ae5f-930506b268b0 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Request method failure captured: Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: request: DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments/3ea76363-0f0d-4583-ae5f-930506b268b0 HTTP/1.1 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDiQb_222HBSnOJYTRi2tbn_kno-r6PA60v0ZqqDcUru4aAlScKwRdkPuRLHFJFAC2Ta4R07g8r85Gw_WbaixS26zbdbuu2Gj9JxPpObkbPAha83mY60kaX7yhNOUllNZE5d7yNMYx4Q1-JbfU66QNfuBwednoYPYyqbPqwHnuuGuvw Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23167431d8f7461989c587085e2a14ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23167431d8f7461989c587085e2a14ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 999d8e2d9b0a43c59a97558e57412d92 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 is not attached to volume 3ea76363-0f0d-4583-ae5f-930506b268b0 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'server_id': '7d87e313-e16c-4a3d-b7e2-61276ce73c88', 'id': '3ea76363-0f0d-4583-ae5f-930506b268b0'} Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3ea76363-0f0d-4583-ae5f-930506b268b0. Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 is not attached to volume 3ea76363-0f0d-4583-ae5f-930506b268b0 Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:22:23.738376 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 is not attached to volume 3ea76363-0f0d-4583-ae5f-930506b268b0 Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Returning 404 to user: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 is not attached to volume 3ea76363-0f0d-4583-ae5f-930506b268b0 {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eaf715f4-a80b-436a-bead-5307d36e5d15 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments/3ea76363-0f0d-4583-ae5f-930506b268b0" status: 404 len: 154 microversion: 2.1 time: 0.094862 Oct 28 20:22:23.742579 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3663/7328] 10.222.0.44 () {58 vars in 1416 bytes} [Fri Oct 28 20:22:23 2022] DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88/os-volume_attachments/3ea76363-0f0d-4583-ae5f-930506b268b0 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:22:27.007178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:27.007677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:27.014259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.014777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.015219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.015912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.016371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.016798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.043411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:22:27.129194 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7ae05bbe-5055-4db6-8cd3-2f6aabb292fc tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 204 len: 0 microversion: 2.1 time: 0.125800 Oct 28 20:22:27.130060 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3666/7329] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:22:27 2022] DELETE /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:22:27.139100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:27.140024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:27.148820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.149442 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.150314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.151237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:27.151344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:27.151781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:27.293583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:27.301736 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-68d73552-18a7-488a-b4b7-6525f75cd6d0 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1552 microversion: 2.1 time: 0.166910 Oct 28 20:22:27.302370 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3664/7330] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:27 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:28.330582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:28.331811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:28.340046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:28.340546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:28.340990 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:28.341734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:28.342202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:28.342639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:28.479666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:28.488037 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6efeace1-b9a4-474c-8c03-760650470064 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1552 microversion: 2.1 time: 0.164917 Oct 28 20:22:28.488657 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3667/7331] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:28 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:29.284387 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-db745855-f299-4e58-b2a1-c1180b112641 req-e158c4c1-4ead-4f5c-a195-5e04ca9d1c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d87e313-e16c-4a3d-b7e2-61276ce73c88", "name": "network-vif-deleted", "tag": "42230f15-f747-4bae-b46e-a0aa0af1dcf0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:29.295056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-db745855-f299-4e58-b2a1-c1180b112641 req-e158c4c1-4ead-4f5c-a195-5e04ca9d1c0c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.295847 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-db745855-f299-4e58-b2a1-c1180b112641 req-e158c4c1-4ead-4f5c-a195-5e04ca9d1c0c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.296271 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-db745855-f299-4e58-b2a1-c1180b112641 req-e158c4c1-4ead-4f5c-a195-5e04ca9d1c0c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.308743 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-db745855-f299-4e58-b2a1-c1180b112641 req-e158c4c1-4ead-4f5c-a195-5e04ca9d1c0c service nova] Creating event network-vif-deleted:42230f15-f747-4bae-b46e-a0aa0af1dcf0 for instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 on n-h2-862769-3 Oct 28 20:22:29.315357 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-db745855-f299-4e58-b2a1-c1180b112641 req-e158c4c1-4ead-4f5c-a195-5e04ca9d1c0c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087344 Oct 28 20:22:29.316262 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3665/7332] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:29.512175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:29.512777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:29.519942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.520582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.520863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.521542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.522020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.522452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.557514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:29.557916 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:29.558375 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:29.559134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lazy-loading 'fault' on Instance uuid 7d87e313-e16c-4a3d-b7e2-61276ce73c88 {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:22:29.615425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999d8e2d9b0a43c59a97558e57412d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23167431d8f7461989c587085e2a14ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:29.624511 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-56673bfd-b9e8-4ce7-a2c5-e8446cf27192 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 200 len: 1346 microversion: 2.1 time: 0.116453 Oct 28 20:22:29.626874 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3668/7333] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:29 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:30.653397 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:30.654474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] [instance: 7d87e313-e16c-4a3d-b7e2-61276ce73c88] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:30.663313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:30.663878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:30.664382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:30.665190 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:30.665715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:30.666203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:30.682013 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] HTTP exception thrown: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 could not be found. Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Request method failure captured: Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 HTTP/1.1 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDiQb_222HBSnOJYTRi2tbn_kno-r6PA60v0ZqqDcUru4aAlScKwRdkPuRLHFJFAC2Ta4R07g8r85Gw_WbaixS26zbdbuu2Gj9JxPpObkbPAha83mY60kaX7yhNOUllNZE5d7yNMYx4Q1-JbfU66QNfuBwednoYPYyqbPqwHnuuGuvw Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/23167431d8f7461989c587085e2a14ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_23167431d8f7461989c587085e2a14ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/23167431d8f7461989c587085e2a14ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: 23167431d8f7461989c587085e2a14ec Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestMinimumBasicScenario-112230887 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 999d8e2d9b0a43c59a97558e57412d92 Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestMinimumBasicScenario-112230887-project Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 could not be found. Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '7d87e313-e16c-4a3d-b7e2-61276ce73c88'} Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 could not be found. Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 could not be found. Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:22:30.683679 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 could not be found. Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Returning 404 to user: Instance 7d87e313-e16c-4a3d-b7e2-61276ce73c88 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9e487a62-4cf3-41e3-8336-4e288ddc51a8 tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88" status: 404 len: 111 microversion: 2.1 time: 0.038355 Oct 28 20:22:30.688664 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3666/7334] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:30 2022] GET /compute/v2.1/servers/7d87e313-e16c-4a3d-b7e2-61276ce73c88 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:22:30.694241 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1e06853f-1528-4596-bd8e-b8a279abd23a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] Calling method '.version_select at 0x7f1d77c7a700>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:30.716742 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1e06853f-1528-4596-bd8e-b8a279abd23a tempest-TestMinimumBasicScenario-112230887 tempest-TestMinimumBasicScenario-112230887-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-253350311" status: 202 len: 0 microversion: 2.1 time: 0.026465 Oct 28 20:22:30.717409 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3669/7335] 10.222.0.44 () {58 vars in 1269 bytes} [Fri Oct 28 20:22:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-253350311 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:22:39.873004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f72190c-b0ee-4977-b83e-05328097fbb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: .version_select at 0x7f1d769655e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1582208740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT6x9+6merF+TGmGniHkpJMCJHSAl3ly5LIqz3b7FCIlknbrTirUyPTioBiJQHxQkMOn3lu0p3GnQZb9rb8o4UJXpY2aUK+mbsbYpvMmn3xizpbIeht8iPEnP1paLLG2w=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:39.889226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-6f72190c-b0ee-4977-b83e-05328097fbb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:22:39.895742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-6f72190c-b0ee-4977-b83e-05328097fbb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:22:39.926794 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f72190c-b0ee-4977-b83e-05328097fbb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.225718 Oct 28 20:22:39.927388 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3667/7336] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:22:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:22:45.699472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:45.700784 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:45.706043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-959541579", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "1838b5a8-8088-408f-93f4-4ab826ac1f94"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1582208740", "security_groups": [{"name": "tempest-secgroup-smoke-2131560498"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:45.839683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] validate_networks() for [('1838b5a8-8088-408f-93f4-4ab826ac1f94', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:22:46.315663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:22:46.316100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:22:46.316586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:22:46.317333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:22:46.317923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:22:46.331849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:46.332429 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:46.332790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:46.333535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:46.334002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:46.335264 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:46.354931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:22:46.360300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:22:46.373259 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:22:46.375737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:22:46.425228 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ea5a8d4b-bf0f-4614-b0ef-699c06c4f06a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727916 Oct 28 20:22:46.426070 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3670/7337] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:22:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:22:46.435101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:46.441142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8786314e-c501-4cce-8204-a235ea0f77dc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:46.441839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8786314e-c501-4cce-8204-a235ea0f77dc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:46.444938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:46.508428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8786314e-c501-4cce-8204-a235ea0f77dc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:46.520836 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8786314e-c501-4cce-8204-a235ea0f77dc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1266 microversion: 2.1 time: 0.086589 Oct 28 20:22:46.521428 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3668/7338] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:46 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:47.545482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:47.546067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:47.553303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:47.553804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:47.554227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:47.555051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:47.555542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:47.555977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:47.630234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:47.638571 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-5fbc625c-c66d-421a-b5fa-2c0ab27d17e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1318 microversion: 2.1 time: 0.098016 Oct 28 20:22:47.639219 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3671/7339] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:47 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:48.664671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:48.666141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:48.675843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:48.676975 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:48.684635 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:48.685424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:48.685912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:48.686381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:48.922751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:48.940547 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4739db28-1220-4027-b6cf-b618cb446efd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.280370 Oct 28 20:22:48.955037 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3669/7340] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:48 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:49.631167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-328739e5-2d4e-449f-94cc-7d223ef0f55f req-1e48d33b-0e4b-456f-a954-ab2c7f4c2498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88d585-4249-42b2-95d9-1f46a769ed5f", "tag": "eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:49.641464 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-328739e5-2d4e-449f-94cc-7d223ef0f55f req-1e48d33b-0e4b-456f-a954-ab2c7f4c2498 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.641961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-328739e5-2d4e-449f-94cc-7d223ef0f55f req-1e48d33b-0e4b-456f-a954-ab2c7f4c2498 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.642522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-328739e5-2d4e-449f-94cc-7d223ef0f55f req-1e48d33b-0e4b-456f-a954-ab2c7f4c2498 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:49.656980 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-328739e5-2d4e-449f-94cc-7d223ef0f55f req-1e48d33b-0e4b-456f-a954-ab2c7f4c2498 service nova] Creating event network-changed:eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b for instance ef88d585-4249-42b2-95d9-1f46a769ed5f on n-h1-862769-3 Oct 28 20:22:49.662977 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-328739e5-2d4e-449f-94cc-7d223ef0f55f req-1e48d33b-0e4b-456f-a954-ab2c7f4c2498 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036755 Oct 28 20:22:49.664364 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3672/7341] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:22:49.964951 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:49.965656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:49.973547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.974024 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.974467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:49.975270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:49.975733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:49.976162 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:50.146416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:50.154677 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f937c2c9-03a7-4f21-a390-66d908486495 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.193724 Oct 28 20:22:50.155284 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3670/7342] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:49 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:51.178272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:51.179019 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:51.186612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:51.187280 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:51.187706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:51.188454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:51.188939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:51.189380 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:51.405930 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:51.414291 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b373c5e4-894f-4550-8cf2-8e768ddc2ed7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.240380 Oct 28 20:22:51.415215 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3673/7343] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:51 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:52.441764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:52.442859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:52.451305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:52.451787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:52.452216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:52.452899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:52.453359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:52.453776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:52.586139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:52.594570 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b29b99e2-43e0-4fb7-9769-acb9455e1153 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.159474 Oct 28 20:22:52.595316 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3671/7344] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:52 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:53.621146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:53.622249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:53.633900 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:53.634777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:53.635503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:53.636693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:53.637495 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:53.638211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:53.777918 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:53.790387 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e48391a-00da-49cf-b9cd-d20cdca04fe7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.176091 Oct 28 20:22:53.790999 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3674/7345] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:53 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:54.813829 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:54.814407 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:54.822084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:54.822572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:54.823064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:54.823733 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:54.824191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:54.824613 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:54.963690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:54.971797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f76da9e0-2341-4a97-9aa0-7e5f6ed54a83 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.162090 Oct 28 20:22:54.972371 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3672/7346] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:54 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:55.995381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:55.996034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:56.003078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.003608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.004030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.004820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.005199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.005634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.160093 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:56.169497 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3ca6d4b5-1350-42ba-b81a-6754dc204ce1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.178125 Oct 28 20:22:56.170088 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3675/7347] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:55 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:56.234625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f38803dd-3c7b-4e89-bd8f-9c0422d46917 req-d832ce8e-03ba-4017-8493-dfb226602b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88d585-4249-42b2-95d9-1f46a769ed5f", "name": "network-vif-plugged", "status": "completed", "tag": "eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:22:56.244631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f38803dd-3c7b-4e89-bd8f-9c0422d46917 req-d832ce8e-03ba-4017-8493-dfb226602b73 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:56.245106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f38803dd-3c7b-4e89-bd8f-9c0422d46917 req-d832ce8e-03ba-4017-8493-dfb226602b73 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:56.245553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f38803dd-3c7b-4e89-bd8f-9c0422d46917 req-d832ce8e-03ba-4017-8493-dfb226602b73 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:56.261465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f38803dd-3c7b-4e89-bd8f-9c0422d46917 req-d832ce8e-03ba-4017-8493-dfb226602b73 service nova] Creating event network-vif-plugged:eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b for instance ef88d585-4249-42b2-95d9-1f46a769ed5f on n-h1-862769-3 Oct 28 20:22:56.266634 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f38803dd-3c7b-4e89-bd8f-9c0422d46917 req-d832ce8e-03ba-4017-8493-dfb226602b73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037944 Oct 28 20:22:56.267419 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3673/7348] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:22:57.196825 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:57.197687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:57.200783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:57.201887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:57.212657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:57.213346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:57.213793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:57.214477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:57.214974 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:57.215428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:57.349424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:57.357314 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b788031f-6782-47fc-91ce-1d6aace4256e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1392 microversion: 2.1 time: 0.167302 Oct 28 20:22:57.357898 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3676/7349] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:57 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:58.378954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:22:58.386390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:58.387107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:58.393744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:58.394225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:58.394656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:58.395393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:58.395844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:58.396261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:58.537905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:58.546142 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f66bf437-2454-473b-9067-f165e5066bdb tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1564 microversion: 2.1 time: 0.169034 Oct 28 20:22:58.546720 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3674/7350] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:58 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:22:58.568341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:22:58.568961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:22:58.576200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:58.576694 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:58.577137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:58.577891 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:22:58.578376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:22:58.578836 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:22:58.719970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:22:58.728332 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-10dc3058-11a3-4e0d-9e12-68529a80298e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1564 microversion: 2.1 time: 0.163859 Oct 28 20:22:58.728913 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3677/7351] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:22:58 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:00.342309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:00.342960 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:00.344951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-394a09cd-d356-4678-ba54-04aa75ff184b req-9fd62608-2c7f-420e-80c5-2a6b26231ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88d585-4249-42b2-95d9-1f46a769ed5f", "tag": "eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:00.350094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.350579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.351043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.351745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.352197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.352620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.357869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-394a09cd-d356-4678-ba54-04aa75ff184b req-9fd62608-2c7f-420e-80c5-2a6b26231ad9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:00.358473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-394a09cd-d356-4678-ba54-04aa75ff184b req-9fd62608-2c7f-420e-80c5-2a6b26231ad9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:00.359030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-394a09cd-d356-4678-ba54-04aa75ff184b req-9fd62608-2c7f-420e-80c5-2a6b26231ad9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:00.372091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-394a09cd-d356-4678-ba54-04aa75ff184b req-9fd62608-2c7f-420e-80c5-2a6b26231ad9 service nova] Creating event network-changed:eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b for instance ef88d585-4249-42b2-95d9-1f46a769ed5f on n-h1-862769-3 Oct 28 20:23:00.380589 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-394a09cd-d356-4678-ba54-04aa75ff184b req-9fd62608-2c7f-420e-80c5-2a6b26231ad9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039434 Oct 28 20:23:00.381610 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3678/7352] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:23:00.573485 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:00.581624 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a0f0d2a9-fc00-4940-9a64-05f388acf82d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1564 microversion: 2.1 time: 0.243191 Oct 28 20:23:00.582430 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3675/7353] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:00 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1564 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:23.921051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:23.922244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=42 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:23.929180 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:23.931512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:23.939372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:23.939859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:23.940286 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:23.941020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:23.941484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:23.941914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:23.996269 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-125f856f-848d-42d7-a16c-59e7ba0a2f49 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action" status: 200 len: 24568 microversion: 2.1 time: 0.078464 Oct 28 20:23:23.996918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3679/7354] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:23:23 2022] POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action => generated 24568 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:23:34.929784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:34.930862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:34.933979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=17 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:34.935134 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=38 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:34.941534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:34.942036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:34.942469 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:34.943192 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:34.943671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:34.944079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:35.014625 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2d2a3ce-62f0-4390-bb98-b391b5a8d52c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action" status: 202 len: 0 microversion: 2.1 time: 0.091812 Oct 28 20:23:35.015587 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3676/7355] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:23:34 2022] POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:23:35.025584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:35.026314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:35.029457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:35.030571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:35.036977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:35.037478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:35.037923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:35.038639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:35.039134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:35.039568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:35.173350 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:35.182525 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0989f08a-a7c1-429e-bdab-0fde69e051c4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1688 microversion: 2.1 time: 0.161149 Oct 28 20:23:35.183070 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3680/7356] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:35 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:36.214393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:36.215592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:36.223059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:36.223540 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:36.223977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:36.224659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:36.225221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:36.225592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:36.362963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:36.375834 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-854eb25a-88b3-48bb-a88d-42b77924a587 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1668 microversion: 2.1 time: 0.169579 Oct 28 20:23:36.376796 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3677/7357] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:36 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:37.483620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:37.487367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:37.499561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.500057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.500504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.501215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.501683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.502120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.563241 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4b64f1d2-673a-43f5-a6a7-712d44748618 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action" status: 200 len: 32637 microversion: 2.1 time: 0.085764 Oct 28 20:23:37.564189 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3681/7358] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:23:37 2022] POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action => generated 32637 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:23:37.581799 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:37.582589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:37.594893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.595382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.595822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.596523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.596974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.597394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.666526 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58436381-2574-48a4-b02a-7b144cc6840f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action" status: 202 len: 0 microversion: 2.1 time: 0.090703 Oct 28 20:23:37.667216 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3678/7359] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:23:37 2022] POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:23:37.676341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:37.677045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:37.684310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.684804 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.685270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.686173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:37.686663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:37.687183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:37.829440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:37.839534 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a3272fb4-63a9-4cdb-ba24-6cacca0b745c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1675 microversion: 2.1 time: 0.167633 Oct 28 20:23:37.840157 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3682/7360] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:37 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:38.870030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:38.871229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:38.881720 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:38.882523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:38.883318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:38.884467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:38.885223 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:38.885926 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.025424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:39.033875 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-011a92e0-7481-4845-9584-73b637814c58 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1683 microversion: 2.1 time: 0.172513 Oct 28 20:23:39.034449 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3679/7361] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:38 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:39.140178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:39.143398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:39.155215 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:39.155714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:39.156167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.156869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:39.157335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:39.157771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:39.220096 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e3bec8bd-4cce-4878-9e52-6d540651aa92 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action" status: 200 len: 38144 microversion: 2.1 time: 0.086614 Oct 28 20:23:39.220769 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3683/7362] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:23:39 2022] POST /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f/action => generated 38144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:23:40.261018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-6d5eadab-01f8-4837-b2b3-b32ac015e000 req-2b1f1ea2-fcb3-41eb-9206-2920a2d73db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88d585-4249-42b2-95d9-1f46a769ed5f", "tag": "eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:40.265065 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:40.265633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:40.272842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.273401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.273899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.274674 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.275221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.275885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.276488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6d5eadab-01f8-4837-b2b3-b32ac015e000 req-2b1f1ea2-fcb3-41eb-9206-2920a2d73db2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.276986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6d5eadab-01f8-4837-b2b3-b32ac015e000 req-2b1f1ea2-fcb3-41eb-9206-2920a2d73db2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.277427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-6d5eadab-01f8-4837-b2b3-b32ac015e000 req-2b1f1ea2-fcb3-41eb-9206-2920a2d73db2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.289377 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-6d5eadab-01f8-4837-b2b3-b32ac015e000 req-2b1f1ea2-fcb3-41eb-9206-2920a2d73db2 service nova] Creating event network-changed:eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b for instance ef88d585-4249-42b2-95d9-1f46a769ed5f on n-h1-862769-3 Oct 28 20:23:40.294411 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-6d5eadab-01f8-4837-b2b3-b32ac015e000 req-2b1f1ea2-fcb3-41eb-9206-2920a2d73db2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037536 Oct 28 20:23:40.295281 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3684/7363] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:23:40.303904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:23:40.396487 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-63cebee8-7ed5-489e-94f7-ee15f2b7e72b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 204 len: 0 microversion: 2.1 time: 0.141721 Oct 28 20:23:40.400412 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3680/7364] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:23:40 2022] DELETE /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:23:40.407553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:40.408516 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:40.418027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.418640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.419207 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.420149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:40.420612 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:40.421132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:40.578910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:40.586999 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4f52167a-362e-4298-ad40-183511613ff0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1689 microversion: 2.1 time: 0.185085 Oct 28 20:23:40.587555 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3685/7365] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:40 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:23:41.616196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:41.617333 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:41.628790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:41.629593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:41.630311 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:41.631541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:41.632251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:41.632947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:41.772042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:41.781767 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e871b0e0-fcf5-480d-a40f-306bffd2702f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1689 microversion: 2.1 time: 0.172754 Oct 28 20:23:41.782548 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3681/7366] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:41 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:42.806758 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:42.807336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:42.815034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.815573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.816022 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:42.816737 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.817227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.817716 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:42.891290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:42.900268 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-04d396a7-85af-4e8b-80ae-c7cc2f775013 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 200 len: 1502 microversion: 2.1 time: 0.097612 Oct 28 20:23:42.901006 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3686/7367] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:42 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 1502 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:42.978164 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e67a6e95-0e8a-49ca-b6b5-e9631bdb25f9 req-fb55a48c-2682-4cf1-8b0d-935d9c92099b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88d585-4249-42b2-95d9-1f46a769ed5f", "name": "network-vif-deleted", "tag": "eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:42.988845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e67a6e95-0e8a-49ca-b6b5-e9631bdb25f9 req-fb55a48c-2682-4cf1-8b0d-935d9c92099b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:42.989324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e67a6e95-0e8a-49ca-b6b5-e9631bdb25f9 req-fb55a48c-2682-4cf1-8b0d-935d9c92099b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:42.989788 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e67a6e95-0e8a-49ca-b6b5-e9631bdb25f9 req-fb55a48c-2682-4cf1-8b0d-935d9c92099b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:43.001987 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e67a6e95-0e8a-49ca-b6b5-e9631bdb25f9 req-fb55a48c-2682-4cf1-8b0d-935d9c92099b service nova] Creating event network-vif-deleted:eb76c674-e5d4-41d9-9e5a-0e9cf13b6d7b for instance ef88d585-4249-42b2-95d9-1f46a769ed5f on n-h1-862769-3 Oct 28 20:23:43.007320 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e67a6e95-0e8a-49ca-b6b5-e9631bdb25f9 req-fb55a48c-2682-4cf1-8b0d-935d9c92099b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Oct 28 20:23:43.007949 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3682/7368] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:23:43.929110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:43.930201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: ef88d585-4249-42b2-95d9-1f46a769ed5f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:43.941903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:43.942749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:43.943534 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:43.944701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:43.945481 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:43.946211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:43.962726 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] HTTP exception thrown: Instance ef88d585-4249-42b2-95d9-1f46a769ed5f could not be found. Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Request method failure captured: Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f HTTP/1.1 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDoPOJ8tm2xCkjKneW5T1yKDriFsV7uMfdWAvhtHImPGz4govxQscjur8FjktQNfi8W3Arjw4rXOB1Qx9KrimKDK0d2h0WCtGuEGpCsl9-IkdDRoYVtejUC_pvq4bLcloO41a94QNSW6_iPYxZXDKUE3PqszH9aukVtVpmMefA7W7YY Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4cf68cde9484df89eb9c69ff7205c32", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 5de02b3eb8bd40288f369c2026b5b8fd Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance ef88d585-4249-42b2-95d9-1f46a769ed5f could not be found. Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'ef88d585-4249-42b2-95d9-1f46a769ed5f'} Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef88d585-4249-42b2-95d9-1f46a769ed5f could not be found. Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef88d585-4249-42b2-95d9-1f46a769ed5f could not be found. Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:23:43.964404 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef88d585-4249-42b2-95d9-1f46a769ed5f could not be found. Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Returning 404 to user: Instance ef88d585-4249-42b2-95d9-1f46a769ed5f could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ad24643c-085f-4407-bfca-bf8dad330845 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f" status: 404 len: 111 microversion: 2.1 time: 0.043475 Oct 28 20:23:43.969023 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3687/7369] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:43 2022] GET /compute/v2.1/servers/ef88d585-4249-42b2-95d9-1f46a769ed5f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:23:47.353823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d79e3559-825d-4b1b-82cd-c8e5c6321c43 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '.version_select at 0x7f1d76afd550>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:47.377851 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d79e3559-825d-4b1b-82cd-c8e5c6321c43 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1582208740" status: 202 len: 0 microversion: 2.1 time: 0.029538 Oct 28 20:23:47.382832 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3683/7370] 10.222.0.44 () {58 vars in 1284 bytes} [Fri Oct 28 20:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1582208740 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:23:47.401203 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bc7f205d-8db9-482f-b5bd-6e1a7da8278d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: .version_select at 0x7f1d772d4700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1569385687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeAO3TYu8rLx09JcY/4VPn2L+FjnUjrM2J0RKIBvLDs+NTvkX4IdjZgUB6pxTBbcqHF9OtTL4M+cPgSfvC5j3RSjAEcerCLFpyR/tVburX1HhzFuO+UZ30p1KpAjhH+iA=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:47.418745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bc7f205d-8db9-482f-b5bd-6e1a7da8278d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:23:47.425011 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-bc7f205d-8db9-482f-b5bd-6e1a7da8278d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:23:47.449856 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bc7f205d-8db9-482f-b5bd-6e1a7da8278d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052700 Oct 28 20:23:47.450392 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3688/7371] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:23:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:23:53.331396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1350600029", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "c1218b3b-6918-4e5b-a211-c50f1cc2792f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1569385687", "security_groups": [{"name": "tempest-secgroup-smoke-38059523"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:53.341982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:53.457555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] validate_networks() for [('c1218b3b-6918-4e5b-a211-c50f1cc2792f', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:23:53.892961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:23:53.894110 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:23:53.894908 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:23:53.895673 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:23:53.896212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:23:53.906637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:53.907505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:53.908126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:53.909059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:53.909721 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:53.910328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:53.940623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:23:53.946078 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:23:53.958813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:23:53.961292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:23:54.007136 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [71f22fd6-515a-4810-9ef3-1140c046b896] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:23:55.014122 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [71f22fd6-515a-4810-9ef3-1140c046b896] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 41202. Oct 28 20:23:55.020508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-38d00990-109a-4bc4-944a-8996ef80625c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.693101 Oct 28 20:23:55.025820 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3684/7372] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:23:53 2022] POST /compute/v2.1/servers => generated 404 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:23:55.033649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8441c060-d8ab-4bfd-be75-c31b484f4a9c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:55.035056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8441c060-d8ab-4bfd-be75-c31b484f4a9c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:55.038235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:23:55.094354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8441c060-d8ab-4bfd-be75-c31b484f4a9c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:55.105568 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8441c060-d8ab-4bfd-be75-c31b484f4a9c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1267 microversion: 2.1 time: 0.074569 Oct 28 20:23:55.106483 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3689/7373] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:55 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:56.132424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:56.133656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:56.141395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:56.142034 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:56.142474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:56.143253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:56.143658 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:56.144084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:56.209184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:56.217132 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4f2dd0ce-a576-4167-a283-c1f316b9ef5a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1337 microversion: 2.1 time: 0.089874 Oct 28 20:23:56.218023 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3685/7374] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:56 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1337 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:57.240552 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:57.241261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:57.249027 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.250635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.251414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.252796 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.253492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.253964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.385778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:57.394971 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f3637431-1284-44be-9075-e0e3cf94b885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1391 microversion: 2.1 time: 0.158578 Oct 28 20:23:57.395564 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3690/7375] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:57 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:57.475703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ee6d7ac3-c30e-4906-86a5-16a76492a6e5 req-8bca2fb6-d683-4b34-8764-252c0f97c35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66e88d4-d25a-4a41-8247-eed4b9b22487", "tag": "f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:23:57.491176 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ee6d7ac3-c30e-4906-86a5-16a76492a6e5 req-8bca2fb6-d683-4b34-8764-252c0f97c35b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:57.491727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ee6d7ac3-c30e-4906-86a5-16a76492a6e5 req-8bca2fb6-d683-4b34-8764-252c0f97c35b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:57.492248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ee6d7ac3-c30e-4906-86a5-16a76492a6e5 req-8bca2fb6-d683-4b34-8764-252c0f97c35b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:57.504572 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ee6d7ac3-c30e-4906-86a5-16a76492a6e5 req-8bca2fb6-d683-4b34-8764-252c0f97c35b service nova] Creating event network-changed:f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0 for instance e66e88d4-d25a-4a41-8247-eed4b9b22487 on n-h2-862769-3 Oct 28 20:23:57.511149 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ee6d7ac3-c30e-4906-86a5-16a76492a6e5 req-8bca2fb6-d683-4b34-8764-252c0f97c35b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038866 Oct 28 20:23:57.511844 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3686/7376] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:23:58.419050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:58.419668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:58.427051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:58.427535 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:58.427980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:58.428697 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:58.429166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:58.430228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:58.574389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:58.585431 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c156febb-0218-4715-9d9f-4146e230cf99 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1391 microversion: 2.1 time: 0.170523 Oct 28 20:23:58.586018 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3691/7377] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:58 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:23:59.610590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:23:59.611356 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:23:59.617986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:59.618458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:59.618937 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:59.619630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:23:59.620082 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:23:59.620504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:23:59.763617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:23:59.772613 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-63256d28-bf9a-4587-8c7c-380c7dc074e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1391 microversion: 2.1 time: 0.167392 Oct 28 20:23:59.773213 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3687/7378] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:23:59 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:00.803346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:00.803925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:00.811374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:00.811879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:00.812333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:00.813049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:00.813611 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:00.814043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:00.951769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:00.960319 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-692281fb-f03a-454c-816e-f8e39c810e31 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1391 microversion: 2.1 time: 0.161016 Oct 28 20:24:00.960954 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3692/7379] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:00 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:01.987888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:01.988528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:01.995821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:01.996336 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:01.997102 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:01.998295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:01.999163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:01.999923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:02.144911 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:02.153867 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8ce289d9-bc5d-4c87-b7a7-b4c75c301160 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1391 microversion: 2.1 time: 0.169634 Oct 28 20:24:02.154450 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3688/7380] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:01 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:02.244529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-30fb639e-1f4f-4ce6-ac47-24f23d580166 req-a5db5e97-5855-4692-9086-8e5a06163301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66e88d4-d25a-4a41-8247-eed4b9b22487", "name": "network-vif-plugged", "status": "completed", "tag": "f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:24:02.262303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-30fb639e-1f4f-4ce6-ac47-24f23d580166 req-a5db5e97-5855-4692-9086-8e5a06163301 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:02.262819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-30fb639e-1f4f-4ce6-ac47-24f23d580166 req-a5db5e97-5855-4692-9086-8e5a06163301 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:02.263256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-30fb639e-1f4f-4ce6-ac47-24f23d580166 req-a5db5e97-5855-4692-9086-8e5a06163301 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:02.274745 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-30fb639e-1f4f-4ce6-ac47-24f23d580166 req-a5db5e97-5855-4692-9086-8e5a06163301 service nova] Creating event network-vif-plugged:f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0 for instance e66e88d4-d25a-4a41-8247-eed4b9b22487 on n-h2-862769-3 Oct 28 20:24:02.280143 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-30fb639e-1f4f-4ce6-ac47-24f23d580166 req-a5db5e97-5855-4692-9086-8e5a06163301 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039395 Oct 28 20:24:02.280739 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3693/7381] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:24:03.180659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:03.181663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:03.192689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:03.193172 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:03.193607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:03.194298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:03.194781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:03.195203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:03.332132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:03.340289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d49797d1-3f97-455a-9394-47d41bf1c68a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1391 microversion: 2.1 time: 0.166175 Oct 28 20:24:03.340846 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3689/7382] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:03 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:04.370271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:04.371499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:04.381163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.381672 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.382123 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.382871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.383348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.383786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.520355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:04.529283 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2919404-0311-4d5b-81f2-633e6b34a873 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1562 microversion: 2.1 time: 0.167820 Oct 28 20:24:04.529892 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3694/7383] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:04 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:04.552262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:04.552934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:04.554976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:04.555616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:04.563512 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.564003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.564440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.565145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:04.565607 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:04.566028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:04.703422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:04.712036 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a4c40c4-63f6-439f-92a1-6c5d3a6fc14f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1562 microversion: 2.1 time: 0.164122 Oct 28 20:24:04.712620 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3690/7384] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:04 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:06.676545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:06.682061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-fdc7afaf-3dbd-44c4-884d-ec4a1ddb5ae2 req-2e1e4ec2-9c51-4193-b872-fcd1295a56d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66e88d4-d25a-4a41-8247-eed4b9b22487", "tag": "f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:24:06.688905 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:06.689214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:06.691503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:06.693653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:06.703420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fdc7afaf-3dbd-44c4-884d-ec4a1ddb5ae2 req-2e1e4ec2-9c51-4193-b872-fcd1295a56d6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.703901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fdc7afaf-3dbd-44c4-884d-ec4a1ddb5ae2 req-2e1e4ec2-9c51-4193-b872-fcd1295a56d6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.704325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-fdc7afaf-3dbd-44c4-884d-ec4a1ddb5ae2 req-2e1e4ec2-9c51-4193-b872-fcd1295a56d6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.708339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.708842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.709284 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.709995 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:06.710445 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:06.710906 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:06.726331 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-fdc7afaf-3dbd-44c4-884d-ec4a1ddb5ae2 req-2e1e4ec2-9c51-4193-b872-fcd1295a56d6 service nova] Creating event network-changed:f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0 for instance e66e88d4-d25a-4a41-8247-eed4b9b22487 on n-h2-862769-3 Oct 28 20:24:06.731948 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-fdc7afaf-3dbd-44c4-884d-ec4a1ddb5ae2 req-2e1e4ec2-9c51-4193-b872-fcd1295a56d6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053371 Oct 28 20:24:06.732785 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3691/7385] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:24:06.853546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:06.861892 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-48a42529-c4af-4b2b-9f2d-cfca7d52d65a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1562 microversion: 2.1 time: 0.189453 Oct 28 20:24:06.862474 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3695/7386] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:06 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:28.151481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=36 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:28.156603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:24:28.158981 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:28.166571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:28.167114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:28.167543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:28.168239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:28.168695 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:28.169109 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:28.229465 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a36e76d2-864f-45a2-8a91-04ded0dc2bd3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487/action" status: 200 len: 24556 microversion: 2.1 time: 0.080207 Oct 28 20:24:28.230239 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3692/7387] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:24:28 2022] POST /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487/action => generated 24556 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:24:39.254115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:24:39.256681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:39.259009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:39.259680 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=32 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:39.266385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.266955 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.267408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.268127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.268597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.269034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.345244 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-308f96a1-bcb7-451c-a198-7ee96bbb6f39 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487/action" status: 202 len: 0 microversion: 2.1 time: 0.094970 Oct 28 20:24:39.345946 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3696/7388] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:24:39 2022] POST /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:24:39.355809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:39.356523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:39.359536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:39.360220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:24:39.368030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.368774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.369365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.370085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:39.370542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:39.370990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:39.509554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:39.517904 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4a7bd194-b33c-4161-9b82-771915c08b15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1673 microversion: 2.1 time: 0.166644 Oct 28 20:24:39.518472 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3693/7389] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:39 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:24:40.546815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:40.547551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:40.556113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:40.556665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:40.557148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:40.557923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:40.558439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:40.558953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:40.698223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:40.706647 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fc0181ee-bbd7-4b0d-8ee6-017c0b490b66 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.167279 Oct 28 20:24:40.707307 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3697/7390] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:40 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:41.733728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:41.734323 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:41.745200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:41.745865 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:41.746410 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:41.747428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:41.748097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:41.748687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:41.885991 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:41.894211 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ee5dc048-a4f3-40e9-9519-26e5910119d5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.167036 Oct 28 20:24:41.894819 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3694/7391] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:41 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:42.922085 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:42.922868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:42.930024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:42.930549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:42.931020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:42.931843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:42.932333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:42.932761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:43.063854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:43.071791 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-92faf5e7-a48c-4ce5-99f0-4435158008ad tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.156195 Oct 28 20:24:43.072362 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3698/7392] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:42 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:44.099636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:44.100575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:44.111974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:44.112769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:44.113496 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:44.114653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:44.115477 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:44.116185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:44.258884 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:44.266886 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-51a5d507-07e7-4260-84b5-0b44f4abf5d1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.173960 Oct 28 20:24:44.267388 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3695/7393] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:44 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:45.295073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:45.296103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:45.303839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:45.304342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:45.304791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:45.305509 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:45.306010 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:45.306447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:45.445166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:45.453468 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d3e853af-4da7-4048-91d3-711d27b70f7f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.165251 Oct 28 20:24:45.454053 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3699/7394] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:45 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:46.481422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:46.482416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:46.491039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:46.491454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:46.491976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:46.492667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:46.493119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:46.493537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:46.627897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:46.639764 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-75a72423-5d9c-4da7-9c6a-c3b32bd1748d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.164876 Oct 28 20:24:46.640513 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3696/7395] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:46 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:47.668609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:47.669723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:47.681478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:47.682308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:47.683111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:47.684332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:47.685120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:47.685849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:47.831424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:47.839655 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-763124fb-e414-4668-828a-61e4c42a6ced tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.177766 Oct 28 20:24:47.840233 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3700/7396] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:47 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:48.867453 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:48.868423 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:48.880245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:48.881041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:48.881757 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:48.882936 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:48.883689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:48.884394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:49.021866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:49.034023 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8f1c2d5-3c8c-48d5-9c0b-743f3db76e07 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.173354 Oct 28 20:24:49.034571 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3697/7397] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:48 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:50.061771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:50.062924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:50.071228 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:50.071744 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:50.072195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:50.072898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:50.073364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:50.073792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:50.212120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:50.220563 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-00d36a1f-0a68-4db6-ab7d-dc20131c2b16 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.165588 Oct 28 20:24:50.221145 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3701/7398] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:50 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:51.244321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:51.244972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:51.252504 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:51.253004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:51.253448 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:51.254150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:51.254610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:51.255081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:51.396516 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:51.405199 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9391e787-ecd2-464e-9a53-e88930f62e88 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.164942 Oct 28 20:24:51.405783 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3698/7399] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:51 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:52.430717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:52.431337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:52.438663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:52.439194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:52.439638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:52.440331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:52.440791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:52.441220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:52.589691 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:52.601316 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-954c0057-fea9-47dd-a796-4bdebcfefcb4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.174426 Oct 28 20:24:52.602130 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3702/7400] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:52 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:53.629638 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:53.630373 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:53.639561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:53.640166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:53.640713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:53.641584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:53.642167 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:53.642711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:53.781631 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:53.789520 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-45a519b8-42a8-45a9-b71e-a99df58dc3e1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.166433 Oct 28 20:24:53.790109 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3699/7401] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:53 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:54.817444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:54.818539 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:54.830274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:54.831179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:54.831926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:54.832960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:54.833428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:54.833871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:54.978107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:54.990752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-646bed16-2218-462a-b6d0-8fe650c18648 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1678 microversion: 2.1 time: 0.179692 Oct 28 20:24:54.991680 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3703/7402] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:54 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:24:56.018786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:24:56.019684 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:24:56.031906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:56.032707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:56.033436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:56.034583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:24:56.035402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:24:56.036007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:24:56.180466 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:24:56.188619 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-783cfc74-2520-49a0-9333-24616d93d3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1681 microversion: 2.1 time: 0.176511 Oct 28 20:24:56.189203 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3700/7403] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:24:56 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:20.416354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:20.420068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:20.422594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:20.423332 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:20.429693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:20.430219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:20.430915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:20.431649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:20.432139 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:20.432597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:20.491262 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0d05acd3-895b-42aa-a42f-2d287553f885 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487/action" status: 200 len: 69244 microversion: 2.1 time: 0.081290 Oct 28 20:25:20.491995 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3704/7404] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:25:20 2022] POST /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487/action => generated 69244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:25:27.647014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:27.647583 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:27.654387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4fbb5a91-3280-45bb-9354-ff0c0bc8e943 req-1f61d91f-cd76-4062-bcbb-05ab3d6522f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66e88d4-d25a-4a41-8247-eed4b9b22487", "tag": "f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:27.663680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=16 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:27.664344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=48 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:27.666369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4fbb5a91-3280-45bb-9354-ff0c0bc8e943 req-1f61d91f-cd76-4062-bcbb-05ab3d6522f0 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.666849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4fbb5a91-3280-45bb-9354-ff0c0bc8e943 req-1f61d91f-cd76-4062-bcbb-05ab3d6522f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.667358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4fbb5a91-3280-45bb-9354-ff0c0bc8e943 req-1f61d91f-cd76-4062-bcbb-05ab3d6522f0 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:27.667971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.668429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.668860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:27.669549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.670256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.670606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:27.681045 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4fbb5a91-3280-45bb-9354-ff0c0bc8e943 req-1f61d91f-cd76-4062-bcbb-05ab3d6522f0 service nova] Creating event network-changed:f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0 for instance e66e88d4-d25a-4a41-8247-eed4b9b22487 on n-h2-862769-3 Oct 28 20:25:27.687923 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4fbb5a91-3280-45bb-9354-ff0c0bc8e943 req-1f61d91f-cd76-4062-bcbb-05ab3d6522f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037551 Oct 28 20:25:27.691386 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3705/7405] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:25:27.698251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:25:27.781670 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-73b9c920-e69f-4da0-a683-d682ce8dfd2a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 204 len: 0 microversion: 2.1 time: 0.137861 Oct 28 20:25:27.793132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:27.794293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:27.794873 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3701/7406] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:25:27 2022] DELETE /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:25:27.802328 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.803067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.803567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:27.804291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:27.804977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:27.805674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:27.946344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:27.954935 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71ca7396-a32e-48a8-9b0a-7feb7c12e86c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1687 microversion: 2.1 time: 0.167092 Oct 28 20:25:27.955526 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3706/7407] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:27 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:28.980529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:28.981204 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:28.989293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:28.989790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:28.990219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:28.990948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:28.991382 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:28.991869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:29.130068 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:29.138080 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd8f888c-1d13-43b8-989b-a9b9d3218be6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1687 microversion: 2.1 time: 0.162625 Oct 28 20:25:29.138656 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3702/7408] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:28 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:29.924197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9c9c2d2a-1d11-4db4-9ca3-7041438e2e5c req-39b3d730-e2bb-4c13-ac9f-e1c1706563df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66e88d4-d25a-4a41-8247-eed4b9b22487", "name": "network-vif-deleted", "tag": "f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:29.934337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c9c2d2a-1d11-4db4-9ca3-7041438e2e5c req-39b3d730-e2bb-4c13-ac9f-e1c1706563df service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:29.934895 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c9c2d2a-1d11-4db4-9ca3-7041438e2e5c req-39b3d730-e2bb-4c13-ac9f-e1c1706563df service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:29.935335 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9c9c2d2a-1d11-4db4-9ca3-7041438e2e5c req-39b3d730-e2bb-4c13-ac9f-e1c1706563df service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:29.946987 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9c9c2d2a-1d11-4db4-9ca3-7041438e2e5c req-39b3d730-e2bb-4c13-ac9f-e1c1706563df service nova] Creating event network-vif-deleted:f4ad60d0-9fc3-4cc3-9230-41f2a64ba2d0 for instance e66e88d4-d25a-4a41-8247-eed4b9b22487 on n-h2-862769-3 Oct 28 20:25:29.951908 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9c9c2d2a-1d11-4db4-9ca3-7041438e2e5c req-39b3d730-e2bb-4c13-ac9f-e1c1706563df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163186 Oct 28 20:25:29.952500 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3707/7409] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:25:30.163391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:30.164196 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:30.173250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.174077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.174553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.175550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.176055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.176707 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.213354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:30.213859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:30.214277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:30.214747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lazy-loading 'fault' on Instance uuid e66e88d4-d25a-4a41-8247-eed4b9b22487 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:25:30.256435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:30.264944 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6b407bfd-e063-4544-ac99-13b2e5d3d4fa tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 200 len: 1357 microversion: 2.1 time: 0.106012 Oct 28 20:25:30.265543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3703/7410] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:30 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:31.293924 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:31.295156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: e66e88d4-d25a-4a41-8247-eed4b9b22487] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:31.305693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:31.306515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:31.307279 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:31.308480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:31.309260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:31.309985 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:31.328170 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] HTTP exception thrown: Instance e66e88d4-d25a-4a41-8247-eed4b9b22487 could not be found. Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Request method failure captured: Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 HTTP/1.1 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDoPOJ8tm2xCkjKneW5T1yKDriFsV7uMfdWAvhtHImPGz4govxQscjur8FjktQNfi8W3Arjw4rXOB1Qx9KrimKDK0d2h0WCtGuEGpCsl9-IkdDRoYVtejUC_pvq4bLcloO41a94QNSW6_iPYxZXDKUE3PqszH9aukVtVpmMefA7W7YY Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4cf68cde9484df89eb9c69ff7205c32", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 5de02b3eb8bd40288f369c2026b5b8fd Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance e66e88d4-d25a-4a41-8247-eed4b9b22487 could not be found. Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'e66e88d4-d25a-4a41-8247-eed4b9b22487'} Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e66e88d4-d25a-4a41-8247-eed4b9b22487 could not be found. Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e66e88d4-d25a-4a41-8247-eed4b9b22487 could not be found. Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:25:31.329819 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e66e88d4-d25a-4a41-8247-eed4b9b22487 could not be found. Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Returning 404 to user: Instance e66e88d4-d25a-4a41-8247-eed4b9b22487 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2db3fa84-1783-46ba-9ff3-5d51c580f5e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487" status: 404 len: 111 microversion: 2.1 time: 0.046296 Oct 28 20:25:31.334299 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3708/7411] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:31 2022] GET /compute/v2.1/servers/e66e88d4-d25a-4a41-8247-eed4b9b22487 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:25:34.355971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1874692-0b2e-4505-a326-6e984bfd07e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '.version_select at 0x7f1d76afa160>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:34.378440 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1874692-0b2e-4505-a326-6e984bfd07e5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1569385687" status: 202 len: 0 microversion: 2.1 time: 0.026325 Oct 28 20:25:34.379233 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3704/7412] 10.222.0.44 () {58 vars in 1284 bytes} [Fri Oct 28 20:25:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1569385687 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:25:34.407293 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-785378b0-ca0f-4ea3-8372-1c0be5906a15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: .version_select at 0x7f1d769efd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1299320525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQxAcuGjvL1miJWSbN2bQ9pJvMlL0WgIr+OvedcXQWSDFDg0T0AYmzkOSuGI4SHujCEnhO10SqVovUvCEIn0W/1tLpEhUZE79Y61RmAmfXEtUEFa2YplEpmmBzWS7dA4w=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:34.423778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-785378b0-ca0f-4ea3-8372-1c0be5906a15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:25:34.429867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-785378b0-ca0f-4ea3-8372-1c0be5906a15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:25:34.454367 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-785378b0-ca0f-4ea3-8372-1c0be5906a15 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051409 Oct 28 20:25:34.455040 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3709/7413] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:25:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:25:40.039949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1974335289", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "4aba251b-aadf-4cfd-8157-70b6c960bc9c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1299320525", "security_groups": [{"name": "tempest-secgroup-smoke-678279319"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:40.261954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:40.280256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] validate_networks() for [('4aba251b-aadf-4cfd-8157-70b6c960bc9c', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:25:40.750948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:25:40.751455 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:25:40.751973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:25:40.752605 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:25:40.753081 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:25:40.762232 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:40.762878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:40.763378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:40.764213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:40.764711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:40.765197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:40.784817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:25:40.790599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:25:40.805394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:25:40.809843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:25:40.864493 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-feecec1c-95a8-448b-a427-eb66e83bf6a2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828473 Oct 28 20:25:40.865159 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3705/7414] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:25:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:25:40.875263 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:25:40.875841 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:25:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 (ip 10.222.0.44) !!! Oct 28 20:25:40.889040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-99169503-b7cf-4de2-bcc2-198ce3d60a63 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:40.889821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-99169503-b7cf-4de2-bcc2-198ce3d60a63 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:41.007564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-99169503-b7cf-4de2-bcc2-198ce3d60a63 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:41.015191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-99169503-b7cf-4de2-bcc2-198ce3d60a63 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1267 microversion: 2.1 time: 0.142253 Oct 28 20:25:41.015777 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3710/7415] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:40 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:42.039094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-66eb6487-0323-4b4a-9286-3b00cf9935b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:42.039694 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-66eb6487-0323-4b4a-9286-3b00cf9935b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:42.093208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-66eb6487-0323-4b4a-9286-3b00cf9935b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:42.100525 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-66eb6487-0323-4b4a-9286-3b00cf9935b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1267 microversion: 2.1 time: 0.066310 Oct 28 20:25:42.101358 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3706/7416] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:42 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:43.126800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bd4a2fac-f2ae-4aa2-a76e-e317be348cc9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:43.127433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bd4a2fac-f2ae-4aa2-a76e-e317be348cc9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:43.135217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:43.189591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bd4a2fac-f2ae-4aa2-a76e-e317be348cc9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:43.196632 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bd4a2fac-f2ae-4aa2-a76e-e317be348cc9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1267 microversion: 2.1 time: 0.077180 Oct 28 20:25:43.197201 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3711/7417] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:43 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:44.220561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7f3f7c3-2da5-4705-94e2-146c07363649 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:44.221893 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d7f3f7c3-2da5-4705-94e2-146c07363649 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:44.279193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7f3f7c3-2da5-4705-94e2-146c07363649 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:44.287031 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7f3f7c3-2da5-4705-94e2-146c07363649 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1267 microversion: 2.1 time: 0.071081 Oct 28 20:25:44.287711 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3707/7418] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:44 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:45.314748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:45.315497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:45.323879 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:45.324433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:45.324929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:45.325803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:45.326321 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:45.326837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:45.400099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:45.408874 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7dac5817-9e3a-4a1f-a26f-66e31b728288 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1271 microversion: 2.1 time: 0.100497 Oct 28 20:25:45.409463 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3712/7419] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:45 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:46.431892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:46.432465 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:46.443174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:46.443665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:46.444101 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:46.444798 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:46.445244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:46.445667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:46.508629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:46.517437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-65185870-2674-4541-92e5-14e5a76f38c1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1325 microversion: 2.1 time: 0.089707 Oct 28 20:25:46.518097 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3708/7420] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:46 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:47.541367 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:47.542002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:47.549545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:47.550053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:47.550506 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:47.551310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:47.551805 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:47.552249 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:47.687136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:47.695830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-42477474-5e42-41be-b930-3e7d500d112b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1392 microversion: 2.1 time: 0.158324 Oct 28 20:25:47.696413 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3713/7421] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:47 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:47.777354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ba0d7cfd-5ddf-4aa2-9531-d45ae5b92622 req-4628be90-3830-4ad1-bd10-45795aa14863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:47.790818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ba0d7cfd-5ddf-4aa2-9531-d45ae5b92622 req-4628be90-3830-4ad1-bd10-45795aa14863 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:47.791325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ba0d7cfd-5ddf-4aa2-9531-d45ae5b92622 req-4628be90-3830-4ad1-bd10-45795aa14863 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:47.792400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ba0d7cfd-5ddf-4aa2-9531-d45ae5b92622 req-4628be90-3830-4ad1-bd10-45795aa14863 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:47.805575 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ba0d7cfd-5ddf-4aa2-9531-d45ae5b92622 req-4628be90-3830-4ad1-bd10-45795aa14863 service nova] Creating event network-changed:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h1-862769-3 Oct 28 20:25:47.810961 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ba0d7cfd-5ddf-4aa2-9531-d45ae5b92622 req-4628be90-3830-4ad1-bd10-45795aa14863 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037500 Oct 28 20:25:47.811587 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3709/7422] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:25:48.719261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:48.719865 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:48.727662 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:48.728214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:48.728688 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:48.729426 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:48.729945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:48.730401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:48.871517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:48.879952 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ce012f8a-fe59-4259-8132-9855d06697e0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1392 microversion: 2.1 time: 0.164942 Oct 28 20:25:48.880559 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3714/7423] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:48 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:49.910030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:49.910727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:49.917454 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:49.917932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:49.918358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:49.919080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:49.919529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:49.919949 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:50.052528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:50.060778 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-db3ab240-eb6b-4d7e-b988-256c5489a6ef tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1392 microversion: 2.1 time: 0.159746 Oct 28 20:25:50.061364 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3710/7424] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:49 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:51.090058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:51.091146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:51.095494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:51.104357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:51.105190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:51.105941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:51.107158 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:51.107938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:51.108666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:51.249857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:51.258084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-17f5cbe3-c2a7-4a0c-a0dd-56f4f3fdaab1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1392 microversion: 2.1 time: 0.174686 Oct 28 20:25:51.258667 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3715/7425] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:51 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:25:52.281726 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:52.282302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:52.284370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:52.291056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.291538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.292012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.292698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.293143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.293565 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.431420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:52.439826 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8856b323-6c5f-412c-96cf-a8f2d9f0cef8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1392 microversion: 2.1 time: 0.162466 Oct 28 20:25:52.440405 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3711/7426] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:52 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:52.841677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5007a90f-19e7-4441-ab0b-318c005b597f req-f4169f67-02be-43a1-b606-fb5ae6577c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "name": "network-vif-plugged", "status": "completed", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:52.852273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5007a90f-19e7-4441-ab0b-318c005b597f req-f4169f67-02be-43a1-b606-fb5ae6577c42 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:52.852771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5007a90f-19e7-4441-ab0b-318c005b597f req-f4169f67-02be-43a1-b606-fb5ae6577c42 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:52.853224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5007a90f-19e7-4441-ab0b-318c005b597f req-f4169f67-02be-43a1-b606-fb5ae6577c42 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:52.864459 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5007a90f-19e7-4441-ab0b-318c005b597f req-f4169f67-02be-43a1-b606-fb5ae6577c42 service nova] Creating event network-vif-plugged:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h1-862769-3 Oct 28 20:25:52.869615 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5007a90f-19e7-4441-ab0b-318c005b597f req-f4169f67-02be-43a1-b606-fb5ae6577c42 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031808 Oct 28 20:25:52.870278 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3716/7427] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:25:53.467251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:53.468256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:53.477672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:53.478151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:53.478614 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:53.479338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:53.479790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:53.480208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:53.623142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:53.631574 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6f504fc-0118-4fe8-9c68-7f63ddfc37b3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1392 microversion: 2.1 time: 0.170907 Oct 28 20:25:53.632144 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3712/7428] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:53 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:54.653292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=8 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:54.662275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:54.663515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:54.676811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:54.677314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:54.677761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:54.678474 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:54.678968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:54.679407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:54.821428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:54.829336 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1d8451d9-c1c2-461d-b775-1cbeb3b6b0ac tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1564 microversion: 2.1 time: 0.177939 Oct 28 20:25:54.829936 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3717/7429] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:54 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:54.851642 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:54.852208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:54.854091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:25:54.860463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:54.860941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:54.861371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:54.862051 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:54.862498 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:54.863017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:55.005915 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:55.014522 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2c6845b-71c7-411b-8f7a-344cec0db5a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1564 microversion: 2.1 time: 0.166800 Oct 28 20:25:55.015138 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3713/7430] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:54 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:25:56.648695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:25:56.649635 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:25:56.654270 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-e222de03-3cd5-48b8-bbb8-8485b0cc6be9 req-d5ddcd69-5584-4d57-a52c-71251239ffb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:25:56.655705 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.656211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.656969 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.657905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.658379 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.658859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.665337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e222de03-3cd5-48b8-bbb8-8485b0cc6be9 req-d5ddcd69-5584-4d57-a52c-71251239ffb1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:25:56.665817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e222de03-3cd5-48b8-bbb8-8485b0cc6be9 req-d5ddcd69-5584-4d57-a52c-71251239ffb1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:25:56.666244 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-e222de03-3cd5-48b8-bbb8-8485b0cc6be9 req-d5ddcd69-5584-4d57-a52c-71251239ffb1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:25:56.678067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-e222de03-3cd5-48b8-bbb8-8485b0cc6be9 req-d5ddcd69-5584-4d57-a52c-71251239ffb1 service nova] Creating event network-changed:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h1-862769-3 Oct 28 20:25:56.683232 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-e222de03-3cd5-48b8-bbb8-8485b0cc6be9 req-d5ddcd69-5584-4d57-a52c-71251239ffb1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 Oct 28 20:25:56.683817 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3714/7431] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:25:56.801589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:25:56.810260 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3bbb982a-7360-4506-84eb-e033c9846397 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1564 microversion: 2.1 time: 0.165811 Oct 28 20:25:56.810960 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3718/7432] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:25:56 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:20.113913 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:20.114712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=36 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:20.119040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:26:20.121275 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:20.128864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:20.129348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:20.129778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:20.130464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:20.130947 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:20.131364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:20.193772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44be678a-356d-4374-88a9-2345efcd973b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action" status: 200 len: 24565 microversion: 2.1 time: 0.083275 Oct 28 20:26:20.194416 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3715/7433] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:26:20 2022] POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action => generated 24565 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:26:31.152649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:26:31.155488 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:31.158412 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=7 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:31.159157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=38 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:31.166592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:31.167189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:31.167695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:31.168494 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:31.169119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:31.169562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:31.212554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:31.218912 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Old instance type m1.heat2, new instance type m1.heat {{(pid=120629) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 20:26:31.226346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:26:31.226819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:26:31.227311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:26:31.227734 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:26:31.228164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:26:31.310464 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7f348e0f-6f33-4899-bd9a-64596c9e425a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action" status: 202 len: 0 microversion: 2.1 time: 0.164583 Oct 28 20:26:31.311388 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3719/7434] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:26:31 2022] POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:26:31.320330 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:31.321040 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:31.325220 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:31.325851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=4 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:26:31.330390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:31.330901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:31.331325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:31.332009 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:31.332438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:31.332941 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:31.468143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:31.476210 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3866aa57-080d-4401-ba5c-c404b2602c0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1692 microversion: 2.1 time: 0.160240 Oct 28 20:26:31.476777 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3716/7435] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:31 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:32.501644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:32.502265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:32.512631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:32.513153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:32.513693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:32.514411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:32.514913 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:32.515349 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:32.654356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:32.662967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-89c915cf-c92d-4f29-b852-31a9b1e3b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1692 microversion: 2.1 time: 0.165640 Oct 28 20:26:32.663519 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3720/7436] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:32 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:33.691527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:33.692598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:33.703627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:33.704116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:33.704559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:33.705256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:33.705719 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:33.706171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:33.845661 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:33.853686 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-49686453-b4d8-48fe-b075-6093215e67cd tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.169091 Oct 28 20:26:33.854266 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3717/7437] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:33 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:34.882243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:34.883308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:34.892894 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:34.893401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:34.893854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:34.894562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:34.895081 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:34.895520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:35.029009 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:35.040638 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-51b51638-f193-4a16-a072-19283f3be9e4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.165353 Oct 28 20:26:35.041224 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3721/7438] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:34 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:36.068588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:36.069567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:36.081388 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:36.082246 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:36.083028 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:36.084175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:36.084923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:36.085629 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:36.227811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:36.235993 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ed087b7-44d4-4158-a0b7-a2ed280961fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.174150 Oct 28 20:26:36.236576 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3718/7439] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:36 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:37.259897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:37.260527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:37.267863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:37.268368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:37.268815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:37.269610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:37.270047 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:37.270478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:37.419274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:37.427597 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-aab94daf-771e-4e81-b6eb-854a2c24b260 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.171687 Oct 28 20:26:37.428176 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3722/7440] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:37 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:38.454741 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:38.455744 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:38.467488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:38.468212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:38.468628 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:38.469342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:38.469810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:38.470226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:38.622055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:38.634294 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bb2b7f72-f05c-429d-ab01-1b62373c8c78 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.185820 Oct 28 20:26:38.635027 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3719/7441] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:38 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:39.662793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:39.663826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:39.674095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:39.674602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:39.675089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:39.675807 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:39.676281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:39.676724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:39.814584 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:39.823036 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bb42112e-9e83-4879-b03e-989ef7ac42da tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.167680 Oct 28 20:26:39.823588 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3723/7442] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:39 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:40.848575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:40.849221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:40.856400 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:40.856886 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:40.857317 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:40.858013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:40.858467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:40.858956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:41.003392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:41.015226 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a899b65f-f3b7-47b5-a1b3-7633ac4f80e8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.171383 Oct 28 20:26:41.015782 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3720/7443] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:40 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:42.045735 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:42.046826 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:42.058845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:42.059693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:42.060447 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:42.061624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:42.062472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:42.063045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:42.193469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:42.201975 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-af368775-d19c-4492-94fc-68c9f054ba72 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.162919 Oct 28 20:26:42.202612 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3724/7444] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:42 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:43.235880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:43.235880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:43.243248 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:43.243879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:43.244447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:43.245376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:43.245920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:43.246352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:43.397100 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:43.405015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-f1b82ee9-f936-45ea-979d-298d5a9a33b6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.176047 Oct 28 20:26:43.405628 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3721/7445] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:43 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:44.432409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:44.433440 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:44.442724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:44.443236 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:44.443684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:44.444396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:44.444862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:44.445302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:44.583419 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:44.591824 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-296b27b2-39d5-4f40-82aa-490067b7ab35 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.166005 Oct 28 20:26:44.592422 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3725/7446] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:44 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:45.625955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:45.627016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:45.638133 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:45.638995 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:45.639713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:45.640848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:45.641738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:45.642177 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:45.773544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:45.781502 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c87fa190-ca1e-4dcf-88be-46d3dfdd635b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.162207 Oct 28 20:26:45.782147 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3722/7447] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:45 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:46.806281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:46.806936 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:46.814225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:46.814761 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:46.815248 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:46.815960 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:46.816424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:46.816860 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:46.955038 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:46.963541 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59ab0cc2-d05b-4435-878b-98899bd75253 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.161299 Oct 28 20:26:46.964113 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3726/7448] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:46 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:47.987603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:47.988221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:47.995580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:47.996075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:47.996510 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:47.997201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:47.997654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:47.998075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:48.133644 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:48.142492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-59dfd3ed-9884-44ab-8425-c7af69a26d79 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.159200 Oct 28 20:26:48.143216 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3723/7449] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:47 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:49.171219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:49.172276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:49.180811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:49.181317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:49.181769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:49.182491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:49.183005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:49.183454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:49.332964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:49.341178 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-59b1637c-d1c9-4cf2-8ad7-2b2c67844e55 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.176621 Oct 28 20:26:49.341759 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3727/7450] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:49 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:50.366429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:50.367245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:50.376175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:50.376776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:50.377321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:50.378298 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:50.378815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:50.379256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:50.516646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:50.524621 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ad7fc447-75ca-47ea-9949-975b1109f3ee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1697 microversion: 2.1 time: 0.163176 Oct 28 20:26:50.525236 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3724/7451] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:50 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:51.152483 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "name": "network-vif-unplugged", "status": "completed", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:26:51.163642 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:51.164130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:51.164564 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:51.176827 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] Creating event network-vif-unplugged:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h2-862769-3 Oct 28 20:26:51.182425 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] Instance 29100e01-cb76-4172-8786-2402274ca9f8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120629) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:26:51.194431 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-64241560-be9f-4c4c-a471-b23c555bff2a req-83e4e196-6055-4d54-8267-58e31abcb968 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045817 Oct 28 20:26:51.195294 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3728/7452] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:26:51.549471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:51.550136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:51.557281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:51.557775 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:51.558214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:51.558958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:51.559434 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:51.559862 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:51.825948 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:51.834127 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2491905d-cce4-447b-9de8-5d1d92066cf6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1696 microversion: 2.1 time: 0.288597 Oct 28 20:26:51.834978 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3725/7453] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:51 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:52.864106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:52.864978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:52.872847 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:52.873653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:52.874166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:52.875035 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:52.875594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:52.876111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:53.015586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:53.024171 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c9ec5153-019e-4aa5-abb9-de8b2e71e8c7 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1694 microversion: 2.1 time: 0.168581 Oct 28 20:26:53.024784 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3729/7454] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:52 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:53.239227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:26:53.255409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:53.255903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:53.256315 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:53.268148 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] Creating event network-changed:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h2-862769-3 Oct 28 20:26:53.273534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] Instance 29100e01-cb76-4172-8786-2402274ca9f8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-3', 'n-h1-862769-3'} {{(pid=120628) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 20:26:53.285056 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f87b6876-1365-42fd-8c16-59e7b1a8e3e8 req-fdc7905d-7563-4dc1-b3ce-50325f67a22d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054332 Oct 28 20:26:53.285647 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3726/7455] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:26:54.048887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:54.049504 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:54.057683 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.058192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.058640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.059628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.060122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.060723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.375925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:54.383834 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8a120f0-3d83-43b2-aa21-13b6dfa0fa91 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1691 microversion: 2.1 time: 0.338997 Oct 28 20:26:54.384413 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3730/7456] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:54 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:54.408524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:26:54.409094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:54.415831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.416245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.416672 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.417357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.417806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.418227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.487208 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1a293b99-611e-40de-9ca4-4c9ead5e020e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action" status: 204 len: 0 microversion: 2.1 time: 0.083771 Oct 28 20:26:54.488071 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3727/7457] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:26:54 2022] POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:26:54.496470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:54.497140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:54.504389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.504889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.505336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.506041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.506510 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.506982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.640505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:54.648779 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e2585737-f2f1-4dc5-bf18-617f2bece81c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1691 microversion: 2.1 time: 0.156258 Oct 28 20:26:54.649399 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3731/7458] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:54 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:26:54.672173 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:54.672794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:54.680408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.680906 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.681376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.682075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:54.682532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:54.682976 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:54.825933 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:54.835314 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b01e45f0-d4ec-4e3c-86d9-0f102d6b5cbc tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1691 microversion: 2.1 time: 0.167494 Oct 28 20:26:54.836060 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3728/7459] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:54 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:55.859632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:26:55.860235 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:26:55.866606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:55.867114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:55.867576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:55.868281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:55.868745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:55.869175 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:56.008182 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:26:56.016800 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d960461-3b91-4061-bb0b-e04605fcf19b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1683 microversion: 2.1 time: 0.161474 Oct 28 20:26:56.017415 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3732/7460] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:26:55 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:26:57.069080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9cef712b-e240-43ba-ad6c-4f6097c593b2 req-1f0823b2-9ab0-4255-b5b5-11e65480ebaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "name": "network-vif-plugged", "status": "completed", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:26:57.081953 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9cef712b-e240-43ba-ad6c-4f6097c593b2 req-1f0823b2-9ab0-4255-b5b5-11e65480ebaa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:26:57.082475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9cef712b-e240-43ba-ad6c-4f6097c593b2 req-1f0823b2-9ab0-4255-b5b5-11e65480ebaa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:26:57.083004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9cef712b-e240-43ba-ad6c-4f6097c593b2 req-1f0823b2-9ab0-4255-b5b5-11e65480ebaa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:26:57.095005 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9cef712b-e240-43ba-ad6c-4f6097c593b2 req-1f0823b2-9ab0-4255-b5b5-11e65480ebaa service nova] Creating event network-vif-plugged:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h2-862769-3 Oct 28 20:26:57.100224 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9cef712b-e240-43ba-ad6c-4f6097c593b2 req-1f0823b2-9ab0-4255-b5b5-11e65480ebaa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091421 Oct 28 20:26:57.100923 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3729/7461] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:18.248890 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:18.251173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:18.254202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=32 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:18.254951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:18.261151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:18.261647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:18.262105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:18.262832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:18.263306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:18.263739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:18.318153 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-43d8b56f-dabf-4579-b636-75c743cd575a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action" status: 200 len: 24573 microversion: 2.1 time: 0.073017 Oct 28 20:27:18.318811 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3733/7462] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:27:18 2022] POST /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:27:25.372489 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:25.373221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:25.375872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=28 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:25.376541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:25.377018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b2b04345-fbcb-4d80-a279-0eaea23088d6 req-d09ca625-cd52-4cf9-b8e1-b6f7afe4dbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:25.383097 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.383580 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.384020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.384765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.385221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.385854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.391356 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b2b04345-fbcb-4d80-a279-0eaea23088d6 req-d09ca625-cd52-4cf9-b8e1-b6f7afe4dbe7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.392071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b2b04345-fbcb-4d80-a279-0eaea23088d6 req-d09ca625-cd52-4cf9-b8e1-b6f7afe4dbe7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.393526 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b2b04345-fbcb-4d80-a279-0eaea23088d6 req-d09ca625-cd52-4cf9-b8e1-b6f7afe4dbe7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.404880 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b2b04345-fbcb-4d80-a279-0eaea23088d6 req-d09ca625-cd52-4cf9-b8e1-b6f7afe4dbe7 service nova] Creating event network-changed:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h2-862769-3 Oct 28 20:27:25.410508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b2b04345-fbcb-4d80-a279-0eaea23088d6 req-d09ca625-cd52-4cf9-b8e1-b6f7afe4dbe7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038960 Oct 28 20:27:25.411752 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3734/7463] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:25.415430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:27:25.500399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-44a2fd2a-8aa8-4438-9aca-065262a2a3f6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 204 len: 0 microversion: 2.1 time: 0.131677 Oct 28 20:27:25.502089 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3730/7464] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:27:25 2022] DELETE /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:27:25.512116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:25.512828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:25.519167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.519660 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.520100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.520814 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:25.521271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:25.521700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:25.678997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:25.687611 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d758293-e7c2-4395-b721-31f64d50852f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1689 microversion: 2.1 time: 0.180278 Oct 28 20:27:25.688409 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3735/7465] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:25 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:26.713411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:26.714121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:26.721680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:26.722166 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:26.722596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:26.723322 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:26.723780 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:26.724201 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:26.935610 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:26.944183 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2103ba57-aba0-4dfe-b205-9479f5fb53c2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 200 len: 1689 microversion: 2.1 time: 0.235177 Oct 28 20:27:26.944759 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3731/7466] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:26 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:27.348853 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-9f3c05d9-b0c5-454b-a3ed-64a11b595ca6 req-c1a173b5-059f-4ab2-a740-f4e8e7bfe95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29100e01-cb76-4172-8786-2402274ca9f8", "name": "network-vif-deleted", "tag": "a70e2a85-68a1-49cf-898a-f0eb96b90f39"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:27.359751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9f3c05d9-b0c5-454b-a3ed-64a11b595ca6 req-c1a173b5-059f-4ab2-a740-f4e8e7bfe95b service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:27.360239 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9f3c05d9-b0c5-454b-a3ed-64a11b595ca6 req-c1a173b5-059f-4ab2-a740-f4e8e7bfe95b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:27.360686 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-9f3c05d9-b0c5-454b-a3ed-64a11b595ca6 req-c1a173b5-059f-4ab2-a740-f4e8e7bfe95b service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:27.372609 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-9f3c05d9-b0c5-454b-a3ed-64a11b595ca6 req-c1a173b5-059f-4ab2-a740-f4e8e7bfe95b service nova] Creating event network-vif-deleted:a70e2a85-68a1-49cf-898a-f0eb96b90f39 for instance 29100e01-cb76-4172-8786-2402274ca9f8 on n-h2-862769-3 Oct 28 20:27:27.377531 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-9f3c05d9-b0c5-454b-a3ed-64a11b595ca6 req-c1a173b5-059f-4ab2-a740-f4e8e7bfe95b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Oct 28 20:27:27.378135 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3736/7467] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:27.968972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:27.969563 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 29100e01-cb76-4172-8786-2402274ca9f8] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:27.976659 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:27.977144 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:27.977577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:27.978292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:27.978739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:27.979183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:27.993437 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] HTTP exception thrown: Instance 29100e01-cb76-4172-8786-2402274ca9f8 could not be found. Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Request method failure captured: Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 HTTP/1.1 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDoPOJ8tm2xCkjKneW5T1yKDriFsV7uMfdWAvhtHImPGz4govxQscjur8FjktQNfi8W3Arjw4rXOB1Qx9KrimKDK0d2h0WCtGuEGpCsl9-IkdDRoYVtejUC_pvq4bLcloO41a94QNSW6_iPYxZXDKUE3PqszH9aukVtVpmMefA7W7YY Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4cf68cde9484df89eb9c69ff7205c32", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 5de02b3eb8bd40288f369c2026b5b8fd Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 29100e01-cb76-4172-8786-2402274ca9f8 could not be found. Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '29100e01-cb76-4172-8786-2402274ca9f8'} Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29100e01-cb76-4172-8786-2402274ca9f8 could not be found. Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29100e01-cb76-4172-8786-2402274ca9f8 could not be found. Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:27:27.995621 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29100e01-cb76-4172-8786-2402274ca9f8 could not be found. Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Returning 404 to user: Instance 29100e01-cb76-4172-8786-2402274ca9f8 could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2739ccb7-0a35-45d1-9820-6179d2fa400c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8" status: 404 len: 111 microversion: 2.1 time: 0.032290 Oct 28 20:27:28.000378 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3732/7468] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:27 2022] GET /compute/v2.1/servers/29100e01-cb76-4172-8786-2402274ca9f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:27:31.326105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-83605ef0-e6c5-49a1-b1f5-810552b5135b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '.version_select at 0x7f1d77b781f0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:31.353129 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-83605ef0-e6c5-49a1-b1f5-810552b5135b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1299320525" status: 202 len: 0 microversion: 2.1 time: 0.032694 Oct 28 20:27:31.354248 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3737/7469] 10.222.0.44 () {58 vars in 1284 bytes} [Fri Oct 28 20:27:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1299320525 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:27:31.382061 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-819b9bd0-5766-471e-b65c-db9227e32bb1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: .version_select at 0x7f1d76ab9af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1097946171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNMTnmoJWJdempxgjAj6WTIe6zRXoyn6e2aRLEYtXCFeAwAHkZDbWaYeQWcEiFK+X+rNe69pLdrYmk/qd7NsiSUiBWjiA9VKzpLuj+fimJrvsgasMbQI1dr1FJV46WoUQ=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:31.399493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-819b9bd0-5766-471e-b65c-db9227e32bb1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:27:31.404714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-819b9bd0-5766-471e-b65c-db9227e32bb1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:27:31.431917 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-819b9bd0-5766-471e-b65c-db9227e32bb1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053793 Oct 28 20:27:31.432526 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3733/7470] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:27:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:37.232409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1167415463", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "7765c77e-e69c-47b2-b476-262352094300"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1097946171", "security_groups": [{"name": "tempest-secgroup-smoke-260901649"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:37.341386 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] validate_networks() for [('7765c77e-e69c-47b2-b476-262352094300', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:27:37.366094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=14 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:37.796602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:27:37.799384 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:27:37.799881 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:27:37.800493 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:27:37.800925 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:27:37.810071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:37.810571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:37.811285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:37.812210 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:37.812858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:37.813467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:37.832401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:27:37.839007 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:27:37.854769 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:27:37.857757 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:27:37.914228 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-24e5eecb-3571-4be6-92f9-93fb1276091b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.685806 Oct 28 20:27:37.915399 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3738/7471] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:27:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:27:37.927281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-077721f0-5997-4dcf-b303-84066fae446b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:37.927903 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-077721f0-5997-4dcf-b303-84066fae446b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:37.984458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:38.018486 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-077721f0-5997-4dcf-b303-84066fae446b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:38.026173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-077721f0-5997-4dcf-b303-84066fae446b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1267 microversion: 2.1 time: 0.103171 Oct 28 20:27:38.030557 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3734/7472] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:37 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:39.054823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:39.056262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:39.067832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:39.069088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:39.069800 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:39.070882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:39.071595 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:39.072417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:39.175695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:39.185374 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d50428a5-9c2a-4ed0-90b3-674c31ff53a1 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1327 microversion: 2.1 time: 0.135505 Oct 28 20:27:39.188606 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3739/7473] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:39 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:40.267044 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:40.267724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:40.274675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:40.275341 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:40.275786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:40.276503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:40.276957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:40.277475 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:40.416178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:40.425805 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-538b74e8-8d8f-46f4-bae6-77502bdd20c3 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1392 microversion: 2.1 time: 0.220454 Oct 28 20:27:40.426663 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3735/7474] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:40 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:40.640126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-a26cdad5-ff11-4be0-bd79-51c45d3f3a8b req-a87d411f-7fd8-4fd9-9072-1843f7148a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b830a7-258b-4a13-8782-3c000a3e488f", "tag": "c5a728ee-d144-44c4-a25a-62a252203666"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:40.657168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a26cdad5-ff11-4be0-bd79-51c45d3f3a8b req-a87d411f-7fd8-4fd9-9072-1843f7148a05 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:40.657591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a26cdad5-ff11-4be0-bd79-51c45d3f3a8b req-a87d411f-7fd8-4fd9-9072-1843f7148a05 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:40.658041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-a26cdad5-ff11-4be0-bd79-51c45d3f3a8b req-a87d411f-7fd8-4fd9-9072-1843f7148a05 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:40.679407 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-a26cdad5-ff11-4be0-bd79-51c45d3f3a8b req-a87d411f-7fd8-4fd9-9072-1843f7148a05 service nova] Creating event network-changed:c5a728ee-d144-44c4-a25a-62a252203666 for instance 34b830a7-258b-4a13-8782-3c000a3e488f on n-h1-862769-3 Oct 28 20:27:40.684948 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-a26cdad5-ff11-4be0-bd79-51c45d3f3a8b req-a87d411f-7fd8-4fd9-9072-1843f7148a05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116981 Oct 28 20:27:40.685872 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3740/7475] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:41.449654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:41.450234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:41.457550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:41.458035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:41.458462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:41.459287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:41.459737 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:41.460151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:41.597636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:41.606146 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6ef0f46d-e01a-4ec6-91a4-745713606bc5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1392 microversion: 2.1 time: 0.160474 Oct 28 20:27:41.606785 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3736/7476] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:41 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:42.630381 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:42.631126 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:42.638831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:42.639337 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:42.639786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:42.640520 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:42.640989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:42.642088 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:42.778931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:42.787370 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b70bf44a-9116-46c3-943a-6fe95baac923 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1392 microversion: 2.1 time: 0.161422 Oct 28 20:27:42.787974 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3741/7477] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:42 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:43.813263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:43.813864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:43.820999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:43.821539 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:43.822016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:43.822834 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:43.823342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:43.823815 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:43.979541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:43.987903 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dda6d019-cc09-40d2-a0b3-7cc96e3b1352 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1392 microversion: 2.1 time: 0.179703 Oct 28 20:27:43.988487 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3737/7478] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:43 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:45.013344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:45.014002 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:45.023108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:45.023745 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:45.024302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:45.025190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:45.025777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:45.026330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:45.163276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:45.171460 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fb4301e0-c176-46dc-9b92-df53795458f9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1392 microversion: 2.1 time: 0.163213 Oct 28 20:27:45.172092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3742/7479] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:45 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:45.234194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-c238544d-5709-4a1e-81a6-9113ccc46883 req-d1921e4a-de30-4eca-973b-6173379df9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b830a7-258b-4a13-8782-3c000a3e488f", "name": "network-vif-plugged", "status": "completed", "tag": "c5a728ee-d144-44c4-a25a-62a252203666"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:45.244643 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c238544d-5709-4a1e-81a6-9113ccc46883 req-d1921e4a-de30-4eca-973b-6173379df9df service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:45.245130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c238544d-5709-4a1e-81a6-9113ccc46883 req-d1921e4a-de30-4eca-973b-6173379df9df service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:45.245543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-c238544d-5709-4a1e-81a6-9113ccc46883 req-d1921e4a-de30-4eca-973b-6173379df9df service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:45.257418 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-c238544d-5709-4a1e-81a6-9113ccc46883 req-d1921e4a-de30-4eca-973b-6173379df9df service nova] Creating event network-vif-plugged:c5a728ee-d144-44c4-a25a-62a252203666 for instance 34b830a7-258b-4a13-8782-3c000a3e488f on n-h1-862769-3 Oct 28 20:27:45.262627 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-c238544d-5709-4a1e-81a6-9113ccc46883 req-d1921e4a-de30-4eca-973b-6173379df9df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Oct 28 20:27:45.263780 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3738/7480] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:46.198647 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:46.199787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:46.207312 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:46.207815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:46.208261 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:46.208975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:46.209441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:46.209878 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:46.349317 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:46.360872 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3fc63b4a-f876-461e-8fa4-36435e7e5c87 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1392 microversion: 2.1 time: 0.168684 Oct 28 20:27:46.361626 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3743/7481] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:46 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:47.389850 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:47.390666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:47.398411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:47.399017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:47.399530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:47.400348 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:47.400880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:47.401370 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:47.542193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:47.550289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-09e7881d-2f54-4613-92d4-8353b4c9d909 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1563 microversion: 2.1 time: 0.168273 Oct 28 20:27:47.550931 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3739/7482] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:47 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:47.573250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:47.573931 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:47.581170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:47.581679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:47.582136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:47.582872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:47.583339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:47.583774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:47.721151 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:47.729123 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1ee25242-33e3-4432-ae25-74dba9cf5539 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1563 microversion: 2.1 time: 0.159898 Oct 28 20:27:47.729674 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3744/7483] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:47 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:27:49.383036 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:27:49.383652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:27:49.385713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:49.393160 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:49.393352 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-040ffa15-40e4-4b88-b200-ef88d8cf3959 req-f2da3d3c-ccf3-4332-a748-956f86a2ae91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b830a7-258b-4a13-8782-3c000a3e488f", "tag": "c5a728ee-d144-44c4-a25a-62a252203666"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:27:49.393835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:49.394143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:49.395171 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:49.395656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:49.396077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:49.398302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:49.399017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:49.400678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:27:49.409092 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-040ffa15-40e4-4b88-b200-ef88d8cf3959 req-f2da3d3c-ccf3-4332-a748-956f86a2ae91 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:27:49.409962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-040ffa15-40e4-4b88-b200-ef88d8cf3959 req-f2da3d3c-ccf3-4332-a748-956f86a2ae91 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:27:49.410651 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-040ffa15-40e4-4b88-b200-ef88d8cf3959 req-f2da3d3c-ccf3-4332-a748-956f86a2ae91 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:27:49.422401 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-040ffa15-40e4-4b88-b200-ef88d8cf3959 req-f2da3d3c-ccf3-4332-a748-956f86a2ae91 service nova] Creating event network-changed:c5a728ee-d144-44c4-a25a-62a252203666 for instance 34b830a7-258b-4a13-8782-3c000a3e488f on n-h1-862769-3 Oct 28 20:27:49.427769 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-040ffa15-40e4-4b88-b200-ef88d8cf3959 req-f2da3d3c-ccf3-4332-a748-956f86a2ae91 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038398 Oct 28 20:27:49.428431 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3745/7484] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:27:49.537969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:27:49.546811 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e186a6d2-9891-4e89-844e-0b4ce34e2911 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1563 microversion: 2.1 time: 0.167780 Oct 28 20:27:49.547426 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3740/7485] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:27:49 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:28:12.832932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:12.833714 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:12.838069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:28:12.840518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:12.847532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:12.848023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:12.848472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:12.849164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:12.849628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:12.850087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:12.909263 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5649fd2-922a-470d-b103-1093bf31ed6e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action" status: 200 len: 24545 microversion: 2.1 time: 0.078143 Oct 28 20:28:12.910150 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3746/7486] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:28:12 2022] POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action => generated 24545 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:28:23.843654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fb9380d8-780c-40dc-b496-129ca37dca64 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:28:23.846599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:23.847615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=32 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:23.855742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb9380d8-780c-40dc-b496-129ca37dca64 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:23.856353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb9380d8-780c-40dc-b496-129ca37dca64 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:23.856897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fb9380d8-780c-40dc-b496-129ca37dca64 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:23.884276 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fb9380d8-780c-40dc-b496-129ca37dca64 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Going to try to stop instance {{(pid=120628) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 20:28:23.937722 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fb9380d8-780c-40dc-b496-129ca37dca64 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action" status: 202 len: 0 microversion: 2.1 time: 0.098974 Oct 28 20:28:23.938349 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3741/7487] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:28:23 2022] POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:28:23.947423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:23.948148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:23.951242 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:23.952164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:28:23.958418 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:23.958962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:23.959411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:23.960127 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:23.960592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:23.961024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:24.102150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:24.112230 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-0b452d0a-75fc-47b4-99d9-5e1248a6250e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.169184 Oct 28 20:28:24.112806 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3747/7488] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:23 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:25.146564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:25.147848 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:25.158205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:25.159111 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:25.159840 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:25.161436 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:25.162174 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:25.162907 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:25.299007 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:25.306925 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2445e36b-5cc0-4cb2-b61f-841b6812a61a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.170171 Oct 28 20:28:25.307512 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3742/7489] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:25 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:26.334840 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:26.335850 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:26.347120 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:26.347953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:26.348720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:26.349934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:26.350738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:26.351471 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:26.822978 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:26.834629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c30bce2d-2289-4805-8aaa-6a01d7a77c6b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.506314 Oct 28 20:28:26.835507 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3748/7490] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:26 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:27.864058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:27.864992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:27.876542 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:27.877338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:27.878064 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:27.879253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:27.879996 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:27.880722 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:28.016014 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:28.027909 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-41828bea-33ed-4672-bcd5-4e5cc2a1df37 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.170217 Oct 28 20:28:28.028768 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3743/7491] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:27 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:29.057838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:29.058428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:29.065923 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:29.066420 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:29.066898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:29.067609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:29.068069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:29.068498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:29.204704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:29.212940 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-54f092a1-8713-478a-9804-1ab1574e04a4 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.159056 Oct 28 20:28:29.213649 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3749/7492] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:29 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:30.238357 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:30.239020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:30.246502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:30.247020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:30.247460 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:30.248151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:30.248611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:30.249035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:30.381020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:30.389278 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fc9381d1-a943-4c4b-83c9-635bce93d19c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.155008 Oct 28 20:28:30.389977 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3744/7493] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:30 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:31.417550 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:31.418567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:31.430045 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:31.430922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:31.431670 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:31.432823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:31.433592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:31.434304 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:31.574976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:31.583753 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2040d2d9-42d8-44a4-b9e9-6738adffd474 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.173161 Oct 28 20:28:31.584322 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3750/7494] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:31 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:32.607372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:32.608035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:32.615313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:32.615794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:32.616227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:32.616909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:32.617359 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:32.617781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:32.751474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:32.759802 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1ee8e9d5-26d8-4eef-ba53-d5243d5ffcd5 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.156454 Oct 28 20:28:32.760379 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3745/7495] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:32 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:33.783904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:33.784525 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:33.792200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:33.792693 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:33.793121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:33.793834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:33.794292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:33.794738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:33.932927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:33.941224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-11c1b0b4-6776-40a4-95d5-61d4f5edfe3d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1692 microversion: 2.1 time: 0.161478 Oct 28 20:28:33.941782 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3751/7496] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:33 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:34.973502 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:34.974446 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:34.986527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:34.987403 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:34.988130 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:34.989291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:34.990045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:34.990811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:35.127861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:35.136144 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3750faee-cbe3-43ab-924c-edbfaf45f0fe tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1669 microversion: 2.1 time: 0.169347 Oct 28 20:28:35.136725 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3746/7497] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:34 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:36.243114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:28:36.245371 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:36.254994 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:36.256441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:36.256441 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:36.256794 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:36.257110 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:36.257603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:36.328107 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ffa1d6ee-6b81-46f8-8617-c353cec1fdb2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action" status: 200 len: 38279 microversion: 2.1 time: 0.088798 Oct 28 20:28:36.328770 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3752/7498] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:28:36 2022] POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action => generated 38279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:28:36.342374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d63b6996-a206-436a-9407-9c9df5dfd378 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:28:36.350664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63b6996-a206-436a-9407-9c9df5dfd378 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:36.351256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63b6996-a206-436a-9407-9c9df5dfd378 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:36.351738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d63b6996-a206-436a-9407-9c9df5dfd378 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:36.375472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d63b6996-a206-436a-9407-9c9df5dfd378 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Going to try to start instance {{(pid=120628) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 20:28:36.420236 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d63b6996-a206-436a-9407-9c9df5dfd378 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action" status: 202 len: 0 microversion: 2.1 time: 0.082614 Oct 28 20:28:36.420917 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3747/7499] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:28:36 2022] POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:28:36.430179 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:36.430929 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:36.438397 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:36.439077 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:36.439659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:36.440391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:36.440942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:36.441378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:36.580640 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:36.589326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b77bf530-c823-4411-8ae8-0137a61e3b96 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1678 microversion: 2.1 time: 0.163704 Oct 28 20:28:36.589895 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3753/7500] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:36 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:37.617035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:37.618543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:37.625238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:37.625731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:37.626226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:37.626956 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:37.627409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:37.627835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:37.780615 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:37.792484 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d3588d95-4baf-4d0b-8620-055fd63c2669 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1678 microversion: 2.1 time: 0.180623 Oct 28 20:28:37.793295 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3748/7501] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:37 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:28:38.819102 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:28:38.819764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:28:38.827736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:38.828297 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:38.828803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:38.829589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:28:38.830112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:28:38.830602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:28:38.970475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:28:38.979047 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-342b1af1-e581-4f16-8754-914f5c0a8ed9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1682 microversion: 2.1 time: 0.164401 Oct 28 20:28:38.979634 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3754/7502] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:28:38 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:03.221013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:03.223350 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:03.225973 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=16 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:03.226656 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:03.233680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:03.234169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:03.234598 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:03.235321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:03.235771 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:03.236184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:03.306177 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-4329b595-0fac-42c3-9da9-3da8a1fb480a tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action" status: 200 len: 62841 microversion: 2.1 time: 0.088441 Oct 28 20:29:03.306942 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3749/7503] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:29:03 2022] POST /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f/action => generated 62841 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:29:10.525681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:10.526276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:10.529025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3d6baf47-91cf-4dda-8c28-2f7927eec011 req-d8942c89-15e7-4ee8-adc3-b768a8dbddf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b830a7-258b-4a13-8782-3c000a3e488f", "tag": "c5a728ee-d144-44c4-a25a-62a252203666"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:10.532557 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=16 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:10.533374 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=46 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:10.536717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.537150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.538255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.539258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.539754 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.540010 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:29:10.540010 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:29:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:29:10.540763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.553640 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3d6baf47-91cf-4dda-8c28-2f7927eec011 req-d8942c89-15e7-4ee8-adc3-b768a8dbddf9 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.554114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3d6baf47-91cf-4dda-8c28-2f7927eec011 req-d8942c89-15e7-4ee8-adc3-b768a8dbddf9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.554537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3d6baf47-91cf-4dda-8c28-2f7927eec011 req-d8942c89-15e7-4ee8-adc3-b768a8dbddf9 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.566291 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3d6baf47-91cf-4dda-8c28-2f7927eec011 req-d8942c89-15e7-4ee8-adc3-b768a8dbddf9 service nova] Creating event network-changed:c5a728ee-d144-44c4-a25a-62a252203666 for instance 34b830a7-258b-4a13-8782-3c000a3e488f on n-h1-862769-3 Oct 28 20:29:10.570396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:29:10.572977 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3d6baf47-91cf-4dda-8c28-2f7927eec011 req-d8942c89-15e7-4ee8-adc3-b768a8dbddf9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048959 Oct 28 20:29:10.573493 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3750/7504] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:29:10.659199 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f58d3d64-1af6-4b52-bf34-547391301b0f tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 204 len: 0 microversion: 2.1 time: 0.137833 Oct 28 20:29:10.660023 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3755/7505] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:29:10 2022] DELETE /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:29:10.672923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:10.673633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:10.680042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.680527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.681084 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.682000 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:10.682756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:10.682958 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:10.825860 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:10.833831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-87d7e377-9847-45e8-8868-a807491d2152 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1688 microversion: 2.1 time: 0.166109 Oct 28 20:29:10.834394 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3751/7506] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:10 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:11.858633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:11.859393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:11.867091 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:11.867587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:11.868029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:11.868749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:11.869186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:11.869615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:12.004677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:12.016865 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6a7970ef-dd2e-4f58-bbeb-c3e6346105d8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1688 microversion: 2.1 time: 0.162413 Oct 28 20:29:12.017651 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3756/7507] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:11 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:12.901050 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f66cbd66-3d12-455d-8026-4085539260b3 req-eddffab9-f729-4588-bf0f-bedc28bcbe59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b830a7-258b-4a13-8782-3c000a3e488f", "name": "network-vif-deleted", "tag": "c5a728ee-d144-44c4-a25a-62a252203666"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:12.912168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f66cbd66-3d12-455d-8026-4085539260b3 req-eddffab9-f729-4588-bf0f-bedc28bcbe59 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:12.912637 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f66cbd66-3d12-455d-8026-4085539260b3 req-eddffab9-f729-4588-bf0f-bedc28bcbe59 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:12.913052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f66cbd66-3d12-455d-8026-4085539260b3 req-eddffab9-f729-4588-bf0f-bedc28bcbe59 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:12.924528 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f66cbd66-3d12-455d-8026-4085539260b3 req-eddffab9-f729-4588-bf0f-bedc28bcbe59 service nova] Creating event network-vif-deleted:c5a728ee-d144-44c4-a25a-62a252203666 for instance 34b830a7-258b-4a13-8782-3c000a3e488f on n-h1-862769-3 Oct 28 20:29:12.930004 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f66cbd66-3d12-455d-8026-4085539260b3 req-eddffab9-f729-4588-bf0f-bedc28bcbe59 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Oct 28 20:29:12.931022 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3752/7508] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:29:13.046172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:13.046817 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:13.054229 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:13.054762 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:13.055232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:13.055928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:13.056596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:13.057037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:13.091273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:13.091775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:13.092211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:13.092674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lazy-loading 'fault' on Instance uuid 34b830a7-258b-4a13-8782-3c000a3e488f {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:29:13.135609 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:13.144006 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2046f5cf-0030-43e3-aac5-1aae7f1f065b tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 200 len: 1357 microversion: 2.1 time: 0.101978 Oct 28 20:29:13.144761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3757/7509] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:13 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 1357 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:14.173880 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:14.174938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: 34b830a7-258b-4a13-8782-3c000a3e488f] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:14.186222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:14.186727 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:14.187161 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:14.187846 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:14.188295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:14.188712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:14.202229 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] HTTP exception thrown: Instance 34b830a7-258b-4a13-8782-3c000a3e488f could not be found. Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Request method failure captured: Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f HTTP/1.1 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDoPOJ8tm2xCkjKneW5T1yKDriFsV7uMfdWAvhtHImPGz4govxQscjur8FjktQNfi8W3Arjw4rXOB1Qx9KrimKDK0d2h0WCtGuEGpCsl9-IkdDRoYVtejUC_pvq4bLcloO41a94QNSW6_iPYxZXDKUE3PqszH9aukVtVpmMefA7W7YY Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4cf68cde9484df89eb9c69ff7205c32", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 5de02b3eb8bd40288f369c2026b5b8fd Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 34b830a7-258b-4a13-8782-3c000a3e488f could not be found. Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '34b830a7-258b-4a13-8782-3c000a3e488f'} Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b830a7-258b-4a13-8782-3c000a3e488f could not be found. Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b830a7-258b-4a13-8782-3c000a3e488f could not be found. Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:29:14.203855 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b830a7-258b-4a13-8782-3c000a3e488f could not be found. Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Returning 404 to user: Instance 34b830a7-258b-4a13-8782-3c000a3e488f could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ede204d1-7a96-4724-b011-a117df65d520 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f" status: 404 len: 111 microversion: 2.1 time: 0.039104 Oct 28 20:29:14.209241 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3753/7510] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:14 2022] GET /compute/v2.1/servers/34b830a7-258b-4a13-8782-3c000a3e488f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:29:17.625416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4d14b448-584b-4260-8012-d65b6f9e4984 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '.version_select at 0x7f1d768705e0>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:17.655435 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4d14b448-584b-4260-8012-d65b6f9e4984 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1097946171" status: 202 len: 0 microversion: 2.1 time: 0.034474 Oct 28 20:29:17.660743 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3758/7511] 10.222.0.44 () {58 vars in 1284 bytes} [Fri Oct 28 20:29:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1097946171 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:29:17.687105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a6c10f69-be61-4596-a3f3-c3ed599849ff tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: .version_select at 0x7f1d767c2f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-67516822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpu5NThKY5twTyKvRsuo9JMCnvOeuBCHulE0LqmZSQbgx7rpBD/u0d3iKXvZy0C+27TLgWXXKTtng03cYJaDZ+/jOPBew0SRZKBp6ETuSd/q5JlWwzEbvCqL/HMwVFOTQ=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:17.704914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-a6c10f69-be61-4596-a3f3-c3ed599849ff tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:29:17.711296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-a6c10f69-be61-4596-a3f3-c3ed599849ff tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:29:17.736760 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a6c10f69-be61-4596-a3f3-c3ed599849ff tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053718 Oct 28 20:29:17.737835 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3754/7512] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:29:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:29:23.367308 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:23.372100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-291780099", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "networks": [{"uuid": "a9e3220f-0aa8-415b-91d2-c694514d7864"}], "key_name": "tempest-TestNetworkAdvancedServerOps-67516822", "security_groups": [{"name": "tempest-secgroup-smoke-1510397982"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:23.491001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] validate_networks() for [('a9e3220f-0aa8-415b-91d2-c694514d7864', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:29:23.928977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:29:23.929428 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:29:23.930067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:29:23.930491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:29:23.930948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:29:23.941103 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:23.941666 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:23.942056 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:23.942857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:23.943322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:23.943752 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:23.967250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:29:23.973031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Getting quotas for user 5de02b3eb8bd40288f369c2026b5b8fd and project f4cf68cde9484df89eb9c69ff7205c32. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:29:23.986475 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:29:23.988838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:29:24.037029 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67594f95-ba53-45df-bd5b-3be9c0bf9212 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671191 Oct 28 20:29:24.037829 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3759/7513] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:29:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:29:24.050337 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-35fcd26f-690a-48ac-bb83-e748fbeea4f2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:24.051837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-35fcd26f-690a-48ac-bb83-e748fbeea4f2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:24.110131 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-35fcd26f-690a-48ac-bb83-e748fbeea4f2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:24.119110 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-35fcd26f-690a-48ac-bb83-e748fbeea4f2 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1264 microversion: 2.1 time: 0.073575 Oct 28 20:29:24.119695 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3755/7514] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:24 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1264 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:29:25.145436 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:25.146057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:25.156205 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:25.156708 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:25.157396 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:25.158309 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:25.159156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:25.160976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:25.252540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:25.261523 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4e55af7c-c9e3-46da-8e9e-88f5adffcd47 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1324 microversion: 2.1 time: 0.123243 Oct 28 20:29:25.262167 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3760/7515] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:25 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1324 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:26.289003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:26.290261 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:26.292473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=16 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:26.300562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:26.301062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:26.301501 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:26.302572 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:26.303235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:26.303685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:26.533142 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:26.542775 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-501783ca-6c7d-46ad-8ebe-e5f7edb86272 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1390 microversion: 2.1 time: 0.258038 Oct 28 20:29:26.558571 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3756/7516] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:26 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:26.721661 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-bf16eb68-8b76-4183-ac63-6c07b8815f5f req-164ffe3f-ccfc-4010-b6d1-3ae631d3ddf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd71f12-01f1-4ee9-b764-5da423f5ed2b", "tag": "5d3acd0d-5c26-4efe-be16-b2dc32e67d40"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:26.733290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bf16eb68-8b76-4183-ac63-6c07b8815f5f req-164ffe3f-ccfc-4010-b6d1-3ae631d3ddf2 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:26.733917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bf16eb68-8b76-4183-ac63-6c07b8815f5f req-164ffe3f-ccfc-4010-b6d1-3ae631d3ddf2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:26.734477 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-bf16eb68-8b76-4183-ac63-6c07b8815f5f req-164ffe3f-ccfc-4010-b6d1-3ae631d3ddf2 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:26.750430 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-bf16eb68-8b76-4183-ac63-6c07b8815f5f req-164ffe3f-ccfc-4010-b6d1-3ae631d3ddf2 service nova] Creating event network-changed:5d3acd0d-5c26-4efe-be16-b2dc32e67d40 for instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b on n-h1-862769-3 Oct 28 20:29:26.756393 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-bf16eb68-8b76-4183-ac63-6c07b8815f5f req-164ffe3f-ccfc-4010-b6d1-3ae631d3ddf2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038684 Oct 28 20:29:26.757058 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3761/7517] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:29:27.569292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:27.570287 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:27.581992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:27.582859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:27.583568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:27.584725 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:27.585557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:27.586309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:27.724964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:27.733158 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-15d264b7-2aa3-4dfe-90a2-aebaf25e106c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1390 microversion: 2.1 time: 0.170537 Oct 28 20:29:27.733751 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3757/7518] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:27 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:28.758194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:28.758942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:28.775615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:28.776113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:28.776559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:28.777272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:28.777729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:28.778163 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:29.034673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:29.043642 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4009bec2-eab0-474a-873a-0b6a3d6b6403 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1390 microversion: 2.1 time: 0.290926 Oct 28 20:29:29.044202 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3762/7519] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:28 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1390 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:30.066035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:30.066712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:30.074056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:30.074555 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:30.075031 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:30.075761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:30.076218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:30.076648 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:30.210564 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:30.219091 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b8885062-44cb-494a-8b94-7c276625cc9e tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1390 microversion: 2.1 time: 0.156997 Oct 28 20:29:30.220062 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3758/7520] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:30 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:31.245858 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:31.246917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:31.255545 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:31.256050 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:31.256499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:31.257208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:31.257676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:31.258112 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:31.389790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:31.397928 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e8c75b1a-4a79-43cb-b185-ba7bffcacb3c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1390 microversion: 2.1 time: 0.158880 Oct 28 20:29:31.398476 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3763/7521] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:31 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:31.797898 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-9cb04c24-8fa1-400e-87e2-18a8d09bc09e req-5dc1378a-3bfb-4e40-8f34-6595d937a6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd71f12-01f1-4ee9-b764-5da423f5ed2b", "name": "network-vif-plugged", "status": "completed", "tag": "5d3acd0d-5c26-4efe-be16-b2dc32e67d40"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:31.810435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9cb04c24-8fa1-400e-87e2-18a8d09bc09e req-5dc1378a-3bfb-4e40-8f34-6595d937a6ed service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:31.811263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9cb04c24-8fa1-400e-87e2-18a8d09bc09e req-5dc1378a-3bfb-4e40-8f34-6595d937a6ed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:31.812037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-9cb04c24-8fa1-400e-87e2-18a8d09bc09e req-5dc1378a-3bfb-4e40-8f34-6595d937a6ed service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:31.826102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-9cb04c24-8fa1-400e-87e2-18a8d09bc09e req-5dc1378a-3bfb-4e40-8f34-6595d937a6ed service nova] Creating event network-vif-plugged:5d3acd0d-5c26-4efe-be16-b2dc32e67d40 for instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b on n-h1-862769-3 Oct 28 20:29:31.832067 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-9cb04c24-8fa1-400e-87e2-18a8d09bc09e req-5dc1378a-3bfb-4e40-8f34-6595d937a6ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037965 Oct 28 20:29:31.832067 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3759/7522] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:29:32.424577 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:32.425173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:32.432414 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:32.432869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:32.433348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:32.434017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:32.434613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:32.434959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:32.570921 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:32.578836 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6c319b89-757c-4ffc-a48a-9e97c6ad5568 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1390 microversion: 2.1 time: 0.159511 Oct 28 20:29:32.579430 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3764/7523] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:32 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:33.608069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:33.609200 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:33.612254 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:33.621280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:33.622067 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:33.622824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:33.623954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:33.624750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:33.625308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:33.778735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:33.786970 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2dd45f41-49ba-45bb-895f-e2b13a6e6a9d tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1563 microversion: 2.1 time: 0.187254 Oct 28 20:29:33.787557 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3760/7524] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:33 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:33.811341 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:33.812004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:33.819576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:33.820115 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:33.820568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:33.821268 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:33.821739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:33.822178 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:33.951490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:33.959148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:33.970637 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7bd34a70-3b12-4f25-88ab-7deefa802ce8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1563 microversion: 2.1 time: 0.163898 Oct 28 20:29:33.971448 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3765/7525] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:33 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:35.603924 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:29:35.604665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:35.605868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dabf38a7-d91e-48c3-a877-27b348a31886 req-491fb891-73ee-4412-8639-5288147023e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd71f12-01f1-4ee9-b764-5da423f5ed2b", "tag": "5d3acd0d-5c26-4efe-be16-b2dc32e67d40"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:35.607920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:35.613217 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:35.613420 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:35.613833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:35.614521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:35.615623 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:35.617049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:35.617690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:35.619553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dabf38a7-d91e-48c3-a877-27b348a31886 req-491fb891-73ee-4412-8639-5288147023e7 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:35.620111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dabf38a7-d91e-48c3-a877-27b348a31886 req-491fb891-73ee-4412-8639-5288147023e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:35.620690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dabf38a7-d91e-48c3-a877-27b348a31886 req-491fb891-73ee-4412-8639-5288147023e7 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:35.635466 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dabf38a7-d91e-48c3-a877-27b348a31886 req-491fb891-73ee-4412-8639-5288147023e7 service nova] Creating event network-changed:5d3acd0d-5c26-4efe-be16-b2dc32e67d40 for instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b on n-h1-862769-3 Oct 28 20:29:35.641073 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dabf38a7-d91e-48c3-a877-27b348a31886 req-491fb891-73ee-4412-8639-5288147023e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038902 Oct 28 20:29:35.641814 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3766/7526] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:29:35.841456 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:29:35.849653 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7b4be55a-9713-4f44-b339-36674c7557d6 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1563 microversion: 2.1 time: 0.249613 Oct 28 20:29:35.850204 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3761/7527] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:29:35 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:29:59.172189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:59.173058 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=36 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:29:59.178183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:29:59.180596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:29:59.188582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:59.189107 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:59.189571 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:59.190306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:29:59.190832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:29:59.191287 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:29:59.245343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-773e69bd-af4b-4439-8a45-153d45f58ac0 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action" status: 200 len: 24563 microversion: 2.1 time: 0.075854 Oct 28 20:29:59.246005 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3767/7528] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:29:59 2022] POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action => generated 24563 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:30:10.151353 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:10.152372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:10.155367 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:10.156541 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=32 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:10.165783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:10.166592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:10.167371 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:10.168505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:10.169325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:10.169970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:10.194803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lazy-loading 'flavor' on Instance uuid fcd71f12-01f1-4ee9-b764-5da423f5ed2b {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:30:10.273675 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-826960ca-3ce1-47fb-8d0d-53b453996413 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action" status: 202 len: 0 microversion: 2.1 time: 0.129364 Oct 28 20:30:10.274382 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3762/7529] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:30:10 2022] POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:30:10.284789 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:10.285499 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:10.288783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:10.289465 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:10.295292 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:10.295786 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:10.296224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:10.296933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:10.297391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:10.297827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:10.434842 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:10.443452 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-51b0d37a-bec2-4e66-977a-c91532cf71db tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1690 microversion: 2.1 time: 0.163032 Oct 28 20:30:10.443994 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3768/7530] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:10 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:11.473838 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:11.475114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:11.485302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:11.485717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:11.486151 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:11.486885 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:11.487362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:11.487759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:11.625633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:11.637580 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-58a9b6b8-95e4-4550-a0c8-7a651105c47c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1673 microversion: 2.1 time: 0.172133 Oct 28 20:30:11.638346 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3763/7531] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:11 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:12.742722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:12.745018 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:12.753382 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.753886 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.754331 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.755061 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.755524 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.755961 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.815635 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd4ad1f6-fcd7-41fb-8d96-6db9994bef03 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action" status: 200 len: 37725 microversion: 2.1 time: 0.076696 Oct 28 20:30:12.816400 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3769/7532] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:30:12 2022] POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action => generated 37725 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:30:12.832025 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:12.832676 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:12.839728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.840207 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.840652 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.841342 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.841795 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.842217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.917599 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7d9d1924-5801-4e9f-b034-162d7038c663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action" status: 202 len: 0 microversion: 2.1 time: 0.089229 Oct 28 20:30:12.921809 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3764/7533] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:30:12 2022] POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:30:12.927498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:12.928213 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:12.941838 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.942467 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.942941 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:12.943663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:12.944137 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:12.944559 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:13.174274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:13.182621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-18fdaeef-b1b5-4b5a-840b-3e8728c23a80 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1679 microversion: 2.1 time: 0.259472 Oct 28 20:30:13.183246 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3770/7534] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:12 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:14.216054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:14.217551 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:14.225235 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:14.226039 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:14.226472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:14.227237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:14.228035 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:14.228463 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:14.372874 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:14.381139 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-002c46eb-2258-44c1-bdf7-3622beb6986c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1679 microversion: 2.1 time: 0.174492 Oct 28 20:30:14.381740 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3765/7535] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:14 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:15.409174 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:15.410251 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:15.423016 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:15.423530 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:15.423988 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:15.424707 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:15.425176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:15.425621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:15.561119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:15.569415 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-de7c2786-f2ed-4fd9-b9fd-f8cdf793b6a9 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1682 microversion: 2.1 time: 0.166984 Oct 28 20:30:15.569989 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3771/7536] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:15 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:15.672229 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:15.674438 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:15.681655 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:15.682140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:15.682579 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:15.683312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:15.683773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:15.684194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:15.727693 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-70c33d90-5ea5-4ebc-8d6c-25862d5bb422 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action" status: 200 len: 37725 microversion: 2.1 time: 0.059305 Oct 28 20:30:15.728315 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3766/7537] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:30:15 2022] POST /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b/action => generated 37725 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 20:30:17.029078 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:17.029621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:17.032126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-131619fa-99a3-436c-9dc8-4c7beb1ffa23 req-282c08ba-0ce7-4c6d-9d36-79defeef20d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd71f12-01f1-4ee9-b764-5da423f5ed2b", "tag": "5d3acd0d-5c26-4efe-be16-b2dc32e67d40"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:17.036952 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.038064 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.038515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.039252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.039902 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.040343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.043961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-131619fa-99a3-436c-9dc8-4c7beb1ffa23 req-282c08ba-0ce7-4c6d-9d36-79defeef20d1 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.044459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-131619fa-99a3-436c-9dc8-4c7beb1ffa23 req-282c08ba-0ce7-4c6d-9d36-79defeef20d1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.044879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-131619fa-99a3-436c-9dc8-4c7beb1ffa23 req-282c08ba-0ce7-4c6d-9d36-79defeef20d1 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.057508 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-131619fa-99a3-436c-9dc8-4c7beb1ffa23 req-282c08ba-0ce7-4c6d-9d36-79defeef20d1 service nova] Creating event network-changed:5d3acd0d-5c26-4efe-be16-b2dc32e67d40 for instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b on n-h1-862769-3 Oct 28 20:30:17.063176 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-131619fa-99a3-436c-9dc8-4c7beb1ffa23 req-282c08ba-0ce7-4c6d-9d36-79defeef20d1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035150 Oct 28 20:30:17.064729 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3767/7538] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:30:17.067636 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:30:17.156351 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2e06a756-46f3-42c3-896d-a773381eaf48 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 204 len: 0 microversion: 2.1 time: 0.130971 Oct 28 20:30:17.157606 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3772/7539] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:30:17 2022] DELETE /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:30:17.170751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:17.171534 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:17.178562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.179080 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.179513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.180208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:17.180666 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:17.181076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:17.345180 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:17.353173 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3e4a5d37-7471-43ca-97a3-d4eeae0634f8 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1688 microversion: 2.1 time: 0.190696 Oct 28 20:30:17.353736 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3768/7540] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:17 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:18.382777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:18.384030 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:18.393695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:18.394193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:18.394630 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:18.395370 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:18.395831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:18.396260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:18.530594 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:18.539453 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ae3e413f-f583-4fbf-92a4-d7ad04525018 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1688 microversion: 2.1 time: 0.164041 Oct 28 20:30:18.540016 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3773/7541] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:18 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:19.429415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ad10b1cb-42c0-446c-bc94-ac924cd41146 req-e6028a23-4b1d-4aee-9142-101aa868ca52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd71f12-01f1-4ee9-b764-5da423f5ed2b", "name": "network-vif-deleted", "tag": "5d3acd0d-5c26-4efe-be16-b2dc32e67d40"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:19.440954 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ad10b1cb-42c0-446c-bc94-ac924cd41146 req-e6028a23-4b1d-4aee-9142-101aa868ca52 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:19.441430 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ad10b1cb-42c0-446c-bc94-ac924cd41146 req-e6028a23-4b1d-4aee-9142-101aa868ca52 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:19.441837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ad10b1cb-42c0-446c-bc94-ac924cd41146 req-e6028a23-4b1d-4aee-9142-101aa868ca52 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:19.453924 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ad10b1cb-42c0-446c-bc94-ac924cd41146 req-e6028a23-4b1d-4aee-9142-101aa868ca52 service nova] Creating event network-vif-deleted:5d3acd0d-5c26-4efe-be16-b2dc32e67d40 for instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b on n-h1-862769-3 Oct 28 20:30:19.459117 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ad10b1cb-42c0-446c-bc94-ac924cd41146 req-e6028a23-4b1d-4aee-9142-101aa868ca52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 Oct 28 20:30:19.459708 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3769/7542] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:30:19.563053 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:19.563821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:19.571841 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:19.572333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:19.573001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:19.573726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:19.574497 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:19.575131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:19.609311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:19.609820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:19.610244 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:19.610755 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lazy-loading 'fault' on Instance uuid fcd71f12-01f1-4ee9-b764-5da423f5ed2b {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:30:19.651798 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de02b3eb8bd40288f369c2026b5b8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cf68cde9484df89eb9c69ff7205c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:19.659695 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f7497b8c-be2d-4b6c-b0ca-8cfe78d3855c tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 200 len: 1354 microversion: 2.1 time: 0.100792 Oct 28 20:30:19.660272 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3774/7543] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:19 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 1354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:20.688934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:20.689675 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] [instance: fcd71f12-01f1-4ee9-b764-5da423f5ed2b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:20.697404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:20.697882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:20.698319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:20.699049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:20.699506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:20.699928 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:20.713641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] HTTP exception thrown: Instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b could not be found. Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Request method failure captured: Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b HTTP/1.1 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDoPOJ8tm2xCkjKneW5T1yKDriFsV7uMfdWAvhtHImPGz4govxQscjur8FjktQNfi8W3Arjw4rXOB1Qx9KrimKDK0d2h0WCtGuEGpCsl9-IkdDRoYVtejUC_pvq4bLcloO41a94QNSW6_iPYxZXDKUE3PqszH9aukVtVpmMefA7W7YY Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4cf68cde9484df89eb9c69ff7205c32", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4cf68cde9484df89eb9c69ff7205c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: f4cf68cde9484df89eb9c69ff7205c32 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1573043143 Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 5de02b3eb8bd40288f369c2026b5b8fd Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1573043143-project Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b could not be found. Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': 'fcd71f12-01f1-4ee9-b764-5da423f5ed2b'} Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b could not be found. Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b could not be found. Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:30:20.715294 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b could not be found. Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Returning 404 to user: Instance fcd71f12-01f1-4ee9-b764-5da423f5ed2b could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c8854e08-c41b-4ff7-b9d3-a2e489441fee tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b" status: 404 len: 111 microversion: 2.1 time: 0.034489 Oct 28 20:30:20.721116 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3770/7544] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:20 2022] GET /compute/v2.1/servers/fcd71f12-01f1-4ee9-b764-5da423f5ed2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:30:23.819256 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b4966681-82c6-42a7-aaaa-9694a1085663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] Calling method '.version_select at 0x7f1d7c382f70>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:23.843789 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b4966681-82c6-42a7-aaaa-9694a1085663 tempest-TestNetworkAdvancedServerOps-1573043143 tempest-TestNetworkAdvancedServerOps-1573043143-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-67516822" status: 202 len: 0 microversion: 2.1 time: 0.029042 Oct 28 20:30:23.844492 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3775/7545] 10.222.0.44 () {58 vars in 1278 bytes} [Fri Oct 28 20:30:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-67516822 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:30:34.996004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=18 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:34.997562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:35.193515 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8af045c4-9a64-48ae-be92-8a0236484858 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'create', calling method: .version_select at 0x7f1d767fe040>, body: {"keypair": {"name": "tempest-TestShelveInstance-88590605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkcWkbn738VGox+atU/gLX7Vrwd2XRFMY9WV24z5j6JuOq6n1C7tGNuira1UM1VZXKJzIsGus6nkki5428gR+huI7Evqvw5H1EbXXFQNJ84Omyn+XBTXq8aGMUGSAtoxg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:35.209793 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-8af045c4-9a64-48ae-be92-8a0236484858 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:30:35.216313 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-8af045c4-9a64-48ae-be92-8a0236484858 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for user 68f04cb57e6f40f2857bd515946a2994 and project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:30:35.277649 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8af045c4-9a64-48ae-be92-8a0236484858 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.287446 Oct 28 20:30:35.278293 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3771/7546] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:30:34 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:30:36.295766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:36.296742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:36.301225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-720191259", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-88590605", "security_groups": [{"name": "tempest-secgroup-smoke-675125135"}], "networks": [{"uuid": "51bd948b-fd79-4f3b-9cee-6c69fe39cc21"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:36.413482 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] validate_networks() for [('51bd948b-fd79-4f3b-9cee-6c69fe39cc21', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:30:36.812505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:30:36.813108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:30:36.814468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:30:36.814596 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:30:36.815665 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:30:36.825835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:36.826357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:36.826831 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:36.827561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:36.828021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:36.828508 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:36.845862 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:30:36.851657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for user 68f04cb57e6f40f2857bd515946a2994 and project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:30:36.866837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:30:36.869140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:30:36.918191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cee55ef4-2016-462c-9579-955ee8b1c242 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.624192 Oct 28 20:30:36.918880 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3776/7547] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:30:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:30:36.930704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-0f9c797a-a73c-464d-b72d-dec9ee017a4d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:36.931409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-0f9c797a-a73c-464d-b72d-dec9ee017a4d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:36.991700 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-0f9c797a-a73c-464d-b72d-dec9ee017a4d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:36.998733 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-0f9c797a-a73c-464d-b72d-dec9ee017a4d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1244 microversion: 2.1 time: 0.072182 Oct 28 20:30:36.999332 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3772/7548] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:36 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:38.022408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8f40a130-abe7-4af7-848b-e95d01edc085 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:38.023296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8f40a130-abe7-4af7-848b-e95d01edc085 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:38.085134 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8f40a130-abe7-4af7-848b-e95d01edc085 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:38.092579 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8f40a130-abe7-4af7-848b-e95d01edc085 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1244 microversion: 2.1 time: 0.074988 Oct 28 20:30:38.093250 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3777/7549] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:38 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:39.119939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6818cf6f-9841-42c5-89c2-8a947526922e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:39.120876 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6818cf6f-9841-42c5-89c2-8a947526922e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:39.184761 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6818cf6f-9841-42c5-89c2-8a947526922e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:39.192417 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6818cf6f-9841-42c5-89c2-8a947526922e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1244 microversion: 2.1 time: 0.078669 Oct 28 20:30:39.193193 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3773/7550] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:39 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:40.219958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9a1737ac-d105-4f53-bc5b-094a66cc50a4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:40.220581 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9a1737ac-d105-4f53-bc5b-094a66cc50a4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:40.277459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9a1737ac-d105-4f53-bc5b-094a66cc50a4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:40.285074 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9a1737ac-d105-4f53-bc5b-094a66cc50a4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1244 microversion: 2.1 time: 0.071614 Oct 28 20:30:40.286798 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3778/7551] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:40 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:41.313187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:41.313751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:41.321585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:41.322095 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:41.322543 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:41.323265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:41.323779 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:41.324216 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:41.523429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:41.531392 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e233d33e-1aa5-4da2-9dc0-cda39b85bc01 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1248 microversion: 2.1 time: 0.224840 Oct 28 20:30:41.531976 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3774/7552] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:41 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1248 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:42.556977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:42.557802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:42.566025 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:42.566517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:42.567017 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:42.567871 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:42.568326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:42.568763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:42.706168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:42.714503 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-09579e30-12a5-4fd7-9bbf-d3cce911f841 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1302 microversion: 2.1 time: 0.163530 Oct 28 20:30:42.715239 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3779/7553] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:42 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:43.738033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:43.738680 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:43.746107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:43.746783 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:43.747237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:43.747930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:43.748392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:43.748817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:43.765417 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-4e8d2ec4-d702-4344-855d-4d21237b78f0 req-388479d9-f5cb-4c96-905f-fbf31f83e333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:43.778793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e8d2ec4-d702-4344-855d-4d21237b78f0 req-388479d9-f5cb-4c96-905f-fbf31f83e333 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:43.779454 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e8d2ec4-d702-4344-855d-4d21237b78f0 req-388479d9-f5cb-4c96-905f-fbf31f83e333 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:43.780003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-4e8d2ec4-d702-4344-855d-4d21237b78f0 req-388479d9-f5cb-4c96-905f-fbf31f83e333 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:43.792882 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-4e8d2ec4-d702-4344-855d-4d21237b78f0 req-388479d9-f5cb-4c96-905f-fbf31f83e333 service nova] Creating event network-changed:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h1-862769-3 Oct 28 20:30:43.798674 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-4e8d2ec4-d702-4344-855d-4d21237b78f0 req-388479d9-f5cb-4c96-905f-fbf31f83e333 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037622 Oct 28 20:30:43.799495 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3780/7554] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:30:43.895756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:43.903698 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2f0edbf2-0274-46da-a6e9-12ab953c35c4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.169663 Oct 28 20:30:43.904408 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3775/7555] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:43 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:44.933823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:44.935029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:44.943131 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:44.943626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:44.944071 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:44.944785 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:44.945247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:44.945676 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:45.082554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:45.090812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d31fd331-7e73-48c2-bede-782acfbd5d08 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.165622 Oct 28 20:30:45.091410 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3781/7556] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:44 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:46.115108 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:46.115691 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:46.123183 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:46.123663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:46.124094 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:46.125033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:46.125488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:46.125904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:46.269169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:46.277256 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c1d14a44-ae1f-4156-9f92-34f9e09c2e13 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.166265 Oct 28 20:30:46.277841 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3776/7557] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:46 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:47.304369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:47.305401 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:47.309984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:47.319583 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:47.320411 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:47.321201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:47.322358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:47.323225 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:47.324013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:47.475669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:47.487765 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee2e63da-c748-4aef-9bad-9a21b159bc03 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.190044 Oct 28 20:30:47.488285 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3782/7558] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:47 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:48.510787 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:48.511429 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:48.519062 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:48.519588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:48.520021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:48.520724 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:48.521208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:48.521633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:48.657786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:48.666351 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d2c9dfb4-ee2d-4426-ac33-bd8ba1325c2c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.159553 Oct 28 20:30:48.666946 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3777/7559] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:48 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:49.693568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:49.694540 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:49.706260 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:49.706815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:49.707263 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:49.707970 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:49.708434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:49.708870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:49.853782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:49.861967 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f406242b-a4c1-4cc3-aa3b-a9dd4ac144a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.175047 Oct 28 20:30:49.862642 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3783/7560] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:49 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:50.014748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-3fcbf80e-0c6b-4826-b35f-6153054df9d9 req-4e02eb0c-664f-4776-bd66-9f743b983656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "name": "network-vif-plugged", "status": "completed", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:50.020030 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=8 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:50.027290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3fcbf80e-0c6b-4826-b35f-6153054df9d9 req-4e02eb0c-664f-4776-bd66-9f743b983656 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:50.027776 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3fcbf80e-0c6b-4826-b35f-6153054df9d9 req-4e02eb0c-664f-4776-bd66-9f743b983656 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:50.028280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-3fcbf80e-0c6b-4826-b35f-6153054df9d9 req-4e02eb0c-664f-4776-bd66-9f743b983656 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:50.040328 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-3fcbf80e-0c6b-4826-b35f-6153054df9d9 req-4e02eb0c-664f-4776-bd66-9f743b983656 service nova] Creating event network-vif-plugged:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h1-862769-3 Oct 28 20:30:50.045498 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-3fcbf80e-0c6b-4826-b35f-6153054df9d9 req-4e02eb0c-664f-4776-bd66-9f743b983656 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034714 Oct 28 20:30:50.046070 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3778/7561] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:30:50.889339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:50.890573 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:50.893549 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=10 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:30:50.905111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:50.905934 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:50.906663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:50.907846 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:50.908617 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:50.909325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:51.048593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:51.056897 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6eb024a1-88d8-4168-b2f4-0657890a3ad3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1369 microversion: 2.1 time: 0.174243 Oct 28 20:30:51.057451 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3784/7562] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:50 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:52.085985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:52.086896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:52.095458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:52.096058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:52.096599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:52.097481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:52.098057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:52.098599 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:52.244796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:52.253239 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b6f4945c-bb12-42eb-9f06-3fdaf4855053 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1554 microversion: 2.1 time: 0.175546 Oct 28 20:30:52.253814 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3779/7563] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:52 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:52.275673 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:30:52.276295 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:30:52.283489 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:52.284108 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:52.284554 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:52.285257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:52.285724 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:52.286147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:52.427136 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:30:52.435390 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-79e8cbd4-8f5d-43c5-b841-dc0e63084b88 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1554 microversion: 2.1 time: 0.163619 Oct 28 20:30:52.435961 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3785/7564] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:30:52 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:30:54.110878 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-6fc477b8-f0a1-4cbd-aca0-1bd704f5b558 req-96a16b5c-5733-4b46-bf36-f062a997e45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:30:54.120703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6fc477b8-f0a1-4cbd-aca0-1bd704f5b558 req-96a16b5c-5733-4b46-bf36-f062a997e45e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:30:54.121266 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6fc477b8-f0a1-4cbd-aca0-1bd704f5b558 req-96a16b5c-5733-4b46-bf36-f062a997e45e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:30:54.121748 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-6fc477b8-f0a1-4cbd-aca0-1bd704f5b558 req-96a16b5c-5733-4b46-bf36-f062a997e45e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:30:54.132894 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-6fc477b8-f0a1-4cbd-aca0-1bd704f5b558 req-96a16b5c-5733-4b46-bf36-f062a997e45e service nova] Creating event network-changed:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h1-862769-3 Oct 28 20:30:54.137860 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-6fc477b8-f0a1-4cbd-aca0-1bd704f5b558 req-96a16b5c-5733-4b46-bf36-f062a997e45e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031043 Oct 28 20:30:54.138438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3780/7565] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:32:51.355986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:51.357208 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=40 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:51.358778 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:32:51.359145 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b/action (ip 10.222.0.44) !!! Oct 28 20:32:51.362512 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 20:32:51.363760 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 20:32:51.372310 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:32:51.373216 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:51.382827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:51.383330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:51.383776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:51.384484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:51.384947 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:51.385378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:51.409442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lazy-loading 'flavor' on Instance uuid d379f64d-52c1-43cf-a216-49dfe7d7432b {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:32:51.605972 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d7beb696-b07c-4051-ad19-7922c5b49669 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b/action" status: 202 len: 0 microversion: 2.1 time: 0.253444 Oct 28 20:32:51.606626 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3786/7566] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:32:51 2022] POST /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:32:51.613882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:51.615380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=34 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:32:51.616622 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:32:51.616816 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b (ip 10.222.0.44) !!! Oct 28 20:32:51.624784 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:51.625686 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:51.639107 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:51.639588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:51.640713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:51.641764 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:51.642224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:51.642641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:51.790099 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:51.798319 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c9649774-7553-48fb-9481-bce7a9c36872 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.186644 Oct 28 20:32:51.798929 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3781/7567] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:51 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:52.828330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:52.829491 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:52.842621 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:52.843156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:52.843603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:52.844458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:52.844928 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:52.845362 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:52.983322 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:52.994973 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3c29ec90-0213-4766-8a48-28f53e06c256 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.175143 Oct 28 20:32:52.995721 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3787/7568] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:52 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:54.023252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:54.024194 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:54.036481 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:54.037292 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:54.037972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:54.039218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:54.040309 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:54.041013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:54.186208 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:54.194544 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1c7886ce-0eb0-4108-9e99-1d223cefd2fb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.178267 Oct 28 20:32:54.195179 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3782/7569] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:54 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:55.230070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:55.232398 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:55.244118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:55.244917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:55.245657 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:55.247124 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:55.247899 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:55.248706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:55.391515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:55.403257 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35fd5164-b55b-4052-9bf5-25da380d2bcb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.179731 Oct 28 20:32:55.403956 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3788/7570] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:55 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:56.431048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:56.432053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:56.440843 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:56.441331 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:56.441769 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:56.442494 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:56.442986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:56.443411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:56.585179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:56.593352 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80bcdf08-3868-4649-9056-c9e89c38bc0b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.169021 Oct 28 20:32:56.593927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3783/7571] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:56 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:57.621148 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:57.622114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:57.632410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:57.633233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:57.633975 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:57.635193 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:57.635958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:57.636667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:57.779176 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:57.787590 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c02f6604-5b4e-41f0-9858-88fbcfe72489 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.173569 Oct 28 20:32:57.788169 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3789/7572] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:57 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:32:58.816345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:32:58.817010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:32:58.828239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:58.828888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:58.829503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:58.830595 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:32:58.831140 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:32:58.831728 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:32:58.970805 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:32:58.980209 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd84aee4-21f2-420a-a6f6-1f9643d96eda tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.171020 Oct 28 20:32:58.980967 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3784/7573] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:58 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:00.008361 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:00.009731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:00.019302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:00.019802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:00.020253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:00.020971 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:00.021431 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:00.021869 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:00.161799 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:00.170191 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-49a0f81f-cc74-4926-a49b-2a11dc71993f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.169388 Oct 28 20:33:00.170789 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3790/7574] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:32:59 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:01.197187 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:01.198139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:01.209823 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:01.210630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:01.211406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:01.212556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:01.213325 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:01.214032 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:01.356072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:01.364227 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2794df6e-f7a0-4862-98e7-8070ca0eb0a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.173702 Oct 28 20:33:01.364811 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3785/7575] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:01 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:02.400649 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:02.401857 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:02.411720 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:02.412218 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:02.412663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:02.413363 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:02.413845 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:02.414274 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:02.551340 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:02.559848 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-32f5bec3-02e6-45b8-9142-91ea7ee1839f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1699 microversion: 2.1 time: 0.165486 Oct 28 20:33:02.560173 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3791/7576] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:02 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:03.587175 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:03.588178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:03.599909 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:03.600702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:03.601416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:03.602562 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:03.603362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:03.604059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:03.740137 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:03.748564 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-7827fa46-98f1-483f-89d2-35c135e052f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1699 microversion: 2.1 time: 0.168081 Oct 28 20:33:03.749166 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3786/7577] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:03 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:04.775772 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:04.776404 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:04.785515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:04.786359 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:04.786893 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:04.788277 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:04.790958 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:04.792459 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:04.945466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:04.957806 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d708fce7-d3fe-4192-a1c9-76be64eb356a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.185253 Oct 28 20:33:04.974967 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3792/7578] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:04 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:05.981791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:05.983202 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:05.991153 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:05.992048 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:05.992476 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:05.993366 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:05.993816 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:05.994245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:06.149861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:06.159712 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-20ce6979-1993-41bd-843a-bdfd2bb3b794 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.181890 Oct 28 20:33:06.160295 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3787/7579] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:05 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:06.852234 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b3649d6c-1752-44dd-8211-98796567a26f req-fd5f693e-cb4b-49e2-85ad-b51b90d5c38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "name": "network-vif-plugged", "status": "completed", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:33:06.863979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b3649d6c-1752-44dd-8211-98796567a26f req-fd5f693e-cb4b-49e2-85ad-b51b90d5c38e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:06.864748 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b3649d6c-1752-44dd-8211-98796567a26f req-fd5f693e-cb4b-49e2-85ad-b51b90d5c38e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:06.865190 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b3649d6c-1752-44dd-8211-98796567a26f req-fd5f693e-cb4b-49e2-85ad-b51b90d5c38e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:06.877421 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b3649d6c-1752-44dd-8211-98796567a26f req-fd5f693e-cb4b-49e2-85ad-b51b90d5c38e service nova] Creating event network-vif-plugged:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h1-862769-3 Oct 28 20:33:06.883142 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b3649d6c-1752-44dd-8211-98796567a26f req-fd5f693e-cb4b-49e2-85ad-b51b90d5c38e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115280 Oct 28 20:33:06.883827 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3793/7580] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:33:07.184715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:07.186163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:07.193982 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:07.194938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:07.195964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:07.196990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:07.197532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:07.198117 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:07.359677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:07.371702 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-12fd7727-b340-4be6-aa07-74ff7cb52370 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.190718 Oct 28 20:33:07.384733 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3788/7581] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:07 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:08.398336 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:08.399223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:08.409600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:08.411729 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:08.412206 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:08.412926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:08.413389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:08.413802 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:08.557543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:08.575980 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f8957ac4-b56b-44c8-a383-d3bbedcb9c96 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.181876 Oct 28 20:33:08.592058 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3794/7582] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:08 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:09.600822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:09.602389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:09.610770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:09.611263 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:09.611696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:09.612527 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:09.612986 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:09.613411 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:09.766833 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:09.778011 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2a3b2e5a-21c3-4cb8-8eb0-8e99bc601699 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.181170 Oct 28 20:33:09.779333 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3789/7583] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:09 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:10.802882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:10.803498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:10.814790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:10.815369 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:10.815778 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:10.816501 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:10.816968 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:10.817400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:10.973054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:10.983752 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-98997dce-5f56-455b-a3a8-c9ddaa529956 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.185946 Oct 28 20:33:10.984357 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3795/7584] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:10 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:33:12.008076 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:12.008622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:12.015588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:12.016049 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:12.016508 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:12.017234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:12.017696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:12.018119 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:12.171711 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:12.179783 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b2468d5d-203d-4816-ac75-405d31deed39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.176055 Oct 28 20:33:12.180376 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3790/7585] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:12 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:13.203819 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:13.204717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:13.212692 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:13.213438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:13.214233 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:13.214986 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:13.215455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:13.215882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:13.357189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:13.365794 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8e79c604-e71e-45b4-b3e4-57bdb3dc1424 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1694 microversion: 2.1 time: 0.166028 Oct 28 20:33:13.366382 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3796/7586] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:13 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:14.389927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:14.390632 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:14.397888 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:14.398364 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:14.398826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:14.399520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:14.399965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:14.400750 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:14.864872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:14.872859 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c142e91d-0695-4a91-bceb-91fe79802c39 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1676 microversion: 2.1 time: 0.486918 Oct 28 20:33:14.873438 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3791/7587] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:14 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1676 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:15.900667 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:15.901767 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:15.912790 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:15.913291 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:15.913740 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:15.914452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:15.915258 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:15.915699 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:16.059867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:16.068276 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6e8cf24b-73d8-4626-9378-bda4ee6e2bff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1676 microversion: 2.1 time: 0.174329 Oct 28 20:33:16.068842 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3797/7588] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:15 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:17.092811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:17.093395 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:17.100818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.101305 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.101731 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.102422 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.102910 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.103349 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.237303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:17.245348 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-936e20e5-c2c5-4584-a87a-b6aa2779c59b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1619 microversion: 2.1 time: 0.156756 Oct 28 20:33:17.245930 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3792/7589] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:17 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1619 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:17.267887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:33:17.268553 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:17.275643 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.276146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.276586 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.277290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.277759 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.278222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.326730 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120629) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 20:33:17.399324 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1f0d9a3f-4c55-41c8-a2e6-16b0d7e6b397 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b/action" status: 202 len: 0 microversion: 2.1 time: 0.135338 Oct 28 20:33:17.399859 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3798/7590] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:33:17 2022] POST /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:33:17.408224 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:17.408864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:17.415777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.416272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.416712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.417437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:17.417875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:17.418299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:17.556782 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:17.564699 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-981b0015-1dba-48c0-a9d4-a8e583f7ae97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1627 microversion: 2.1 time: 0.160389 Oct 28 20:33:17.565392 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3793/7591] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:17 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1627 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:18.591195 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:18.591820 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:18.598410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:18.598942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:18.599435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:18.600140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:18.600597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:18.601029 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:18.743444 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:18.752007 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-15770e86-daa8-4d1d-80d4-748c942aff22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.166327 Oct 28 20:33:18.752693 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3799/7592] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:18 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:18.880654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "name": "network-vif-unplugged", "status": "completed", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:33:18.892923 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:18.894529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:18.894989 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:18.907347 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] Creating event network-vif-unplugged:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h2-862769-3 Oct 28 20:33:18.910921 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] [0d302f4d-6df0-4468-84fd-4e298f14bd58] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:33:19.779832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:19.780413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:19.787972 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:19.788485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:19.788927 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:19.790101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:19.790889 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:19.791325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:19.796118 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:19.921397 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] [0d302f4d-6df0-4468-84fd-4e298f14bd58] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42324. Oct 28 20:33:19.926344 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-1bf0d720-dc88-4fec-a621-b94d5652ba28 req-ddbdb8ff-8b20-4fc5-92f9-14701affd673 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.049599 Oct 28 20:33:19.927362 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3794/7593] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:33:19.937469 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:19.945442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-37f0c524-17a6-44ae-ac87-2c864bad6d33 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.169716 Oct 28 20:33:19.946204 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3800/7594] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:19 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:20.057858 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d9cbab13-5f02-4974-87a1-65476f92e2ab req-cc1f5204-9066-44b7-94b2-a1a61d686bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:33:20.068079 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d9cbab13-5f02-4974-87a1-65476f92e2ab req-cc1f5204-9066-44b7-94b2-a1a61d686bc8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:20.068561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d9cbab13-5f02-4974-87a1-65476f92e2ab req-cc1f5204-9066-44b7-94b2-a1a61d686bc8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:20.068994 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d9cbab13-5f02-4974-87a1-65476f92e2ab req-cc1f5204-9066-44b7-94b2-a1a61d686bc8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:20.080570 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d9cbab13-5f02-4974-87a1-65476f92e2ab req-cc1f5204-9066-44b7-94b2-a1a61d686bc8 service nova] Creating event network-changed:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h2-862769-3 Oct 28 20:33:20.085519 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d9cbab13-5f02-4974-87a1-65476f92e2ab req-cc1f5204-9066-44b7-94b2-a1a61d686bc8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094441 Oct 28 20:33:20.086112 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3795/7595] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:33:20.970866 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:20.971565 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:20.980368 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:20.981378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:20.982376 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:20.983669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:20.984531 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:20.985094 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:21.138013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:21.147218 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bdf2543c-792c-4138-9938-0bb6663d2ee8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.180771 Oct 28 20:33:21.161124 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3801/7596] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:20 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:22.172641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:22.173344 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:22.175369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=31 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:22.180870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:22.181365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:22.181797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:22.182500 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:22.182977 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:22.183401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:22.193217 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=83 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:22.339532 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:22.347745 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-404f771b-b9a0-4e21-97b8-528a75369bcf tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.180239 Oct 28 20:33:22.348528 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3796/7597] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:22 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:23.373132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:23.373763 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:23.376703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:33:23.382409 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:23.382953 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:23.383519 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:23.384237 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:23.384700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:23.385119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:23.528677 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:23.536857 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35264ea7-131d-4ba1-84f7-738f035c6747 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.167861 Oct 28 20:33:23.537446 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3802/7598] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:23 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:24.561755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:24.562320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:24.570611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:24.571372 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:24.572045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:24.572552 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:24.573027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:24.573990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:24.727132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:24.735385 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79496562-b865-4e15-953e-5c4a314a265c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.177735 Oct 28 20:33:24.735999 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3797/7599] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:24 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:25.760627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:25.762096 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:25.769882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:25.770399 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:25.770905 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:25.771632 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:25.772098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:25.772521 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:25.927223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:25.936938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cbc75132-fe2f-49e0-8a04-3a11818f68af tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.180984 Oct 28 20:33:25.941628 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3803/7600] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:25 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:26.963255 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:26.963931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:26.971045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:26.971530 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:26.971957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:26.972654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:26.973104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:26.973521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:27.113408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:27.122493 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dbde14c4-d56a-4bf2-86ee-eabf9fee0dd2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.163814 Oct 28 20:33:27.123116 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3798/7601] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:26 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:28.145792 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:28.146589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:28.154211 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:28.154837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:28.155353 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:28.156140 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:28.156593 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:28.157024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:28.312956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:28.321255 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ab161cd4-54a9-4537-af94-0ce3cd7d8d62 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.179458 Oct 28 20:33:28.321841 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3804/7602] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:28 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:29.345225 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:29.345930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:29.353300 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:29.353786 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:29.354218 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:29.354964 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:29.355404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:29.355824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:29.509699 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:29.517802 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c5dd03a2-f1a6-43a1-8389-b36b5dc1418f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.176638 Oct 28 20:33:29.519829 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3799/7603] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:29 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:30.546751 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:30.548492 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:30.561843 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:30.563099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:30.564042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:30.566908 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:30.567701 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:30.568438 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:30.702572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:30.710978 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9b18df6f-bb80-49cc-b6d4-4eddf093283c tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.171518 Oct 28 20:33:30.711580 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3805/7604] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:30 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:31.734221 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:31.734821 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:31.742070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:31.742559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:31.743026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:31.744338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:31.744831 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:31.745256 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:31.879609 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:31.887506 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bd3c54d1-856a-48b8-a703-30ec7066e1b9 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.157290 Oct 28 20:33:31.888123 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3800/7605] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:31 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:32.922433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:32.923194 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:32.934303 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:32.935270 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:32.935723 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:32.936439 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:32.936904 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:32.937338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:33.079515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:33.087877 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-514ff768-8907-46d4-9129-552448d07ed7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.171866 Oct 28 20:33:33.088533 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3806/7606] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:32 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:34.115441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:34.116433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:34.128139 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:34.128932 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:34.129646 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:34.130827 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:34.131567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:34.132262 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:34.272057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:34.282495 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-efa6e637-10dc-4925-a1d7-9ca73bb5e118 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.173729 Oct 28 20:33:34.283106 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3801/7607] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:34 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:34.809569 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5a03ca83-8c65-4041-a4dd-915b41534f59 req-80d12116-4e24-4fa8-b7cf-64a2ad1f25d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "name": "network-vif-plugged", "status": "completed", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:33:34.821981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5a03ca83-8c65-4041-a4dd-915b41534f59 req-80d12116-4e24-4fa8-b7cf-64a2ad1f25d6 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:34.822849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5a03ca83-8c65-4041-a4dd-915b41534f59 req-80d12116-4e24-4fa8-b7cf-64a2ad1f25d6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:34.823305 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5a03ca83-8c65-4041-a4dd-915b41534f59 req-80d12116-4e24-4fa8-b7cf-64a2ad1f25d6 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:34.835058 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5a03ca83-8c65-4041-a4dd-915b41534f59 req-80d12116-4e24-4fa8-b7cf-64a2ad1f25d6 service nova] Creating event network-vif-plugged:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h2-862769-3 Oct 28 20:33:34.840662 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5a03ca83-8c65-4041-a4dd-915b41534f59 req-80d12116-4e24-4fa8-b7cf-64a2ad1f25d6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034846 Oct 28 20:33:34.841766 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3807/7608] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:33:35.310955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:35.311777 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:35.319332 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:35.319820 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:35.320398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:35.320939 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:35.321391 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:35.321806 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:35.468723 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:35.481029 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6495e9cc-685b-4d0a-845d-a661209605c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.176413 Oct 28 20:33:35.481927 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3802/7609] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:35 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:36.509324 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:36.510537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:36.524406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:36.525316 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:36.526059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:36.527273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:36.528013 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:36.528722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:36.667721 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:36.676039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-29937350-d580-4a76-9571-30daffdb2e5b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1685 microversion: 2.1 time: 0.174036 Oct 28 20:33:36.676591 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3808/7610] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:36 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:33:37.703826 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:33:37.704538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:33:37.713004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:37.713567 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:37.714074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:37.714934 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:33:37.715464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:33:37.715955 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:33:37.854205 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:33:37.862580 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-10c6d316-2fd2-4943-92e7-8bf84f203c8d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1672 microversion: 2.1 time: 0.165379 Oct 28 20:33:37.863192 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3803/7611] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:33:37 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:49.535057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=13 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:49.536189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=48 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:49.540072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=15 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:49.541441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=47 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:34:49.543098 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:49.543690 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:49.547735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-0ca06077-c33e-4651-8e87-dd7c57b5bccf req-72081b4b-f771-4e80-9f3d-c92ea0ef3598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:34:49.555157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.555653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.556100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.556829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.557653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.557791 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.559369 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0ca06077-c33e-4651-8e87-dd7c57b5bccf req-72081b4b-f771-4e80-9f3d-c92ea0ef3598 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.559957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0ca06077-c33e-4651-8e87-dd7c57b5bccf req-72081b4b-f771-4e80-9f3d-c92ea0ef3598 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.560824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-0ca06077-c33e-4651-8e87-dd7c57b5bccf req-72081b4b-f771-4e80-9f3d-c92ea0ef3598 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.575026 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-0ca06077-c33e-4651-8e87-dd7c57b5bccf req-72081b4b-f771-4e80-9f3d-c92ea0ef3598 service nova] Creating event network-changed:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h2-862769-3 Oct 28 20:34:49.582381 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-0ca06077-c33e-4651-8e87-dd7c57b5bccf req-72081b4b-f771-4e80-9f3d-c92ea0ef3598 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044612 Oct 28 20:34:49.582381 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3804/7612] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:34:49.587954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:34:49.674938 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5a4c5f7-4bfb-4dd9-9b6d-9ba913bb91d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 204 len: 0 microversion: 2.1 time: 0.141932 Oct 28 20:34:49.679066 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3809/7613] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:34:49 2022] DELETE /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:34:49.685390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:49.686812 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:49.694179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.694665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.695354 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.696226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:49.696842 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:49.697458 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:49.845626 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:49.853663 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-63458ee3-089d-4fbd-912d-65eaed71ed2d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.173026 Oct 28 20:34:49.854245 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3805/7614] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:49 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:50.880052 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:50.880775 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:50.888266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:50.888776 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:50.889227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:50.889938 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:50.890406 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:50.890882 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:51.105306 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:34:51.113381 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-31c21614-a9ac-43ab-b8e3-806a36eb47d6 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 200 len: 1678 microversion: 2.1 time: 0.238437 Oct 28 20:34:51.113977 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3810/7615] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:50 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:34:51.549129 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-d389d20d-aadd-464d-b40e-17c16abd223b req-efc7087a-bedb-40f1-8d74-978a4ac1a5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d379f64d-52c1-43cf-a216-49dfe7d7432b", "name": "network-vif-deleted", "tag": "4fa76453-0817-4d5e-965f-d078053bb911"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:34:51.560320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d389d20d-aadd-464d-b40e-17c16abd223b req-efc7087a-bedb-40f1-8d74-978a4ac1a5de service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:51.560790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d389d20d-aadd-464d-b40e-17c16abd223b req-efc7087a-bedb-40f1-8d74-978a4ac1a5de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:51.561234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-d389d20d-aadd-464d-b40e-17c16abd223b req-efc7087a-bedb-40f1-8d74-978a4ac1a5de service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:51.580223 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-d389d20d-aadd-464d-b40e-17c16abd223b req-efc7087a-bedb-40f1-8d74-978a4ac1a5de service nova] Creating event network-vif-deleted:4fa76453-0817-4d5e-965f-d078053bb911 for instance d379f64d-52c1-43cf-a216-49dfe7d7432b on n-h2-862769-3 Oct 28 20:34:51.586277 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-d389d20d-aadd-464d-b40e-17c16abd223b req-efc7087a-bedb-40f1-8d74-978a4ac1a5de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102728 Oct 28 20:34:51.586906 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3806/7616] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:34:52.141652 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:52.142773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: d379f64d-52c1-43cf-a216-49dfe7d7432b] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:34:52.154378 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:52.155951 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:52.156768 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:52.157965 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:34:52.158756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:34:52.159339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:34:52.173540 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] HTTP exception thrown: Instance d379f64d-52c1-43cf-a216-49dfe7d7432b could not be found. Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Request method failure captured: Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b HTTP/1.1 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXDvmFdM9EDbHOVifLLk6OaFWG2qTZGCTiVY6PnQrE0clK4sXZ6o2MS3UgXgfZ9Tqq-CwR6b0vCVqRYtGTlDKVu2XeK8YfB5O7skWEJZrM0_l2frpGN09KmGuCTcjUAXuAReqZYUNbg0y7oWNSvalf8dNAtefmUaz5v_w6uX2VKb6c4c Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: ef3a28c8e143407e865d6d0aefe16f11 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestShelveInstance-1821599659 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef3a28c8e143407e865d6d0aefe16f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef3a28c8e143407e865d6d0aefe16f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef3a28c8e143407e865d6d0aefe16f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef3a28c8e143407e865d6d0aefe16f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestShelveInstance-1821599659 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: ef3a28c8e143407e865d6d0aefe16f11 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestShelveInstance-1821599659 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestShelveInstance-1821599659-project Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 68f04cb57e6f40f2857bd515946a2994 Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestShelveInstance-1821599659-project Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance d379f64d-52c1-43cf-a216-49dfe7d7432b could not be found. Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'd379f64d-52c1-43cf-a216-49dfe7d7432b'} Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d379f64d-52c1-43cf-a216-49dfe7d7432b could not be found. Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d379f64d-52c1-43cf-a216-49dfe7d7432b could not be found. Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:34:52.175224 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d379f64d-52c1-43cf-a216-49dfe7d7432b could not be found. Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Returning 404 to user: Instance d379f64d-52c1-43cf-a216-49dfe7d7432b could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3fc29f01-6656-496d-8b03-ec13c2d86eaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b" status: 404 len: 111 microversion: 2.1 time: 0.041704 Oct 28 20:34:52.180659 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3811/7617] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:34:52 2022] GET /compute/v2.1/servers/d379f64d-52c1-43cf-a216-49dfe7d7432b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:34:52.360347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c3629fa2-6299-43fa-86b2-3b4d006ff120 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '.version_select at 0x7f1d767fcdc0>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:34:52.382641 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c3629fa2-6299-43fa-86b2-3b4d006ff120 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-88590605" status: 202 len: 0 microversion: 2.1 time: 0.026349 Oct 28 20:34:52.383457 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3807/7618] 10.222.0.44 () {58 vars in 1248 bytes} [Fri Oct 28 20:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-88590605 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:34:52.403423 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e20032e4-f3ab-4f1a-80b1-c305660929c3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'create', calling method: .version_select at 0x7f1d77cc3af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-894769857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrqaEaKJjFpKrTJH4UuNpzobGf/07SQyq/miabnzSdX6aovwBQEn1MMkY/eSaneH5gBioO/xHOPTPjO9EAXQFK98N4W0RWus62hkotby2Kq50i20HdwCHJZ6HAX8p8jqA=="}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:34:52.419023 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e20032e4-f3ab-4f1a-80b1-c305660929c3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:34:52.425059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-e20032e4-f3ab-4f1a-80b1-c305660929c3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for user 68f04cb57e6f40f2857bd515946a2994 and project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'key_pairs'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:34:52.452492 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e20032e4-f3ab-4f1a-80b1-c305660929c3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053128 Oct 28 20:34:52.453087 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3812/7619] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:34:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:08.698577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:08.699433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:08.703810 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1752981970", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-894769857", "security_groups": [{"name": "tempest-secgroup-smoke-936290837"}], "networks": [{"uuid": "51bd948b-fd79-4f3b-9cee-6c69fe39cc21"}], "block_device_mapping_v2": [{"uuid": "de4bfd82-3327-4f46-9b31-6d886b1dc72f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:08.825428 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] validate_networks() for [('51bd948b-fd79-4f3b-9cee-6c69fe39cc21', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:35:09.266705 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:35:09.267390 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:35:09.267875 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:35:09.268273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:35:09.268709 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:35:09.278571 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:09.279086 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:09.279517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:09.280237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:09.280690 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:09.281103 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:09.301010 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:35:09.306249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Getting quotas for user 68f04cb57e6f40f2857bd515946a2994 and project ef3a28c8e143407e865d6d0aefe16f11. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:35:09.367408 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:35:09.370042 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de4bfd82-3327-4f46-9b31-6d886b1dc72f',volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:35:09.523926 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-56683e59-167f-4130-9b1a-41ea2bb9ad91 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.826930 Oct 28 20:35:09.524484 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3808/7620] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:35:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:35:09.537457 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:09.538230 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:09.539054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:09.544926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ca1da604-c2a4-4386-8944-a9c8d6427821 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:09.545756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ca1da604-c2a4-4386-8944-a9c8d6427821 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:09.613057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ca1da604-c2a4-4386-8944-a9c8d6427821 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:09.620798 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ca1da604-c2a4-4386-8944-a9c8d6427821 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1088 microversion: 2.1 time: 0.085395 Oct 28 20:35:09.621379 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3813/7621] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:09 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:10.644979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1f53351e-95db-40ce-8750-427a92fa8dba tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:10.645591 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1f53351e-95db-40ce-8750-427a92fa8dba tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:10.702259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1f53351e-95db-40ce-8750-427a92fa8dba tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:10.709377 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1f53351e-95db-40ce-8750-427a92fa8dba tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1088 microversion: 2.1 time: 0.069173 Oct 28 20:35:10.709928 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3809/7622] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:10 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:11.732189 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-8863de00-e9f8-4c56-8cd0-ab3be48f7f7e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:11.732822 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-8863de00-e9f8-4c56-8cd0-ab3be48f7f7e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:11.788160 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-8863de00-e9f8-4c56-8cd0-ab3be48f7f7e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:11.797127 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-8863de00-e9f8-4c56-8cd0-ab3be48f7f7e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1088 microversion: 2.1 time: 0.068973 Oct 28 20:35:11.797718 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3814/7623] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:11 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:12.824681 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-de0a6956-c7d8-4724-8ddb-12bbc51e1731 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:12.825999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-de0a6956-c7d8-4724-8ddb-12bbc51e1731 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:12.888433 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-de0a6956-c7d8-4724-8ddb-12bbc51e1731 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:12.895663 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-de0a6956-c7d8-4724-8ddb-12bbc51e1731 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1088 microversion: 2.1 time: 0.077892 Oct 28 20:35:12.896519 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3810/7624] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:12 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:13.922434 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:13.923173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:13.931706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:13.932288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:13.932803 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:13.933627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:13.934168 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:13.934668 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:14.004162 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:14.012264 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7d5f422c-2341-4188-825a-fe5f893a9246 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1138 microversion: 2.1 time: 0.095029 Oct 28 20:35:14.012844 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3815/7625] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:13 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:15.037464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:15.038056 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:15.046074 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:15.046561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:15.047016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:15.047912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:15.048447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:15.048859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:15.121070 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:15.132095 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eb4fd281-87a2-450a-8f5c-fe9a2a1376ea tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1204 microversion: 2.1 time: 0.100287 Oct 28 20:35:15.132677 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3811/7626] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:15 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:16.112828 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-cfd83674-88c6-489c-96dd-a209473a2cf8 req-b1a43e43-26e6-49cd-9124-fa71929b1349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:16.127266 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cfd83674-88c6-489c-96dd-a209473a2cf8 req-b1a43e43-26e6-49cd-9124-fa71929b1349 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:16.127922 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cfd83674-88c6-489c-96dd-a209473a2cf8 req-b1a43e43-26e6-49cd-9124-fa71929b1349 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:16.128606 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-cfd83674-88c6-489c-96dd-a209473a2cf8 req-b1a43e43-26e6-49cd-9124-fa71929b1349 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:16.152343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-cfd83674-88c6-489c-96dd-a209473a2cf8 req-b1a43e43-26e6-49cd-9124-fa71929b1349 service nova] Creating event network-changed:0896029f-99b4-47a5-afdd-a1201f695d98 for instance 9405b100-e688-4c1a-a840-707d320f159e on n-h1-862769-3 Oct 28 20:35:16.156058 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:16.156762 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:16.158616 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-cfd83674-88c6-489c-96dd-a209473a2cf8 req-b1a43e43-26e6-49cd-9124-fa71929b1349 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054887 Oct 28 20:35:16.159835 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3816/7627] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:16.164490 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:16.164992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:16.165421 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:16.166735 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:16.167185 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:16.167604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:16.312654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:16.321930 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bfa8c633-6265-4260-a7bd-3f386e4df8de tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1271 microversion: 2.1 time: 0.170024 Oct 28 20:35:16.322627 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3812/7628] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:16 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:17.347325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:17.348700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:17.355070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:17.355567 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:17.356005 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:17.356713 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:17.357172 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:17.357628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:17.494663 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:17.502803 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-71e88d15-5c63-4035-96a4-cc5532c10021 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1271 microversion: 2.1 time: 0.160572 Oct 28 20:35:17.503494 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3817/7629] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:17 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:18.526158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:18.526802 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:18.534314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:18.534832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:18.535267 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:18.535971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:18.536425 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:18.536854 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:18.677577 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:18.686062 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2ba7d2d6-655f-4b58-9732-61a44f0bf056 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1271 microversion: 2.1 time: 0.163878 Oct 28 20:35:18.686644 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3813/7630] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:18 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:19.710099 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:19.710746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:19.719343 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:19.719731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:19.720196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:19.720962 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:19.721364 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:19.721788 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:19.859703 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:19.871629 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2254b157-4bcd-473b-b8bc-9e8a49b3f7a2 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1271 microversion: 2.1 time: 0.165346 Oct 28 20:35:19.872177 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3818/7631] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:19 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:20.898870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:20.899749 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:20.902755 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:20.912619 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:20.913412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:20.914123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:20.915293 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:20.916451 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:20.917154 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:21.064517 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:21.072538 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e775d72d-cfeb-413c-a1aa-c8cef914d441 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.180405 Oct 28 20:35:21.073141 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3814/7632] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:20 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:22.100413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:22.101413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:22.105897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=4 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:22.114957 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:22.115774 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:22.116528 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:22.117685 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:22.118458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:22.119224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:22.256067 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:22.264079 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fdc1a086-ddc9-43f7-a1d1-fd1608b44ff4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.170361 Oct 28 20:35:22.264632 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3819/7633] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:22 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:23.289468 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:23.290250 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:23.294138 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=10 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:35:23.301026 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:23.301671 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:23.302245 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:23.303213 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:23.303813 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:23.304380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:23.448347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:23.460803 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cef2299a-dee9-45f8-95d1-604508964c46 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.176556 Oct 28 20:35:23.461602 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3815/7634] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:23 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:24.488051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:24.488732 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:24.498220 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:24.498942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:24.499537 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:24.500473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:24.501095 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:24.501675 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:24.639653 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:24.647910 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1a76827f-6753-4ebf-ac0a-501e2a46d324 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.165382 Oct 28 20:35:24.648494 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3820/7635] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:24 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:25.675247 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:25.676258 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:25.687459 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:25.688020 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:25.688406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:25.689145 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:25.689649 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:25.690179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:25.829435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:25.837530 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-2328e042-1261-491a-9f4a-a3da9bd7b480 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.168880 Oct 28 20:35:25.838075 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3816/7636] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:25 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:26.862561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:26.863214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:26.869687 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:26.870192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:26.870641 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:26.871372 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:26.871837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:26.872272 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:27.014223 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:27.022621 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-ee64ddbd-a4cd-4777-a8df-5377facd6534 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.164377 Oct 28 20:35:27.023214 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3821/7637] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:26 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:28.052492 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:28.053503 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:28.063704 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:28.064191 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:28.064616 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:28.065302 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:28.065754 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:28.066168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:28.206404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:28.218034 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-133d211c-7655-4b48-a121-2441ef6a7aff tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.172093 Oct 28 20:35:28.219405 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3817/7638] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:28 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:29.242884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:29.243514 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:29.255302 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:29.255849 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:29.256265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:29.257024 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:29.257485 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:29.257959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:29.407896 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:29.417039 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e04d4eae-28b9-4a3d-a83d-f04c507c3a56 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.178020 Oct 28 20:35:29.418275 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3822/7639] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:29 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:30.445147 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:30.446237 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:30.455556 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:30.456037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:30.456472 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:30.457156 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:30.457602 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:30.458021 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:30.590383 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:30.598831 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-eceabfc2-ba28-415b-b075-14967a626750 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.160203 Oct 28 20:35:30.599407 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3818/7640] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:30 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:31.365296 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-601b9fb7-c49e-41d0-b03d-bbe334926781 req-64b0337d-1d88-412b-b1ab-b999974c2268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "name": "network-vif-plugged", "status": "completed", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:31.376749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-601b9fb7-c49e-41d0-b03d-bbe334926781 req-64b0337d-1d88-412b-b1ab-b999974c2268 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:31.377252 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-601b9fb7-c49e-41d0-b03d-bbe334926781 req-64b0337d-1d88-412b-b1ab-b999974c2268 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:31.377695 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-601b9fb7-c49e-41d0-b03d-bbe334926781 req-64b0337d-1d88-412b-b1ab-b999974c2268 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:31.389084 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-601b9fb7-c49e-41d0-b03d-bbe334926781 req-64b0337d-1d88-412b-b1ab-b999974c2268 service nova] Creating event network-vif-plugged:0896029f-99b4-47a5-afdd-a1201f695d98 for instance 9405b100-e688-4c1a-a840-707d320f159e on n-h1-862769-3 Oct 28 20:35:31.394740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-601b9fb7-c49e-41d0-b03d-bbe334926781 req-64b0337d-1d88-412b-b1ab-b999974c2268 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033364 Oct 28 20:35:31.395539 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3823/7641] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:35:31.624828 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:31.625389 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:31.632969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:31.633450 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:31.633882 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:31.634568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:31.635054 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:31.635479 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:31.766179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:31.774879 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-01de6736-0618-4b81-bd47-7a42d0ea433d tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1259 microversion: 2.1 time: 0.155847 Oct 28 20:35:31.775457 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3819/7642] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:31 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:32.804183 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:32.805079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:32.815114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:32.815771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:32.816522 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:32.817633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:32.818132 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:32.818773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:32.969700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:32.978253 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2c70f537-e976-4609-895b-7dbadaa98067 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1443 microversion: 2.1 time: 0.182125 Oct 28 20:35:32.978869 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3824/7643] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:32 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1443 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:33.000808 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:35:33.001381 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:35:33.008535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:33.009015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:33.009440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:33.010123 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:33.010570 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:33.011012 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:33.144447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:35:33.152545 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-79a98363-8279-4c76-9471-d87ace227359 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1443 microversion: 2.1 time: 0.155766 Oct 28 20:35:33.153163 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3820/7644] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:35:32 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:35:34.770576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-f8f368bc-5f62-42df-a9f6-906dadcd6a20 req-999d4f8f-29ab-430a-9853-348e4116661d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:35:34.780856 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f8f368bc-5f62-42df-a9f6-906dadcd6a20 req-999d4f8f-29ab-430a-9853-348e4116661d service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:35:34.781344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f8f368bc-5f62-42df-a9f6-906dadcd6a20 req-999d4f8f-29ab-430a-9853-348e4116661d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:35:34.781782 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-f8f368bc-5f62-42df-a9f6-906dadcd6a20 req-999d4f8f-29ab-430a-9853-348e4116661d service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:35:34.793613 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-f8f368bc-5f62-42df-a9f6-906dadcd6a20 req-999d4f8f-29ab-430a-9853-348e4116661d service nova] Creating event network-changed:0896029f-99b4-47a5-afdd-a1201f695d98 for instance 9405b100-e688-4c1a-a840-707d320f159e on n-h1-862769-3 Oct 28 20:35:34.799066 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-f8f368bc-5f62-42df-a9f6-906dadcd6a20 req-999d4f8f-29ab-430a-9853-348e4116661d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032106 Oct 28 20:35:34.799839 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3825/7645] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:37:32.380454 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b72bd91-391c-4fa9-9ea6-f22b8465edd5] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:37:32.381961 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9c52e5a-70f9-441b-9223-dec5b930acb1] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:37:32.382966 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:32.384152 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=62 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:32.386261 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 20:37:32.386679 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e/action (ip 10.222.0.44) !!! Oct 28 20:37:32.388552 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 20:37:32.388794 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e/action (ip 10.222.0.44) !!! Oct 28 20:37:32.504892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:32.505523 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:32.512589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:32.513105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:32.513553 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:32.514219 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:32.514669 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:32.515120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:32.537393 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lazy-loading 'flavor' on Instance uuid 9405b100-e688-4c1a-a840-707d320f159e {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:37:32.615578 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-8c50531c-ef4e-487f-8ef6-5e40c88b756a tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e/action" status: 202 len: 0 microversion: 2.1 time: 0.238684 Oct 28 20:37:32.616184 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3821/7646] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:37:32 2022] POST /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:37:32.622864 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:37:32.623748 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fc1657b-75c1-488d-b75a-e03b085f7311] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:37:32.625779 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=30 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:32.626551 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=54 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:37:32.628530 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 20:37:32.628686 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e (ip 10.222.0.44) !!! Oct 28 20:37:32.630841 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:37:32.631001 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e (ip 10.222.0.44) !!! Oct 28 20:37:32.641200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:32.642285 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:32.656196 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:32.656829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:32.657416 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:32.658247 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:32.658722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:32.659166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:32.886039 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:32.897358 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-caef1709-1102-4859-96f8-7d8e4f3d18d1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.276501 Oct 28 20:37:32.897941 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3826/7647] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:32 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:37:33.929587 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:33.930329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:33.938528 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:33.939045 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:33.939483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:33.940170 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:33.940639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:33.941055 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:33.946244 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9c52e5a-70f9-441b-9223-dec5b930acb1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42744. Oct 28 20:37:33.947067 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b72bd91-391c-4fa9-9ea6-f22b8465edd5] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42742. Oct 28 20:37:34.140380 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:34.152129 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c0547e14-effb-42ce-bf20-b3d8298cdcc0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.232462 Oct 28 20:37:34.153029 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3822/7648] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:33 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:35.183870 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:35.185164 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:35.201338 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:35.202185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:35.202945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:35.204116 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:35.204977 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:35.205644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:35.214535 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fc1657b-75c1-488d-b75a-e03b085f7311] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42752. Oct 28 20:37:35.215290 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42750. Oct 28 20:37:35.338877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:35.349508 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-35681282-2fcf-4091-b5fb-b777c12e9b66 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.172520 Oct 28 20:37:35.350317 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3827/7649] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:35 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:36.377521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:36.378588 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:36.386483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:36.386999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:36.387574 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:36.388257 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:36.388706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:36.389120 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:36.530029 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:36.538251 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c88f7f8c-26b7-448b-8019-c9f2cb0397b4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.167399 Oct 28 20:37:36.538843 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3823/7650] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:36 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:37.566105 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:37.567615 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:37.579466 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:37.580301 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:37.581146 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:37.582326 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:37.583156 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:37.584330 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:37.727051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:37.735530 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9240ff1e-26cb-4c41-9307-abe98dd091f7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.176126 Oct 28 20:37:37.736115 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3828/7651] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:37 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:38.763017 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:38.764022 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:38.775214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:38.775696 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:38.776125 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:38.776818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:38.777273 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:38.777697 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:39.206745 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:39.218893 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a852fa80-cb82-4af4-ae95-0a4d3ac1abaa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.462488 Oct 28 20:37:39.219695 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3824/7652] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:38 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:40.243186 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:40.243816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:40.251727 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:40.252202 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:40.252738 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:40.253515 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:40.253982 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:40.254452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:40.397603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:40.406056 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-cd255be5-fb55-48fb-aa31-75bbb46e2beb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.166962 Oct 28 20:37:40.406620 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3829/7653] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:40 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:41.433870 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:41.434957 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:41.446622 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:41.447585 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:41.448016 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:41.448715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:41.449179 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:41.449601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:41.591713 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:41.599750 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-faa0afb4-d8a5-4f58-9ea7-b3fc74163a09 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.172627 Oct 28 20:37:41.600296 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3825/7654] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:41 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:42.624538 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:42.625192 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:42.633391 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:42.633907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:42.634377 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:42.635141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:42.635622 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:42.636074 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:42.771887 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:42.780169 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2a0caf0b-1b23-460f-9326-ff7500c556ae tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.159858 Oct 28 20:37:42.780742 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3830/7655] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:42 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:43.808409 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:43.809412 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:43.821239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:43.822043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:43.822633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:43.823360 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:43.823818 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:43.824242 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:43.965488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:43.974005 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-3bb8cc80-82f4-4057-8c19-b861647a849e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.172247 Oct 28 20:37:43.974584 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3826/7656] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:43 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:45.000200 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:45.000942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:45.010278 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:45.010944 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:45.011503 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:45.012383 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:45.012964 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:45.013507 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:45.162197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:45.170759 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-6f65c097-b46b-4ac5-85d1-e9537451a1f8 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.175890 Oct 28 20:37:45.172092 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3831/7657] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:44 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:46.195573 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:46.196197 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:46.203617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:46.204106 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:46.204536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:46.205233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:46.205685 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:46.206105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:46.344654 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:46.352735 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5c8df200-ec43-4dd0-8a1f-51bd4d3ad45e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.161223 Oct 28 20:37:46.353286 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3827/7658] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:46 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:47.377147 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:47.377793 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:47.384731 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:47.385290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:47.385739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:47.386450 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:47.386933 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:47.387387 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:47.518832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:47.527222 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df2799c0-8c30-4cfe-82e3-7d390980a984 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1568 microversion: 2.1 time: 0.154216 Oct 28 20:37:47.527807 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3832/7659] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:47 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:47.550181 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:47.550835 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:47.558113 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:47.558633 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:47.559098 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:47.559839 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:47.560290 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:47.560747 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:47.602641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120628) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 20:37:47.678711 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-535f9f97-d06e-4423-ad2c-0b058036a060 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "POST /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e/action" status: 202 len: 0 microversion: 2.1 time: 0.132375 Oct 28 20:37:47.679585 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3828/7660] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:37:47 2022] POST /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:37:47.687939 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:47.688833 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:47.695059 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:47.695562 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:47.696006 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:47.696704 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:47.697354 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:47.697996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:47.871243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:47.879584 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2f17c0af-eb64-41bb-a055-d8c8b759be1f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1516 microversion: 2.1 time: 0.195731 Oct 28 20:37:47.880277 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3833/7661] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:47 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:48.039234 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-627baef8-63ea-459d-8813-ef4387467935 req-26febb45-f0ca-4b04-a670-b3a2d80c78c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "name": "network-vif-unplugged", "status": "completed", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:37:48.054304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-627baef8-63ea-459d-8813-ef4387467935 req-26febb45-f0ca-4b04-a670-b3a2d80c78c8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:48.055066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-627baef8-63ea-459d-8813-ef4387467935 req-26febb45-f0ca-4b04-a670-b3a2d80c78c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:48.055714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-627baef8-63ea-459d-8813-ef4387467935 req-26febb45-f0ca-4b04-a670-b3a2d80c78c8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:48.066873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.compute.server_external_events [req-627baef8-63ea-459d-8813-ef4387467935 req-26febb45-f0ca-4b04-a670-b3a2d80c78c8 service nova] Unable to find a host for instance 9405b100-e688-4c1a-a840-707d320f159e. Dropping event network-vif-unplugged {{(pid=120628) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 20:37:48.067892 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-627baef8-63ea-459d-8813-ef4387467935 req-26febb45-f0ca-4b04-a670-b3a2d80c78c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032580 Oct 28 20:37:48.068723 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3829/7662] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 20:37:48.903646 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:48.904638 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:48.911983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:48.912470 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:48.912911 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:48.913613 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:48.914073 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:48.914502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:49.062122 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:49.070204 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a7e3b62f-7928-48d0-a28e-be31f21b1450 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1518 microversion: 2.1 time: 0.170637 Oct 28 20:37:49.070884 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3834/7663] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:48 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:50.093961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:50.094559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:50.102004 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:50.102495 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:50.102963 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:50.103665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:50.104121 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:50.104546 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:50.237471 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:50.245772 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-48ce3f1b-3567-46b9-87d2-9261fa7732b3 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1518 microversion: 2.1 time: 0.155773 Oct 28 20:37:50.246440 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3830/7664] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:50 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:51.269627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:51.270546 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:51.278054 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:51.278561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:51.279034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:51.279756 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:51.280222 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:51.280832 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:51.418008 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:51.426130 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dcb97248-8a7f-4feb-ba82-c35e3246a1ab tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1518 microversion: 2.1 time: 0.160618 Oct 28 20:37:51.426953 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3835/7665] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:51 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:52.448971 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:52.449521 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:52.457047 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:52.457535 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:52.457969 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:52.458663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:52.459127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:52.459558 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:52.938319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:52.946303 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b456d496-d57d-4979-8d46-683c650bebc1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1518 microversion: 2.1 time: 0.501455 Oct 28 20:37:52.946908 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3831/7666] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:52 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1518 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:53.970070 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:53.970681 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:53.978003 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:53.978505 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:53.978996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:53.979717 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:53.980185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:53.980624 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:54.113998 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:54.122038 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-67d8658f-08f9-462a-a529-6bd9db0a216e tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.156115 Oct 28 20:37:54.122630 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3836/7667] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:53 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:55.149606 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:55.150568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:55.158790 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:55.159274 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:55.159703 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:55.160398 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:55.160849 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:55.161272 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:55.297738 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:55.306103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-538c9f38-5ff0-4497-a412-ce0eb01f7ccc tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.163134 Oct 28 20:37:55.306659 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3832/7668] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:55 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:56.333706 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:56.334787 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:56.346468 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:56.347351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:56.348084 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:56.349232 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:56.350000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:56.350746 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:56.488999 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:56.501406 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7bcf2214-6da2-425e-9fdc-c74afb532615 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.174047 Oct 28 20:37:56.502151 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3837/7669] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:56 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:57.529240 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:57.529972 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:57.538778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:57.539404 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:57.539943 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:57.540803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:57.541365 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:57.542265 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:57.683143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:57.691911 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ba37ebfc-f299-4abd-addb-760c2a126023 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.169456 Oct 28 20:37:57.692482 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3833/7670] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:57 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:58.719271 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:58.720255 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:58.731728 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:58.732452 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:58.732898 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:58.733589 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:58.734062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:58.734490 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:58.866834 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:37:58.875105 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f2e0a928-cdc1-4055-9047-7c6746e486c1 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.162651 Oct 28 20:37:58.875918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3838/7671] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:58 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:59.902612 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:37:59.903641 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:37:59.912253 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:59.912837 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:59.913347 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:37:59.914165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:37:59.914715 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:37:59.915243 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:00.060536 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:38:00.068624 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-13bbebd4-545e-43d4-b4d5-51e14aea6e97 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.172510 Oct 28 20:38:00.069223 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3834/7672] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:37:59 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:01.094674 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:38:01.095620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:38:01.103106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:01.103597 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:01.104055 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:01.104739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:01.105199 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:01.105626 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:01.243872 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:38:01.251910 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-7c1b9df5-adff-4939-846d-4cf89b50feb0 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.162709 Oct 28 20:38:01.252463 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3839/7673] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:38:01 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:02.280480 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:38:02.281596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:38:02.293452 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:02.294296 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:02.294990 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:02.295693 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:02.296150 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:02.296569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:02.300636 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:02.436879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:38:02.445102 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-698afd8f-a739-4bfe-b3e4-f340af826425 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.171234 Oct 28 20:38:02.445709 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3835/7674] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:38:02 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:03.472173 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:38:03.472996 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:38:03.476480 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=29 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:03.483855 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:03.484502 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:03.485101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:03.486106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:03.486634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:03.487245 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:03.490591 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=85 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:03.627806 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:38:03.636218 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-1bce1e17-0cd5-410d-a375-1b027e5b63fd tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.170557 Oct 28 20:38:03.636795 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3840/7675] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:38:03 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:04.132312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-4d0179f4-91b5-4d1a-ad42-7699066168b3 req-570e04be-389f-4a0a-a28a-79778b8c0ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "name": "network-vif-plugged", "status": "completed", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:38:04.137625 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:38:04.144209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4d0179f4-91b5-4d1a-ad42-7699066168b3 req-570e04be-389f-4a0a-a28a-79778b8c0ffa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:04.145283 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4d0179f4-91b5-4d1a-ad42-7699066168b3 req-570e04be-389f-4a0a-a28a-79778b8c0ffa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:04.145717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-4d0179f4-91b5-4d1a-ad42-7699066168b3 req-570e04be-389f-4a0a-a28a-79778b8c0ffa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:04.157655 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-4d0179f4-91b5-4d1a-ad42-7699066168b3 req-570e04be-389f-4a0a-a28a-79778b8c0ffa service nova] Creating event network-vif-plugged:0896029f-99b4-47a5-afdd-a1201f695d98 for instance 9405b100-e688-4c1a-a840-707d320f159e on n-h1-862769-3 Oct 28 20:38:04.163153 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-4d0179f4-91b5-4d1a-ad42-7699066168b3 req-570e04be-389f-4a0a-a28a-79778b8c0ffa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034716 Oct 28 20:38:04.163781 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3836/7676] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:38:04.664141 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:38:04.665049 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:38:04.676314 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:04.676811 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:04.677253 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:04.677954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:04.678415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:04.678884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:04.818181 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:38:04.826411 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-78991503-2d14-48e5-bb81-159249e79a2f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1574 microversion: 2.1 time: 0.169228 Oct 28 20:38:04.827050 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3841/7677] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:38:04 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:05.856327 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:38:05.857462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:38:05.868437 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:05.869236 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:05.870233 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:05.871308 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:38:05.872127 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:38:05.872974 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:38:06.017554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:38:06.026015 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d7ab21ba-b723-4782-801b-a1a66370a9d7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1561 microversion: 2.1 time: 0.178513 Oct 28 20:38:06.026600 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3837/7678] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:38:05 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:20.532478 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:20.533273 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=11 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:20.534103 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:39:20.534478 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:39:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e (ip 10.222.0.44) !!! Oct 28 20:39:20.541472 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:20.542563 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:20.543402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:20.544203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:20.550821 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.551764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.551764 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.552455 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.552915 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.553344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.582227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Going to try to terminate instance {{(pid=120629) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:39:20.598706 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-bd841dcf-0532-4843-a28b-7c26c61b3b2a req-64cb4d1e-113f-45d3-8ec2-14bc7a7fed86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:20.608576 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bd841dcf-0532-4843-a28b-7c26c61b3b2a req-64cb4d1e-113f-45d3-8ec2-14bc7a7fed86 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.609037 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bd841dcf-0532-4843-a28b-7c26c61b3b2a req-64cb4d1e-113f-45d3-8ec2-14bc7a7fed86 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.609474 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-bd841dcf-0532-4843-a28b-7c26c61b3b2a req-64cb4d1e-113f-45d3-8ec2-14bc7a7fed86 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.622188 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-bd841dcf-0532-4843-a28b-7c26c61b3b2a req-64cb4d1e-113f-45d3-8ec2-14bc7a7fed86 service nova] Creating event network-changed:0896029f-99b4-47a5-afdd-a1201f695d98 for instance 9405b100-e688-4c1a-a840-707d320f159e on n-h1-862769-3 Oct 28 20:39:20.628072 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-bd841dcf-0532-4843-a28b-7c26c61b3b2a req-64cb4d1e-113f-45d3-8ec2-14bc7a7fed86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094163 Oct 28 20:39:20.629300 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3838/7679] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:39:20.676780 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-db7940f2-7533-49ef-8066-cede8b175d9b tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 204 len: 0 microversion: 2.1 time: 0.145470 Oct 28 20:39:20.677682 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3842/7680] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:39:20 2022] DELETE /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:20.693334 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:20.695057 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:20.704662 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.705169 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.706033 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.707090 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:20.707859 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:20.708487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:20.848589 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:20.857076 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e16b7fc7-d071-441f-a18d-e2b78dc76c22 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.172960 Oct 28 20:39:20.857638 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3839/7681] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:20 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:21.881276 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:21.882185 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:21.889422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:21.889917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:21.890360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:21.891114 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:21.891620 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:21.892080 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:22.027548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:22.036101 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-b68082ae-8e9d-4050-bf93-9a65be8f0161 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1567 microversion: 2.1 time: 0.159199 Oct 28 20:39:22.036695 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3843/7682] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:21 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:22.889141 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-7d018234-0cb9-425c-87a2-c463cf15b683 req-58287dbb-acde-4d31-869c-d665a0905a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9405b100-e688-4c1a-a840-707d320f159e", "name": "network-vif-deleted", "tag": "0896029f-99b4-47a5-afdd-a1201f695d98"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:22.903195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7d018234-0cb9-425c-87a2-c463cf15b683 req-58287dbb-acde-4d31-869c-d665a0905a00 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:22.903791 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7d018234-0cb9-425c-87a2-c463cf15b683 req-58287dbb-acde-4d31-869c-d665a0905a00 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:22.904363 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-7d018234-0cb9-425c-87a2-c463cf15b683 req-58287dbb-acde-4d31-869c-d665a0905a00 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:22.916686 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-7d018234-0cb9-425c-87a2-c463cf15b683 req-58287dbb-acde-4d31-869c-d665a0905a00 service nova] Creating event network-vif-deleted:0896029f-99b4-47a5-afdd-a1201f695d98 for instance 9405b100-e688-4c1a-a840-707d320f159e on n-h1-862769-3 Oct 28 20:39:22.922424 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-7d018234-0cb9-425c-87a2-c463cf15b683 req-58287dbb-acde-4d31-869c-d665a0905a00 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037037 Oct 28 20:39:22.923071 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3840/7683] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:23.060300 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:23.060868 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:23.068041 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.068543 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.069000 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.069700 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:23.070157 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:23.070576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:23.146678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:23.155770 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dcaa035b-9d03-4bee-b61a-d037808867f4 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1219 microversion: 2.1 time: 0.099517 Oct 28 20:39:23.156939 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3844/7684] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:23 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:24.181231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:24.181899 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:24.188797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:24.189286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:24.189716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:24.190406 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:24.190896 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:24.191320 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:24.261836 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:24.270131 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-c192f2cf-f9a7-4859-9cc5-5f495f01f417 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1219 microversion: 2.1 time: 0.094077 Oct 28 20:39:24.270665 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3841/7685] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:24 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:25.293753 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:25.294348 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:25.301926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:25.302435 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:25.302914 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:25.303637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:25.304100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:25.304529 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:25.370057 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:25.378229 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3d34a939-2bdd-4be6-b762-f667fab9646f tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1219 microversion: 2.1 time: 0.089018 Oct 28 20:39:25.378949 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3845/7686] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:25 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:26.401303 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:26.401873 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:26.409259 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:26.409752 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:26.410168 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:26.410938 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:26.411402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:26.411832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:26.477163 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:26.485833 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-fa516913-5374-4fc4-9258-de9ffcc25eeb tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1219 microversion: 2.1 time: 0.088740 Oct 28 20:39:26.486470 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3842/7687] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:26 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:27.508664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:27.509250 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:27.516605 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:27.517089 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:27.517602 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:27.518473 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:27.518984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:27.519407 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:27.552932 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:27.553442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:27.553892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:27.554357 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.objects.instance [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lazy-loading 'fault' on Instance uuid 9405b100-e688-4c1a-a840-707d320f159e {{(pid=120629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:39:27.599560 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f04cb57e6f40f2857bd515946a2994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3a28c8e143407e865d6d0aefe16f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:27.608321 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-d299cdc6-20ff-413f-ae4b-8055445211b7 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 200 len: 1224 microversion: 2.1 time: 0.103527 Oct 28 20:39:27.608918 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3846/7688] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:27 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:28.632493 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:28.633043 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] [instance: 9405b100-e688-4c1a-a840-707d320f159e] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:28.640660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:28.641447 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:28.642027 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:28.642904 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:28.643435 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:28.643920 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:28.661388 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.wsgi [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] HTTP exception thrown: Instance 9405b100-e688-4c1a-a840-707d320f159e could not be found. Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Request method failure captured: Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: request: GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e HTTP/1.1 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Accept: application/json Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Accept-Encoding: identity Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Connection: close Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Content-Length: 0 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Content-Type: application/json Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Host: 10.222.0.44 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: Openstack-System-Scope: None Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: User-Agent: python-urllib3/1.26.12 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Auth-Token: gAAAAABjXDvmFdM9EDbHOVifLLk6OaFWG2qTZGCTiVY6PnQrE0clK4sXZ6o2MS3UgXgfZ9Tqq-CwR6b0vCVqRYtGTlDKVu2XeK8YfB5O7skWEJZrM0_l2frpGN09KmGuCTcjUAXuAReqZYUNbg0y7oWNSvalf8dNAtefmUaz5v_w6uX2VKb6c4c Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Id: None Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Domain-Name: None Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Identity-Status: Confirmed Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Is-Admin-Project: True Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Id: default Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Domain-Name: Default Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Id: ef3a28c8e143407e865d6d0aefe16f11 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Project-Name: tempest-TestShelveInstance-1821599659 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Role: member,reader Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Roles: member,reader Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef3a28c8e143407e865d6d0aefe16f11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef3a28c8e143407e865d6d0aefe16f11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef3a28c8e143407e865d6d0aefe16f11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef3a28c8e143407e865d6d0aefe16f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant: tempest-TestShelveInstance-1821599659 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Id: ef3a28c8e143407e865d6d0aefe16f11 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-Tenant-Name: tempest-TestShelveInstance-1821599659 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-User: tempest-TestShelveInstance-1821599659-project Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Id: default Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Domain-Name: Default Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Id: 68f04cb57e6f40f2857bd515946a2994 Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: X-User-Name: tempest-TestShelveInstance-1821599659-project Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: method: > Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: exception: Instance 9405b100-e688-4c1a-a840-707d320f159e could not be found. Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: action_args: {'id': '9405b100-e688-4c1a-a840-707d320f159e'} Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9405b100-e688-4c1a-a840-707d320f159e could not be found. Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9405b100-e688-4c1a-a840-707d320f159e could not be found. Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:39:28.663136 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9405b100-e688-4c1a-a840-707d320f159e could not be found. Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: ERROR nova.api.openstack.wsgi Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Returning 404 to user: Instance 9405b100-e688-4c1a-a840-707d320f159e could not be found. {{(pid=120628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-251e0145-0674-44fb-af3d-d86f56b19faa tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e" status: 404 len: 111 microversion: 2.1 time: 0.036330 Oct 28 20:39:28.668872 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3843/7689] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:28 2022] GET /compute/v2.1/servers/9405b100-e688-4c1a-a840-707d320f159e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:39:28.831082 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-df88bb73-0d03-4784-80f0-d87289b17519 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] Calling method '.version_select at 0x7f1d7464eb80>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:28.862078 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-df88bb73-0d03-4784-80f0-d87289b17519 tempest-TestShelveInstance-1821599659 tempest-TestShelveInstance-1821599659-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-894769857" status: 202 len: 0 microversion: 2.1 time: 0.034748 Oct 28 20:39:28.866618 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3847/7690] 10.222.0.44 () {58 vars in 1251 bytes} [Fri Oct 28 20:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-894769857 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 20:39:46.020104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=12 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:46.021052 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=24 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:46.188013 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-9f37e159-39df-45ba-813a-4fc27ff4ef2c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Action: 'create', calling method: .version_select at 0x7f1d769a7af0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1343395009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlvfzjiPknx6M5DVvGEI5YzTnQl3qwsxTbAxeg6Pg4nJKcsyQgpko30S+Gu4gHysBLazo33ctoRUTZogsqERDNjKLoqrKqoDNLEzFCOi2X06wavQrXCD90dgotfffQnKg=="}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:46.204211 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9f37e159-39df-45ba-813a-4fc27ff4ef2c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Getting quotas for project 434cd628b0e44b61bd1a90020366176a. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:39:46.209590 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-9f37e159-39df-45ba-813a-4fc27ff4ef2c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Getting quotas for user 1b7b3e315580430aadd2a2c916d77099 and project 434cd628b0e44b61bd1a90020366176a. Resources: {'key_pairs'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:39:46.246728 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-9f37e159-39df-45ba-813a-4fc27ff4ef2c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.231545 Oct 28 20:39:46.247266 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3844/7691] 10.222.0.44 () {60 vars in 1159 bytes} [Fri Oct 28 20:39:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:47.319171 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:47.319919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:47.324736 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-385388385", "imageRef": "d275f742-67cf-44be-b2bb-1596dfea8f48", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1343395009", "security_groups": [{"name": "tempest-secgroup-smoke-833379604"}], "networks": [{"uuid": "af17cb4c-045d-4521-a79c-1c8aac44b187"}]}} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:47.436919 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.network.neutron [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] validate_networks() for [('af17cb4c-045d-4521-a79c-1c8aac44b187', None, None, None, None, None)] {{(pid=120629) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:39:47.935415 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Flavor limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:39:47.935852 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Image limits 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:39:47.936360 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Flavor pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:39:47.936816 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Image pref 0:0:0 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:39:47.937427 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.virt.hardware [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:39:47.947227 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:47.947742 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:47.948187 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:47.948926 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:47.949393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:47.949829 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:47.972100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Getting quotas for project 434cd628b0e44b61bd1a90020366176a. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:39:47.977824 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.quota [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Getting quotas for user 1b7b3e315580430aadd2a2c916d77099 and project 434cd628b0e44b61bd1a90020366176a. Resources: {'cores', 'instances', 'ram'} {{(pid=120629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:39:47.991722 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Going to run 1 instances... {{(pid=120629) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:39:47.994086 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d275f742-67cf-44be-b2bb-1596dfea8f48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:39:48.045635 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-74e2d2b1-5ddb-41b8-9b54-58946c9b285c tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.728420 Oct 28 20:39:48.046310 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3848/7692] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:39:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:39:48.058716 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-1322e3e3-7af5-4b56-b658-617545b86535 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:48.059324 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-1322e3e3-7af5-4b56-b658-617545b86535 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:48.115596 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-1322e3e3-7af5-4b56-b658-617545b86535 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:48.125354 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-1322e3e3-7af5-4b56-b658-617545b86535 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1248 microversion: 2.1 time: 0.071365 Oct 28 20:39:48.126904 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3845/7693] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:48 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:49.150166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:49.152150 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:49.168877 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:49.169403 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:49.169980 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:49.170777 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:49.171262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:49.171696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:49.264854 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:49.275812 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-dd13ec8e-33f4-4e90-b98b-187d254ca703 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1300 microversion: 2.1 time: 0.130021 Oct 28 20:39:49.276534 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3849/7694] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:49 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:50.299730 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:50.300584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:50.307601 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:50.308091 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:50.308518 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:50.309214 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:50.309664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:50.310085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:50.510797 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:50.519269 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-a9e902ea-c42b-427b-a8d9-36067ecb9233 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.223718 Oct 28 20:39:50.519858 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3846/7695] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:50 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:50.915393 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-52381ac4-7cd3-4988-8972-7a63c04916e4 req-78d05b98-91eb-4859-bd24-a0ed834b44a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:50.926355 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-52381ac4-7cd3-4988-8972-7a63c04916e4 req-78d05b98-91eb-4859-bd24-a0ed834b44a8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:50.926880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-52381ac4-7cd3-4988-8972-7a63c04916e4 req-78d05b98-91eb-4859-bd24-a0ed834b44a8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:50.927319 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-52381ac4-7cd3-4988-8972-7a63c04916e4 req-78d05b98-91eb-4859-bd24-a0ed834b44a8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:50.939573 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-52381ac4-7cd3-4988-8972-7a63c04916e4 req-78d05b98-91eb-4859-bd24-a0ed834b44a8 service nova] Creating event network-changed:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:39:50.944899 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-52381ac4-7cd3-4988-8972-7a63c04916e4 req-78d05b98-91eb-4859-bd24-a0ed834b44a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130476 Oct 28 20:39:50.946365 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3850/7696] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:51.543392 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:51.544041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:51.551362 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:51.551851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:51.552286 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:51.552985 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:51.553440 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:51.553864 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:51.705249 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:51.713399 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6a4e8d07-62b1-46b5-a9b1-b11cd2a6324f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.174523 Oct 28 20:39:51.714012 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3847/7697] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:51 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:52.736333 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:52.737043 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:52.744451 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:52.744948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:52.745394 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:52.746101 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:52.746884 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:52.747281 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:52.966069 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:52.974363 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-e5f322e1-7ac4-4fd3-8c84-66bdd1f38fbe tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.242435 Oct 28 20:39:52.975338 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3851/7698] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:52 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:54.002284 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:54.003299 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:54.014781 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:54.015603 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:54.016277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:54.016979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:54.017441 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:54.017877 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:54.151126 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:54.159201 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7488144-b9b2-435b-8852-f2526d6fdf32 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.163670 Oct 28 20:39:54.159776 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3848/7699] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:53 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:55.182709 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:55.184001 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:55.191486 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:55.192104 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:55.192548 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:55.193262 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:55.193726 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:55.194161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:55.330983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:55.339263 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-4bc63fa4-bc4e-48d9-86fc-f67f21b05db5 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.160657 Oct 28 20:39:55.339848 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3852/7700] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:55 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:56.364832 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:56.365593 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:56.374664 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:56.375310 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:56.375822 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:56.376773 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:56.377343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:56.377866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:56.516965 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:56.525222 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-aad17796-783b-4237-b2c4-c2a36c04aa7d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.165791 Oct 28 20:39:56.525823 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3849/7701] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:56 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:56.751556 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-b08513ab-0bee-4160-94e9-067f78ec716b req-44b3f927-f45c-48f3-95ad-b2932b1be936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "name": "network-vif-plugged", "status": "completed", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:39:56.761484 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b08513ab-0bee-4160-94e9-067f78ec716b req-44b3f927-f45c-48f3-95ad-b2932b1be936 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:56.761981 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b08513ab-0bee-4160-94e9-067f78ec716b req-44b3f927-f45c-48f3-95ad-b2932b1be936 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:56.762421 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-b08513ab-0bee-4160-94e9-067f78ec716b req-44b3f927-f45c-48f3-95ad-b2932b1be936 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:56.774185 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-b08513ab-0bee-4160-94e9-067f78ec716b req-44b3f927-f45c-48f3-95ad-b2932b1be936 service nova] Creating event network-vif-plugged:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:39:56.779278 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-b08513ab-0bee-4160-94e9-067f78ec716b req-44b3f927-f45c-48f3-95ad-b2932b1be936 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086596 Oct 28 20:39:56.779878 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3853/7702] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:39:57.552742 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:57.553768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:57.565059 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:57.565549 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:57.565979 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:57.566677 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:57.567158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:57.567584 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:57.703374 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:57.711427 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6945ccce-d2d6-4d13-9d99-b2fba7091812 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1373 microversion: 2.1 time: 0.165760 Oct 28 20:39:57.711986 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3850/7703] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:57 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:58.736037 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:58.737021 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=6 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:58.743079 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:58.744014 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:58.752954 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:58.753442 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:58.753880 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:58.754572 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:58.755068 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:58.755496 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:58.893739 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:58.905442 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-41c38997-a070-47c6-aa50-471a582cbd83 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1558 microversion: 2.1 time: 0.172714 Oct 28 20:39:58.906176 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3854/7704] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:58 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:58.928970 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:39:58.929592 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:39:58.931559 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:39:58.937708 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:58.938193 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:58.938630 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:58.939402 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:39:58.939863 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:39:58.940314 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:39:59.085817 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:39:59.094492 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d75932b0-2a68-471a-88f7-56f4e3ce902d tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1558 microversion: 2.1 time: 0.169441 Oct 28 20:39:59.095060 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3851/7705] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:39:58 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:40:00.753111 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-dd4b22d1-d68f-43c7-b687-efe7c9e0ed30 req-7ffe2cb5-c0cc-4d1c-a416-67c49b13c14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:40:00.763358 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dd4b22d1-d68f-43c7-b687-efe7c9e0ed30 req-7ffe2cb5-c0cc-4d1c-a416-67c49b13c14e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:40:00.763863 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dd4b22d1-d68f-43c7-b687-efe7c9e0ed30 req-7ffe2cb5-c0cc-4d1c-a416-67c49b13c14e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:40:00.764644 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-dd4b22d1-d68f-43c7-b687-efe7c9e0ed30 req-7ffe2cb5-c0cc-4d1c-a416-67c49b13c14e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:40:00.775895 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-dd4b22d1-d68f-43c7-b687-efe7c9e0ed30 req-7ffe2cb5-c0cc-4d1c-a416-67c49b13c14e service nova] Creating event network-changed:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:40:00.781432 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-dd4b22d1-d68f-43c7-b687-efe7c9e0ed30 req-7ffe2cb5-c0cc-4d1c-a416-67c49b13c14e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031975 Oct 28 20:40:00.782117 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3855/7706] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:41:58.119368 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b72bd91-391c-4fa9-9ea6-f22b8465edd5] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:41:58.120874 n-d-862769-3 devstack@n-api.service[120628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9c52e5a-70f9-441b-9223-dec5b930acb1] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 20:41:58.122252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:58.123557 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=36 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:41:58.125095 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:41:58.125371 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208/action (ip 10.222.0.44) !!! Oct 28 20:41:58.129070 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 20:41:58.129568 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208/action (ip 10.222.0.44) !!! Oct 28 20:41:58.139639 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2083017771"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:41:58.142069 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:41:58.152226 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:58.152698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:58.153209 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:58.153900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:41:58.154343 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:41:58.154794 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:41:58.361888 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-6f3476b4-e837-495e-81bf-748de55b34e8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "POST /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208/action" status: 202 len: 0 microversion: 2.1 time: 0.245656 Oct 28 20:41:58.362543 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3852/7707] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:41:58 2022] POST /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 20:42:05.237608 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fc1657b-75c1-488d-b75a-e03b085f7311] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:42:05.239543 n-d-862769-3 devstack@n-api.service[120629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 20:42:05.240254 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:05.241040 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=32 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:05.242877 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 20:42:05.243995 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:42:05.262167 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-87f59819-2a8f-44e4-88d2-04a9d8997660 req-2320daee-b4be-4d49-bf92-5c79ef51454c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "name": "network-vif-plugged", "status": "completed", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:42:05.280576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-87f59819-2a8f-44e4-88d2-04a9d8997660 req-2320daee-b4be-4d49-bf92-5c79ef51454c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:05.281389 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-87f59819-2a8f-44e4-88d2-04a9d8997660 req-2320daee-b4be-4d49-bf92-5c79ef51454c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:05.282028 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-87f59819-2a8f-44e4-88d2-04a9d8997660 req-2320daee-b4be-4d49-bf92-5c79ef51454c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:05.296267 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-87f59819-2a8f-44e4-88d2-04a9d8997660 req-2320daee-b4be-4d49-bf92-5c79ef51454c service nova] Creating event network-vif-plugged:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:42:05.302830 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-87f59819-2a8f-44e4-88d2-04a9d8997660 req-2320daee-b4be-4d49-bf92-5c79ef51454c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066623 Oct 28 20:42:05.304641 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3856/7708] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:42:11.930537 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:11.931375 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:11.935803 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1605936563", "imageRef": "d4450413-4f61-4260-b400-2d9f85e884f7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1343395009", "security_groups": [{"name": "tempest-secgroup-smoke-833379604"}], "networks": [{"uuid": "af17cb4c-045d-4521-a79c-1c8aac44b187"}]}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:42:11.965568 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b72bd91-391c-4fa9-9ea6-f22b8465edd5] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 43236. Oct 28 20:42:11.967985 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9c52e5a-70f9-441b-9223-dec5b930acb1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 43238. Oct 28 20:42:12.063077 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.network.neutron [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] validate_networks() for [('af17cb4c-045d-4521-a79c-1c8aac44b187', None, None, None, None, None)] {{(pid=120628) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 20:42:12.847575 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Flavor limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 20:42:12.847999 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Image limits 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 20:42:12.848660 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Flavor pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 20:42:12.849230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Image pref 0:0:0 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 20:42:12.849830 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.virt.hardware [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 20:42:12.864003 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:12.864491 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:12.864930 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:12.865667 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:12.866124 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:12.866554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:12.884401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Getting quotas for project 434cd628b0e44b61bd1a90020366176a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 20:42:12.890071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.quota [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Getting quotas for user 1b7b3e315580430aadd2a2c916d77099 and project 434cd628b0e44b61bd1a90020366176a. Resources: {'cores', 'instances', 'ram'} {{(pid=120628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 20:42:12.903319 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Going to run 1 instances... {{(pid=120628) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 20:42:12.905851 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4450413-4f61-4260-b400-2d9f85e884f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 20:42:12.958287 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-773d18db-fe31-4d87-b3eb-fb76421cc4b4 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031259 Oct 28 20:42:12.959027 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3853/7709] 10.222.0.44 () {60 vars in 1147 bytes} [Fri Oct 28 20:42:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 20:42:12.974161 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c31f2903-a195-4472-bed9-025352ae3616 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:12.975458 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c31f2903-a195-4472-bed9-025352ae3616 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:12.990208 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fc1657b-75c1-488d-b75a-e03b085f7311] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 43252. Oct 28 20:42:12.992626 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e0647aa-c397-4c0b-a3c1-aa20e68668aa] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 43254. Oct 28 20:42:13.050170 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c31f2903-a195-4472-bed9-025352ae3616 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:13.057424 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c31f2903-a195-4472-bed9-025352ae3616 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1249 microversion: 2.1 time: 0.091089 Oct 28 20:42:13.058000 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3857/7710] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:12 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:14.081158 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:14.083148 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:14.090538 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:14.091085 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:14.091529 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:14.092464 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:14.093132 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:14.093483 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:14.170651 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:14.178631 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e82b89ad-0c5b-4219-b14f-be8779a19767 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1319 microversion: 2.1 time: 0.102335 Oct 28 20:42:14.179273 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3854/7711] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:14 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:15.177917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-05fb006b-cc81-489f-a224-932a04846d47 req-f9eea545-a382-4fe4-834f-dff401aee33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "name": "network-vif-unplugged", "status": "completed", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:42:15.192542 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-05fb006b-cc81-489f-a224-932a04846d47 req-f9eea545-a382-4fe4-834f-dff401aee33c service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:15.193385 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-05fb006b-cc81-489f-a224-932a04846d47 req-f9eea545-a382-4fe4-834f-dff401aee33c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:15.194042 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-05fb006b-cc81-489f-a224-932a04846d47 req-f9eea545-a382-4fe4-834f-dff401aee33c service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:15.202280 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:15.202778 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:15.210644 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-05fb006b-cc81-489f-a224-932a04846d47 req-f9eea545-a382-4fe4-834f-dff401aee33c service nova] Creating event network-vif-unplugged:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:42:15.222075 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:15.222739 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:15.224897 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:15.228087 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:15.228569 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:15.229015 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:15.229144 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-05fb006b-cc81-489f-a224-932a04846d47 req-f9eea545-a382-4fe4-834f-dff401aee33c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043025 Oct 28 20:42:15.230079 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3858/7712] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:42:15.391252 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:15.399073 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-80335d6d-620e-41e9-aaa4-1e7d87f46ba7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.201410 Oct 28 20:42:15.399899 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3855/7713] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:15 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:16.425627 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:16.426634 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:16.436224 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:16.436766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:16.437214 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:16.438100 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:16.438576 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:16.439679 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:16.599020 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:16.608224 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-2dd82f7c-6d49-441d-8182-9209441c213f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.187878 Oct 28 20:42:16.608820 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3859/7714] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:16 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:17.631912 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:17.632524 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:17.639714 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:17.640195 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:17.640620 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:17.641338 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:17.641789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:17.642210 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:17.780222 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:17.788378 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-ef848ac7-5ea3-4061-ab02-d4214777c68a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.160909 Oct 28 20:42:17.800782 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3856/7715] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:17 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:42:18.811837 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:18.812664 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:18.819669 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:18.820166 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:18.820608 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:18.821311 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:18.821766 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:18.822201 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:18.968408 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:18.977186 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-c636a66b-91fc-4cf9-93ff-0989c4afd4b1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.169256 Oct 28 20:42:18.983229 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3860/7716] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:18 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:20.000962 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:20.001600 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:20.008594 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:20.009089 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:20.009522 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:20.010238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:20.010702 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:20.011143 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:20.156513 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:20.164801 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-d72d82aa-a336-4033-8f9e-6c548c7961f9 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.167757 Oct 28 20:42:20.165399 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3857/7717] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:19 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:21.188517 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:21.189165 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:21.196329 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:21.196835 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:21.197275 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:21.197989 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:21.198511 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:21.198920 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:21.346910 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:21.354809 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-bfdc1ee5-43af-4acf-8ca5-5f5c3cb8d717 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.170286 Oct 28 20:42:21.355394 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3861/7718] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:21 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:22.381376 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:22.382811 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:22.391665 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:22.392550 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:22.393230 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:22.394178 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:22.394901 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:22.395544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:22.547427 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:22.555747 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-010e6226-50d9-4aa7-bf5e-363b5b87dc8e tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.180031 Oct 28 20:42:22.556599 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3858/7719] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:22 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:23.579133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:23.580561 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:23.583512 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell0:SELECT=2 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:23.589219 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:23.589712 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:23.590152 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:23.590903 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:23.591344 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:23.591771 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:23.817979 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:23.826144 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-fa4d1fb6-dccc-4967-b942-2bdcae14def1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.250969 Oct 28 20:42:23.826761 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3862/7720] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:23 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:24.011072 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-f6959c0a-67ce-4cc3-953b-0e48f4a12704 req-37518a5c-dd24-4028-a467-6df398cfac83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:42:24.018053 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:24.039770 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell0:SELECT=6 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:42:24.056759 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f6959c0a-67ce-4cc3-953b-0e48f4a12704 req-37518a5c-dd24-4028-a467-6df398cfac83 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:24.057653 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f6959c0a-67ce-4cc3-953b-0e48f4a12704 req-37518a5c-dd24-4028-a467-6df398cfac83 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:24.059345 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-f6959c0a-67ce-4cc3-953b-0e48f4a12704 req-37518a5c-dd24-4028-a467-6df398cfac83 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:24.090598 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-f6959c0a-67ce-4cc3-953b-0e48f4a12704 req-37518a5c-dd24-4028-a467-6df398cfac83 service nova] Creating event network-changed:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:42:24.104196 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-f6959c0a-67ce-4cc3-953b-0e48f4a12704 req-37518a5c-dd24-4028-a467-6df398cfac83 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097395 Oct 28 20:42:24.104856 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3859/7721] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:42:24.853463 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:24.854413 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:24.866051 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:24.866773 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:24.867243 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:24.867956 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:24.868422 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:24.868859 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:25.007034 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:25.015270 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3f2cbcd6-5c96-495d-8cf0-6c4583f11b61 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.168576 Oct 28 20:42:25.015851 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3863/7722] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:24 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:26.043212 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:26.044203 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:26.055506 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:26.055992 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:26.056424 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:26.057114 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:26.057568 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:26.057987 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:26.202561 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:26.210728 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-07bb7d90-2fde-4fbf-97f9-bdf1170f3be7 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.175263 Oct 28 20:42:26.211337 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3860/7723] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:26 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:27.236138 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:27.236839 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:27.247984 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:27.248678 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:27.249288 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:27.250342 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:27.251004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:27.251600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:27.390633 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:27.399809 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-3060054f-1c31-4118-9ff6-631e03a133ed tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.170040 Oct 28 20:42:27.400418 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3864/7724] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:27 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:28.426582 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:28.427279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:28.434717 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:28.435251 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:28.435756 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:28.436467 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:28.436931 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:28.437358 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:28.571041 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:28.579312 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-bc7d8878-dc25-42c7-bce1-4af53bfb5c43 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.159809 Oct 28 20:42:28.579873 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3861/7725] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:28 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 20:42:29.360087 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-0c6692ee-d299-4205-81b9-6ccd5d3d303e req-f5b4538a-a1cd-4f42-910d-72078ce0006e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "name": "network-vif-plugged", "status": "completed", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:42:29.372976 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0c6692ee-d299-4205-81b9-6ccd5d3d303e req-f5b4538a-a1cd-4f42-910d-72078ce0006e service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:29.373749 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0c6692ee-d299-4205-81b9-6ccd5d3d303e req-f5b4538a-a1cd-4f42-910d-72078ce0006e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:29.374153 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-0c6692ee-d299-4205-81b9-6ccd5d3d303e req-f5b4538a-a1cd-4f42-910d-72078ce0006e service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:29.386323 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-0c6692ee-d299-4205-81b9-6ccd5d3d303e req-f5b4538a-a1cd-4f42-910d-72078ce0006e service nova] Creating event network-vif-plugged:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:42:29.392325 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-0c6692ee-d299-4205-81b9-6ccd5d3d303e req-f5b4538a-a1cd-4f42-910d-72078ce0006e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036091 Oct 28 20:42:29.393308 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3865/7726] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 20:42:29.602487 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:29.603239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:29.610927 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:29.611439 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:29.611879 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:29.612604 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:29.613071 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:29.613505 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:29.752547 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:29.764589 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-5723952f-7a50-4a60-9f35-031b4950802f tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1374 microversion: 2.1 time: 0.165976 Oct 28 20:42:29.765362 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3862/7727] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:29 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:30.790907 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:30.791639 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:30.798433 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:30.798973 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:30.799424 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:30.800133 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:30.800603 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:30.801046 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:30.941265 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:30.949776 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-649da6e3-ef33-4d36-9a3c-de36f47e9164 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1558 microversion: 2.1 time: 0.164076 Oct 28 20:42:30.950399 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3866/7728] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:30 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:30.971852 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:42:30.972473 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:42:30.979751 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:30.980238 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:30.980687 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:30.981401 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:30.981861 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:30.982291 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:31.124281 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:42:31.132797 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-dfd932ba-ab89-4499-b943-69f0e95a3b48 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1558 microversion: 2.1 time: 0.164936 Oct 28 20:42:31.133408 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3863/7729] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:42:30 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:42:33.094867 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-64f113fb-e3e8-4e40-befc-d377d1020600 req-6e47853f-956d-4c01-ad05-04ae14254a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:42:33.105031 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64f113fb-e3e8-4e40-befc-d377d1020600 req-6e47853f-956d-4c01-ad05-04ae14254a64 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:42:33.105527 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64f113fb-e3e8-4e40-befc-d377d1020600 req-6e47853f-956d-4c01-ad05-04ae14254a64 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:42:33.105948 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-64f113fb-e3e8-4e40-befc-d377d1020600 req-6e47853f-956d-4c01-ad05-04ae14254a64 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:42:33.117109 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-64f113fb-e3e8-4e40-befc-d377d1020600 req-6e47853f-956d-4c01-ad05-04ae14254a64 service nova] Creating event network-changed:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:42:33.122075 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-64f113fb-e3e8-4e40-befc-d377d1020600 req-6e47853f-956d-4c01-ad05-04ae14254a64 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031014 Oct 28 20:42:33.122790 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3867/7730] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:04.477689 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:04.479227 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=58 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:04.480348 n-d-862769-3 devstack@n-api.service[120628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:44:04.480711 n-d-862769-3 devstack@n-api.service[120628]: Fri Oct 28 20:44:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00/action (ip 10.222.0.44) !!! Oct 28 20:44:04.488488 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1424272699"}} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:04.492188 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:04.504122 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:04.504611 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:04.505698 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:04.506416 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:04.506900 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:04.507328 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:04.867415 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-448dd83f-6861-40fd-b39d-25e561ba9bd2 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "POST /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00/action" status: 202 len: 0 microversion: 2.1 time: 0.392671 Oct 28 20:44:04.868065 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3864/7731] 10.222.0.44 () {60 vars in 1278 bytes} [Fri Oct 28 20:44:04 2022] POST /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 20:44:09.898684 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-409fbbf9-93f0-4115-b1ef-26858d84ce75 req-5f74a6b8-ba6f-4d1c-9a26-3c00f25ff5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "name": "network-vif-plugged", "status": "completed", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:09.907327 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_api:SELECT=26 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:09.908119 n-d-862769-3 devstack@n-api.service[120629]: DEBUG dbcounter [-] [120629] Writing DB stats nova_cell1:SELECT=50 {{(pid=120629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:09.909345 n-d-862769-3 devstack@n-api.service[120629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 20:44:09.909740 n-d-862769-3 devstack@n-api.service[120629]: Fri Oct 28 20:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 28 20:44:09.924702 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-409fbbf9-93f0-4115-b1ef-26858d84ce75 req-5f74a6b8-ba6f-4d1c-9a26-3c00f25ff5fa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:09.925610 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-409fbbf9-93f0-4115-b1ef-26858d84ce75 req-5f74a6b8-ba6f-4d1c-9a26-3c00f25ff5fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:09.926113 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-409fbbf9-93f0-4115-b1ef-26858d84ce75 req-5f74a6b8-ba6f-4d1c-9a26-3c00f25ff5fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:09.940326 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-409fbbf9-93f0-4115-b1ef-26858d84ce75 req-5f74a6b8-ba6f-4d1c-9a26-3c00f25ff5fa service nova] Creating event network-vif-plugged:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:44:09.946329 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-409fbbf9-93f0-4115-b1ef-26858d84ce75 req-5f74a6b8-ba6f-4d1c-9a26-3c00f25ff5fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052750 Oct 28 20:44:09.947066 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3868/7732] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:18.626663 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_api:SELECT=2 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:18.627627 n-d-862769-3 devstack@n-api.service[120628]: DEBUG dbcounter [-] [120628] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:44:18.628959 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-5d0602f2-60e6-4f92-bd7e-b2da266a28fb req-168276e5-1d70-40f5-a43b-d7df89e90bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:18.632312 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:18.633112 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:18.640917 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5d0602f2-60e6-4f92-bd7e-b2da266a28fb req-168276e5-1d70-40f5-a43b-d7df89e90bdc service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.641410 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5d0602f2-60e6-4f92-bd7e-b2da266a28fb req-168276e5-1d70-40f5-a43b-d7df89e90bdc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.641554 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.641823 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-5d0602f2-60e6-4f92-bd7e-b2da266a28fb req-168276e5-1d70-40f5-a43b-d7df89e90bdc service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.642189 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.642647 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.643544 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.643983 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.644617 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.653942 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-5d0602f2-60e6-4f92-bd7e-b2da266a28fb req-168276e5-1d70-40f5-a43b-d7df89e90bdc service nova] Creating event network-changed:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:44:18.659415 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-5d0602f2-60e6-4f92-bd7e-b2da266a28fb req-168276e5-1d70-40f5-a43b-d7df89e90bdc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 Oct 28 20:44:18.660585 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3869/7733] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:18.677914 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:44:18.767394 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-114916ac-26d9-4e1f-89d9-f2cbafc4ff59 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 204 len: 0 microversion: 2.1 time: 0.146317 Oct 28 20:44:18.768400 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3865/7734] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:44:18 2022] DELETE /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:44:18.779637 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:18.780629 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:18.787106 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.787600 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.788036 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.788741 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:18.789197 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:18.789631 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:18.992400 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:19.000431 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-a805ad32-427a-459e-a829-e2f24ecb735b tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1683 microversion: 2.1 time: 0.226046 Oct 28 20:44:19.001226 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3870/7735] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:18 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1683 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:19.912295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ea7fdeff-8d2c-46b3-a15f-d7b882d0f197 req-55196048-84dc-4df9-8934-4c2141443081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "name": "network-vif-unplugged", "status": "completed", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:19.925520 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ea7fdeff-8d2c-46b3-a15f-d7b882d0f197 req-55196048-84dc-4df9-8934-4c2141443081 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:19.926304 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ea7fdeff-8d2c-46b3-a15f-d7b882d0f197 req-55196048-84dc-4df9-8934-4c2141443081 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:19.926734 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ea7fdeff-8d2c-46b3-a15f-d7b882d0f197 req-55196048-84dc-4df9-8934-4c2141443081 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:19.937636 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ea7fdeff-8d2c-46b3-a15f-d7b882d0f197 req-55196048-84dc-4df9-8934-4c2141443081 service nova] Creating event network-vif-unplugged:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:44:19.942782 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ea7fdeff-8d2c-46b3-a15f-d7b882d0f197 req-55196048-84dc-4df9-8934-4c2141443081 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035249 Oct 28 20:44:19.943531 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3866/7736] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:20.024943 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:20.025568 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:20.033827 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:20.034299 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:20.034783 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:20.035588 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:20.036696 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:20.037144 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:20.211983 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:20.221410 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-05d70dd9-950b-49b2-9789-8c027470a716 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 200 len: 1683 microversion: 2.1 time: 0.200403 Oct 28 20:44:20.222225 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3871/7737] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:20 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 1683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:20.794318 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-ac9a9c30-ecab-42e9-b872-0d8e5e9aef4b req-dfd9c9ca-c3b6-45da-9adf-2fdf79a7ded8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787dfcb-760b-4e48-a3ea-3597c5a63c00", "name": "network-vif-deleted", "tag": "7639d280-faba-4765-b40a-4b82a5f5bc45"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:20.804321 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ac9a9c30-ecab-42e9-b872-0d8e5e9aef4b req-dfd9c9ca-c3b6-45da-9adf-2fdf79a7ded8 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:20.804807 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ac9a9c30-ecab-42e9-b872-0d8e5e9aef4b req-dfd9c9ca-c3b6-45da-9adf-2fdf79a7ded8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:20.805239 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-ac9a9c30-ecab-42e9-b872-0d8e5e9aef4b req-dfd9c9ca-c3b6-45da-9adf-2fdf79a7ded8 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:20.817124 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-ac9a9c30-ecab-42e9-b872-0d8e5e9aef4b req-dfd9c9ca-c3b6-45da-9adf-2fdf79a7ded8 service nova] Creating event network-vif-deleted:7639d280-faba-4765-b40a-4b82a5f5bc45 for instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 on n-h2-862769-3 Oct 28 20:44:20.822138 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-ac9a9c30-ecab-42e9-b872-0d8e5e9aef4b req-dfd9c9ca-c3b6-45da-9adf-2fdf79a7ded8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089185 Oct 28 20:44:20.822811 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3867/7738] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:21.245290 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:21.245897 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: c787dfcb-760b-4e48-a3ea-3597c5a63c00] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:21.253004 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:21.253498 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:21.253942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:21.254645 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:21.255149 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:21.255587 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:21.272343 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] HTTP exception thrown: Instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 could not be found. Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Request method failure captured: Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 HTTP/1.1 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXD4NkYXt1_qGdSA2HRWk5qAIhoRZAeOi8lRTaU5FZfaHllGPB_f7SqtAmGTiyfG4uvb9oIIGIS6DOU5OmSMAHfQYc8t5GsiWIblh6bxMJLyiMC_AtpxxJOpRA0uObmp40jKNKuCDytERJZweMhB_rnohFLeQB3H9B96xw6JtsxENTmo Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 434cd628b0e44b61bd1a90020366176a Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestSnapshotPattern-143554662 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/434cd628b0e44b61bd1a90020366176a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_434cd628b0e44b61bd1a90020366176a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/434cd628b0e44b61bd1a90020366176a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/434cd628b0e44b61bd1a90020366176a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestSnapshotPattern-143554662 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 434cd628b0e44b61bd1a90020366176a Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestSnapshotPattern-143554662 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestSnapshotPattern-143554662-project Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1b7b3e315580430aadd2a2c916d77099 Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestSnapshotPattern-143554662-project Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 could not be found. Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': 'c787dfcb-760b-4e48-a3ea-3597c5a63c00'} Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 could not be found. Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 could not be found. Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:44:21.273945 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 could not be found. Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Returning 404 to user: Instance c787dfcb-760b-4e48-a3ea-3597c5a63c00 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-348c8dcf-fc52-4927-9f38-76eda3653422 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00" status: 404 len: 111 microversion: 2.1 time: 0.034148 Oct 28 20:44:21.279715 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3872/7739] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:21 2022] GET /compute/v2.1/servers/c787dfcb-760b-4e48-a3ea-3597c5a63c00 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:44:22.644710 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:22.645277 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:22.651844 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.652351 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.652768 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.653462 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.653918 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.654329 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.681165 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Going to try to terminate instance {{(pid=120628) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 20:44:22.767941 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-cd2892e8-caa4-4e5a-bd0e-bb113c501df1 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "DELETE /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 204 len: 0 microversion: 2.1 time: 0.128204 Oct 28 20:44:22.769212 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3868/7740] 10.222.0.44 () {58 vars in 1239 bytes} [Fri Oct 28 20:44:22 2022] DELETE /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 20:44:22.778592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:22.779257 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:22.786351 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.786892 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.787346 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.788062 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.788532 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.788967 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.839394 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [req-a1229aed-f59c-4005-a4f4-aa146edcce93 req-23803994-deb9-4da9-84d7-3a1c0b7d4745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:22.850066 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a1229aed-f59c-4005-a4f4-aa146edcce93 req-23803994-deb9-4da9-84d7-3a1c0b7d4745 service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:22.850824 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a1229aed-f59c-4005-a4f4-aa146edcce93 req-23803994-deb9-4da9-84d7-3a1c0b7d4745 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:22.851355 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [req-a1229aed-f59c-4005-a4f4-aa146edcce93 req-23803994-deb9-4da9-84d7-3a1c0b7d4745 service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:22.863992 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.compute.server_external_events [req-a1229aed-f59c-4005-a4f4-aa146edcce93 req-23803994-deb9-4da9-84d7-3a1c0b7d4745 service nova] Creating event network-changed:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:44:22.869329 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [req-a1229aed-f59c-4005-a4f4-aa146edcce93 req-23803994-deb9-4da9-84d7-3a1c0b7d4745 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034542 Oct 28 20:44:22.869943 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3869/7741] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:22.927325 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.policy [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120629) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:22.935295 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-f6909d9e-c11e-47fc-82ac-b41a054615b8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1683 microversion: 2.1 time: 0.161807 Oct 28 20:44:22.935867 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3873/7742] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:22 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:23.960104 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:23.960796 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:23.967789 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:23.968279 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:23.968712 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:23.969415 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:23.969866 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:23.970295 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:24.116765 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:24.125289 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-e26efab8-916b-4625-826b-f5d26c7b6ead tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1683 microversion: 2.1 time: 0.170422 Oct 28 20:44:24.125916 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3870/7743] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:23 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:25.056212 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [req-87197e3b-6b10-4afd-8c78-4871fb54b2d2 req-4595ced7-f821-4258-bced-7cb0d532f2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f8ce7d-3f20-4974-9d0d-60575fbaa208", "name": "network-vif-deleted", "tag": "cc2b2be2-ada1-47a4-bec4-b14cdb0385ef"}]} {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 20:44:25.068582 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-87197e3b-6b10-4afd-8c78-4871fb54b2d2 req-4595ced7-f821-4258-bced-7cb0d532f2fa service nova] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:25.069130 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-87197e3b-6b10-4afd-8c78-4871fb54b2d2 req-4595ced7-f821-4258-bced-7cb0d532f2fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:25.069518 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [req-87197e3b-6b10-4afd-8c78-4871fb54b2d2 req-4595ced7-f821-4258-bced-7cb0d532f2fa service nova] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:25.081091 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.compute.server_external_events [req-87197e3b-6b10-4afd-8c78-4871fb54b2d2 req-4595ced7-f821-4258-bced-7cb0d532f2fa service nova] Creating event network-vif-deleted:cc2b2be2-ada1-47a4-bec4-b14cdb0385ef for instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 on n-h1-862769-3 Oct 28 20:44:25.086328 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [req-87197e3b-6b10-4afd-8c78-4871fb54b2d2 req-4595ced7-f821-4258-bced-7cb0d532f2fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034104 Oct 28 20:44:25.086959 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3874/7744] 10.222.0.44 () {64 vars in 1317 bytes} [Fri Oct 28 20:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 20:44:25.152869 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:25.153809 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.compute.api [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120628) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:25.162231 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:25.162743 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:25.163184 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:25.163892 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:25.164352 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:25.164774 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:25.198414 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:25.198961 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:25.199396 n-d-862769-3 devstack@n-api.service[120628]: DEBUG oslo_concurrency.lockutils [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:25.199845 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.objects.instance [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lazy-loading 'fault' on Instance uuid 33f8ce7d-3f20-4974-9d0d-60575fbaa208 {{(pid=120628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 20:44:25.242278 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.policy [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7b3e315580430aadd2a2c916d77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd628b0e44b61bd1a90020366176a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120628) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 20:44:25.250205 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-37e1b5b0-db3d-4ccf-b960-f69b26f42b39 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 200 len: 1338 microversion: 2.1 time: 0.104888 Oct 28 20:44:25.250828 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3871/7745] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:25 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 20:44:26.280143 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '>' {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:26.281298 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.compute.api [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] [instance: 33f8ce7d-3f20-4974-9d0d-60575fbaa208] Fetching instance by UUID {{(pid=120629) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 20:44:26.291997 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:26.292815 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:26.293942 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:26.295121 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Acquiring lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 20:44:26.295883 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 20:44:26.296592 n-d-862769-3 devstack@n-api.service[120629]: DEBUG oslo_concurrency.lockutils [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Lock "c3d72f5c-12c5-4ca8-b006-0eb4a596a968" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 20:44:26.310740 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.wsgi [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] HTTP exception thrown: Instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 could not be found. Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Request method failure captured: Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: request: GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 HTTP/1.1 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Accept: application/json Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Accept-Encoding: identity Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Connection: close Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Content-Length: 0 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Content-Type: application/json Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Host: 10.222.0.44 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: Openstack-System-Scope: None Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: User-Agent: python-urllib3/1.26.12 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Auth-Token: gAAAAABjXD4NkYXt1_qGdSA2HRWk5qAIhoRZAeOi8lRTaU5FZfaHllGPB_f7SqtAmGTiyfG4uvb9oIIGIS6DOU5OmSMAHfQYc8t5GsiWIblh6bxMJLyiMC_AtpxxJOpRA0uObmp40jKNKuCDytERJZweMhB_rnohFLeQB3H9B96xw6JtsxENTmo Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Id: None Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Domain-Name: None Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Identity-Status: Confirmed Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Is-Admin-Project: True Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Id: default Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Domain-Name: Default Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Id: 434cd628b0e44b61bd1a90020366176a Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Project-Name: tempest-TestSnapshotPattern-143554662 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Role: member,reader Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Roles: member,reader Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/434cd628b0e44b61bd1a90020366176a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_434cd628b0e44b61bd1a90020366176a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/434cd628b0e44b61bd1a90020366176a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/434cd628b0e44b61bd1a90020366176a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}] Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant: tempest-TestSnapshotPattern-143554662 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Id: 434cd628b0e44b61bd1a90020366176a Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-Tenant-Name: tempest-TestSnapshotPattern-143554662 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-User: tempest-TestSnapshotPattern-143554662-project Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Id: default Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-User-Domain-Name: Default Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-User-Id: 1b7b3e315580430aadd2a2c916d77099 Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: X-User-Name: tempest-TestSnapshotPattern-143554662-project Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: method: > Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: exception: Instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 could not be found. Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: action_args: {'id': '33f8ce7d-3f20-4974-9d0d-60575fbaa208'} Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: {{(pid=120629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 could not be found. Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 could not be found. Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 20:44:26.312339 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 could not be found. Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: ERROR nova.api.openstack.wsgi Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: DEBUG nova.api.openstack.wsgi [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Returning 404 to user: Instance 33f8ce7d-3f20-4974-9d0d-60575fbaa208 could not be found. {{(pid=120629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: INFO nova.api.openstack.requestlog [None req-9665d9e4-f2da-426c-9d8d-05c187907e6a tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208" status: 404 len: 111 microversion: 2.1 time: 0.042174 Oct 28 20:44:26.317628 n-d-862769-3 devstack@n-api.service[120629]: [pid: 120629|app: 0|req: 3875/7746] 10.222.0.44 () {58 vars in 1236 bytes} [Fri Oct 28 20:44:26 2022] GET /compute/v2.1/servers/33f8ce7d-3f20-4974-9d0d-60575fbaa208 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 20:44:26.481105 n-d-862769-3 devstack@n-api.service[120628]: DEBUG nova.api.openstack.wsgi [None req-b7a2373f-b437-44c7-8517-37a41645eac8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] Calling method '.version_select at 0x7f1d767c2040>' {{(pid=120628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 20:44:26.510103 n-d-862769-3 devstack@n-api.service[120628]: INFO nova.api.openstack.requestlog [None req-b7a2373f-b437-44c7-8517-37a41645eac8 tempest-TestSnapshotPattern-143554662 tempest-TestSnapshotPattern-143554662-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1343395009" status: 202 len: 0 microversion: 2.1 time: 0.032949 Oct 28 20:44:26.510621 n-d-862769-3 devstack@n-api.service[120628]: [pid: 120628|app: 0|req: 3872/7747] 10.222.0.44 () {58 vars in 1257 bytes} [Fri Oct 28 20:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1343395009 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)